-- Logs begin at Sat 2022-06-18 20:01:13 UTC, end at Sat 2022-06-18 23:29:29 UTC. -- Jun 18 21:43:51.774665 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jun 18 21:43:51.783372 ncdv-master-1 devstack@keystone.service[91189]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 21:43:51 2022] *** Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: nodename: ncdv-master-1 Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: machine: x86_64 Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: clock source: unix Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: pcre jit disabled Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: detected number of CPU cores: 4 Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: current working directory: / Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: detected binary path: /usr/bin/uwsgi-core Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: your processes number limit is 47680 Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: your memory page size is 4096 bytes Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: detected max file descriptor number: 2048 Jun 18 21:43:51.786423 ncdv-master-1 devstack@keystone.service[91189]: lock engine: pthread robust mutexes Jun 18 21:43:51.787158 ncdv-master-1 devstack@keystone.service[91189]: thunder lock: enabled Jun 18 21:43:51.787158 ncdv-master-1 devstack@keystone.service[91189]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 18 21:43:51.787158 ncdv-master-1 devstack@keystone.service[91189]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 21:43:51.835086 ncdv-master-1 devstack@keystone.service[91189]: Python main interpreter initialized at 0x55ad16cff9c0 Jun 18 21:43:51.835086 ncdv-master-1 devstack@keystone.service[91189]: python threads support enabled Jun 18 21:43:51.835086 ncdv-master-1 devstack@keystone.service[91189]: your server socket listen backlog is limited to 100 connections Jun 18 21:43:51.835086 ncdv-master-1 devstack@keystone.service[91189]: your mercy for graceful operations on workers is 90 seconds Jun 18 21:43:51.835470 ncdv-master-1 devstack@keystone.service[91189]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 21:43:51.835470 ncdv-master-1 devstack@keystone.service[91189]: *** Operational MODE: preforking *** Jun 18 21:43:51.835768 ncdv-master-1 devstack@keystone.service[91189]: *** uWSGI is running in multiple interpreter mode *** Jun 18 21:43:51.835768 ncdv-master-1 devstack@keystone.service[91189]: spawned uWSGI master process (pid: 91189) Jun 18 21:43:51.835982 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jun 18 21:43:51.837163 ncdv-master-1 devstack@keystone.service[91189]: spawned uWSGI worker 1 (pid: 91204, cores: 1) Jun 18 21:43:51.837163 ncdv-master-1 devstack@keystone.service[91189]: spawned uWSGI worker 2 (pid: 91205, cores: 1) Jun 18 21:43:51.837163 ncdv-master-1 devstack@keystone.service[91189]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 21:43:57.526007 ncdv-master-1 devstack@keystone.service[91205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:43:57.526007 ncdv-master-1 devstack@keystone.service[91205]: from cryptography.utils import int_from_bytes Jun 18 21:43:57.526823 ncdv-master-1 devstack@keystone.service[91204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:43:57.526823 ncdv-master-1 devstack@keystone.service[91204]: from cryptography.utils import int_from_bytes Jun 18 21:43:57.527263 ncdv-master-1 devstack@keystone.service[91205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:43:57.527263 ncdv-master-1 devstack@keystone.service[91205]: from cryptography.utils import int_from_bytes Jun 18 21:43:57.527391 ncdv-master-1 devstack@keystone.service[91204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:43:57.527391 ncdv-master-1 devstack@keystone.service[91204]: from cryptography.utils import int_from_bytes Jun 18 21:43:57.575804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 21:43:57.575985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 21:43:57.575985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 21:43:57.576131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 21:43:57.576202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] command line args: [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 21:43:57.576260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] command line args: [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 21:43:57.576401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 21:43:57.576485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 21:43:57.576545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ================================================================================ {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 21:43:57.576600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ================================================================================ {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 21:43:57.576826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] admin_token = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.576947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] admin_token = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] config_dir = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] config_dir = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] config_source = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] config_source = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] debug = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] debug = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.577822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.578998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] list_limit = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] list_limit = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] log_config_append = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] log_config_append = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] log_dir = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] log_dir = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] log_file = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] log_file = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.579913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.580997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.581991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.582875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.583095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.583236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.583869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] publish_errors = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] publish_errors = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.584896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] standard_threads = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] standard_threads = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.585988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] use_journal = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] use_journal = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] use_json = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] use_json = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] use_stderr = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.586994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] use_stderr = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.587104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] use_syslog = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.587212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] use_syslog = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.587327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.587435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:43:57.587544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.587663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.587773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.587880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.587995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.588900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.589929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.590993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.591897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.592896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.593987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.594981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.595934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.596960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.597948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.598925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.599937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.600910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.601974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.602983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.603109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.603248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.603377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.603497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.603757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.603873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.603990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.604933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.605952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.606955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.607908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.608936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.609901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.610906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] auth.external = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] auth.external = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.611939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] auth.password = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] auth.token = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] auth.password = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] auth.token = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.612946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.613958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] credential.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] credential.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.614961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.615924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.616903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.617917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.618931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.619949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.620066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.620207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.620322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.620440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.620595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.620709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.620906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.621128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.621251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.621362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.621484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.621639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.621777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.621898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.622912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.623922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.624971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.625138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.625254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.625375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.625491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.625602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.626938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.627048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.627167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.627278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.627388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.627498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.627607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.627717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.628491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.628619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.628772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.628885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.628997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.629967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.630973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.631963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.632957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.633997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.634109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.634218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.634328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.634437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.634553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.634673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.634857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.635955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.636981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.637902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.638905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.639881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.640955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.641800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.642883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.643944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] role.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] role.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.644863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] role.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] role.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.645964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.646969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.647970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.648963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.649978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.650902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.651897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.652911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.653936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.654924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.655922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.connection = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.connection = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.656950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.657910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.658909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.659912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 21:43:57.660912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:43:57.660912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 21:43:57.689379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.689517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.689629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.689707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.689824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.689990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.698361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.698455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.727946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.728155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.728344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.728624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.779846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.780193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.827731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.827937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.828515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.828718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.893381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.893565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.893812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.893961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.894049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.894170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.894261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.894425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.894564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.894702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.894908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.895111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.917286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.917435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.917581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.917663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.917790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.917907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.917984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.918057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.918132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.918205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.918279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.918340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.918524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.918650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.931250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.931502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.944981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.945074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.945198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.945275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.945407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91204) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.945487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91205) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 18 21:43:57.963083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.963213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.963342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 21:43:57.963445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 21:43:57.963632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.963757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.963891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 21:43:57.963972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 18 21:43:57.964035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.964161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.964368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.964507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.964586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.964661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.964788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.964890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.975814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.975965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.976104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.976224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.976312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.976389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.976610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.976736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.984727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:57.984872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:57.987996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:57.988123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:57.988255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.988338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.988535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.988659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.988916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.989995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.990134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.990271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.990352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.990519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.990643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.990738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:57.990817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.017105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.017404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.018731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.019008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.019150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.019288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.024277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.024527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.024618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.024797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.024881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.025132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.032190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.032389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.032521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.032746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.037000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.037309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.037433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.037597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.037681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.037849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.037981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.038116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.038249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.038330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.038508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.038632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.038766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.038861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.039037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.039308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.059225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.059491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.059694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.059980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.064057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.064575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.067716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.068015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.068317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.068613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.073021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.073683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.076608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.077293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.080386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.080679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.080959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.081102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.081258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.081342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.081539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.081666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.081805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.081899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.082143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.082430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.101054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.101432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.101702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.101824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.101960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.102203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.102473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.102749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.109849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.110717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.111557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.111829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.112431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.112705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.114883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.115171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.115451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.115735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.115858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.116018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.116141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.116294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.116606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.116887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.129416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.129695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.129972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.130250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.130386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.130574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.130698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.130834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.130971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.131066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.131143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.131453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.131739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.132019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.149007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.150214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.152316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.153567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.155632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.156894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.157224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.158527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.158845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.159125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.159416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.160144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.160432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.160721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.166790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.168152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.168395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.169795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.171616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.171902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.172180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.172425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.173015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.173323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.173607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.173905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.181758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.182076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.182338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.183199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.183485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.183759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.190138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91205) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.190416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.190687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.190955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.191220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.191515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.191777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91204) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 18 21:43:58.191902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.192966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.193074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.193148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.193368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.193495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.193603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91205) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.193712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.193897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.194176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.194436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.194704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.194977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.195243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91204) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 18 21:43:58.231470 ncdv-master-1 devstack@keystone.service[91205]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ad16cff9c0 pid: 91205 (default app) Jun 18 21:43:58.233459 ncdv-master-1 devstack@keystone.service[91204]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ad16cff9c0 pid: 91204 (default app) Jun 18 21:43:58.234845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fee48a-7045-47df-aacb-ab6793cd8694 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:43:58.235136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fee48a-7045-47df-aacb-ab6793cd8694 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:43:58.235414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fee48a-7045-47df-aacb-ab6793cd8694 None None] PATH_INFO: `/v3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:43:58.239654 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Sat Jun 18 21:43:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:06.344502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91ca85-8dee-4076-a28a-6bd39f61ba18 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:06.345088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91ca85-8dee-4076-a28a-6bd39f61ba18 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:06.345088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91ca85-8dee-4076-a28a-6bd39f61ba18 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:06.349448 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:06.356003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:06.356677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:06.356818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:06.436381 ncdv-master-1 devstack@keystone.service[91205]: INFO dbcounter [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] Registered counter for database keystone Jun 18 21:44:06.461234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG oslo_db.sqlalchemy.engines [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:44:06.473538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writer thread running {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:44:06.756207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG passlib.handlers.bcrypt [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91205) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 18 21:44:06.756639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG passlib.handlers.bcrypt [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91205) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 18 21:44:06.812293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:06.814096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:06.944889 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 590 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 18 21:44:07.119869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91ca85-8dee-4076-a28a-6bd39f61ba18 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:07.204571 ncdv-master-1 devstack@keystone.service[91204]: INFO dbcounter [None req-3a91ca85-8dee-4076-a28a-6bd39f61ba18 None None] Registered counter for database keystone Jun 18 21:44:07.226188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG oslo_db.sqlalchemy.engines [None req-3a91ca85-8dee-4076-a28a-6bd39f61ba18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:44:07.237370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writer thread running {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:44:07.468633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91ca85-8dee-4076-a28a-6bd39f61ba18 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:07.474294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fbf7a-391c-4214-b783-9b2306579e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:07.474959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fbf7a-391c-4214-b783-9b2306579e81 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:07.475236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fbf7a-391c-4214-b783-9b2306579e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:07.475508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fbf7a-391c-4214-b783-9b2306579e81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:07.484557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fbf7a-391c-4214-b783-9b2306579e81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:07.534665 ncdv-master-1 devstack@keystone.service[91204]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5e6fbf7a-391c-4214-b783-9b2306579e81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 18 21:44:07.534995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fbf7a-391c-4214-b783-9b2306579e81 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:07.545302 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Jun 18 21:44:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 21:44:07.551594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:07.566783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf37df-7908-40fc-b6a0-bded351494dc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:07.572384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093af3bc-312a-4f1a-8522-269596769647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:07.573532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af3bc-312a-4f1a-8522-269596769647 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:07.573809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af3bc-312a-4f1a-8522-269596769647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:07.574075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093af3bc-312a-4f1a-8522-269596769647 admin admin] PATH_INFO: `/v3/projects/66f428458e264ccfa7aaee63beb4b0a3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:07.575699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093af3bc-312a-4f1a-8522-269596769647 admin admin] RBAC: Authorizing `identity:get_project(project_id=66f428458e264ccfa7aaee63beb4b0a3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:07.627652 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.common.rbac_enforcer.enforcer [None req-093af3bc-312a-4f1a-8522-269596769647 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 18 21:44:07.627986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093af3bc-312a-4f1a-8522-269596769647 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:07.632666 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Sat Jun 18 21:44:07 2022] GET /identity/v3/projects/66f428458e264ccfa7aaee63beb4b0a3 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:09.890733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab927a-fb22-4fa2-9244-7ee4c74eb794 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:09.891595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab927a-fb22-4fa2-9244-7ee4c74eb794 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:09.891595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab927a-fb22-4fa2-9244-7ee4c74eb794 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:09.898595 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:09.906415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b208d-196f-44a0-a327-9b6980e3da81 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:09.906999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b208d-196f-44a0-a327-9b6980e3da81 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:09.906999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b208d-196f-44a0-a327-9b6980e3da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:09.934780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0f3b208d-196f-44a0-a327-9b6980e3da81 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:09.936289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f3b208d-196f-44a0-a327-9b6980e3da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:09.945662 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 18 21:44:09.970875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab927a-fb22-4fa2-9244-7ee4c74eb794 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:09.993928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab927a-fb22-4fa2-9244-7ee4c74eb794 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:09.999053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec38c7c-e6a9-477f-831f-6dffed39cb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:09.999702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38c7c-e6a9-477f-831f-6dffed39cb7f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:09.999986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38c7c-e6a9-477f-831f-6dffed39cb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:10.000261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38c7c-e6a9-477f-831f-6dffed39cb7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:10.008898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec38c7c-e6a9-477f-831f-6dffed39cb7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:10.010735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec38c7c-e6a9-477f-831f-6dffed39cb7f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:10.020624 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Sat Jun 18 21:44:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 21:44:10.026081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b208d-196f-44a0-a327-9b6980e3da81 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:10.035574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b208d-196f-44a0-a327-9b6980e3da81 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:10.040592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a552e08-92a2-4bea-9b8b-41a343713869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:10.041501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552e08-92a2-4bea-9b8b-41a343713869 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:10.041786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552e08-92a2-4bea-9b8b-41a343713869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:10.042064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a552e08-92a2-4bea-9b8b-41a343713869 admin admin] PATH_INFO: `/v3/users/4a36d37a77f14439b4a1d892bb4af6b7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:10.043530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a552e08-92a2-4bea-9b8b-41a343713869 admin admin] RBAC: Authorizing `identity:get_user(user_id=4a36d37a77f14439b4a1d892bb4af6b7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:10.045425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a552e08-92a2-4bea-9b8b-41a343713869 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:10.047019 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Sat Jun 18 21:44:10 2022] GET /identity/v3/users/4a36d37a77f14439b4a1d892bb4af6b7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:12.387973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b277f-bc78-4078-94be-121f97c68bce None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.388501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b277f-bc78-4078-94be-121f97c68bce None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.388501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b277f-bc78-4078-94be-121f97c68bce None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.389852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:12.395133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9e28-72d6-41fd-9b98-35937a03dc15 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.395571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9e28-72d6-41fd-9b98-35937a03dc15 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.395659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9e28-72d6-41fd-9b98-35937a03dc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.411288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e1283-e3a5-4ca1-be43-66c84088f22a None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.411579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e1283-e3a5-4ca1-be43-66c84088f22a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.411983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e1283-e3a5-4ca1-be43-66c84088f22a None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.412887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-69fc9e28-72d6-41fd-9b98-35937a03dc15 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:12.413372 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:12.414073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69fc9e28-72d6-41fd-9b98-35937a03dc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:12.419023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.419320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.419598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.461441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG passlib.handlers.bcrypt [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91204) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 18 21:44:12.461858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG passlib.handlers.bcrypt [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91204) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 18 21:44:12.497093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:12.506729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:12.508346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:12.521124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc9e28-72d6-41fd-9b98-35937a03dc15 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:12.545310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:12.607888 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:12.627142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc9e28-72d6-41fd-9b98-35937a03dc15 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:12.631249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:12.661826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:12.662564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.662847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.663120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.674152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:12.685268 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:12.686260 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:12.687076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:12.692166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:12.732001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4fd56-bb21-453a-8ec2-7979889bd732 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:12.735027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:12.770682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:12.771578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.771861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.772141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.772272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:12.790921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061930f6-61b2-4670-83b8-30e0b604e7fb None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:12.828176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:12.828847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.829160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.830565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.830565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:12.830565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:12.831879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:12.844127 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:12.849884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:12.852235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:12.853868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:12.948073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5f6c2-1225-436b-9773-fa9cbdafda37 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:12.951664 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:12.957364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:12.960412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:12.983388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:12.984269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:12.984543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:12.984822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] PATH_INFO: `/v3/users/4a36d37a77f14439b4a1d892bb4af6b7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:12.986065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] RBAC: Authorizing `identity:get_user(user_id=4a36d37a77f14439b4a1d892bb4af6b7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:12.987581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:12.989231 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:12 2022] GET /identity/v3/users/4a36d37a77f14439b4a1d892bb4af6b7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:12.994563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:13.009118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:13.054802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb790a-dc8a-468a-b8c8-80e49644a378 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:13.088569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:13.089374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:13.089636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:13.089901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:13.108111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ea416-72af-4fe1-a122-c5310c940613 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:13.108578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:13.110125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:44:13.132677 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:13.133594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:13.134433 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:44:13.134433 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:44:13.134433 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:44:13.134433 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:13.134433 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:13.139799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:13.142664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:13.143483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:13.143761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:13.144028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:13.145238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:13.146697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:13.148444 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:13.153945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:13.199158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:13.237702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:13.246425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba858988-bcf8-4cbc-8a18-8c7186bd76c9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:13.257620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19571ac-721f-41bc-baad-1ff660301f5b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:13.280905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35890055-caf1-49cb-b03b-8d645daf4677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:13.281606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35890055-caf1-49cb-b03b-8d645daf4677 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:13.281884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35890055-caf1-49cb-b03b-8d645daf4677 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:13.282158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35890055-caf1-49cb-b03b-8d645daf4677 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:13.282885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35890055-caf1-49cb-b03b-8d645daf4677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:13.283189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35890055-caf1-49cb-b03b-8d645daf4677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:13.284579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35890055-caf1-49cb-b03b-8d645daf4677 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:13.291562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bf35f-10e4-470c-ab93-ae8cb0481ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:13.292218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bf35f-10e4-470c-ab93-ae8cb0481ddc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:13.292502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bf35f-10e4-470c-ab93-ae8cb0481ddc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:13.292778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bf35f-10e4-470c-ab93-ae8cb0481ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:13.293645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bf35f-10e4-470c-ab93-ae8cb0481ddc None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.domain.id=default, user.id=4a36d37a77f14439b4a1d892bb4af6b7) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:13.293952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bf35f-10e4-470c-ab93-ae8cb0481ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:13.295422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bf35f-10e4-470c-ab93-ae8cb0481ddc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:13.301570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:13.302266 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 11/21] 10.222.0.30 () {56 vars in 1322 bytes} [Sat Jun 18 21:44:13 2022] GET /identity/v3/role_assignments?user.id=4a36d37a77f14439b4a1d892bb4af6b7&scope.domain.id=default&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:16.280216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be1735-ecc6-49b2-ba3f-6ae9750aa9d1 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.280216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be1735-ecc6-49b2-ba3f-6ae9750aa9d1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.280216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be1735-ecc6-49b2-ba3f-6ae9750aa9d1 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.280853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2aea6-f6a3-44ef-bff5-1b1eb4039429 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.280853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2aea6-f6a3-44ef-bff5-1b1eb4039429 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.281291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 11/22] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:16.281359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2aea6-f6a3-44ef-bff5-1b1eb4039429 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.281693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 12/23] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:16.286779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63882ad-04dc-477e-9643-d3d79062d4d5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.286893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6289-a5db-46ba-90a4-345394f25712 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.287164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6289-a5db-46ba-90a4-345394f25712 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.287449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda6289-a5db-46ba-90a4-345394f25712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.287791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63882ad-04dc-477e-9643-d3d79062d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.288248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63882ad-04dc-477e-9643-d3d79062d4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.312540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9dda6289-a5db-46ba-90a4-345394f25712 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:16.314154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9dda6289-a5db-46ba-90a4-345394f25712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:16.318051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c63882ad-04dc-477e-9643-d3d79062d4d5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:16.319228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c63882ad-04dc-477e-9643-d3d79062d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:16.417165 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 13/24] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:16.418373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddffd-42ed-4b42-9d86-af31ffb7029b None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.418661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddffd-42ed-4b42-9d86-af31ffb7029b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.418936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddffd-42ed-4b42-9d86-af31ffb7029b None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.421061 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 14/25] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:16.422678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462497c5-ac75-48fb-a983-89a1780dab6d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.423137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462497c5-ac75-48fb-a983-89a1780dab6d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.423979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462497c5-ac75-48fb-a983-89a1780dab6d None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.425636 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 15/26] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:16.426890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1900756-bebb-402c-893b-894afc3489ec None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.427359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1900756-bebb-402c-893b-894afc3489ec None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.427830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1900756-bebb-402c-893b-894afc3489ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.439051 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 12/27] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:16.445063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de74cf-95fa-48a5-be88-075ff91c51a2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.445805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de74cf-95fa-48a5-be88-075ff91c51a2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.446358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de74cf-95fa-48a5-be88-075ff91c51a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.447688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d1900756-bebb-402c-893b-894afc3489ec None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:16.453074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1900756-bebb-402c-893b-894afc3489ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:16.479804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-50de74cf-95fa-48a5-be88-075ff91c51a2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:16.481027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-50de74cf-95fa-48a5-be88-075ff91c51a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:16.528887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:16.544238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 16/28] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:16.546112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1900756-bebb-402c-893b-894afc3489ec None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:16.550615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:16.557870 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 13/29] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:16.558973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de74cf-95fa-48a5-be88-075ff91c51a2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:16.665477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1900756-bebb-402c-893b-894afc3489ec None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:16.691827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de74cf-95fa-48a5-be88-075ff91c51a2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:16.703554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:16.705136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.705591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.706104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.717352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:16.725233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:16.726072 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:16.726836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:16.729209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 17/30] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:16.730206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:16.738370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:16.739327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.739803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.740272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.741270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:16.742897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:16.808394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:16.849640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92446e95-abed-4a2b-adc4-b27c4b64c67a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:16.883139 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 14/31] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Jun 18 21:44:16 2022] POST /identity/v3/roles => generated 225 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:16.884610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:16.886006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:16.886932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:16.887371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:16.887788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:16.888704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:16.890394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:16.926967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:17.005111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e7e34-f69f-4e88-9d5a-ef0efacdd139 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:17.050958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:17.052145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.052674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.053207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.065439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:17.067403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:44:17.087792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:17.093159 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:17.093970 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:44:17.093970 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:44:17.093970 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:44:17.093970 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:17.095851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 15/32] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:17.096899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:17.119553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 18/33] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Jun 18 21:44:16 2022] POST /identity/v3/roles => generated 219 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:17.120769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:17.198365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:17.214340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301563a-160f-43a5-b182-c664c6cbea7c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:17.241441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0a09b-d306-499b-a10d-379422078553 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:17.253370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:17.254465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.255001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.255488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.256454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:17.256952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:17.258755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:17.268585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:17.278150 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 16/34] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:17.284390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:17.290388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:17.290967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.290967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.291095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.291896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:17.292209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:17.293987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:17.328140 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 19/35] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:17.333452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:17.406436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffb020-a514-4f32-b380-ab3a8d0bc576 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:17.446828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:17.447920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.448204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.448480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] PATH_INFO: `/v3/users/4a36d37a77f14439b4a1d892bb4af6b7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.450243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] RBAC: Authorizing `identity:get_user(user_id=4a36d37a77f14439b4a1d892bb4af6b7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:17.451746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:17.453757 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 17/36] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:17 2022] GET /identity/v3/users/4a36d37a77f14439b4a1d892bb4af6b7 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:17.460069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:17.495127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:17.512427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbc22f-9e84-40de-9bb3-bbae5ca47f78 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:17.555866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:17.557314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.557803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.558466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.559413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:17.561957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:17.603369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bfc63-19ac-4d6c-bed5-0a3c22f61ceb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:17.611429 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 20/37] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:44:17 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:17.648226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedda7c-eb7d-4467-a32d-e978e1ecfd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:17.649146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedda7c-eb7d-4467-a32d-e978e1ecfd8d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.649427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedda7c-eb7d-4467-a32d-e978e1ecfd8d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.649698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedda7c-eb7d-4467-a32d-e978e1ecfd8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.651064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedda7c-eb7d-4467-a32d-e978e1ecfd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:17.652589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedda7c-eb7d-4467-a32d-e978e1ecfd8d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:17.654715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 18/38] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:17.660154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:17.704706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:17.784894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c81818-cbff-497f-8f3a-8b2464fc6415 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:17.821578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bebd8-0757-4c55-aa97-bf24ba4705c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:17.822468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bebd8-0757-4c55-aa97-bf24ba4705c8 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.822749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bebd8-0757-4c55-aa97-bf24ba4705c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.823029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bebd8-0757-4c55-aa97-bf24ba4705c8 None admin] PATH_INFO: `/v3/domains/default/users/4a36d37a77f14439b4a1d892bb4af6b7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.825090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bebd8-0757-4c55-aa97-bf24ba4705c8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4a36d37a77f14439b4a1d892bb4af6b7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:17.826564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bebd8-0757-4c55-aa97-bf24ba4705c8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:17.846902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 21/39] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Jun 18 21:44:17 2022] PUT /identity/v3/domains/default/users/4a36d37a77f14439b4a1d892bb4af6b7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:17.869837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292d23-dae2-4fe7-95fa-585b81849230 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.870026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292d23-dae2-4fe7-95fa-585b81849230 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.870308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292d23-dae2-4fe7-95fa-585b81849230 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.872397 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 19/40] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:17.878391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c15f-44d2-4448-8ef9-710d8d21113a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.878709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c15f-44d2-4448-8ef9-710d8d21113a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.878951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c15f-44d2-4448-8ef9-710d8d21113a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.890963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd332e-0dad-44ca-9a34-b05ed061e2f5 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.891269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd332e-0dad-44ca-9a34-b05ed061e2f5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.891676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd332e-0dad-44ca-9a34-b05ed061e2f5 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.893236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 20/41] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:17.898629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fd40c15f-44d2-4448-8ef9-710d8d21113a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:17.899400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39f98f-f005-41d4-873d-2c6fd5e1efaa None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:17.899688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39f98f-f005-41d4-873d-2c6fd5e1efaa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:17.899995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39f98f-f005-41d4-873d-2c6fd5e1efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:17.901271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fd40c15f-44d2-4448-8ef9-710d8d21113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:17.918750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cc39f98f-f005-41d4-873d-2c6fd5e1efaa None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:17.921003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cc39f98f-f005-41d4-873d-2c6fd5e1efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:17.982461 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 22/42] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:17.999696 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 21/43] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:18.007662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40c15f-44d2-4448-8ef9-710d8d21113a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:18.026424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39f98f-f005-41d4-873d-2c6fd5e1efaa None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:18.039461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:18.050607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:18.128623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40c15f-44d2-4448-8ef9-710d8d21113a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:18.147401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39f98f-f005-41d4-873d-2c6fd5e1efaa None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:18.162031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:18.162833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:18.163109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:18.163384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:18.164564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:18.166089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:18.167888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 23/44] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:18.173465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:18.193328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963221a-41aa-4648-bf72-7b4d8dc40a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:18.194002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963221a-41aa-4648-bf72-7b4d8dc40a8b None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:18.194256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963221a-41aa-4648-bf72-7b4d8dc40a8b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:18.194530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963221a-41aa-4648-bf72-7b4d8dc40a8b None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:18.195278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963221a-41aa-4648-bf72-7b4d8dc40a8b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:18.196694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963221a-41aa-4648-bf72-7b4d8dc40a8b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:18.211359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Jun 18 21:44:18 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:44:18.281400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:18.289440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56836e9-efa9-464d-b189-78f2150e1223 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:18.328386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59524b9e-ffe9-40cc-bf09-011c3b07982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:18.329189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524b9e-ffe9-40cc-bf09-011c3b07982d None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:18.329385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524b9e-ffe9-40cc-bf09-011c3b07982d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:18.329669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524b9e-ffe9-40cc-bf09-011c3b07982d None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:18.330410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59524b9e-ffe9-40cc-bf09-011c3b07982d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:18.331905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59524b9e-ffe9-40cc-bf09-011c3b07982d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:18.363683 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:44:18 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:44:20.170233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7d137-4198-4b94-84af-a4ae89a2ac07 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.170802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7d137-4198-4b94-84af-a4ae89a2ac07 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.170802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7d137-4198-4b94-84af-a4ae89a2ac07 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.172775 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 23/47] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:20.181685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dd4c1-0163-4834-9727-921a4bd1d3d3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.182108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dd4c1-0163-4834-9727-921a4bd1d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.182283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dd4c1-0163-4834-9727-921a4bd1d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.204431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fe0dd4c1-0163-4834-9727-921a4bd1d3d3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:20.205656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fe0dd4c1-0163-4834-9727-921a4bd1d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:20.280791 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 25/48] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:20.306873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7d137-4198-4b94-84af-a4ae89a2ac07 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:20.391722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:20.418620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7d137-4198-4b94-84af-a4ae89a2ac07 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:20.459653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:20.460468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.460751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.461025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.474171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:20.482942 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:20.483987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:20.484924 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 24/49] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:20.492603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0dd4c1-0163-4834-9727-921a4bd1d3d3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:20.583392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:20.608751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0dd4c1-0163-4834-9727-921a4bd1d3d3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:20.645201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8b7da-920d-4ed2-8864-76d9f77dec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:20.645882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b7da-920d-4ed2-8864-76d9f77dec78 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.646170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b7da-920d-4ed2-8864-76d9f77dec78 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.646447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b7da-920d-4ed2-8864-76d9f77dec78 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.647210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b7da-920d-4ed2-8864-76d9f77dec78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:20.647517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b7da-920d-4ed2-8864-76d9f77dec78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:20.648976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b7da-920d-4ed2-8864-76d9f77dec78 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:20.657347 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 26/50] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:20.663091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:20.688009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b865-e578-4e1f-9e8d-30a31f62bd0e None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.688373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b865-e578-4e1f-9e8d-30a31f62bd0e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.688732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b865-e578-4e1f-9e8d-30a31f62bd0e None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.690126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 27/51] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:20.695423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98d82-988e-4fdd-93bf-2df104abecd4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.695718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98d82-988e-4fdd-93bf-2df104abecd4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.696041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98d82-988e-4fdd-93bf-2df104abecd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.714474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-52e98d82-988e-4fdd-93bf-2df104abecd4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:20.716043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-52e98d82-988e-4fdd-93bf-2df104abecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:20.774183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c81c3-402e-49a2-9a75-4fb04f66fe76 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:20.786553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 28/52] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:20.807483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:20.808419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.808701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.808977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] PATH_INFO: `/v3/users/4a36d37a77f14439b4a1d892bb4af6b7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.810351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] RBAC: Authorizing `identity:get_user(user_id=4a36d37a77f14439b4a1d892bb4af6b7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:20.811630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98d82-988e-4fdd-93bf-2df104abecd4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:20.811814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:20.813535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 25/53] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:20 2022] GET /identity/v3/users/4a36d37a77f14439b4a1d892bb4af6b7 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:20.818691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:20.822354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:20.881266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:20.915957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98d82-988e-4fdd-93bf-2df104abecd4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:20.925247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8914-018e-4c6f-af0b-760fc9a4540e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:20.948940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943e42-015b-4feb-a269-33249354033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:20.949777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943e42-015b-4feb-a269-33249354033c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.950064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943e42-015b-4feb-a269-33249354033c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.950337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943e42-015b-4feb-a269-33249354033c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.951538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69943e42-015b-4feb-a269-33249354033c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:20.952985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69943e42-015b-4feb-a269-33249354033c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:20.954803 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 29/54] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:20.958741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:20.959535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:20.959822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:20.960102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:20.960486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943e42-015b-4feb-a269-33249354033c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:20.961324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:20.962784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:20.964407 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 26/55] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:20.969845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:21.042806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:21.061838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943e42-015b-4feb-a269-33249354033c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:21.071664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef6d59-85ce-4724-ae53-78e62771133c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:21.097178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2ad2b-841b-4b52-86f0-b43019124349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:21.097864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2ad2b-841b-4b52-86f0-b43019124349 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:21.098136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2ad2b-841b-4b52-86f0-b43019124349 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:21.098414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2ad2b-841b-4b52-86f0-b43019124349 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:21.099136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2ad2b-841b-4b52-86f0-b43019124349 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:21.100606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2ad2b-841b-4b52-86f0-b43019124349 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:21.104634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296f2d7-82de-4716-bdda-7724b114e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:21.104797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:21.105298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f2d7-82de-4716-bdda-7724b114e775 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:21.105598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f2d7-82de-4716-bdda-7724b114e775 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:21.105889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296f2d7-82de-4716-bdda-7724b114e775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:21.106836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296f2d7-82de-4716-bdda-7724b114e775 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.domain.id=default, user.id=4a36d37a77f14439b4a1d892bb4af6b7) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:21.107153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296f2d7-82de-4716-bdda-7724b114e775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:21.108614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296f2d7-82de-4716-bdda-7724b114e775 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:21.118852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 27/56] 10.222.0.30 () {56 vars in 1322 bytes} [Sat Jun 18 21:44:20 2022] GET /identity/v3/role_assignments?user.id=4a36d37a77f14439b4a1d892bb4af6b7&scope.domain.id=default&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:21.127136 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 30/57] 10.222.0.30 () {60 vars in 1140 bytes} [Sat Jun 18 21:44:20 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:23.438472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562eca1-4e03-4e06-91cd-b48e45c3bdc0 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:23.438986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562eca1-4e03-4e06-91cd-b48e45c3bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:23.438986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562eca1-4e03-4e06-91cd-b48e45c3bdc0 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:23.440320 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 28/58] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:23.446721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805cdc-c9c1-41dc-890f-3a40123bf1cd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:23.447433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805cdc-c9c1-41dc-890f-3a40123bf1cd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:23.447662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805cdc-c9c1-41dc-890f-3a40123bf1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:23.471992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c6805cdc-c9c1-41dc-890f-3a40123bf1cd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:23.473225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c6805cdc-c9c1-41dc-890f-3a40123bf1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:23.543701 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 31/59] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:23.570838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562eca1-4e03-4e06-91cd-b48e45c3bdc0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:23.687566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562eca1-4e03-4e06-91cd-b48e45c3bdc0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:23.722367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352f0fd-d2f6-4322-a902-5e4908b13d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:23.723184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352f0fd-d2f6-4322-a902-5e4908b13d68 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:23.723468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352f0fd-d2f6-4322-a902-5e4908b13d68 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:23.723743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352f0fd-d2f6-4322-a902-5e4908b13d68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:23.725058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352f0fd-d2f6-4322-a902-5e4908b13d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:23.726527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352f0fd-d2f6-4322-a902-5e4908b13d68 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:23.728236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 29/60] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:23.734201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6805cdc-c9c1-41dc-890f-3a40123bf1cd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:23.834650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6805cdc-c9c1-41dc-890f-3a40123bf1cd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:23.851779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:23.871419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb41eb8-eaf0-4b50-8122-536aaf972be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:23.872084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41eb8-eaf0-4b50-8122-536aaf972be8 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:23.872390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41eb8-eaf0-4b50-8122-536aaf972be8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:23.872660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41eb8-eaf0-4b50-8122-536aaf972be8 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:23.873419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41eb8-eaf0-4b50-8122-536aaf972be8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:23.874886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41eb8-eaf0-4b50-8122-536aaf972be8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:23.902434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 32/61] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:44:23 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:27.054881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8abdb-9575-4416-b1ce-57c4914d8dfb None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.055714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8abdb-9575-4416-b1ce-57c4914d8dfb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.056137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8abdb-9575-4416-b1ce-57c4914d8dfb None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.057745 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 30/62] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:27.063242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3617f-4e7e-4906-b954-280d4ebaaa88 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.063638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3617f-4e7e-4906-b954-280d4ebaaa88 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.063808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3617f-4e7e-4906-b954-280d4ebaaa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.090070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0df3617f-4e7e-4906-b954-280d4ebaaa88 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:27.091296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0df3617f-4e7e-4906-b954-280d4ebaaa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:27.181707 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 33/63] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:27.218986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8abdb-9575-4416-b1ce-57c4914d8dfb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:27.223660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:27.362806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8abdb-9575-4416-b1ce-57c4914d8dfb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:27.413831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4652f-fb1b-4b2c-b797-28a13c1df8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:27.414710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4652f-fb1b-4b2c-b797-28a13c1df8a9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.414996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4652f-fb1b-4b2c-b797-28a13c1df8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.415276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4652f-fb1b-4b2c-b797-28a13c1df8a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.429747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4652f-fb1b-4b2c-b797-28a13c1df8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-e7e4652f-fb1b-4b2c-b797-28a13c1df8a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:27.437547 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:27.438400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:27.439166 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 31/64] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:27.444890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3617f-4e7e-4906-b954-280d4ebaaa88 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:27.454343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b434-9813-468e-afea-1ccbef82fcdb None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.454631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b434-9813-468e-afea-1ccbef82fcdb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.454921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b434-9813-468e-afea-1ccbef82fcdb None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.456317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 32/65] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:27.466589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054b7f-b977-45fb-984a-f8d91552d292 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.467101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054b7f-b977-45fb-984a-f8d91552d292 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.467558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054b7f-b977-45fb-984a-f8d91552d292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.499143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-57054b7f-b977-45fb-984a-f8d91552d292 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:27.500357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-57054b7f-b977-45fb-984a-f8d91552d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:27.584621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3617f-4e7e-4906-b954-280d4ebaaa88 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:27.587446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:27.623615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:27.633389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 33/66] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:27.639264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:27.640165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.640585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.640996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.641924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:27.642366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:27.643921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:27.652814 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 34/67] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:27.658494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054b7f-b977-45fb-984a-f8d91552d292 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:27.670628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:27.794385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd51d-0dea-49a7-ab8c-e65c5098ff47 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:27.811803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054b7f-b977-45fb-984a-f8d91552d292 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:27.841998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f4150-f76b-4d91-9447-8890840c2f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:27.842987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4150-f76b-4d91-9447-8890840c2f0c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.843372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4150-f76b-4d91-9447-8890840c2f0c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.843749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f4150-f76b-4d91-9447-8890840c2f0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.854676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f4150-f76b-4d91-9447-8890840c2f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:27.857353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96038551-e39a-445c-bcee-4ee79fae7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:27.858250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038551-e39a-445c-bcee-4ee79fae7e09 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.858537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038551-e39a-445c-bcee-4ee79fae7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.858822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038551-e39a-445c-bcee-4ee79fae7e09 None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1a8f4150-f76b-4d91-9447-8890840c2f0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:27.863230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:27.864094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:27.864863 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 35/68] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:27.870299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705eb5-3232-42d5-8d2c-9bb605b113d7 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.870661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705eb5-3232-42d5-8d2c-9bb605b113d7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.871009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705eb5-3232-42d5-8d2c-9bb605b113d7 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.872463 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 36/69] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:27.874179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705eb5-3232-42d5-8d2c-9bb605b113d7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:27.881944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96038551-e39a-445c-bcee-4ee79fae7e09 None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:27.883494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96038551-e39a-445c-bcee-4ee79fae7e09 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:27.885411 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 34/70] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:27 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:27.887073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e7e72-1671-499b-a406-4053f3efa0fc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:27.887361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e7e72-1671-499b-a406-4053f3efa0fc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:27.887642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e7e72-1671-499b-a406-4053f3efa0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:27.905755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:27.909215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a68e7e72-1671-499b-a406-4053f3efa0fc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:27.910942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a68e7e72-1671-499b-a406-4053f3efa0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:27.972821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:27.987687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705eb5-3232-42d5-8d2c-9bb605b113d7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:27.998346 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 35/71] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:27.999302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e7e72-1671-499b-a406-4053f3efa0fc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.051503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.052523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.052955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.053398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.054353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:28.055001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:28.056776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:28.067461 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 37/72] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:28.070077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.113012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e7e72-1671-499b-a406-4053f3efa0fc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.151595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.152171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.152457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.152757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.178803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.193482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d255645-5d47-42a2-8dda-33adac2328ab None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.209615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.228297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7f958-e945-4319-b99e-47e15de3c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.229155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f958-e945-4319-b99e-47e15de3c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.229433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f958-e945-4319-b99e-47e15de3c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.229702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7f958-e945-4319-b99e-47e15de3c6c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.235360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:28.237697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:28.240169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7f958-e945-4319-b99e-47e15de3c6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-b3d7f958-e945-4319-b99e-47e15de3c6c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:28.247687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:28.248542 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:28.249360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 38/73] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:28.250381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7937-f2d2-4745-96cb-f0bcda2db96e None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.250381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7937-f2d2-4745-96cb-f0bcda2db96e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.250670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e7937-f2d2-4745-96cb-f0bcda2db96e None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.252109 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 39/74] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:28.256556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7937-f2d2-4745-96cb-f0bcda2db96e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.348337 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 36/75] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:28.349000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.369513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e7937-f2d2-4745-96cb-f0bcda2db96e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.402509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ed25-8a28-48ec-8888-851170eb5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.403335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ed25-8a28-48ec-8888-851170eb5dfd None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.403617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ed25-8a28-48ec-8888-851170eb5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.403893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ed25-8a28-48ec-8888-851170eb5dfd None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.405257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ed25-8a28-48ec-8888-851170eb5dfd None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:28.406795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ed25-8a28-48ec-8888-851170eb5dfd None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:28.409080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 40/76] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:28.409802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f898-1f80-4d3f-b971-1637d9411a36 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.410095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f898-1f80-4d3f-b971-1637d9411a36 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.410375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f898-1f80-4d3f-b971-1637d9411a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.427009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2716f898-1f80-4d3f-b971-1637d9411a36 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:28.428201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2716f898-1f80-4d3f-b971-1637d9411a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:28.432675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.439157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.451749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0d387-db05-4ff3-955f-f87fb765fea4 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.485154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.485840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.486122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.486395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.487162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:28.487468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:28.488878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:28.493641 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 41/77] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:28.494930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6fe82-5952-435e-bc51-f6a9d0a74cfe None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.495216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6fe82-5952-435e-bc51-f6a9d0a74cfe None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.495492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6fe82-5952-435e-bc51-f6a9d0a74cfe None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.496744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 42/78] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:28.497422 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 37/79] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:28.498334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.501476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6fe82-5952-435e-bc51-f6a9d0a74cfe None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.604452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8044f4-9c8b-4096-98f3-9b56ad4f5078 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.608327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6fe82-5952-435e-bc51-f6a9d0a74cfe None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.638327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.638984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.639271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.639549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.640479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341d94-5d3e-4a09-b1a1-facb7adbbad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.641372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341d94-5d3e-4a09-b1a1-facb7adbbad7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.641653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341d94-5d3e-4a09-b1a1-facb7adbbad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.641931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341d94-5d3e-4a09-b1a1-facb7adbbad7 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.643100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341d94-5d3e-4a09-b1a1-facb7adbbad7 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:28.644582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341d94-5d3e-4a09-b1a1-facb7adbbad7 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:28.646321 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 43/80] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:28.647441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b98c8-7af9-4097-b219-3011c6a1c543 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.647725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b98c8-7af9-4097-b219-3011c6a1c543 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.648341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b98c8-7af9-4097-b219-3011c6a1c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.654259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.663779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ea5b98c8-7af9-4097-b219-3011c6a1c543 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:28.665018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ea5b98c8-7af9-4097-b219-3011c6a1c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:28.674382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.707992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:28.709562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:28.749054 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 44/81] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:28.749054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b98c8-7af9-4097-b219-3011c6a1c543 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.810574 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 38/82] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:28.812535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.834686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b98c8-7af9-4097-b219-3011c6a1c543 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.857184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.868434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.869371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.869628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.869903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] PATH_INFO: `/v3/users/4a36d37a77f14439b4a1d892bb4af6b7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.871110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] RBAC: Authorizing `identity:get_user(user_id=4a36d37a77f14439b4a1d892bb4af6b7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:28.872599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:28.874277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 45/83] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/users/4a36d37a77f14439b4a1d892bb4af6b7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:28.875123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.889184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:28.914897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf307c7d-8607-421b-81db-8269888f6c38 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:28.950096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:28.950927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:28.951213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:28.951491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:28.962488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:28.970148 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:28.970968 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 39/84] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:28.972231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:28.974843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9576dd-eb6e-476a-a035-3c485ba12b15 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.009862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.010501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.010777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.011050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.012287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=16910e694ce34571a8e3953471ac3733) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:29.012600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.014707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.019980 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 46/85] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/role_assignments?user.id=16910e694ce34571a8e3953471ac3733&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=0329a03140564541b142bbc7fc5111a8 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:29.020710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.083236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5516950-ea79-435d-b7b2-e0fbca280ff3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.087162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.116523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.129255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.130126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.130412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.130746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.132386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.140424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.140424 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 40/86] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:29.140424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.155444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab619a-995c-4ecc-871b-7f285dffa8f9 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.197089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.197903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.198188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.198470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.199718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.201244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.203210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 47/87] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:29.203823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.250855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdabe3-3124-4ecc-a1cc-8101c24c2bb6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.286829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.287517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.287792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.288072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.305566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bbac8-32e9-460b-a557-65811f5ac878 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.333727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.342634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.343357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.343608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.343899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.344659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:29.344960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.346390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.360304 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 48/88] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:29.360304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.367616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.370203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.371851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.459707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e4f8-9fe7-42bb-a322-f8e080385861 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.478727 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 41/89] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:29.479601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.498690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.499371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.499659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.499938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.500666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.502178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.523737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 49/90] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:44:29 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:29.524623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.586671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.597316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.627459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35738-64ab-4771-b583-5ac0c9100821 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.654130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f612b-35d9-4b8c-9880-7cb5098bb390 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.669090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.669777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.670060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.670336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.671268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] RBAC: Adding query filter params (role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=16910e694ce34571a8e3953471ac3733) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:29.671590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.673140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.679799 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 42/91] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/role_assignments?user.id=16910e694ce34571a8e3953471ac3733&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=77c95569fa354b93b35fc5a694f02453 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:29.680780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.709166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.710784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.711602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.712023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.714648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.717207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.719906 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 50/92] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:29.726198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.802510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552db30-c640-413e-a6c1-c63dee74fd8f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.842078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.842987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.843272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.843508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269198d-01f5-4894-a527-b9bf461429cd None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:29.843605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.844898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.846570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:29.848579 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 43/93] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:29.858252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:29.864942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.880569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:29.891617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:29.892737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:29.893289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:29.893766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:29.997293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:29.999084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:30.039262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2ebb6-70c9-49b4-bea7-7062fe1db6b5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:30.085251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:30.086417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:30.087159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:30.088481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:30.089583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=4a36d37a77f14439b4a1d892bb4af6b7) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:30.090098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:30.091771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:30.102673 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 44/94] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/role_assignments?user.id=4a36d37a77f14439b4a1d892bb4af6b7&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:30.131117 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 51/95] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 21:44:30.136885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:30.218239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:30.261295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37497990-b465-4100-a65d-e50e3ea7d9ad None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:30.310801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fdc30-830a-4705-bf6d-8ca4ddf0e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:30.312144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fdc30-830a-4705-bf6d-8ca4ddf0e91c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:30.312637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fdc30-830a-4705-bf6d-8ca4ddf0e91c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:30.313131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fdc30-830a-4705-bf6d-8ca4ddf0e91c None admin] PATH_INFO: `/v3/projects/61e581f7b579440ca94d83d1c6915ff9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:30.314748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fdc30-830a-4705-bf6d-8ca4ddf0e91c None admin] RBAC: Authorizing `identity:get_project(project_id=61e581f7b579440ca94d83d1c6915ff9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:30.316526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fdc30-830a-4705-bf6d-8ca4ddf0e91c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:30.318640 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 45/96] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:30 2022] GET /identity/v3/projects/61e581f7b579440ca94d83d1c6915ff9 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:30.324926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:30.378714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:30.461047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc6377-440f-4b9a-a51f-2513dc6933b7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:30.498905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65aee8-fa49-4329-9f27-131503fff5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:30.499571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65aee8-fa49-4329-9f27-131503fff5c6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:30.499856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65aee8-fa49-4329-9f27-131503fff5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:30.500128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65aee8-fa49-4329-9f27-131503fff5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:30.500977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65aee8-fa49-4329-9f27-131503fff5c6 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=61e581f7b579440ca94d83d1c6915ff9, user.id=16910e694ce34571a8e3953471ac3733) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:30.501313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65aee8-fa49-4329-9f27-131503fff5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:30.502785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65aee8-fa49-4329-9f27-131503fff5c6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:30.508741 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 52/97] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:30 2022] GET /identity/v3/role_assignments?user.id=16910e694ce34571a8e3953471ac3733&scope.project.id=61e581f7b579440ca94d83d1c6915ff9&role.id=0329a03140564541b142bbc7fc5111a8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:31.968225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83764-ca91-4fb1-b715-f99b7331583d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:31.969395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83764-ca91-4fb1-b715-f99b7331583d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:31.969896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83764-ca91-4fb1-b715-f99b7331583d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:31.971483 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 46/98] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:31.977991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df198-eb4c-4e01-a27e-a856dc7e3548 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:31.978823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df198-eb4c-4e01-a27e-a856dc7e3548 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:31.979335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39df198-eb4c-4e01-a27e-a856dc7e3548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:32.003136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d39df198-eb4c-4e01-a27e-a856dc7e3548 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:32.004719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d39df198-eb4c-4e01-a27e-a856dc7e3548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:32.098470 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 53/99] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:32.139327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83764-ca91-4fb1-b715-f99b7331583d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:32.269409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83764-ca91-4fb1-b715-f99b7331583d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:32.311161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:32.312355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:32.312880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:32.313403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:32.316832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:32.333937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:32.341880 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:32.342731 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:32.343501 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 47/100] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:32.349491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39df198-eb4c-4e01-a27e-a856dc7e3548 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:32.379593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:32.474179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39df198-eb4c-4e01-a27e-a856dc7e3548 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:32.519987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:32.520741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:32.521041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:32.521321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:32.522076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:32.522379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:32.528079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:32.537006 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 54/101] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:32.542900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:32.671551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb287cc-428b-49fe-bf2a-d4dd7b78c6ea None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:32.707763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999711e-6965-460e-91cc-6db613266b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:32.709060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999711e-6965-460e-91cc-6db613266b8b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:32.709551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999711e-6965-460e-91cc-6db613266b8b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:32.710028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999711e-6965-460e-91cc-6db613266b8b None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:32.711541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999711e-6965-460e-91cc-6db613266b8b None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:32.713224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999711e-6965-460e-91cc-6db613266b8b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:32.715373 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 48/102] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:32 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:32.721586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:32.812152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534d50-1622-4e08-ab4c-b4c8ff0d6b48 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:32.812766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534d50-1622-4e08-ab4c-b4c8ff0d6b48 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:32.813268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534d50-1622-4e08-ab4c-b4c8ff0d6b48 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:32.815079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 49/103] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:32.820501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49ec99-f457-4965-af6c-7c6a86f8323a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:32.821074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49ec99-f457-4965-af6c-7c6a86f8323a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:32.821560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49ec99-f457-4965-af6c-7c6a86f8323a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:32.839159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0a49ec99-f457-4965-af6c-7c6a86f8323a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:32.840670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0a49ec99-f457-4965-af6c-7c6a86f8323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:32.849880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:32.866091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a135f4e-2aba-4ee7-8b8d-01fa7ff2e893 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:32.915615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:32.925992 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 50/104] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:32.929123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:32.929123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:32.929494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:32.929927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:32.931276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:32.932898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:32.934966 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 55/105] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:32 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:32.942840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49ec99-f457-4965-af6c-7c6a86f8323a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:32.977260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:33.058614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49ec99-f457-4965-af6c-7c6a86f8323a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:33.098250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:33.099646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.100306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.100788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/16910e694ce34571a8e3953471ac3733/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.103439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c320ef8324d0b95d89216c9c6bc1e, user_id=16910e694ce34571a8e3953471ac3733, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:33.105427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:33.129111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 51/106] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:32 2022] PUT /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/16910e694ce34571a8e3953471ac3733/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:33.179300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffff83-8c76-426a-a2f9-cb01c5515d61 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:33.234872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df15d-0051-496d-9d99-812058164840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:33.235777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df15d-0051-496d-9d99-812058164840 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.236065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df15d-0051-496d-9d99-812058164840 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.236347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df15d-0051-496d-9d99-812058164840 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.253687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df15d-0051-496d-9d99-812058164840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-565df15d-0051-496d-9d99-812058164840 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:33.262195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:33.263235 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:33.264036 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 56/107] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:44:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:33.271556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:33.369125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:33.404687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7355999-ea22-41b8-a40b-da1536c37f7f None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.404687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7355999-ea22-41b8-a40b-da1536c37f7f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.404687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7355999-ea22-41b8-a40b-da1536c37f7f None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.404687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 57/108] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:33.410674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032d16-d76a-4c8b-a246-b4b8926cfe33 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.410975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032d16-d76a-4c8b-a246-b4b8926cfe33 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.411246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032d16-d76a-4c8b-a246-b4b8926cfe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.432810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4682-eec3-48ed-8ced-7e8bbbe84959 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:33.458372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-99032d16-d76a-4c8b-a246-b4b8926cfe33 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:33.459661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-99032d16-d76a-4c8b-a246-b4b8926cfe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:33.471258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:33.472401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.472932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.473430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.474411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:33.474916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:33.476768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:33.479127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:33.488042 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 52/109] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:44:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:33.494732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:33.577949 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 58/110] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:33.607354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33887-3057-48a1-9176-c96dc1137228 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.607961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33887-3057-48a1-9176-c96dc1137228 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.608505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33887-3057-48a1-9176-c96dc1137228 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.610202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 59/111] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:33.616851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67084-9f39-4838-8faf-ac1a85b784c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.617212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67084-9f39-4838-8faf-ac1a85b784c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.617478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67084-9f39-4838-8faf-ac1a85b784c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.645578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-50b67084-9f39-4838-8faf-ac1a85b784c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:33.647665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-50b67084-9f39-4838-8faf-ac1a85b784c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:33.673054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc0f69-faa2-4e1b-be02-dd7c93a1c2c3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:33.711550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:33.749294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:33.750192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.750484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.750763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.755035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:33.756520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:33.758317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 53/112] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:33 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:33.759116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:33.778968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 60/113] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:33.779863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b67084-9f39-4838-8faf-ac1a85b784c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:33.889414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:33.926098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b67084-9f39-4838-8faf-ac1a85b784c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:33.928328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c67a2-5d2b-4c60-b8ed-ae089a7eaf5e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:33.970131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123cc21-90fe-4d74-8cf6-0852ab224866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:33.970500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:33.971373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123cc21-90fe-4d74-8cf6-0852ab224866 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.971494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.971674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.971958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.972187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123cc21-90fe-4d74-8cf6-0852ab224866 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.972590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123cc21-90fe-4d74-8cf6-0852ab224866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.973250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:33.974019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123cc21-90fe-4d74-8cf6-0852ab224866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:33.974976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:33.975766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123cc21-90fe-4d74-8cf6-0852ab224866 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:33.976825 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 61/114] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:33 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:33.977642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:33.978064 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 54/115] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:33.979428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2c1cc-30e9-45b2-aee1-63ee9d616bec None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:33.979865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2c1cc-30e9-45b2-aee1-63ee9d616bec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:33.980608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2c1cc-30e9-45b2-aee1-63ee9d616bec None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:33.987374 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 55/116] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:33.988392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2c1cc-30e9-45b2-aee1-63ee9d616bec None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.063751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:34.100688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f7afd-34f0-4ecd-ae46-4e7c09b0f10e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.114820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2c1cc-30e9-45b2-aee1-63ee9d616bec None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.139624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.140815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.141340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.141816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.154567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:34.158488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7898ec-3d91-4236-bcac-4aea6d3e457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.159459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7898ec-3d91-4236-bcac-4aea6d3e457d None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.159792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7898ec-3d91-4236-bcac-4aea6d3e457d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.160073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7898ec-3d91-4236-bcac-4aea6d3e457d None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/16910e694ce34571a8e3953471ac3733/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.162475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7898ec-3d91-4236-bcac-4aea6d3e457d None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c320ef8324d0b95d89216c9c6bc1e, user_id=16910e694ce34571a8e3953471ac3733, role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:34.163823 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:34.164653 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:34.165427 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:34.166008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7898ec-3d91-4236-bcac-4aea6d3e457d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:34.168049 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 62/117] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:34.169085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.172084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:34.183148 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 56/118] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:33 2022] PUT /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/16910e694ce34571a8e3953471ac3733/roles/77c95569fa354b93b35fc5a694f02453 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:34.185205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba82674-3a2d-43cc-bcc9-24b1727e883a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.186898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba82674-3a2d-43cc-bcc9-24b1727e883a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.187898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba82674-3a2d-43cc-bcc9-24b1727e883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.210038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4ba82674-3a2d-43cc-bcc9-24b1727e883a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:34.211927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ba82674-3a2d-43cc-bcc9-24b1727e883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:34.283936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1d8bb-3969-4841-bf4d-d2693fae0b9d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.295064 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 57/119] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:34.296410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba82674-3a2d-43cc-bcc9-24b1727e883a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.321061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.322313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.322313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.322529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.323140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:34.324945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:34.349905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:34.375952 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 63/120] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:44:34 2022] POST /identity/v3/projects => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:34.376848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.428243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba82674-3a2d-43cc-bcc9-24b1727e883a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.484338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc1a84-7e84-47e8-8f0f-e10e60772520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.485216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc1a84-7e84-47e8-8f0f-e10e60772520 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.485567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc1a84-7e84-47e8-8f0f-e10e60772520 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.485914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc1a84-7e84-47e8-8f0f-e10e60772520 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.486790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc1a84-7e84-47e8-8f0f-e10e60772520 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:34.487183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc1a84-7e84-47e8-8f0f-e10e60772520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:34.488742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc1a84-7e84-47e8-8f0f-e10e60772520 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:34.488957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:34.500517 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 58/121] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:34.502082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b7356-f21d-45f0-9380-d9647ece2e45 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.502441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b7356-f21d-45f0-9380-d9647ece2e45 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.502783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b7356-f21d-45f0-9380-d9647ece2e45 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.504176 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 59/122] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:34.513111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b7356-f21d-45f0-9380-d9647ece2e45 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.562348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0c391-d4a4-4b80-b83f-10dc33caeefc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.601411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83762e-91fc-4a35-89b9-467e201bdbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.602545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83762e-91fc-4a35-89b9-467e201bdbdd None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.603004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83762e-91fc-4a35-89b9-467e201bdbdd None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.603282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83762e-91fc-4a35-89b9-467e201bdbdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.616098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83762e-91fc-4a35-89b9-467e201bdbdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-0f83762e-91fc-4a35-89b9-467e201bdbdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:34.623832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:34.625000 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:34.626048 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 64/123] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:34.626827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739a5c-43c3-4318-8285-25eb45d958ba None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.626989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739a5c-43c3-4318-8285-25eb45d958ba None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.627275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739a5c-43c3-4318-8285-25eb45d958ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.650049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ba739a5c-43c3-4318-8285-25eb45d958ba None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:34.651534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ba739a5c-43c3-4318-8285-25eb45d958ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:34.654144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b7356-f21d-45f0-9380-d9647ece2e45 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.656975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:34.694923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.695904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.696192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.696856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] PATH_INFO: `/v3/users/2062c4ae9773461a8713aee4e3304e08` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.722943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] RBAC: Authorizing `identity:get_user(user_id=2062c4ae9773461a8713aee4e3304e08)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:34.724808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:34.727929 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 60/124] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:34 2022] GET /identity/v3/users/2062c4ae9773461a8713aee4e3304e08 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:34.729333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.731686 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 65/125] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:34.735662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739a5c-43c3-4318-8285-25eb45d958ba None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.787720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:34.847146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739a5c-43c3-4318-8285-25eb45d958ba None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.861534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910677b7-90dd-427e-a9e1-03af9844385d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:34.889526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.890773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.891200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.891599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.913828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:34.915041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:34.915457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:34.915836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:34.916711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:34.917279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:34.919298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:34.932258 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 61/126] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:34.933066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:34.985418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:34.994757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:34.996210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:35.096109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:35.117343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532691-1cb4-4ce9-9257-7a5798637fe2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:35.175997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:35.176818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:35.177123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:35.177400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:35.186314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 66/127] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:35.189436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:35.205191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:35.213296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:35.214203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:35.215012 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 62/128] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:35.216380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:35.347686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:35.368372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb508-f669-424d-a69d-c60fc4d64ac0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:35.399248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc49c-4f5e-41e8-92a4-4043e16510eb None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:35.429316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:35.430938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:35.433690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:35.434212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:35.437045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:35.439812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:35.444916 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 63/129] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:35 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:35.446113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:35.478506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:35.479766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:35.481438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:35.481732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] PATH_INFO: `/v3/users/4a36d37a77f14439b4a1d892bb4af6b7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:35.483024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] RBAC: Authorizing `identity:get_user(user_id=4a36d37a77f14439b4a1d892bb4af6b7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:35.484536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:35.492604 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 67/130] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:35 2022] GET /identity/v3/users/4a36d37a77f14439b4a1d892bb4af6b7 => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:35.492604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:35.516673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:35.650860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ec1b6-fe98-41a3-9edd-fee5a67a2e51 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:35.659218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe954fb-021b-4395-bf6c-ae104030f936 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:35.698208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f151-2129-471d-adbf-642865d889fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:35.699234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f151-2129-471d-adbf-642865d889fd None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:35.700376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f151-2129-471d-adbf-642865d889fd None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:35.701468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721f151-2129-471d-adbf-642865d889fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:35.702586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f151-2129-471d-adbf-642865d889fd None admin] RBAC: Adding query filter params (role.id=eddcd54841c04e12a67598d8bb34631e, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=2062c4ae9773461a8713aee4e3304e08) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:35.704116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f151-2129-471d-adbf-642865d889fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:35.706354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721f151-2129-471d-adbf-642865d889fd None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:35.714785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:35.715595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:35.717445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:35.718075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:35.720060 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 68/131] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:35 2022] GET /identity/v3/role_assignments?user.id=2062c4ae9773461a8713aee4e3304e08&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=eddcd54841c04e12a67598d8bb34631e => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:35.720973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] RBAC: Adding query filter params (name=member) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:35.721419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:35.721790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f151-2129-471d-adbf-642865d889fd None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:35.723178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:35.743363 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 64/132] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:35.749142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:35.788032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:35.940007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:36.005743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33984f-c5fb-4f59-906b-460e0b95ff92 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:36.023578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721f151-2129-471d-adbf-642865d889fd None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:36.054307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:36.055940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.056223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.056552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.062609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:36.064105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:36.065822 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 65/133] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:35 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:36.074917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:36.101817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:36.102750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.103031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.103359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.104831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:36.107035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:36.109905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 69/134] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:35 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:36.116404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:36.248393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc54d02-542b-44eb-aec9-09835fd1e1ca None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:36.284731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f4709-b273-4ac6-aa82-41e7613ee33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:36.285683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f4709-b273-4ac6-aa82-41e7613ee33a None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.286109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f4709-b273-4ac6-aa82-41e7613ee33a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.286391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f4709-b273-4ac6-aa82-41e7613ee33a None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/4a36d37a77f14439b4a1d892bb4af6b7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.288394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f4709-b273-4ac6-aa82-41e7613ee33a None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c320ef8324d0b95d89216c9c6bc1e, user_id=4a36d37a77f14439b4a1d892bb4af6b7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:36.290110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f4709-b273-4ac6-aa82-41e7613ee33a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:36.298743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:36.307051 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 70/135] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:36 2022] PUT /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/4a36d37a77f14439b4a1d892bb4af6b7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:36.308229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962827a-a905-499f-9e3c-d05def3152c2 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.308520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962827a-a905-499f-9e3c-d05def3152c2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.308796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962827a-a905-499f-9e3c-d05def3152c2 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.315388 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 71/136] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:36.320915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9c3e-90ab-481a-b9b3-e897b94a98ff None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.321219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9c3e-90ab-481a-b9b3-e897b94a98ff None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.321495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9c3e-90ab-481a-b9b3-e897b94a98ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.345444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:36.350552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e4ab9c3e-90ab-481a-b9b3-e897b94a98ff None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:36.351961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e4ab9c3e-90ab-481a-b9b3-e897b94a98ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:36.355351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43391714-b1c2-498a-978f-a792fc07787b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:36.448381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:36.450975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.451259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.451537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] PATH_INFO: `/v3/projects/61e581f7b579440ca94d83d1c6915ff9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.454461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] RBAC: Authorizing `identity:get_project(project_id=61e581f7b579440ca94d83d1c6915ff9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:36.455962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:36.458124 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 66/137] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:36 2022] GET /identity/v3/projects/61e581f7b579440ca94d83d1c6915ff9 => generated 312 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:36.468917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:36.484361 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 72/138] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:36.545821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9c3e-90ab-481a-b9b3-e897b94a98ff None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:36.698546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9c3e-90ab-481a-b9b3-e897b94a98ff None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:36.699422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31f7a-6e93-4f29-b3d5-1f3a003d5acf None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:36.738391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:36.739202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.739526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.739803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.751024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:36.759860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:36.760779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:36.761582 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 73/139] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:36.762218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:36.768307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:36.777794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:36.779005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.779488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.779960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] PATH_INFO: `/v3/projects/61e581f7b579440ca94d83d1c6915ff9/users/16910e694ce34571a8e3953471ac3733/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.782237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=61e581f7b579440ca94d83d1c6915ff9, user_id=16910e694ce34571a8e3953471ac3733, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:36.789064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:36.807391 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 67/140] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:36 2022] PUT /identity/v3/projects/61e581f7b579440ca94d83d1c6915ff9/users/16910e694ce34571a8e3953471ac3733/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:36.880179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e227d-813c-4d7b-9d1b-68110b4ebaf7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:36.919297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:36.920025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:36.920306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:36.920577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:36.922121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:36.922427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:36.923888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:36.934447 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 74/141] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:36.940817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:36.960355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:37.095086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18862a3-fe51-4892-96ca-216fb2189fcf None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:37.153542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:37.154449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:37.154727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:37.154997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:37.161944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:37.163701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:37.165908 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 68/142] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:36 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:37.171389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:37.243443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:37.292583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc951959-ff2b-4829-97f2-d5a510a0f812 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:37.329555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33687208-02b9-4692-9a39-b5598fe886ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:37.330226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687208-02b9-4692-9a39-b5598fe886ca None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:37.330504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687208-02b9-4692-9a39-b5598fe886ca None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:37.330777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33687208-02b9-4692-9a39-b5598fe886ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:37.404039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33687208-02b9-4692-9a39-b5598fe886ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:37.405531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33687208-02b9-4692-9a39-b5598fe886ca None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:37.471624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:37.518527 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 75/143] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:37.524304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:37.528131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ccd01-ce2b-4612-b7cd-dbfa422bc48a None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:37.528764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ccd01-ce2b-4612-b7cd-dbfa422bc48a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:37.529234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ccd01-ce2b-4612-b7cd-dbfa422bc48a None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:37.530758 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 76/144] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:37.536706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3beee-bdca-4213-8b60-87ead06775cf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:37.537209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3beee-bdca-4213-8b60-87ead06775cf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:37.537772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3beee-bdca-4213-8b60-87ead06775cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:37.566557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3dd3beee-bdca-4213-8b60-87ead06775cf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:37.568945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3dd3beee-bdca-4213-8b60-87ead06775cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:37.678483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:37.721195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc216ad-f0f3-4e62-b994-414efe6ccc3f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:37.732971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 77/145] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:37.783468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3beee-bdca-4213-8b60-87ead06775cf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:37.789187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:37.791278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:37.791761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:37.792231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:37.793674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:37.795762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:37.798074 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 69/146] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:37 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:37.804139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:37.929443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0242f-23ae-4f4e-94ab-9e91b07acfbb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:37.977419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:37.986344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc8f17-4b5d-43ae-9f68-a9ed1b31dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:37.987022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8f17-4b5d-43ae-9f68-a9ed1b31dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:37.987380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8f17-4b5d-43ae-9f68-a9ed1b31dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:37.987659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc8f17-4b5d-43ae-9f68-a9ed1b31dcf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:37.988555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8f17-4b5d-43ae-9f68-a9ed1b31dcf0 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=16910e694ce34571a8e3953471ac3733) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:37.988872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8f17-4b5d-43ae-9f68-a9ed1b31dcf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:37.990453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc8f17-4b5d-43ae-9f68-a9ed1b31dcf0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:38.000403 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 70/147] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:37 2022] GET /identity/v3/role_assignments?user.id=16910e694ce34571a8e3953471ac3733&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=0329a03140564541b142bbc7fc5111a8 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:38.001723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7402e-877e-439a-9fc4-c2895748e2bf None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.002015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7402e-877e-439a-9fc4-c2895748e2bf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.002290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7402e-877e-439a-9fc4-c2895748e2bf None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.003502 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 71/148] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:38.005498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3beee-bdca-4213-8b60-87ead06775cf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:38.009495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a710-d4b0-4928-99f5-0a2f3a82b756 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.014869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a710-d4b0-4928-99f5-0a2f3a82b756 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.015302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a710-d4b0-4928-99f5-0a2f3a82b756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.048234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1bf4a710-d4b0-4928-99f5-0a2f3a82b756 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:38.049777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1bf4a710-d4b0-4928-99f5-0a2f3a82b756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:38.057190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:38.091280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:38.092156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.092437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.092708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.100263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:38.100263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:38.100525 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 78/149] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:38.109957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:38.232695 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 72/150] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:38.267341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a710-d4b0-4928-99f5-0a2f3a82b756 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:38.280872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b0d1-4c1c-4eda-b9cc-64c99d1a69f5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:38.341946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:38.342684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.342968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.343243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.344014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:38.345635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:38.378037 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 79/151] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:44:38 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:38.449675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a710-d4b0-4928-99f5-0a2f3a82b756 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:38.488031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a65883-4135-4720-8642-830562703019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:38.488800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65883-4135-4720-8642-830562703019 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.489092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65883-4135-4720-8642-830562703019 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.489369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a65883-4135-4720-8642-830562703019 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.499720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:38.503675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a65883-4135-4720-8642-830562703019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-24a65883-4135-4720-8642-830562703019 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:38.513025 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:38.513973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:38.514783 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 73/152] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:38.520554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:38.539823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:38.678365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee17e95-04aa-4498-ba77-19ae61c0c3c0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:38.709753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d7ff-d11d-42fe-8527-6aa7113cb579 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.710354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d7ff-d11d-42fe-8527-6aa7113cb579 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.710354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d7ff-d11d-42fe-8527-6aa7113cb579 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.711953 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 74/153] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:38.717490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da7d3-d612-49bc-9447-a6e74f5903d6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.717754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da7d3-d612-49bc-9447-a6e74f5903d6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.718078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6da7d3-d612-49bc-9447-a6e74f5903d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.725939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:38.727061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.727561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.728029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.730175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:38.730692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:38.732363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:38.744763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 80/154] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:38.746864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4a6da7d3-d612-49bc-9447-a6e74f5903d6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:38.748461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4a6da7d3-d612-49bc-9447-a6e74f5903d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:38.751580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:38.839320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:38.843317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 75/155] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:38.870595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6da7d3-d612-49bc-9447-a6e74f5903d6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:38.871520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9259-27b0-4d9d-be1d-52b403d22e29 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:38.910306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:38.911360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:38.911806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:38.912235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:38.913743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:38.915507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:38.918525 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 81/156] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:38 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:38.927412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:38.998041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6da7d3-d612-49bc-9447-a6e74f5903d6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.032552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:39.052599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:39.054217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.054590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.054869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.062662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255c2e9-208d-4897-ad83-661e81fd0129 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.085833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:39.098868 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:39.099876 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:39.100644 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:39.102898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:39.103586 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 76/157] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:39.104347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.104347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.104521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.114146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:39.123676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:39.202309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:39.205142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:39.263884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147b83f-b0c8-45c7-82db-b6d0ad7e5cfe None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.333631 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 82/158] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 21:44:39.340119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:39.351277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:39.351964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.352247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.352523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.353348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] RBAC: Adding query filter params (name=reader) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:39.353654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:39.357455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:39.380869 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 77/159] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:39.386240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:39.399226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:39.474822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:39.532808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde431f-6d44-477d-9b78-5b6c925e104b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.571261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b2bec-9d0b-46e9-9e84-392046089d4c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.583381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:39.584276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.584550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.584822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] PATH_INFO: `/v3/users/2062c4ae9773461a8713aee4e3304e08` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.588416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] RBAC: Authorizing `identity:get_user(user_id=2062c4ae9773461a8713aee4e3304e08)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:39.589907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:39.591565 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 78/160] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:39 2022] GET /identity/v3/users/2062c4ae9773461a8713aee4e3304e08 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:39.597905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:39.634401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:39.635289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.635570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.635843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.637704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:39.639171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:39.641126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 83/161] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:39 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:39.652929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:39.776588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ed48-883b-4da0-a503-60988ec7ac32 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.807140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:39.818397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba00e8-0054-4878-b4c6-b51335a95bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:39.819435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba00e8-0054-4878-b4c6-b51335a95bd6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.819744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba00e8-0054-4878-b4c6-b51335a95bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.819999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba00e8-0054-4878-b4c6-b51335a95bd6 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.821332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba00e8-0054-4878-b4c6-b51335a95bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:39.822885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba00e8-0054-4878-b4c6-b51335a95bd6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:39.824943 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 79/162] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:39 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:39.826306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ac35-487a-408a-b6a3-4f8d56c0ffc0 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.826850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ac35-487a-408a-b6a3-4f8d56c0ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.826962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ac35-487a-408a-b6a3-4f8d56c0ffc0 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.828178 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 80/163] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:39.832925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ac35-487a-408a-b6a3-4f8d56c0ffc0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:39.911261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906e676-d82b-4e30-8860-69009daa03a1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.935575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:39.953670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ac35-487a-408a-b6a3-4f8d56c0ffc0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:39.989955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:39.991158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:39.991655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:39.992103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/2062c4ae9773461a8713aee4e3304e08/roles/eddcd54841c04e12a67598d8bb34631e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:39.994668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c320ef8324d0b95d89216c9c6bc1e, user_id=2062c4ae9773461a8713aee4e3304e08, role_id=eddcd54841c04e12a67598d8bb34631e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:39.996297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:40.005162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37c073-4b10-431d-873c-5441026ed9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:40.005162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c073-4b10-431d-873c-5441026ed9b4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:40.005162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c073-4b10-431d-873c-5441026ed9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:40.005162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c073-4b10-431d-873c-5441026ed9b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:40.005545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37c073-4b10-431d-873c-5441026ed9b4 None admin] RBAC: Adding query filter params (role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=16910e694ce34571a8e3953471ac3733) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:40.005545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37c073-4b10-431d-873c-5441026ed9b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:40.005664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37c073-4b10-431d-873c-5441026ed9b4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:40.012805 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 84/164] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:39 2022] GET /identity/v3/role_assignments?user.id=16910e694ce34571a8e3953471ac3733&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=77c95569fa354b93b35fc5a694f02453 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:40.020239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3426-f652-4931-885d-0dedd874c15c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:40.020239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3426-f652-4931-885d-0dedd874c15c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:40.020239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3426-f652-4931-885d-0dedd874c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:40.036928 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 81/165] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:39 2022] PUT /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/users/2062c4ae9773461a8713aee4e3304e08/roles/eddcd54841c04e12a67598d8bb34631e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:44:40.062442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-707a3426-f652-4931-885d-0dedd874c15c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:40.063582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-707a3426-f652-4931-885d-0dedd874c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:40.152063 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 85/166] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:40.189342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:40.268377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:40.329422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c4bf-5cb5-4687-aaec-b96fd16abb9e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:40.369182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:40.370000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:40.370285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:40.370560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:40.382962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:40.390888 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:40.391826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:40.392760 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 82/167] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:40.398517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3426-f652-4931-885d-0dedd874c15c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:40.538396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3426-f652-4931-885d-0dedd874c15c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:40.539983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:40.575875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:40.576566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:40.576828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:40.577205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:40.577971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:40.578278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:40.579793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:40.591271 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 86/168] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:40.596919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:40.728602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049090-1134-488d-bcaf-d7e813e8b50c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:40.737801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:40.769072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1572c5-9617-4c03-bd4b-57eada620e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:40.769963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1572c5-9617-4c03-bd4b-57eada620e9f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:40.770233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1572c5-9617-4c03-bd4b-57eada620e9f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:40.770505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1572c5-9617-4c03-bd4b-57eada620e9f None admin] PATH_INFO: `/v3/users/4a36d37a77f14439b4a1d892bb4af6b7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:40.777801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1572c5-9617-4c03-bd4b-57eada620e9f None admin] RBAC: Authorizing `identity:get_user(user_id=4a36d37a77f14439b4a1d892bb4af6b7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:40.779272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1572c5-9617-4c03-bd4b-57eada620e9f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:40.781339 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 83/169] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:40 2022] GET /identity/v3/users/4a36d37a77f14439b4a1d892bb4af6b7 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:40.786586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:40.927194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1964c5-0bf7-4a19-8382-943fb744c551 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:40.971799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:40.972465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:40.972746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:40.973098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:41.017587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:41.039074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaca3b-15e4-416f-8072-3b231a998ade None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:41.039252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaca3b-15e4-416f-8072-3b231a998ade None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:41.039467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaca3b-15e4-416f-8072-3b231a998ade None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:41.041135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 84/170] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:41.054486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2869c2-7e49-4b82-8ec0-a6dd5278ffe8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:41.054772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2869c2-7e49-4b82-8ec0-a6dd5278ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:41.055045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2869c2-7e49-4b82-8ec0-a6dd5278ffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:41.082917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:41.084671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:41.114046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1a2869c2-7e49-4b82-8ec0-a6dd5278ffe8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:41.115233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1a2869c2-7e49-4b82-8ec0-a6dd5278ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:41.231648 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 87/171] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:41.237761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:41.311089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:41.344820 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 85/172] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:41.357283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf82d32-2859-403a-bf24-b1d93f8f1fe0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:41.395943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:41.396824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:41.397150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:41.397475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:41.398716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:41.400360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:41.403171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2869c2-7e49-4b82-8ec0-a6dd5278ffe8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:41.405305 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 88/173] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:41 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:41.409913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:41.517914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214b102-f0f9-4b08-8111-b97b69b8573b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:41.553520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:41.565395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:41.566110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:41.566396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:41.566749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:41.567612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=4a36d37a77f14439b4a1d892bb4af6b7) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:41.567926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:41.569713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:41.581423 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 89/174] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:41 2022] GET /identity/v3/role_assignments?user.id=4a36d37a77f14439b4a1d892bb4af6b7&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:41.615295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2869c2-7e49-4b82-8ec0-a6dd5278ffe8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:41.623431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:41.659760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:41.660603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:41.660875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:41.661227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:41.679782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:41.687930 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:41.688881 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:41.689780 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 86/175] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:41.696915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:41.835683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d8486-77ea-47a6-920c-9692067e0359 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:41.869492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:41.870173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:41.870455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:41.870731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:41.871493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:41.871797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:41.873221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:41.882048 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 90/176] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:41.890169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:42.053660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f45c4-c168-4595-aa2d-45fb5f8e98d0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:42.095939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5a6e8-a675-4ee0-bf29-e1562d618ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:42.097068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5a6e8-a675-4ee0-bf29-e1562d618ef0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.097483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5a6e8-a675-4ee0-bf29-e1562d618ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.097889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5a6e8-a675-4ee0-bf29-e1562d618ef0 None admin] PATH_INFO: `/v3/users/16910e694ce34571a8e3953471ac3733` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.101760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5a6e8-a675-4ee0-bf29-e1562d618ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=16910e694ce34571a8e3953471ac3733)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:42.103387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5a6e8-a675-4ee0-bf29-e1562d618ef0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:42.105508 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 87/177] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:41 2022] GET /identity/v3/users/16910e694ce34571a8e3953471ac3733 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:42.111299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:42.187582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:42.231429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f1a62-e0ed-4777-9b88-0072df1eb827 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:42.266045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:42.266706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.266989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.267263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.336173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:42.336943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e1aa-ecf4-450d-8290-d3f9f4356c96 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.337500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e1aa-ecf4-450d-8290-d3f9f4356c96 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.337763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:42.338163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e1aa-ecf4-450d-8290-d3f9f4356c96 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.339919 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 88/178] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:42.349313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5d350-a2df-4ff2-96eb-753e1d78c7c4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.349881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5d350-a2df-4ff2-96eb-753e1d78c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.350347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5d350-a2df-4ff2-96eb-753e1d78c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.391327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4eb5d350-a2df-4ff2-96eb-753e1d78c7c4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:42.392942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4eb5d350-a2df-4ff2-96eb-753e1d78c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:42.401435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:42.444077 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 91/179] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:42.453813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:42.455086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:42.545055 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 89/180] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 18 21:44:42.563414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c27ede-ab08-4458-9214-f511b1eb0d7f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:42.572331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5d350-a2df-4ff2-96eb-753e1d78c7c4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:42.602717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:42.604409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.604696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.604971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] PATH_INFO: `/v3/projects/61e581f7b579440ca94d83d1c6915ff9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.606367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] RBAC: Authorizing `identity:get_project(project_id=61e581f7b579440ca94d83d1c6915ff9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:42.610057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:42.615077 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 92/181] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:42 2022] GET /identity/v3/projects/61e581f7b579440ca94d83d1c6915ff9 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:42.618077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:42.673429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:42.757009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5d350-a2df-4ff2-96eb-753e1d78c7c4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:42.771734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d07e4-6442-4341-a3ba-3531bb647c41 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:42.800115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8e20f-b402-4a8a-a1a7-b8a219ed0f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:42.800919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8e20f-b402-4a8a-a1a7-b8a219ed0f2e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.801229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8e20f-b402-4a8a-a1a7-b8a219ed0f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.801502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8e20f-b402-4a8a-a1a7-b8a219ed0f2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.810622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db664ed-6399-494c-9013-42b1b932cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:42.811446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db664ed-6399-494c-9013-42b1b932cbe0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.811802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8e20f-b402-4a8a-a1a7-b8a219ed0f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:42.812025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db664ed-6399-494c-9013-42b1b932cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.812427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db664ed-6399-494c-9013-42b1b932cbe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.813421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db664ed-6399-494c-9013-42b1b932cbe0 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=61e581f7b579440ca94d83d1c6915ff9, user.id=16910e694ce34571a8e3953471ac3733) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:42.813863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db664ed-6399-494c-9013-42b1b932cbe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:42.815451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db664ed-6399-494c-9013-42b1b932cbe0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-d3a8e20f-b402-4a8a-a1a7-b8a219ed0f2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:42.819386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:42.820428 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:42.821441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 90/182] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:42.822166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50cea0-88ea-471a-90f1-b4a2f6d31168 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.826826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50cea0-88ea-471a-90f1-b4a2f6d31168 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.826826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50cea0-88ea-471a-90f1-b4a2f6d31168 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.827953 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 91/183] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:42.828717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50cea0-88ea-471a-90f1-b4a2f6d31168 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:42.830369 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 93/184] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:42 2022] GET /identity/v3/role_assignments?user.id=16910e694ce34571a8e3953471ac3733&scope.project.id=61e581f7b579440ca94d83d1c6915ff9&role.id=0329a03140564541b142bbc7fc5111a8 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:42.832166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f73f-a6f5-4bd7-ba9e-80282edab2a0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.832647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f73f-a6f5-4bd7-ba9e-80282edab2a0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.833125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f73f-a6f5-4bd7-ba9e-80282edab2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.858138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:42.864237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4d42f73f-a6f5-4bd7-ba9e-80282edab2a0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:42.866930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4d42f73f-a6f5-4bd7-ba9e-80282edab2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:42.936575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50cea0-88ea-471a-90f1-b4a2f6d31168 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:42.974147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:42.974829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.975111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.975386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.976325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:42.976629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:42.977546 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 94/185] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:42.979048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8b85-1ba0-4e49-b753-2b88b94e4629 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.979481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8b85-1ba0-4e49-b753-2b88b94e4629 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.979911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8b85-1ba0-4e49-b753-2b88b94e4629 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:42.981722 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 95/186] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:42.982267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:42.989063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b432d-4515-4886-a1f4-5de0e337bc2f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:42.989063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b432d-4515-4886-a1f4-5de0e337bc2f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:42.989063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b432d-4515-4886-a1f4-5de0e337bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.011570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c72b432d-4515-4886-a1f4-5de0e337bc2f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:43.011876 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 92/187] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:43.012779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.013207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c72b432d-4515-4886-a1f4-5de0e337bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:43.048810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.098881 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 96/188] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:43.099825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b432d-4515-4886-a1f4-5de0e337bc2f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.119057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.138155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f064e52-85dc-4415-8dac-3460179ca37f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.188826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.190089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.190379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.190659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.205003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:43.214057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:43.214941 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:43.215743 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:43.217726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b432d-4515-4886-a1f4-5de0e337bc2f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.221072 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 93/189] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:43.221192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.255903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.256819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.257146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.257405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] PATH_INFO: `/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.272128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] RBAC: Authorizing `identity:get_user(user_id=c4c7c3bb3d534141aa2247086ea4eb6c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:43.273759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:43.275464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 97/190] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:43.276214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.287709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.337055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0090a-5ad6-4ab4-a82d-8fdfb1d41ebe None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.373537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4981b-8152-45da-9c36-194e76c6bf5e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.376809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.377651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.377925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.378193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.379407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:43.380864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:43.382543 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 94/191] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:43.383304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.403297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.417173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.417834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.418116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.418395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.419153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:43.419461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:43.420855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:43.433145 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 98/192] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:43.433145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.500652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5f82a-28f5-457e-afea-eda0d28f0e6b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.517149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.540210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465d6b-e9cf-4d2f-9d11-200c332ff90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.540871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465d6b-e9cf-4d2f-9d11-200c332ff90b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.541416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465d6b-e9cf-4d2f-9d11-200c332ff90b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.541598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465d6b-e9cf-4d2f-9d11-200c332ff90b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.553971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539768d-f322-40d1-adcd-72feef29a96f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.588729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.589454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.589737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.590013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.590729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:43.592192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:43.613439 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 99/193] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:44:43 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:43.614076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.630154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2465d6b-e9cf-4d2f-9d11-200c332ff90b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:43.633310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2465d6b-e9cf-4d2f-9d11-200c332ff90b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:43.650910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.744512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dd771-6140-4bb7-abfe-63fac7a268b6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.767968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 95/194] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:43.769451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3dae-66e2-47b8-a738-ec1520962997 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.769743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3dae-66e2-47b8-a738-ec1520962997 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.770021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3dae-66e2-47b8-a738-ec1520962997 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.773086 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 96/195] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:43.773229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3dae-66e2-47b8-a738-ec1520962997 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.778832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.789633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86957042-9063-450d-ba17-0975d31ae468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.791096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957042-9063-450d-ba17-0975d31ae468 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.791374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957042-9063-450d-ba17-0975d31ae468 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.791645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957042-9063-450d-ba17-0975d31ae468 None admin] PATH_INFO: `/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.792909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86957042-9063-450d-ba17-0975d31ae468 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c7c3bb3d534141aa2247086ea4eb6c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:43.794427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86957042-9063-450d-ba17-0975d31ae468 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:43.796254 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 100/196] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:43.797330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd9bb-0feb-43a4-80a8-5548dec93c02 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.797611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd9bb-0feb-43a4-80a8-5548dec93c02 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.797882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd9bb-0feb-43a4-80a8-5548dec93c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.817223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-855cd9bb-0feb-43a4-80a8-5548dec93c02 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:43.818453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-855cd9bb-0feb-43a4-80a8-5548dec93c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:43.891813 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 101/197] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:43.892496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd9bb-0feb-43a4-80a8-5548dec93c02 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:43.901891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3dae-66e2-47b8-a738-ec1520962997 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:43.923905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:43.954747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:43.955936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:43.955936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:43.956233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:43.958545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:43.960192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:43.963275 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 97/198] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:43.964040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:44.014977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd9bb-0feb-43a4-80a8-5548dec93c02 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:44.048067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:44.068004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:44.068671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:44.068945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:44.069296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:44.110966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d0c59-2d26-420a-938f-381c2f7bbdef None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:44.149438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:44.149765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:44.150157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:44.150431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:44.150760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:44.151235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:44.166409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:44.174867 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:44.175918 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:44.176738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:44.179005 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 98/199] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:44.180075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:44.225840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:44.269844 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 102/200] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:44.273307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:44.297531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119df35-f9c0-487f-9eb0-de8298214631 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:44.299551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:44.346190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:44.346859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:44.347142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:44.347420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:44.348526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=c4c7c3bb3d534141aa2247086ea4eb6c) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:44.348843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:44.351286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:44.360792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 99/201] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:44 2022] GET /identity/v3/role_assignments?user.id=c4c7c3bb3d534141aa2247086ea4eb6c&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:44.361506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:44.417503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e720d-2375-4ba6-b35e-a97814f3ffb8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:44.491750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404851d-e9d2-4c86-b710-6f892589242f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:44.500298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:44.508836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:44.509727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:44.510103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:44.510708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:44.511390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:44.511777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:44.513261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:44.534294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:44.535205 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 103/202] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:44.535700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:44.536240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:44.536690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:44.538358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:44.540135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:44.541067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:44.542667 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 100/203] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:44 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:44.548916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:44.702440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190269e-568c-46cc-9e4a-0d0b937e94c9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:44.704215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:44.739997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:44.740653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:44.740828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc170b-e686-4b18-8b84-319782c686f5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:44.741063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:44.741315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:44.742155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] RBAC: Adding query filter params (role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=c4c7c3bb3d534141aa2247086ea4eb6c) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:44.742461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:44.744275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:44.750646 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 101/204] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:44 2022] GET /identity/v3/role_assignments?user.id=c4c7c3bb3d534141aa2247086ea4eb6c&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=77c95569fa354b93b35fc5a694f02453 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:44.805509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:44.806461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:44.806740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:44.807055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] PATH_INFO: `/v3/users/2062c4ae9773461a8713aee4e3304e08` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:44.808317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] RBAC: Authorizing `identity:get_user(user_id=2062c4ae9773461a8713aee4e3304e08)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:44.809807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:44.811773 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 104/205] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:44 2022] GET /identity/v3/users/2062c4ae9773461a8713aee4e3304e08 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:44.817075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:44.891573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:44.995610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fb3a-0aef-46f6-b4bc-964b89378b66 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:45.052690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:45.053417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:45.053727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:45.053998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:45.131486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:45.133006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:45.173655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:45.237143 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 102/206] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:45.245550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:45.372786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ebf4f-61eb-4a7c-8002-59634260cd15 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:45.416652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e75d4-44a7-413a-82b3-99ddb5670486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:45.417557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e75d4-44a7-413a-82b3-99ddb5670486 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:45.417834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e75d4-44a7-413a-82b3-99ddb5670486 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:45.418105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e75d4-44a7-413a-82b3-99ddb5670486 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:45.419296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e75d4-44a7-413a-82b3-99ddb5670486 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:45.420744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e75d4-44a7-413a-82b3-99ddb5670486 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:45.422772 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 105/207] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:45 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:45.428677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:45.545556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc8127-cbfc-4b61-bbcf-8dfde3831205 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:45.583711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c02a-b272-4f30-b20f-039f7d67c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:45.584363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c02a-b272-4f30-b20f-039f7d67c851 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:45.584712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c02a-b272-4f30-b20f-039f7d67c851 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:45.584974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c02a-b272-4f30-b20f-039f7d67c851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:45.585834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c02a-b272-4f30-b20f-039f7d67c851 None admin] RBAC: Adding query filter params (role.id=eddcd54841c04e12a67598d8bb34631e, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e, user.id=2062c4ae9773461a8713aee4e3304e08) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:45.586143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c02a-b272-4f30-b20f-039f7d67c851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:45.587587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c02a-b272-4f30-b20f-039f7d67c851 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:45.593522 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 103/208] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:45 2022] GET /identity/v3/role_assignments?user.id=2062c4ae9773461a8713aee4e3304e08&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=eddcd54841c04e12a67598d8bb34631e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:46.430486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d548-e8f7-405d-b513-2f964e96988d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:46.431456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d548-e8f7-405d-b513-2f964e96988d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:46.431932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d548-e8f7-405d-b513-2f964e96988d None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:46.433557 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 106/209] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:46.438981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ccab7-5a8d-4e59-b7ba-5ad02ba41ae5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:46.439802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ccab7-5a8d-4e59-b7ba-5ad02ba41ae5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:46.440291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ccab7-5a8d-4e59-b7ba-5ad02ba41ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:46.445755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:46.459281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a95ccab7-5a8d-4e59-b7ba-5ad02ba41ae5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:46.460828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a95ccab7-5a8d-4e59-b7ba-5ad02ba41ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:46.529464 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 104/210] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:46.554358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d548-e8f7-405d-b513-2f964e96988d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:46.580519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:46.584792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ee8eb-a94d-4308-b6da-84f74c1cee42 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:46.585437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ee8eb-a94d-4308-b6da-84f74c1cee42 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:46.585933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ee8eb-a94d-4308-b6da-84f74c1cee42 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:46.587505 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 105/211] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:46.592712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5630-07e6-4934-bf8a-40b2fd9d95ec None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:46.593317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5630-07e6-4934-bf8a-40b2fd9d95ec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:46.593791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5630-07e6-4934-bf8a-40b2fd9d95ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:46.611461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0bfa5630-07e6-4934-bf8a-40b2fd9d95ec None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:46.612994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0bfa5630-07e6-4934-bf8a-40b2fd9d95ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:46.663982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d548-e8f7-405d-b513-2f964e96988d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:46.705144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:46.705144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:46.705144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:46.705144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:46.705507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 106/212] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:46.715176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:46.723335 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:46.724296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:46.726095 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 107/213] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:46.733006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5630-07e6-4934-bf8a-40b2fd9d95ec None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:46.733497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:46.814442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:46.833967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:46.853238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65127055-8cc8-407e-89c6-221d20abf414 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:46.865684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5630-07e6-4934-bf8a-40b2fd9d95ec None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:46.888162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:46.888970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:46.889279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:46.889554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:46.890750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:46.892242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:46.898502 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 108/214] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:46.900037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:46.912487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:46.913079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:46.913366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:46.913642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:46.914579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] RBAC: Adding query filter params (name=member) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:46.914905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:46.916279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:46.929113 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 107/215] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:46.930526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.009874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8257b98-569a-4a33-a89a-cec8713b8049 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.046301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a787-f538-483b-810f-85b7eed0ce5d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.052356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bb1c7-56f8-4842-ab95-dd826694617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.053059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bb1c7-56f8-4842-ab95-dd826694617d None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.053402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bb1c7-56f8-4842-ab95-dd826694617d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.053787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bb1c7-56f8-4842-ab95-dd826694617d None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.054505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bb1c7-56f8-4842-ab95-dd826694617d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:47.056003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bb1c7-56f8-4842-ab95-dd826694617d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:47.071150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.081790 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 109/216] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:44:46 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:44:47.081790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355244d9-e6cc-46f9-b929-23b76c87a88f None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.081790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355244d9-e6cc-46f9-b929-23b76c87a88f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.081790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355244d9-e6cc-46f9-b929-23b76c87a88f None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.081790 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 110/217] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:47.086555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1b2d2-d33a-46e3-a2fb-543425974349 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.086846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1b2d2-d33a-46e3-a2fb-543425974349 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.087145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1b2d2-d33a-46e3-a2fb-543425974349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.101997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.102911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.103234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.103510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] PATH_INFO: `/v3/users/9ba5b5f6b155447b8737268fe42f24a6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.112688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.122386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-53c1b2d2-d33a-46e3-a2fb-543425974349 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:47.124937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] RBAC: Authorizing `identity:get_user(user_id=9ba5b5f6b155447b8737268fe42f24a6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:47.125389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-53c1b2d2-d33a-46e3-a2fb-543425974349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:47.126535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:47.133557 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 108/218] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:46 2022] GET /identity/v3/users/9ba5b5f6b155447b8737268fe42f24a6 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:47.134659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.218569 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 111/219] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:47.243139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1b2d2-d33a-46e3-a2fb-543425974349 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.269253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b579e-fd55-41ed-b57c-908d10839f94 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.321164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f49bd-6a62-4703-a0f6-195d9cfd9244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.321821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f49bd-6a62-4703-a0f6-195d9cfd9244 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.322103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f49bd-6a62-4703-a0f6-195d9cfd9244 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.322429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f49bd-6a62-4703-a0f6-195d9cfd9244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.378062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1b2d2-d33a-46e3-a2fb-543425974349 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.387574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.410850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f49bd-6a62-4703-a0f6-195d9cfd9244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:47.412770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f49bd-6a62-4703-a0f6-195d9cfd9244 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:47.426890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.427710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.427992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.428298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.435494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.444325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:47.452110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:47.453293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:47.454203 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 112/220] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:47.459979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.542709 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 109/221] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:47.543770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406400-3217-4df4-a731-d321d53b5eb2 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.544057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406400-3217-4df4-a731-d321d53b5eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.544388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406400-3217-4df4-a731-d321d53b5eb2 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.557152 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 110/222] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:47.557152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aeb1b-bcbf-425f-8684-a435013edd2e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.557152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aeb1b-bcbf-425f-8684-a435013edd2e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.557152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aeb1b-bcbf-425f-8684-a435013edd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.574140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8e1aeb1b-bcbf-425f-8684-a435013edd2e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:47.576095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8e1aeb1b-bcbf-425f-8684-a435013edd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:47.590254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7de83-7040-49d3-b75e-260df528add7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.632962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.633794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.634139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.634522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.635356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:47.635731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:47.637233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:47.651108 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 113/223] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:47.651108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.665277 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 111/224] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:47.666447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aeb1b-bcbf-425f-8684-a435013edd2e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.681425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.738503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.773687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aeb1b-bcbf-425f-8684-a435013edd2e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.784594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb29252-c782-4a01-aca0-0b55e9f9c5b7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.809782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.810579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.810858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.811134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] PATH_INFO: `/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.812347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c7c3bb3d534141aa2247086ea4eb6c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:47.813904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:47.815686 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 112/225] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:47.820865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.825748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.826799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.827217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.827624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.829015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:47.831091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:47.833623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 114/226] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:47.834718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.914289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.935539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac5ec7-8c40-46be-893f-eaa18f8282a9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.946347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc73db-dd46-4f97-a8e0-962fe016f1c8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:47.971949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.972923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.973366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.973711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.974291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:47.984941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:47.985719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:47.986763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:47.987178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:47.987595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:47.988914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:47.990528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:47.992725 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 115/227] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:47.993650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:47.998792 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:47.999722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:48.000536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 113/228] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:48.002025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:48.105831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefcc19-2f47-42e6-aa38-c868434ca849 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:48.110056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41817f-b126-4756-8781-3d25160183fb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:48.145366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:48.146453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:48.146830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:48.147236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/c4c7c3bb3d534141aa2247086ea4eb6c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:48.149311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b8863989e2c40f6810172d2e8d6e388, user_id=c4c7c3bb3d534141aa2247086ea4eb6c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:48.150184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:48.150965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:48.151125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:48.151548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:48.151954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:48.152917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=9ba5b5f6b155447b8737268fe42f24a6) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:48.153381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:48.155153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:48.162465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 116/229] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:47 2022] GET /identity/v3/role_assignments?user.id=9ba5b5f6b155447b8737268fe42f24a6&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=0329a03140564541b142bbc7fc5111a8 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:48.163565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:48.173872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:48.178856 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 114/230] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:48 2022] PUT /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/c4c7c3bb3d534141aa2247086ea4eb6c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:44:48.235562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:48.281864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad1c74-8d98-46cf-9664-ac32fa549b02 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:48.318547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:48.319610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:48.320029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:48.320438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:48.321376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:48.321849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:48.323394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:48.333511 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 117/231] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:44:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:48.341158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:48.473777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dedbe4-9c99-4cc8-95c9-233c519d5668 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:48.513338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:48.514243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:48.514612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:48.514889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] PATH_INFO: `/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:48.516241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] RBAC: Authorizing `identity:get_user(user_id=c4c7c3bb3d534141aa2247086ea4eb6c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:48.517770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:48.519962 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 115/232] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:48 2022] GET /identity/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:48.525188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:48.668768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756e4d-d67b-4453-99aa-a2730039fe47 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:48.690728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:48.704785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f5a13-588e-46c9-b196-d5c6ca34e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:48.705699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f5a13-588e-46c9-b196-d5c6ca34e6ae None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:48.705977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f5a13-588e-46c9-b196-d5c6ca34e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:48.706564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f5a13-588e-46c9-b196-d5c6ca34e6ae None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:48.707759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f5a13-588e-46c9-b196-d5c6ca34e6ae None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:48.709233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f5a13-588e-46c9-b196-d5c6ca34e6ae None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:48.711346 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 118/233] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:48 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:48.716687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:48.821402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:48.861079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea821a-6025-4b40-b57a-195bab2bffaf None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:48.898089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683614-00d6-4b08-abc7-03f847de0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:48.898981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683614-00d6-4b08-abc7-03f847de0ff2 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:48.899256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683614-00d6-4b08-abc7-03f847de0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:48.899528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683614-00d6-4b08-abc7-03f847de0ff2 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/c4c7c3bb3d534141aa2247086ea4eb6c/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:48.905847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683614-00d6-4b08-abc7-03f847de0ff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b8863989e2c40f6810172d2e8d6e388, user_id=c4c7c3bb3d534141aa2247086ea4eb6c, role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:48.907367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683614-00d6-4b08-abc7-03f847de0ff2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:48.936311 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 116/234] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:48 2022] PUT /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/c4c7c3bb3d534141aa2247086ea4eb6c/roles/77c95569fa354b93b35fc5a694f02453 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:49.845151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e594f2-bdce-4624-b695-51cdaa65f397 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:49.845662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e594f2-bdce-4624-b695-51cdaa65f397 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:49.845768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e594f2-bdce-4624-b695-51cdaa65f397 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:49.847313 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 119/235] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:49.856754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d25829-b24b-418a-bd70-25f23fec200a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:49.857205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d25829-b24b-418a-bd70-25f23fec200a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:49.857397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d25829-b24b-418a-bd70-25f23fec200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:49.882801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-47d25829-b24b-418a-bd70-25f23fec200a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:49.884399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47d25829-b24b-418a-bd70-25f23fec200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:49.965672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 117/236] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:49.985194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354a5b-f475-48df-81c3-e9d8c76238e0 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:49.985796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354a5b-f475-48df-81c3-e9d8c76238e0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:49.986264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b354a5b-f475-48df-81c3-e9d8c76238e0 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:49.988113 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 120/237] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:49.994003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025624f-4e56-49eb-bc3b-30fffe6f0509 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:49.994412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025624f-4e56-49eb-bc3b-30fffe6f0509 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:49.994693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025624f-4e56-49eb-bc3b-30fffe6f0509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.002576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b354a5b-f475-48df-81c3-e9d8c76238e0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:50.022363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4025624f-4e56-49eb-bc3b-30fffe6f0509 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:50.023556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4025624f-4e56-49eb-bc3b-30fffe6f0509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:50.119756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:50.148995 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 118/238] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:50.163340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b354a5b-f475-48df-81c3-e9d8c76238e0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:50.201633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025624f-4e56-49eb-bc3b-30fffe6f0509 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:50.223684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:50.224497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:50.224779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:50.225115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.226812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:50.228510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:50.230853 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 121/239] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:50.235852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:50.314057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025624f-4e56-49eb-bc3b-30fffe6f0509 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:50.328560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:50.353593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:50.354793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:50.355271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:50.355738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.374758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:50.386346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f61052-0f0d-46c8-ab79-149fe87f5057 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:50.390643 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:50.391541 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:50.392328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:50.396567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 119/240] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:50.397928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:50.427338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:50.429200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:50.430485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:50.431114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.434084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:50.436235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:50.470837 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 122/241] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:44:50 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:50.505690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:50.574222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b2379-3ac3-4324-9510-df2086f39c9e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:50.627384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:50.628426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:50.628906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:50.629492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.630493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:50.631052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:50.632883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:50.643606 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 120/242] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:50.650313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:50.808420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8bc38-1007-4aef-8122-60f862c80a9e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:50.824462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:50.852232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb16e4c-3dfd-4469-bcfa-9cd7bafa34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:50.853163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16e4c-3dfd-4469-bcfa-9cd7bafa34b8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:50.853449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16e4c-3dfd-4469-bcfa-9cd7bafa34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:50.853730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16e4c-3dfd-4469-bcfa-9cd7bafa34b8 None admin] PATH_INFO: `/v3/users/fde95a57e5674b988190a054d8d261cd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.868413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb16e4c-3dfd-4469-bcfa-9cd7bafa34b8 None admin] RBAC: Authorizing `identity:get_user(user_id=fde95a57e5674b988190a054d8d261cd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:50.869978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb16e4c-3dfd-4469-bcfa-9cd7bafa34b8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:50.871899 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 123/243] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:50 2022] GET /identity/v3/users/fde95a57e5674b988190a054d8d261cd => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:50.877341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:50.930767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac64333-42f9-451a-b724-edae7f194506 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:50.931041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac64333-42f9-451a-b724-edae7f194506 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:50.931251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac64333-42f9-451a-b724-edae7f194506 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.932630 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 124/244] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:50.938271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76684f1-be17-4c5f-9d5f-0d1ae124cae6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:50.938562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76684f1-be17-4c5f-9d5f-0d1ae124cae6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:50.938840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76684f1-be17-4c5f-9d5f-0d1ae124cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:50.962199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c76684f1-be17-4c5f-9d5f-0d1ae124cae6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:50.964108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c76684f1-be17-4c5f-9d5f-0d1ae124cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:51.028938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30dc5-070f-4b98-8465-f4c412a30259 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:51.042020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:51.068852 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 125/245] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:51.082091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:51.082772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:51.083044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:51.083360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:51.110620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76684f1-be17-4c5f-9d5f-0d1ae124cae6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:51.169941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:51.171656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:51.289701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:51.293179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76684f1-be17-4c5f-9d5f-0d1ae124cae6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:51.341978 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 121/246] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:51.347172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:51.365699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:51.367224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77a78-354b-4bd7-a4bd-4eca16e63410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:51.368043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77a78-354b-4bd7-a4bd-4eca16e63410 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:51.368318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77a78-354b-4bd7-a4bd-4eca16e63410 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:51.368631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77a78-354b-4bd7-a4bd-4eca16e63410 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:51.394114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de77a78-354b-4bd7-a4bd-4eca16e63410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-3de77a78-354b-4bd7-a4bd-4eca16e63410 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:51.410238 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:51.411155 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:51.411938 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 126/247] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:51.413323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5d7-d4d8-4abc-a9ab-00e4e6611a4c None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:51.413323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5d7-d4d8-4abc-a9ab-00e4e6611a4c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:51.413486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5d7-d4d8-4abc-a9ab-00e4e6611a4c None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:51.415713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 127/248] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:51.421159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638cbc-8f06-4a89-9509-45c98fb4c06e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:51.421449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638cbc-8f06-4a89-9509-45c98fb4c06e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:51.421724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17638cbc-8f06-4a89-9509-45c98fb4c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:51.455737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-17638cbc-8f06-4a89-9509-45c98fb4c06e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:51.457394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-17638cbc-8f06-4a89-9509-45c98fb4c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:51.479513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303941f5-06e0-45ed-8cbe-0d37e625a667 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:51.540913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:51.541726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:51.541997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:51.542267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:51.543532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:51.545057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:51.547208 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 122/249] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:51 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:51.548049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:51.595466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 128/250] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:51.596338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638cbc-8f06-4a89-9509-45c98fb4c06e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:51.685453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:51.743931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:51.753758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc830b5-8b10-4aff-a2e0-2b71c0d050ab None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:51.756109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17638cbc-8f06-4a89-9509-45c98fb4c06e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:51.794585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:51.795539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:51.795822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:51.796095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:51.796942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] RBAC: Adding query filter params (role.id=eddcd54841c04e12a67598d8bb34631e, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=fde95a57e5674b988190a054d8d261cd) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:51.797277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:51.798753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:51.805732 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 129/251] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:51 2022] GET /identity/v3/role_assignments?user.id=fde95a57e5674b988190a054d8d261cd&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=eddcd54841c04e12a67598d8bb34631e => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:51.806817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:51.875608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:51.876346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:51.876789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:51.877368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:51.878753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:51.879190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:51.880929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:51.906711 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 123/252] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:51.915874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:52.041550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0a62-9901-4519-b694-1521acb5e07d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:52.112251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a910c-64c8-440f-84b8-321863451195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:52.112980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a910c-64c8-440f-84b8-321863451195 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.113305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a910c-64c8-440f-84b8-321863451195 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.113579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a910c-64c8-440f-84b8-321863451195 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.140295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a910c-64c8-440f-84b8-321863451195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-404a910c-64c8-440f-84b8-321863451195 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:52.150826 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:52.151745 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:52.152540 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 130/253] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:52.157202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b6e9-49dc-48ce-8caf-a929b005d115 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.157722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b6e9-49dc-48ce-8caf-a929b005d115 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.158265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b6e9-49dc-48ce-8caf-a929b005d115 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.160387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 131/254] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:52.161627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b6e9-49dc-48ce-8caf-a929b005d115 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:52.176476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0985b8-0700-4c72-bce2-cc876b76eba8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:52.186779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:52.217621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb8aaa-05c8-41b5-8452-1b562b617472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:52.218509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb8aaa-05c8-41b5-8452-1b562b617472 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.218790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb8aaa-05c8-41b5-8452-1b562b617472 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.219069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb8aaa-05c8-41b5-8452-1b562b617472 None admin] PATH_INFO: `/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.220275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb8aaa-05c8-41b5-8452-1b562b617472 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c7c3bb3d534141aa2247086ea4eb6c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:52.221756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb8aaa-05c8-41b5-8452-1b562b617472 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:52.223408 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 124/255] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:51 2022] GET /identity/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:52.233196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8118-d772-4906-949d-e9f1309d34ef None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.233196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8118-d772-4906-949d-e9f1309d34ef None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.233196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8118-d772-4906-949d-e9f1309d34ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.259067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-49ef8118-d772-4906-949d-e9f1309d34ef None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:52.261485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-49ef8118-d772-4906-949d-e9f1309d34ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:52.263910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:52.334403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b6e9-49dc-48ce-8caf-a929b005d115 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:52.360767 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 125/256] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:52.361581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8118-d772-4906-949d-e9f1309d34ef None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:52.436607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:52.437242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.437525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.437800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.438647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:52.438954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:52.440347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:52.450673 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 132/257] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:52.451454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:52.520035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8118-d772-4906-949d-e9f1309d34ef None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:52.537208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:52.563553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e079b-1b22-4d43-a3d0-281ef7e8c9bd None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:52.583386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:52.584048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.584442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.584712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.597222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:52.600684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:52.601865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.602153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.602430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.613660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:52.626776 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:52.627648 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:52.628436 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 133/258] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:44:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:52.630427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:52.735160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:52.736650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:52.761278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639243d-b61b-4972-823b-8a4a36ec9a0a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:52.795749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:52.796749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.798028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.798310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] PATH_INFO: `/v3/users/9ba5b5f6b155447b8737268fe42f24a6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.799680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] RBAC: Authorizing `identity:get_user(user_id=9ba5b5f6b155447b8737268fe42f24a6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:52.801876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:52.806082 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 134/259] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:52 2022] GET /identity/v3/users/9ba5b5f6b155447b8737268fe42f24a6 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:52.806875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:52.814674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:52.916545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6768e-4893-4e56-8bd1-70ea1ca791a4 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:52.945200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 126/260] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:52.946149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:52.956303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:52.957145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:52.957438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:52.957724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:52.958492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:52.958808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:52.960417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:52.968969 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 135/261] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:44:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:52.969882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:53.025971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:53.056675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:53.095963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e94f6-4a40-4555-b0dd-f2060349042d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:53.133536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:53.134590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:53.134813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:53.135127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:53.136551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:53.138185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:53.142407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7a44d-22b4-48f9-bee8-77e8edad8ad8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:53.145233 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 136/262] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:52 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:53.146120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:53.205395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:53.206602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:53.206891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:53.207197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:53.209614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:53.216691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:53.218174 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 127/263] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:52 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:53.221772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:53.283837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba722f-c76f-4aca-b2f9-cf021ddae94d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:53.320465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:53.321374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:53.321660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:53.321935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] PATH_INFO: `/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:53.324753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] RBAC: Authorizing `identity:get_user(user_id=c4c7c3bb3d534141aa2247086ea4eb6c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:53.324753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:53.326526 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 137/264] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:53 2022] GET /identity/v3/users/c4c7c3bb3d534141aa2247086ea4eb6c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:53.327357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:53.330245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:53.412960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136c2e7-8e6d-4b71-b4cb-189cecf114a1 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:53.424177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:53.434811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26fe89-6cbf-4775-83ec-28bc157d094d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:53.468850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:53.469563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:53.469847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:53.470285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:53.471273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=c4c7c3bb3d534141aa2247086ea4eb6c) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:53.471672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:53.472955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:53.473193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:53.474267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:53.474814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:53.475351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/9ba5b5f6b155447b8737268fe42f24a6/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:53.477712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] RBAC: Authorizing `identity:create_grant(project_id=0b8863989e2c40f6810172d2e8d6e388, user_id=9ba5b5f6b155447b8737268fe42f24a6, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:53.479489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 128/265] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:53 2022] GET /identity/v3/role_assignments?user.id=c4c7c3bb3d534141aa2247086ea4eb6c&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:53.485138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:53.485723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:53.508052 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 138/266] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:53 2022] PUT /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/9ba5b5f6b155447b8737268fe42f24a6/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:53.627302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296bc44-13a0-4bf3-ae35-c98b5517ece5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:53.669062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3d2f2-7749-4025-841b-b1f208895688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:53.669789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d2f2-7749-4025-841b-b1f208895688 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:53.670071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d2f2-7749-4025-841b-b1f208895688 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:53.670343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d2f2-7749-4025-841b-b1f208895688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:53.723721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:53.761436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3d2f2-7749-4025-841b-b1f208895688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:53.762954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3d2f2-7749-4025-841b-b1f208895688 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:53.872850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 129/267] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:53.878815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:53.968898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:53.994824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dae8b1-35b5-486f-8027-c54dc18aef8a None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:53.995749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dae8b1-35b5-486f-8027-c54dc18aef8a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:53.996227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dae8b1-35b5-486f-8027-c54dc18aef8a None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.002000 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 130/268] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:54.008765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e86eae-2be7-41d4-bfb9-a4805209186e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.009082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e86eae-2be7-41d4-bfb9-a4805209186e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.009363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e86eae-2be7-41d4-bfb9-a4805209186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.017609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985104b-1775-407f-8751-2851ff4919ef None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:54.039334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-96e86eae-2be7-41d4-bfb9-a4805209186e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:54.040527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-96e86eae-2be7-41d4-bfb9-a4805209186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:54.083611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c286be6-d21a-415d-a071-7edcc12f6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:54.085233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286be6-d21a-415d-a071-7edcc12f6b13 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.085693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286be6-d21a-415d-a071-7edcc12f6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.086168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c286be6-d21a-415d-a071-7edcc12f6b13 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.088454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c286be6-d21a-415d-a071-7edcc12f6b13 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:54.090158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c286be6-d21a-415d-a071-7edcc12f6b13 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:54.094572 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 139/269] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:53 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:54.096407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe58e-1a25-4b4c-8ef2-e5cfbf6d1a2d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.097018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe58e-1a25-4b4c-8ef2-e5cfbf6d1a2d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.097801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe58e-1a25-4b4c-8ef2-e5cfbf6d1a2d None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.099617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 140/270] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:54.100590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe58e-1a25-4b4c-8ef2-e5cfbf6d1a2d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:54.140327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:54.146875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 131/271] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:54.148740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47865d2f-2f08-4f67-b0b8-3d0b87d24043 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.149235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47865d2f-2f08-4f67-b0b8-3d0b87d24043 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.149687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47865d2f-2f08-4f67-b0b8-3d0b87d24043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.168583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-47865d2f-2f08-4f67-b0b8-3d0b87d24043 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:54.170142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47865d2f-2f08-4f67-b0b8-3d0b87d24043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:54.243918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe58e-1a25-4b4c-8ef2-e5cfbf6d1a2d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:54.250049 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 132/272] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:54.251143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47865d2f-2f08-4f67-b0b8-3d0b87d24043 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:54.297232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:54.309060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:54.309060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.309060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.309060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.309451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] RBAC: Adding query filter params (role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=c4c7c3bb3d534141aa2247086ea4eb6c) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:54.309451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:54.310940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:54.318751 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 141/273] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:54 2022] GET /identity/v3/role_assignments?user.id=c4c7c3bb3d534141aa2247086ea4eb6c&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=77c95569fa354b93b35fc5a694f02453 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:54.326188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:54.384217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47865d2f-2f08-4f67-b0b8-3d0b87d24043 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:54.418133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:54.429776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:54.430890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.431314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.431728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.454537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:54.463326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:54.464396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:54.465490 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:54.468061 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 133/274] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:54.476605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:54.574040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507debd5-eefd-472c-b294-c8d2f7a9bf32 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:54.621962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:54.623308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.623308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.623308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.624617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:54.626664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:54.627765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9478f-5027-441a-b5c0-c73769af1f61 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:54.628377 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 142/275] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:54.633923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:54.676756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:54.678470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.678981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.679443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.680394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] RBAC: Adding query filter params (name=member) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:54.680890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:54.683973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:54.701299 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 134/276] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:54.710215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:54.714176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:54.769450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc487df-c68c-4525-9b31-19bfdef7d245 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:54.790344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:54.810668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cefc2-e73d-4014-b79c-f94837c4bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:54.811345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cefc2-e73d-4014-b79c-f94837c4bb74 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.811629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cefc2-e73d-4014-b79c-f94837c4bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.811921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cefc2-e73d-4014-b79c-f94837c4bb74 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.812622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cefc2-e73d-4014-b79c-f94837c4bb74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:54.814117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cefc2-e73d-4014-b79c-f94837c4bb74 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:54.836203 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 143/277] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:44:54 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:44:54.837552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358b94-e966-4c23-80db-327fbd6dca15 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.837833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358b94-e966-4c23-80db-327fbd6dca15 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.838235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0358b94-e966-4c23-80db-327fbd6dca15 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.841082 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 144/278] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:54.845352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861a95-952b-4a86-bb09-329f172ea3fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.845792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861a95-952b-4a86-bb09-329f172ea3fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.845949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861a95-952b-4a86-bb09-329f172ea3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.864331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c660680-e2b3-4a5a-a984-bc12a9c9c42d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:54.886298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c5861a95-952b-4a86-bb09-329f172ea3fd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:54.888800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c5861a95-952b-4a86-bb09-329f172ea3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:54.901949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:54.902860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:54.903205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:54.903482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] PATH_INFO: `/v3/users/8f6fdac4677341dfbe8eca08648de361` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:54.921066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fdac4677341dfbe8eca08648de361)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:54.922605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:54.924770 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 135/279] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:54 2022] GET /identity/v3/users/8f6fdac4677341dfbe8eca08648de361 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:54.931522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:54.984415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 145/280] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:55.012359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861a95-952b-4a86-bb09-329f172ea3fd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:55.061695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2a15-690a-4e63-a701-e0f6ff2c77b6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:55.073956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:55.086538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:55.106807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:55.107472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:55.107747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:55.110595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:55.111461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, user.id=8f6fdac4677341dfbe8eca08648de361, scope.system=all) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:55.111773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:55.113263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:55.121103 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 136/281] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Jun 18 21:44:54 2022] GET /identity/v3/role_assignments?user.id=8f6fdac4677341dfbe8eca08648de361&scope.system=all&role.id=0329a03140564541b142bbc7fc5111a8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:55.154646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861a95-952b-4a86-bb09-329f172ea3fd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:55.196174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:55.197425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:55.197901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:55.198366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:55.211630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:55.219950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:55.221093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:55.222039 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:55.224149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 146/282] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:55.231116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:55.399532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbb92b-32ea-4597-9cea-539d22139193 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:55.439860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:55.440819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:55.441271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:55.441684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:55.442595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:55.443037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:55.444598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:55.454037 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 137/283] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:55.462115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:55.572143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54c19-2c01-4406-b3d9-f7ababaeb5c7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:55.581894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:55.606790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:55.607673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:55.607954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:55.608226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] PATH_INFO: `/v3/users/fde95a57e5674b988190a054d8d261cd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:55.609465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] RBAC: Authorizing `identity:get_user(user_id=fde95a57e5674b988190a054d8d261cd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:55.610934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:55.612896 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 147/284] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:55 2022] GET /identity/v3/users/fde95a57e5674b988190a054d8d261cd => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:55.618779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:55.674105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:55.768916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193b594-afb9-4920-b58d-05cb38dd26eb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:55.815984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b30c9d-f1f0-44c6-86fa-1d5d4c5866cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:55.816903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30c9d-f1f0-44c6-86fa-1d5d4c5866cf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:55.817214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30c9d-f1f0-44c6-86fa-1d5d4c5866cf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:55.817530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b30c9d-f1f0-44c6-86fa-1d5d4c5866cf None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:55.821735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b30c9d-f1f0-44c6-86fa-1d5d4c5866cf None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:55.823214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b30c9d-f1f0-44c6-86fa-1d5d4c5866cf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:55.824938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 138/285] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:55 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:55.830758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:55.953513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef251a5f-af40-426e-adda-304bd3470801 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:55.988426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcaff7-2d31-42aa-ad77-92de19bce546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:55.989366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcaff7-2d31-42aa-ad77-92de19bce546 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:55.989642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcaff7-2d31-42aa-ad77-92de19bce546 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:55.989912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcaff7-2d31-42aa-ad77-92de19bce546 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/fde95a57e5674b988190a054d8d261cd/roles/eddcd54841c04e12a67598d8bb34631e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:56.001910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcaff7-2d31-42aa-ad77-92de19bce546 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b8863989e2c40f6810172d2e8d6e388, user_id=fde95a57e5674b988190a054d8d261cd, role_id=eddcd54841c04e12a67598d8bb34631e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:56.003394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bcaff7-2d31-42aa-ad77-92de19bce546 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:56.028818 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 148/286] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:44:55 2022] PUT /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388/users/fde95a57e5674b988190a054d8d261cd/roles/eddcd54841c04e12a67598d8bb34631e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:56.556038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788714-a566-417e-967c-8b4d4d4355f8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:56.556528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788714-a566-417e-967c-8b4d4d4355f8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:56.556528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788714-a566-417e-967c-8b4d4d4355f8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:56.558226 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 139/287] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:56.563358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b05a9-1e6d-43db-ab1e-b4ae816c9aef None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:56.563818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b05a9-1e6d-43db-ab1e-b4ae816c9aef None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:56.563982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b05a9-1e6d-43db-ab1e-b4ae816c9aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:56.586026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-015b05a9-1e6d-43db-ab1e-b4ae816c9aef None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:56.587217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-015b05a9-1e6d-43db-ab1e-b4ae816c9aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:56.620694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:56.671678 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 149/288] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:56.696517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd788714-a566-417e-967c-8b4d4d4355f8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:56.817726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd788714-a566-417e-967c-8b4d4d4355f8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:56.820591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:56.861020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:56.861849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:56.862130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:56.862405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:56.876898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:56.884849 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:56.885767 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:56.886999 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 140/289] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:56.892250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b05a9-1e6d-43db-ab1e-b4ae816c9aef None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:57.024946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b05a9-1e6d-43db-ab1e-b4ae816c9aef None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:57.060124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:57.060810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:57.061121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:57.061399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:57.062209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:57.062519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:57.063907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:57.073370 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 150/290] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:57.078785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:57.229804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38d50e-5247-4b94-850f-1516b9996985 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:57.276711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:57.277632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:57.277913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:57.278187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] PATH_INFO: `/v3/users/9ba5b5f6b155447b8737268fe42f24a6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:57.279701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] RBAC: Authorizing `identity:get_user(user_id=9ba5b5f6b155447b8737268fe42f24a6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:57.281280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:57.283232 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 141/291] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:57 2022] GET /identity/v3/users/9ba5b5f6b155447b8737268fe42f24a6 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:57.288803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:57.319283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:57.415047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e9cf9-72d3-4de8-970c-bb906576d121 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:57.467083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0ebff-0eeb-46c1-90af-7fb891e175a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:57.467740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0ebff-0eeb-46c1-90af-7fb891e175a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:57.468018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0ebff-0eeb-46c1-90af-7fb891e175a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:57.468286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0ebff-0eeb-46c1-90af-7fb891e175a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:57.555890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0ebff-0eeb-46c1-90af-7fb891e175a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:57.557425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0ebff-0eeb-46c1-90af-7fb891e175a0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:57.595231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:57.685978 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 151/292] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:44:57.691716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:57.734449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:57.748534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1f1a-e308-414b-b92b-395993a7e385 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:57.748828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1f1a-e308-414b-b92b-395993a7e385 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:57.749109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e1f1a-e308-414b-b92b-395993a7e385 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:57.750670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 152/293] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:44:57.758582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9506-3b6e-4b7c-884f-c817eb2cfc06 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:57.759106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9506-3b6e-4b7c-884f-c817eb2cfc06 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:57.759472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9506-3b6e-4b7c-884f-c817eb2cfc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:57.790432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-285f9506-3b6e-4b7c-884f-c817eb2cfc06 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:57.791927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-285f9506-3b6e-4b7c-884f-c817eb2cfc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:57.853954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2737b-9702-4c9e-95c8-d7b3427dfd90 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:57.874026 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 153/294] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:57.905262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a2140-3897-4a5f-b007-ebfc32138855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:57.906799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a2140-3897-4a5f-b007-ebfc32138855 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:57.907493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a2140-3897-4a5f-b007-ebfc32138855 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:57.908182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a2140-3897-4a5f-b007-ebfc32138855 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:57.910688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a2140-3897-4a5f-b007-ebfc32138855 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:57.912680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a2140-3897-4a5f-b007-ebfc32138855 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:57.917085 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 142/295] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:44:57 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:57.922694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f9506-3b6e-4b7c-884f-c817eb2cfc06 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:57.924556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2e2a-cd08-49c0-b366-d051662d2cd9 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:57.924842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2e2a-cd08-49c0-b366-d051662d2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:57.925142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2e2a-cd08-49c0-b366-d051662d2cd9 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:57.929279 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 143/296] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:57.934424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c2e2a-cd08-49c0-b366-d051662d2cd9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:57.990788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:58.042701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f9506-3b6e-4b7c-884f-c817eb2cfc06 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.074758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:58.081449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c2e2a-cd08-49c0-b366-d051662d2cd9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.089097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e59cf-efd9-47cf-9004-a25e07ad6b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.089097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e59cf-efd9-47cf-9004-a25e07ad6b23 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.089097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e59cf-efd9-47cf-9004-a25e07ad6b23 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.089423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e59cf-efd9-47cf-9004-a25e07ad6b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.093064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e59cf-efd9-47cf-9004-a25e07ad6b23 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=9ba5b5f6b155447b8737268fe42f24a6) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:58.093064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e59cf-efd9-47cf-9004-a25e07ad6b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:58.093064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e59cf-efd9-47cf-9004-a25e07ad6b23 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:58.104979 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 154/297] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:44:57 2022] GET /identity/v3/role_assignments?user.id=9ba5b5f6b155447b8737268fe42f24a6&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=0329a03140564541b142bbc7fc5111a8 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:58.106513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96272f50-616f-4bd7-8232-3afc82f1be2f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.106803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96272f50-616f-4bd7-8232-3afc82f1be2f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.107135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96272f50-616f-4bd7-8232-3afc82f1be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.135378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.136555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.137069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.137647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.138334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-96272f50-616f-4bd7-8232-3afc82f1be2f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:58.139182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:58.139625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-96272f50-616f-4bd7-8232-3afc82f1be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:58.141092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:58.142927 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 144/298] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:44:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:58.150327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:58.274249 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 155/299] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:58.311166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96272f50-616f-4bd7-8232-3afc82f1be2f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:58.326050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a646c6-b2cd-46ef-b407-75f53d2d80c4 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.371759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:58.372072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910427c3-8a4a-4579-bc60-3304c4dffe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.372735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910427c3-8a4a-4579-bc60-3304c4dffe65 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.373015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910427c3-8a4a-4579-bc60-3304c4dffe65 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.373317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910427c3-8a4a-4579-bc60-3304c4dffe65 None admin] PATH_INFO: `/v3/groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.374117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910427c3-8a4a-4579-bc60-3304c4dffe65 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:58.375472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910427c3-8a4a-4579-bc60-3304c4dffe65 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:58.393139 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 145/300] 10.222.0.30 () {60 vars in 1134 bytes} [Sat Jun 18 21:44:58 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:44:58.394464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bab45-ec53-4d2a-9dbd-98ddd23c3ff6 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.394758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bab45-ec53-4d2a-9dbd-98ddd23c3ff6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.395039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bab45-ec53-4d2a-9dbd-98ddd23c3ff6 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.396702 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 146/301] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:58.402131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bfb36-699c-4942-ad0c-67c7be76220b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.402503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bfb36-699c-4942-ad0c-67c7be76220b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.402858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bfb36-699c-4942-ad0c-67c7be76220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.423006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dc3bfb36-699c-4942-ad0c-67c7be76220b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:58.424430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dc3bfb36-699c-4942-ad0c-67c7be76220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:58.436578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96272f50-616f-4bd7-8232-3afc82f1be2f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.455260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:58.495597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.496554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.496900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.497331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.513132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:58.517807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 147/302] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:58.523957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:58.524930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:58.525802 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 156/303] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:58.530303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bfb36-699c-4942-ad0c-67c7be76220b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:58.550981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:58.664911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bfb36-699c-4942-ad0c-67c7be76220b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.687546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120fe2-a4ca-46c7-b9d4-e7e6f5e255e0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.702309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:58.714013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.715042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.715370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.715650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.716904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:58.717246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:58.718920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:58.729293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.730188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.730447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 148/304] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:58.730561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.730811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.738589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:58.746179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:58.754395 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:58.755456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:44:58.756637 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 157/305] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:44:58.762064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:58.766946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:58.872216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85e92-f7b7-4a92-adfa-93a7b10d35ce None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.903702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61e073-ea6c-44ed-8f0c-375647f0c5e3 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:58.919253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.920144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.920426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.920700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] PATH_INFO: `/v3/users/7fe35ceb6ae84fba87d2c2c47d85a502` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.935024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] RBAC: Authorizing `identity:get_user(user_id=7fe35ceb6ae84fba87d2c2c47d85a502)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:58.936497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:58.943015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 149/306] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:58 2022] GET /identity/v3/users/7fe35ceb6ae84fba87d2c2c47d85a502 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:58.944661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:58.946761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:58.947666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:58.948155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:58.948627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:58.949620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:58.950144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:58.951755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:58.961984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 158/307] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:58.969170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:59.006508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:59.039602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:59.063369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d652732-a15b-4974-b5c7-7225dfd63aea None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:59.092039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd1d77-fd2b-4f4b-9e67-34c164bb3482 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:59.099742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e8562-a610-4a23-b5fd-b8cf7eee2ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:59.100492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e8562-a610-4a23-b5fd-b8cf7eee2ec9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.100709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e8562-a610-4a23-b5fd-b8cf7eee2ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.100983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e8562-a610-4a23-b5fd-b8cf7eee2ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.101859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e8562-a610-4a23-b5fd-b8cf7eee2ec9 None admin] RBAC: Adding query filter params (role.id=eddcd54841c04e12a67598d8bb34631e, user.id=7fe35ceb6ae84fba87d2c2c47d85a502, scope.system=all) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:59.102485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e8562-a610-4a23-b5fd-b8cf7eee2ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:59.103786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e8562-a610-4a23-b5fd-b8cf7eee2ec9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:59.109073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 150/308] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Jun 18 21:44:58 2022] GET /identity/v3/role_assignments?user.id=7fe35ceb6ae84fba87d2c2c47d85a502&scope.system=all&role.id=eddcd54841c04e12a67598d8bb34631e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:44:59.118679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bd6e6-4720-423c-a79e-0cb9c05ba720 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.118956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bd6e6-4720-423c-a79e-0cb9c05ba720 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.119230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bd6e6-4720-423c-a79e-0cb9c05ba720 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.120601 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 151/309] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:44:59.126916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393fcf-5f6f-4c31-9261-286dbba8b498 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.127194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393fcf-5f6f-4c31-9261-286dbba8b498 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.127384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0393fcf-5f6f-4c31-9261-286dbba8b498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.140176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:59.141324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.144552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.144552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] PATH_INFO: `/v3/users/8f6fdac4677341dfbe8eca08648de361` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.146584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fdac4677341dfbe8eca08648de361)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:59.147849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:59.150002 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 159/310] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:58 2022] GET /identity/v3/users/8f6fdac4677341dfbe8eca08648de361 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:59.155573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a0393fcf-5f6f-4c31-9261-286dbba8b498 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:44:59.156787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a0393fcf-5f6f-4c31-9261-286dbba8b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:44:59.166039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:59.240122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 152/311] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:44:59.267594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0393fcf-5f6f-4c31-9261-286dbba8b498 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:59.299127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08edb-17a1-4cbf-8372-9ff2e1f4759a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:59.300758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:59.340913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:59.341818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.342095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.342368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] PATH_INFO: `/v3/system/users/8f6fdac4677341dfbe8eca08648de361/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.344673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8f6fdac4677341dfbe8eca08648de361, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:59.346368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:59.348967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:59.369149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 160/312] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Jun 18 21:44:59 2022] PUT /identity/v3/system/users/8f6fdac4677341dfbe8eca08648de361/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:44:59.390178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0393fcf-5f6f-4c31-9261-286dbba8b498 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:59.439365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:59.440195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.440471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.440741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.453174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:44:59.461422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:44:59.462397 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:44:59.463209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 153/313] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:44:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:44:59.471125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:59.582251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2414-9592-4d8a-b9b0-5297399f8a28 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:59.618221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:59.618895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.619173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.619446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.620197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:44:59.620503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:59.622023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:59.632958 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 161/314] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:44:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:59.638516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:59.754678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88604c-c3d5-4978-b651-a882c0da9e0f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:59.784502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:59.789674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:59.790559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.790834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.791109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] PATH_INFO: `/v3/users/fde95a57e5674b988190a054d8d261cd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:44:59.792444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] RBAC: Authorizing `identity:get_user(user_id=fde95a57e5674b988190a054d8d261cd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:44:59.793920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:44:59.795893 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 154/315] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:44:59 2022] GET /identity/v3/users/fde95a57e5674b988190a054d8d261cd => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:44:59.801380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:44:59.831687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:44:59.904336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0abfd-0b51-48ae-b219-06f8fe08de65 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:44:59.945257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:44:59.945917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:44:59.946194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:44:59.946466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:00.016547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:00.017955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:00.045171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:00.118496 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 162/316] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:00.126114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:00.230899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762357-6d17-47ca-b60f-0dacbc72ad6a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:00.264449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c586be6-8af3-491f-8ec4-4de047438543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:00.265353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c586be6-8af3-491f-8ec4-4de047438543 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:00.265630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c586be6-8af3-491f-8ec4-4de047438543 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:00.265901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c586be6-8af3-491f-8ec4-4de047438543 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:00.267149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c586be6-8af3-491f-8ec4-4de047438543 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:00.268528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c586be6-8af3-491f-8ec4-4de047438543 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:00.270565 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 155/317] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:00 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:00.276564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:00.385093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ffea-92d0-4fd3-b11e-4008a59bda79 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:00.412184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:00.420246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6a6ba-0462-45b2-8d81-da65cad8ed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:00.420910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a6ba-0462-45b2-8d81-da65cad8ed65 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:00.421216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a6ba-0462-45b2-8d81-da65cad8ed65 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:00.421489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a6ba-0462-45b2-8d81-da65cad8ed65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:00.422325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a6ba-0462-45b2-8d81-da65cad8ed65 None admin] RBAC: Adding query filter params (role.id=eddcd54841c04e12a67598d8bb34631e, scope.project.id=0b8863989e2c40f6810172d2e8d6e388, user.id=fde95a57e5674b988190a054d8d261cd) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:00.422630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a6ba-0462-45b2-8d81-da65cad8ed65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:00.424080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a6ba-0462-45b2-8d81-da65cad8ed65 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:00.430514 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 163/318] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:00 2022] GET /identity/v3/role_assignments?user.id=fde95a57e5674b988190a054d8d261cd&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=eddcd54841c04e12a67598d8bb34631e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:00.894976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824c03e-810c-4489-8a68-8d74ca52ff61 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:00.895558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824c03e-810c-4489-8a68-8d74ca52ff61 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:00.895558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824c03e-810c-4489-8a68-8d74ca52ff61 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:00.897083 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 156/319] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:00.902205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08adc36-5d1f-4e15-8546-4b1d89b621f6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:00.902622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08adc36-5d1f-4e15-8546-4b1d89b621f6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:00.902715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08adc36-5d1f-4e15-8546-4b1d89b621f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:00.921313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e08adc36-5d1f-4e15-8546-4b1d89b621f6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:00.922494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e08adc36-5d1f-4e15-8546-4b1d89b621f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:00.991433 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 164/320] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:01.014976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824c03e-810c-4489-8a68-8d74ca52ff61 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:01.096004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:01.133071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824c03e-810c-4489-8a68-8d74ca52ff61 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:01.171425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6715a0-2406-48e2-ab44-09d82c0e2250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:01.172149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6715a0-2406-48e2-ab44-09d82c0e2250 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.172431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6715a0-2406-48e2-ab44-09d82c0e2250 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.172703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6715a0-2406-48e2-ab44-09d82c0e2250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.173916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6715a0-2406-48e2-ab44-09d82c0e2250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:01.175353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6715a0-2406-48e2-ab44-09d82c0e2250 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:01.177181 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 157/321] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:01.182639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08adc36-5d1f-4e15-8546-4b1d89b621f6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:01.297408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08adc36-5d1f-4e15-8546-4b1d89b621f6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:01.320515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:01.333951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2c412-1246-47ca-a884-ae2cdb2998ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:01.334628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c412-1246-47ca-a884-ae2cdb2998ee None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.334910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c412-1246-47ca-a884-ae2cdb2998ee None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.335181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c412-1246-47ca-a884-ae2cdb2998ee None admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.335885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2c412-1246-47ca-a884-ae2cdb2998ee None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:01.337372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2c412-1246-47ca-a884-ae2cdb2998ee None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:01.361076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 165/322] 10.222.0.30 () {60 vars in 1134 bytes} [Sat Jun 18 21:45:01 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:01.470727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9bef-3cb9-47c0-800a-4c8ddfc02f7e None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.471092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9bef-3cb9-47c0-800a-4c8ddfc02f7e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.471327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9bef-3cb9-47c0-800a-4c8ddfc02f7e None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.472829 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 158/323] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:01.478833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf258-15c5-4744-80f4-9c53ef0ed5c0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.479132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf258-15c5-4744-80f4-9c53ef0ed5c0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.479403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf258-15c5-4744-80f4-9c53ef0ed5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.497584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-09bbf258-15c5-4744-80f4-9c53ef0ed5c0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:01.498801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-09bbf258-15c5-4744-80f4-9c53ef0ed5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:01.584586 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 166/324] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:01.607824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a9bef-3cb9-47c0-800a-4c8ddfc02f7e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:01.720187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a9bef-3cb9-47c0-800a-4c8ddfc02f7e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:01.757629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:01.758806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.759280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.759746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.764853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:01.776187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:01.781605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31714d4-4732-4110-a378-e762ae3ce410 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.781897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31714d4-4732-4110-a378-e762ae3ce410 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.782176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31714d4-4732-4110-a378-e762ae3ce410 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:01.782641 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:01.783491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:45:01.784284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:01.784908 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 167/325] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:01.784974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 159/326] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:01.790227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17665b4-55f4-4608-9f1c-9df66e6d8027 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.790516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17665b4-55f4-4608-9f1c-9df66e6d8027 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.790630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:01.790786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17665b4-55f4-4608-9f1c-9df66e6d8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.817748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a17665b4-55f4-4608-9f1c-9df66e6d8027 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:01.819171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a17665b4-55f4-4608-9f1c-9df66e6d8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:01.902611 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 168/327] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:01.921324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75308e-9f5b-4551-96e2-f0676c4ceeb8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:01.928594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17665b4-55f4-4608-9f1c-9df66e6d8027 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:01.964752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:01.965527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:01.965818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:01.966451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:01.967388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:01.967799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:01.969225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:01.981709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:01.982162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 160/328] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:01.989601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:02.060354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17665b4-55f4-4608-9f1c-9df66e6d8027 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:02.071204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:02.106044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:02.107025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:02.107498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:02.107929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:02.121456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:02.125724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b082920-7a84-43b5-bb47-ca2ce812935c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:02.130904 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:02.131980 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:02.132971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:02.139615 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 169/329] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:02.140975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:02.170123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:02.171476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:02.172283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:02.172871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] PATH_INFO: `/v3/users/7fe35ceb6ae84fba87d2c2c47d85a502` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:02.174712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] RBAC: Authorizing `identity:get_user(user_id=7fe35ceb6ae84fba87d2c2c47d85a502)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:02.176704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:02.179136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 161/330] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:45:01 2022] GET /identity/v3/users/7fe35ceb6ae84fba87d2c2c47d85a502 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:02.185447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:02.323664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613db79-4fd0-4f58-8c3b-b823d437da74 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:02.325365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:02.360794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:02.361547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:02.361830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:02.362101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:02.363028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:02.363329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:02.364899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:02.374095 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 170/331] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:02.379581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:02.411421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16e341-261c-4fe0-aa09-6b6d75814485 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:02.462858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:02.497850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:02.498747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:02.499030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:02.499317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] PATH_INFO: `/v3/system/users/7fe35ceb6ae84fba87d2c2c47d85a502/roles/eddcd54841c04e12a67598d8bb34631e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:02.500868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7fe35ceb6ae84fba87d2c2c47d85a502, role_id=eddcd54841c04e12a67598d8bb34631e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:02.502285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:02.523982 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 162/332] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Jun 18 21:45:02 2022] PUT /identity/v3/system/users/7fe35ceb6ae84fba87d2c2c47d85a502/roles/eddcd54841c04e12a67598d8bb34631e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:45:02.524731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d12d-c7a8-4f4d-bb88-8edcf4b44323 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:02.576025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02f631-28f8-4ff8-ad86-ff70c6289585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:02.576950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f631-28f8-4ff8-ad86-ff70c6289585 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:02.577261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f631-28f8-4ff8-ad86-ff70c6289585 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:02.577534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f631-28f8-4ff8-ad86-ff70c6289585 None admin] PATH_INFO: `/v3/users/8f6fdac4677341dfbe8eca08648de361` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:02.578836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02f631-28f8-4ff8-ad86-ff70c6289585 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6fdac4677341dfbe8eca08648de361)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:02.580278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02f631-28f8-4ff8-ad86-ff70c6289585 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:02.582301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 171/333] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:45:02 2022] GET /identity/v3/users/8f6fdac4677341dfbe8eca08648de361 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:02.588682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:02.730925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286d256-304d-4ffa-91ac-5acf06d12e8b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:02.769683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58109d70-05b0-4568-8a79-9aaf4f1c93b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:02.770354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58109d70-05b0-4568-8a79-9aaf4f1c93b9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:02.770639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58109d70-05b0-4568-8a79-9aaf4f1c93b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:02.770981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58109d70-05b0-4568-8a79-9aaf4f1c93b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:02.771840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58109d70-05b0-4568-8a79-9aaf4f1c93b9 None admin] RBAC: Adding query filter params (role.id=0329a03140564541b142bbc7fc5111a8, user.id=8f6fdac4677341dfbe8eca08648de361, scope.system=all) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:02.772153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58109d70-05b0-4568-8a79-9aaf4f1c93b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:02.773668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58109d70-05b0-4568-8a79-9aaf4f1c93b9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:02.793196 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 163/334] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Jun 18 21:45:02 2022] GET /identity/v3/role_assignments?user.id=8f6fdac4677341dfbe8eca08648de361&scope.system=all&role.id=0329a03140564541b142bbc7fc5111a8 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:04.543907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0f1f9-8369-4b95-b3d1-7762913cca77 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:04.544424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0f1f9-8369-4b95-b3d1-7762913cca77 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:04.544522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0f1f9-8369-4b95-b3d1-7762913cca77 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:04.546127 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 172/335] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:04.551478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f9c4-fcff-400a-a920-79c6bf30c84c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:04.551910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f9c4-fcff-400a-a920-79c6bf30c84c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:04.552013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f9c4-fcff-400a-a920-79c6bf30c84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:04.555270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a195be-45a2-42c7-a9b6-74ef0164fddd None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:04.555550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a195be-45a2-42c7-a9b6-74ef0164fddd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:04.555824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a195be-45a2-42c7-a9b6-74ef0164fddd None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:04.557295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 173/336] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:04.563386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99dc6-aa0b-4f16-9197-b266da2dc8da None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:04.563669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99dc6-aa0b-4f16-9197-b266da2dc8da None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:04.563942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99dc6-aa0b-4f16-9197-b266da2dc8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:04.590008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4e03f9c4-fcff-400a-a920-79c6bf30c84c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:04.591214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4e03f9c4-fcff-400a-a920-79c6bf30c84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:04.597111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1db99dc6-aa0b-4f16-9197-b266da2dc8da None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:04.598540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1db99dc6-aa0b-4f16-9197-b266da2dc8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:04.650678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:04.686870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:04.709250 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 174/337] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:04.721230 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 164/338] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:04.739861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99dc6-aa0b-4f16-9197-b266da2dc8da None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:04.772062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f9c4-fcff-400a-a920-79c6bf30c84c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:04.849836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99dc6-aa0b-4f16-9197-b266da2dc8da None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:04.889181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:04.890012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:04.890290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:04.890560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:04.918027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:04.925685 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:04.926613 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:04.927893 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 175/339] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:04.938141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:04.957528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f9c4-fcff-400a-a920-79c6bf30c84c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:05.000209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:05.042990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:05.043808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:05.044084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:05.044516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:05.066160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:05.074909 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:05.075976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:05.076972 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:05.085875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 165/340] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:45:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:05.112661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:05.173057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62e52d-c48e-4f7e-a6dd-be2497ef20a0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:05.180406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:05.242222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765e699-af49-4cb3-9914-b905004ce115 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:05.278031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab756b2-3596-494d-a73a-b45af1a6bfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:05.278713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab756b2-3596-494d-a73a-b45af1a6bfb3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:05.278996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab756b2-3596-494d-a73a-b45af1a6bfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:05.279276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab756b2-3596-494d-a73a-b45af1a6bfb3 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:05.280038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab756b2-3596-494d-a73a-b45af1a6bfb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:05.280373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab756b2-3596-494d-a73a-b45af1a6bfb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:05.283130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab756b2-3596-494d-a73a-b45af1a6bfb3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:05.285126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d3803-d24f-49b7-b770-35eecb93bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:05.285803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3803-d24f-49b7-b770-35eecb93bf16 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:05.286083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3803-d24f-49b7-b770-35eecb93bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:05.286382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d3803-d24f-49b7-b770-35eecb93bf16 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:05.287150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d3803-d24f-49b7-b770-35eecb93bf16 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:05.287456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d3803-d24f-49b7-b770-35eecb93bf16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:05.288840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d3803-d24f-49b7-b770-35eecb93bf16 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:05.301620 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 166/341] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:05.304247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db5a8-a337-4625-aab1-d906151199c3 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:05.304535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db5a8-a337-4625-aab1-d906151199c3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:05.304839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130db5a8-a337-4625-aab1-d906151199c3 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:05.306143 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 167/342] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:05.312816 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 176/343] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:05.314141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ecec7-281d-4801-af29-05eb0a686aec None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:05.314512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ecec7-281d-4801-af29-05eb0a686aec None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:05.314798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ecec7-281d-4801-af29-05eb0a686aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:05.315514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db5a8-a337-4625-aab1-d906151199c3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:05.352063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b67ecec7-281d-4801-af29-05eb0a686aec None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:05.353298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b67ecec7-281d-4801-af29-05eb0a686aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:05.449277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 177/344] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:05.450521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ecec7-281d-4801-af29-05eb0a686aec None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:05.491985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:05.492461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:05.500496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130db5a8-a337-4625-aab1-d906151199c3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:05.567279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:05.567984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:05.568266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:05.568541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:05.660205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ecec7-281d-4801-af29-05eb0a686aec None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:05.701999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:05.702621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:05.702902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:05.703172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:05.706479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:05.707971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:05.812830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:05.814571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:05.852149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:05.891068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:05.895835 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 168/345] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:05.897506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.024804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031872a0-c6ca-4750-aa54-c956926168e2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.064084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.065114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.065501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.065883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.072239 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 178/346] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:06.073170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.078434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:06.086937 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:06.087951 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:06.088791 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:06.089471 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 169/347] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:06.090029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.168423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:06.206722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614b7ad-615d-4dce-b3fc-e2e7a07332d2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.243568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.244554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.244908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.245289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.246581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:06.248201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:06.250231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 170/348] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:06.251007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.251126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491a75f-4a27-4e3f-b08c-fa2cb40ddd8c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.277510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:06.307137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.308989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.309511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.309981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.311454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:06.313811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:06.316188 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 179/349] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:06.317643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.375395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2de93-cf59-46ec-b0c8-087630889c88 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.410597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:06.426226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb73719-41a1-426e-860f-43018db6b350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.427228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb73719-41a1-426e-860f-43018db6b350 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.427509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb73719-41a1-426e-860f-43018db6b350 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.427780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb73719-41a1-426e-860f-43018db6b350 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.428544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb73719-41a1-426e-860f-43018db6b350 None admin] RBAC: Adding query filter params (name=member) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:06.428843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb73719-41a1-426e-860f-43018db6b350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:06.430701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb73719-41a1-426e-860f-43018db6b350 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:06.441638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024a9bc-6986-437c-a7c5-a4d534feeccc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.442049 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 171/350] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:06.443656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804e876-0ceb-431f-87dc-56dca0df1f23 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.443941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804e876-0ceb-431f-87dc-56dca0df1f23 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.444219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804e876-0ceb-431f-87dc-56dca0df1f23 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.446165 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 172/351] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:06.448880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804e876-0ceb-431f-87dc-56dca0df1f23 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.509362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb0015-54c7-4389-b2ed-a068936fdd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.510859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb0015-54c7-4389-b2ed-a068936fdd41 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.511145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb0015-54c7-4389-b2ed-a068936fdd41 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.511418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb0015-54c7-4389-b2ed-a068936fdd41 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.523423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb0015-54c7-4389-b2ed-a068936fdd41 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:06.525888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb0015-54c7-4389-b2ed-a068936fdd41 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:06.528202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 180/352] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:06.533120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07847a-ff52-407d-aace-67dc774e623b None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.533120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07847a-ff52-407d-aace-67dc774e623b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.533120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07847a-ff52-407d-aace-67dc774e623b None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.533120 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 181/353] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:06.533120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07847a-ff52-407d-aace-67dc774e623b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.595072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:06.643155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804e876-0ceb-431f-87dc-56dca0df1f23 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.665894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07847a-ff52-407d-aace-67dc774e623b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.682387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93b4d5-23a5-4999-8c3c-3f8b260ae438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.682572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b4d5-23a5-4999-8c3c-3f8b260ae438 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.682847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b4d5-23a5-4999-8c3c-3f8b260ae438 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.683119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93b4d5-23a5-4999-8c3c-3f8b260ae438 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.684297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93b4d5-23a5-4999-8c3c-3f8b260ae438 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:06.685850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93b4d5-23a5-4999-8c3c-3f8b260ae438 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:06.687484 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 173/354] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:06.688639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d4819-a67b-4b3e-9242-fdc7e530b0c3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.688921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d4819-a67b-4b3e-9242-fdc7e530b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.689240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d4819-a67b-4b3e-9242-fdc7e530b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.706617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c78d4819-a67b-4b3e-9242-fdc7e530b0c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:06.707817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c78d4819-a67b-4b3e-9242-fdc7e530b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:06.710493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885661-4cd1-4569-8506-874dc1672dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.711099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885661-4cd1-4569-8506-874dc1672dee None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.711497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885661-4cd1-4569-8506-874dc1672dee None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.711774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885661-4cd1-4569-8506-874dc1672dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.776212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:06.788291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17885661-4cd1-4569-8506-874dc1672dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:06.789751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17885661-4cd1-4569-8506-874dc1672dee None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:06.792570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 174/355] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:06.793450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d4819-a67b-4b3e-9242-fdc7e530b0c3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:06.842019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:06.906582 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 182/356] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:06.907895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261fde-722e-4d1a-af80-5312d37767d8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.908181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261fde-722e-4d1a-af80-5312d37767d8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.908456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261fde-722e-4d1a-af80-5312d37767d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.918142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d4819-a67b-4b3e-9242-fdc7e530b0c3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:06.926378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c5261fde-722e-4d1a-af80-5312d37767d8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:06.927616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c5261fde-722e-4d1a-af80-5312d37767d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:06.961799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73727f5-b81c-496e-a00f-91a89e7a9e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:06.965184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73727f5-b81c-496e-a00f-91a89e7a9e34 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.965184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73727f5-b81c-496e-a00f-91a89e7a9e34 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.965184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73727f5-b81c-496e-a00f-91a89e7a9e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.968719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73727f5-b81c-496e-a00f-91a89e7a9e34 None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:06.969170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73727f5-b81c-496e-a00f-91a89e7a9e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:06.970674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73727f5-b81c-496e-a00f-91a89e7a9e34 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:06.981559 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 175/357] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=0329a03140564541b142bbc7fc5111a8 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:06.982908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee385-e7af-4ced-a81f-def3d9dfa314 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:06.983191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee385-e7af-4ced-a81f-def3d9dfa314 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:06.983468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bee385-e7af-4ced-a81f-def3d9dfa314 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:06.984689 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 176/358] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:06.989882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bee385-e7af-4ced-a81f-def3d9dfa314 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.031888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 183/359] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:07.032797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5261fde-722e-4d1a-af80-5312d37767d8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.084988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:07.172811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bee385-e7af-4ced-a81f-def3d9dfa314 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:07.220889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:07.235045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:07.235775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.236055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.236327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.241069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:07.241069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:07.241069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:07.246687 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 177/360] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:06 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=77c95569fa354b93b35fc5a694f02453 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:07.247649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.275310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5261fde-722e-4d1a-af80-5312d37767d8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:07.360356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc393c31-c7b1-4bc2-a882-d9ad1a6f1c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:07.361153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc393c31-c7b1-4bc2-a882-d9ad1a6f1c42 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.361439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc393c31-c7b1-4bc2-a882-d9ad1a6f1c42 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.361715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc393c31-c7b1-4bc2-a882-d9ad1a6f1c42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.377977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc393c31-c7b1-4bc2-a882-d9ad1a6f1c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-cc393c31-c7b1-4bc2-a882-d9ad1a6f1c42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:07.389779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:07.390757 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:07.391567 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 184/361] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:07.392772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b97ff-efe8-4e7d-9183-224864c498a9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.392950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b97ff-efe8-4e7d-9183-224864c498a9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.398923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b97ff-efe8-4e7d-9183-224864c498a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.424987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-243b97ff-efe8-4e7d-9183-224864c498a9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:07.427278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c359dcc-1b58-4713-9815-427494ea5cbf None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:07.431580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-243b97ff-efe8-4e7d-9183-224864c498a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:07.451630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:07.485619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:07.486568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.486847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.487116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.488534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:07.490092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:07.493295 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 178/362] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:07.494828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.540294 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 185/363] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:07.541629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b97ff-efe8-4e7d-9183-224864c498a9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.611310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fccec-012f-41dd-ac8f-9ab2a4ef086c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:07.622130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:07.657261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:07.658825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.659387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.659868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.671526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b97ff-efe8-4e7d-9183-224864c498a9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:07.673436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:07.682395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:07.683403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:07.684211 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:07.686873 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 179/364] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:07.687946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.709088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:07.709813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.709979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.710249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.711008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:07.711317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:07.712716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:07.724199 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 186/365] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:07.725211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.742928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:07.836525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b531f-131b-4009-982e-fafb23f51996 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:07.854205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c181a-ca22-473c-8ea9-dae327729712 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:07.877669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:07.878508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.878783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.879046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.880411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:07.881890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:07.884014 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 180/366] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:07.884792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:07.890016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:07.901669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:07.902487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:07.902769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:07.903505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:07.919492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:07.930351 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:07.931269 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:07.932076 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:07.936360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 187/367] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:07.937852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:08.017607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02cee-d300-492f-b9d0-a6f73a3a26e4 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:08.041051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:08.059034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802625c-cbc1-4ad5-adff-675bf7454d31 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:08.067808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:08.068491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:08.068772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:08.069059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:08.069943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:08.070250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:08.071729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:08.084589 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 181/368] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:08.085622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:08.099184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:08.100609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:08.100897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:08.101207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] PATH_INFO: `/v3/users/7fe35ceb6ae84fba87d2c2c47d85a502` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:08.102888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] RBAC: Authorizing `identity:get_user(user_id=7fe35ceb6ae84fba87d2c2c47d85a502)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:08.104914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:08.107745 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 188/369] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:45:07 2022] GET /identity/v3/users/7fe35ceb6ae84fba87d2c2c47d85a502 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:08.108906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:08.185759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:08.218617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde0136-6ddf-41d2-8475-b6db7e3607df None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:08.242606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec3f33-2b09-4b0a-b6ad-219cf39e454c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:08.263814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:08.264489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:08.264773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:08.265067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:08.266375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=0b8863989e2c40f6810172d2e8d6e388) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:08.266695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:08.268617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:08.282433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:08.283099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:08.283378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:08.283651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:08.284405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:08.284707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:08.285142 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 182/370] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:08 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=0329a03140564541b142bbc7fc5111a8 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:08.286043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:08.286244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:08.306099 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 189/371] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:08.306973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:08.366549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:08.475024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011ba5-f8b5-460d-97e6-145b489142cc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:08.486788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2570e-96bd-49c4-a9e5-2acb5904e46e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:08.512129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:08.517641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:08.518317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:08.518598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:08.518987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:08.519832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] RBAC: Adding query filter params (role.id=eddcd54841c04e12a67598d8bb34631e, user.id=7fe35ceb6ae84fba87d2c2c47d85a502, scope.system=all) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:08.520142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:08.521918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:08.536492 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 190/372] 10.222.0.30 () {56 vars in 1308 bytes} [Sat Jun 18 21:45:08 2022] GET /identity/v3/role_assignments?user.id=7fe35ceb6ae84fba87d2c2c47d85a502&scope.system=all&role.id=eddcd54841c04e12a67598d8bb34631e => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:08.537446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:08.552752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:08.553453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:08.553739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:08.554019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:08.656031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c3a1-114a-4bb9-9d4b-09eec8cff5fc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:08.683011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:08.684495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:08.695297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:08.695956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:08.696239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:08.696515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:08.745635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:08.782907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:08.784404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:08.789412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:08.873156 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 183/373] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:08.879194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:08.944623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 191/374] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:08.949938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:09.093270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e5c56-c6a0-4edf-a36b-d7158cb930ee None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:09.137397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:09.142461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8bb27-bc86-410f-bf3c-016b501b6098 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:09.158324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:09.159202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:09.159484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:09.159758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:09.165780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:09.167256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:09.169332 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 184/375] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:08 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:09.174648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:09.187445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:09.188562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:09.188987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:09.189420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] PATH_INFO: `/v3/projects/66f428458e264ccfa7aaee63beb4b0a3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:09.190176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:09.192082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] RBAC: Authorizing `identity:get_project(project_id=66f428458e264ccfa7aaee63beb4b0a3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:09.194385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:09.196417 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 192/376] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:08 2022] GET /identity/v3/projects/66f428458e264ccfa7aaee63beb4b0a3 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:09.203160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:09.310411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9ecf-731c-432d-a84e-cef1b2212a5e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:09.318091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b86ff-79b9-49e8-992a-3c2a4fa55b1e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:09.346506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:09.347373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:09.347647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:09.348082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:09.350537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:09.352158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:09.354286 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 185/377] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:09 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:09.355313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:09.356302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:09.356578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:09.356851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] PATH_INFO: `/v3/groups/71f783bc1f51401ebbf78bf313482e05` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:09.361984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:09.362157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] RBAC: Authorizing `identity:get_group(group_id=71f783bc1f51401ebbf78bf313482e05)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:09.363810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:09.366199 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 193/378] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:09 2022] GET /identity/v3/groups/71f783bc1f51401ebbf78bf313482e05 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:09.372035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:09.386696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:09.479721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:09.483404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076b31-7d19-4ce1-b2f3-ccfabd2b876c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:09.516643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67450f50-7041-4c8b-9803-1ae39cfbc9fe None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:09.520634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b89538-6be0-4e64-a87c-9c21cebc7dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:09.521570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b89538-6be0-4e64-a87c-9c21cebc7dc9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:09.522025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b89538-6be0-4e64-a87c-9c21cebc7dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:09.522685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b89538-6be0-4e64-a87c-9c21cebc7dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:09.523787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b89538-6be0-4e64-a87c-9c21cebc7dc9 None admin] RBAC: Adding query filter params (group.id=71f783bc1f51401ebbf78bf313482e05, role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=66f428458e264ccfa7aaee63beb4b0a3) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:09.524286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b89538-6be0-4e64-a87c-9c21cebc7dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:09.525934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b89538-6be0-4e64-a87c-9c21cebc7dc9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:09.532540 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 194/379] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:09 2022] GET /identity/v3/role_assignments?group.id=71f783bc1f51401ebbf78bf313482e05&scope.project.id=66f428458e264ccfa7aaee63beb4b0a3&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:09.572902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f67544-afb3-48f5-b8b7-18311eb0b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:09.573541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67544-afb3-48f5-b8b7-18311eb0b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:09.573822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67544-afb3-48f5-b8b7-18311eb0b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:09.574098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f67544-afb3-48f5-b8b7-18311eb0b5a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:09.574955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67544-afb3-48f5-b8b7-18311eb0b5a7 None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=0b8863989e2c40f6810172d2e8d6e388) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:09.575266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67544-afb3-48f5-b8b7-18311eb0b5a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:09.576743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f67544-afb3-48f5-b8b7-18311eb0b5a7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:09.584148 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 186/380] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:09 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=77c95569fa354b93b35fc5a694f02453 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:10.297965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f512e-bedd-4355-898f-3143eda6de66 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.299002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f512e-bedd-4355-898f-3143eda6de66 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.299486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f512e-bedd-4355-898f-3143eda6de66 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.301069 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 195/381] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:10.307363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23db7-35d2-4553-88be-c1acf6dcb688 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.308162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23db7-35d2-4553-88be-c1acf6dcb688 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.308625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c23db7-35d2-4553-88be-c1acf6dcb688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.326759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-29c23db7-35d2-4553-88be-c1acf6dcb688 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:10.328258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-29c23db7-35d2-4553-88be-c1acf6dcb688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:10.339206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5a458-c428-4c3d-9670-94661b9d09bf None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.339791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5a458-c428-4c3d-9670-94661b9d09bf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.340297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5a458-c428-4c3d-9670-94661b9d09bf None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.342077 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 196/382] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:10.347042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f90c2-e1c5-4ebf-bbea-51325383c24c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.347589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f90c2-e1c5-4ebf-bbea-51325383c24c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.348061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f90c2-e1c5-4ebf-bbea-51325383c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.375245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ed5f90c2-e1c5-4ebf-bbea-51325383c24c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:10.376447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ed5f90c2-e1c5-4ebf-bbea-51325383c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:10.430329 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 187/383] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:10.462323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23db7-35d2-4553-88be-c1acf6dcb688 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:10.494494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 197/384] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:10.534626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f90c2-e1c5-4ebf-bbea-51325383c24c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:10.537368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:10.550683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:10.623522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c23db7-35d2-4553-88be-c1acf6dcb688 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:10.651301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f90c2-e1c5-4ebf-bbea-51325383c24c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:10.687230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:10.688424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.688893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.689380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.700831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:10.706061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:10.706885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.707165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.707439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:10.710359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:10.711245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:10.712059 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:10.714926 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 198/385] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:45:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:10.723096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:10.735991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:10.746310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:10.747193 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:10.747980 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 188/386] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:10.754744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:10.798535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:10.861868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78834d74-9735-4450-8fa7-ac697b0fd41e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:10.912317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:10.912998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.913300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.913644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.914339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:10.914640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:10.916044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:10.929007 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 199/387] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:10.934147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:10.940153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0cb9f-219b-4757-9241-8b2273652289 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:10.974186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:10.983752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:10.984441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:10.984725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:10.985021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:10.985805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:10.986113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:10.987501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:11.003742 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 189/388] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:11.010220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:11.106597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109481c-c285-4139-b3ee-856c74bc0735 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:11.153088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:11.170835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014cf41-e2cd-42e3-a914-60d5b1ab98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:11.171728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014cf41-e2cd-42e3-a914-60d5b1ab98a5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.172256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014cf41-e2cd-42e3-a914-60d5b1ab98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.172550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014cf41-e2cd-42e3-a914-60d5b1ab98a5 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.174717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014cf41-e2cd-42e3-a914-60d5b1ab98a5 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:11.176508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014cf41-e2cd-42e3-a914-60d5b1ab98a5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:11.179178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 200/389] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:10 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:11.180585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6742fe-65f8-4159-b2ff-31ac2cf04f8f None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.180883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6742fe-65f8-4159-b2ff-31ac2cf04f8f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.181192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6742fe-65f8-4159-b2ff-31ac2cf04f8f None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.182508 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 201/390] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:11.185253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6742fe-65f8-4159-b2ff-31ac2cf04f8f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:11.200876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729cb78-bdfe-41a2-8f59-6ddd466718d6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:11.237825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0b810-bfa7-4193-8e3a-6984dd1e38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:11.238739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b810-bfa7-4193-8e3a-6984dd1e38a3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.239018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b810-bfa7-4193-8e3a-6984dd1e38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.239358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b810-bfa7-4193-8e3a-6984dd1e38a3 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.240663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0b810-bfa7-4193-8e3a-6984dd1e38a3 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:11.242173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0b810-bfa7-4193-8e3a-6984dd1e38a3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:11.244294 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 190/391] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:11 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:11.245658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4952-1ee3-452f-9d7d-e733864c9fbf None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.245939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4952-1ee3-452f-9d7d-e733864c9fbf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.246209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c4952-1ee3-452f-9d7d-e733864c9fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.267435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6f0c4952-1ee3-452f-9d7d-e733864c9fbf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:11.268805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6f0c4952-1ee3-452f-9d7d-e733864c9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:11.314661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6742fe-65f8-4159-b2ff-31ac2cf04f8f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:11.336577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:11.359317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:11.360461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.360886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.361344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.362692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:11.364385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:11.365485 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 191/392] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:11.366636 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 202/393] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:11 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:11.366815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c4952-1ee3-452f-9d7d-e733864c9fbf None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:11.373023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:11.446034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:11.494031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c4952-1ee3-452f-9d7d-e733864c9fbf None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:11.500007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87b3a-626f-4abd-a3e0-909b7857777d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:11.534083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:11.534951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.535234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.535509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.536775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:11.538213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:11.540292 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 192/394] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:11 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:11.541065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:11.551506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:11.553132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.553953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.554697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.558055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c320ef8324d0b95d89216c9c6bc1e, group_id=6dc4d5506ebf41a4850caa4239e34a8a, role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:11.559974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:11.578678 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 203/395] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Jun 18 21:45:11 2022] PUT /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/77c95569fa354b93b35fc5a694f02453 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:45:11.579784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:11.624673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:11.710741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ec14b-803e-41c9-a139-a5bd128a9677 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:11.722934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9e4c9-da68-47a5-ad43-3cacb4891938 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:11.736868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:11.755859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:11.757239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.758189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.758834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.762413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c320ef8324d0b95d89216c9c6bc1e, group_id=6dc4d5506ebf41a4850caa4239e34a8a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:11.764236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:11.784145 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 204/396] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Jun 18 21:45:11 2022] PUT /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:11.799832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:11.801145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:11.801695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:11.802253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:11.815633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:11.824501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:11.825621 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:11.826446 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:11.829153 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 193/397] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:11.838250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:11.987721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05220e-b09c-461b-b455-7e3e53acbd8d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:12.028160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:12.028160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.028160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.028160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.028560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:12.028560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:12.029642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:12.039290 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 205/398] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:12.044867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:12.150772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb629-a6b1-4659-8150-8d5857f054ed None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:12.168631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:12.188190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:12.189253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.189538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.189814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.191000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:12.192514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:12.194667 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 194/399] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:12 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:12.207008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:12.269081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:12.368969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6400f-666d-493e-aa4e-0db66bcfea4d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:12.426833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaff1f6-043d-4105-9450-f1b880b1a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:12.427702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaff1f6-043d-4105-9450-f1b880b1a46c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.427980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaff1f6-043d-4105-9450-f1b880b1a46c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.428252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaff1f6-043d-4105-9450-f1b880b1a46c None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.433791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaff1f6-043d-4105-9450-f1b880b1a46c None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:12.435257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaff1f6-043d-4105-9450-f1b880b1a46c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:12.437346 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 206/400] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:12 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:12.443030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:12.521835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564506e6-0348-4496-b127-9d3c09c61119 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.522127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564506e6-0348-4496-b127-9d3c09c61119 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.522290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564506e6-0348-4496-b127-9d3c09c61119 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.530131 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 207/401] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:12.535048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4df5c-cb63-4124-9617-5f9d80b266a1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.535332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4df5c-cb63-4124-9617-5f9d80b266a1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.535601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4df5c-cb63-4124-9617-5f9d80b266a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.556105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-71e4df5c-cb63-4124-9617-5f9d80b266a1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:12.557579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71e4df5c-cb63-4124-9617-5f9d80b266a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:12.558491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527a8d5-206c-4483-87b4-73117c3fad31 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:12.593667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24d3c6-9dc3-490f-b272-c3ea0b1f657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:12.594648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24d3c6-9dc3-490f-b272-c3ea0b1f657b None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.594933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24d3c6-9dc3-490f-b272-c3ea0b1f657b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.595211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24d3c6-9dc3-490f-b272-c3ea0b1f657b None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.597310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24d3c6-9dc3-490f-b272-c3ea0b1f657b None admin] RBAC: Authorizing `identity:create_grant(project_id=0b8863989e2c40f6810172d2e8d6e388, group_id=6dc4d5506ebf41a4850caa4239e34a8a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:12.599142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24d3c6-9dc3-490f-b272-c3ea0b1f657b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:12.619535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 195/402] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Jun 18 21:45:12 2022] PUT /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:12.621598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d5e6-7356-4d12-bdb0-def5e7b56cdd None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.621890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d5e6-7356-4d12-bdb0-def5e7b56cdd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.622170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d5e6-7356-4d12-bdb0-def5e7b56cdd None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.624479 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 196/403] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:12.629350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8509-dd86-4893-8fcc-fe4e1300ed24 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.629725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8509-dd86-4893-8fcc-fe4e1300ed24 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.630111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d8509-dd86-4893-8fcc-fe4e1300ed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.650319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5c8d8509-dd86-4893-8fcc-fe4e1300ed24 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:12.651528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5c8d8509-dd86-4893-8fcc-fe4e1300ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:12.659498 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 208/404] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:12.698569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4df5c-cb63-4124-9617-5f9d80b266a1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:12.716667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:12.774900 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 197/405] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:12.791611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:12.829926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8509-dd86-4893-8fcc-fe4e1300ed24 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:12.856840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4df5c-cb63-4124-9617-5f9d80b266a1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:12.895738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:12.896923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:12.897421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:12.897988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:12.917999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:12.928113 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:12.929001 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:12.929833 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 209/406] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:45:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:12.938008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:12.957124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d8509-dd86-4893-8fcc-fe4e1300ed24 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:12.999599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.001763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.003358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.003787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.053680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:13.061464 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:13.062640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:13.063629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:13.069533 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 198/407] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:13.082138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:13.090352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:13.094073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e11ee9-746a-445a-a70e-8e8ed278a0ef None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:13.150197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:13.174631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.175537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.175977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.176394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.179373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:13.179963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:13.184098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:13.203302 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 210/408] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:13.210718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:13.231896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285048-da91-4ef0-938d-2045ebc8067d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:13.266597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.267270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.267546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.267819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.268569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:13.268872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:13.270416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:13.278820 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 199/409] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:13.284345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:13.378800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:13.385799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d230c0-dffd-468b-b95e-6ef89fbd901a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:13.421346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.422310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.422592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.422861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] PATH_INFO: `/v3/groups/71f783bc1f51401ebbf78bf313482e05` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.424050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] RBAC: Authorizing `identity:get_group(group_id=71f783bc1f51401ebbf78bf313482e05)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:13.425729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:13.427752 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 200/410] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:13 2022] GET /identity/v3/groups/71f783bc1f51401ebbf78bf313482e05 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:13.433208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:13.447468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f114c-25d6-47c3-abcd-a85e321a92f5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:13.489769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.490752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.491035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.491364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.492596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:13.494123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:13.495760 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 211/411] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:13 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:13.502406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:13.541761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:13.570565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b853077-8fe7-4070-a24f-cf30931f0db5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:13.608193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072875d-a604-46ad-86f8-a2bc4e5fb7a0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:13.626806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.628049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.628528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.629066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] PATH_INFO: `/v3/projects/66f428458e264ccfa7aaee63beb4b0a3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.636444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] RBAC: Authorizing `identity:get_project(project_id=66f428458e264ccfa7aaee63beb4b0a3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:13.638108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:13.641701 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 201/412] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:13 2022] GET /identity/v3/projects/66f428458e264ccfa7aaee63beb4b0a3 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:13.646729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:13.676899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.678530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:13.678871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.679776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.680304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.685435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:13.687128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:13.689455 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 212/413] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:13 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:13.696653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:13.755947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e72a-d861-41c0-8f2c-203f23906790 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:13.794462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210c0d9-cec8-4c51-9f7f-447156f7ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:13.795374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c0d9-cec8-4c51-9f7f-447156f7ffa6 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:13.795652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c0d9-cec8-4c51-9f7f-447156f7ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:13.795935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c0d9-cec8-4c51-9f7f-447156f7ffa6 None admin] PATH_INFO: `/v3/projects/66f428458e264ccfa7aaee63beb4b0a3/groups/71f783bc1f51401ebbf78bf313482e05/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:13.798754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210c0d9-cec8-4c51-9f7f-447156f7ffa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=66f428458e264ccfa7aaee63beb4b0a3, group_id=71f783bc1f51401ebbf78bf313482e05, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:13.800290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210c0d9-cec8-4c51-9f7f-447156f7ffa6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:13.828948 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 202/414] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Jun 18 21:45:13 2022] PUT /identity/v3/projects/66f428458e264ccfa7aaee63beb4b0a3/groups/71f783bc1f51401ebbf78bf313482e05/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:13.948890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:13.957134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c3789-32c6-4a3b-aa68-9d21c155a789 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:14.012758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e743f74-a0d3-40d9-bb9c-0952d567147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:14.013751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743f74-a0d3-40d9-bb9c-0952d567147a None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:14.014034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743f74-a0d3-40d9-bb9c-0952d567147a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:14.014303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743f74-a0d3-40d9-bb9c-0952d567147a None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:14.017926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e743f74-a0d3-40d9-bb9c-0952d567147a None admin] RBAC: Authorizing `identity:create_grant(project_id=0b8863989e2c40f6810172d2e8d6e388, group_id=6dc4d5506ebf41a4850caa4239e34a8a, role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:14.019673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e743f74-a0d3-40d9-bb9c-0952d567147a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:14.043406 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 213/415] 10.222.0.30 () {58 vars in 1442 bytes} [Sat Jun 18 21:45:13 2022] PUT /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388/groups/6dc4d5506ebf41a4850caa4239e34a8a/roles/77c95569fa354b93b35fc5a694f02453 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:45:14.518338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594609bd-8491-4ad7-bfc1-eb70c784a8c8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:14.519058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594609bd-8491-4ad7-bfc1-eb70c784a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:14.519536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594609bd-8491-4ad7-bfc1-eb70c784a8c8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:14.521442 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 203/416] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:14.526685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291eac2-1c6c-4b41-9200-94c240709890 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:14.527133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291eac2-1c6c-4b41-9200-94c240709890 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:14.527133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291eac2-1c6c-4b41-9200-94c240709890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:14.548144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0291eac2-1c6c-4b41-9200-94c240709890 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:14.549334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0291eac2-1c6c-4b41-9200-94c240709890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:14.645227 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 214/417] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:14.686476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594609bd-8491-4ad7-bfc1-eb70c784a8c8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:14.820512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:14.832734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594609bd-8491-4ad7-bfc1-eb70c784a8c8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:14.882882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e409-3387-4d4e-a161-947b269d7d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:14.884067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e409-3387-4d4e-a161-947b269d7d86 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:14.884545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e409-3387-4d4e-a161-947b269d7d86 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:14.885054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e409-3387-4d4e-a161-947b269d7d86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:14.902394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0e409-3387-4d4e-a161-947b269d7d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-71c0e409-3387-4d4e-a161-947b269d7d86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:14.910708 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:14.911587 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:14.912383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:14.915189 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 204/418] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:45:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:14.920730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291eac2-1c6c-4b41-9200-94c240709890 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:15.034777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145c29-b447-41ce-92c6-685601f36dad None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.035063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145c29-b447-41ce-92c6-685601f36dad None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.035348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4145c29-b447-41ce-92c6-685601f36dad None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.037087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 205/419] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:15.045062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaea2c6-b0cb-4258-8100-63873aede5c7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.045543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaea2c6-b0cb-4258-8100-63873aede5c7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.045920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaea2c6-b0cb-4258-8100-63873aede5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.061163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:15.076102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291eac2-1c6c-4b41-9200-94c240709890 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:15.094055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dcaea2c6-b0cb-4258-8100-63873aede5c7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:15.095367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dcaea2c6-b0cb-4258-8100-63873aede5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:15.116922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:15.117627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.117906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.118181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.118933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:15.119236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:15.120615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:15.136290 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 215/420] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:15.146102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:15.208673 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 206/421] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:15.231123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaea2c6-b0cb-4258-8100-63873aede5c7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:15.332819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:15.343247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935b2a-c848-48dc-80c3-3fdfe3da282b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:15.354361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaea2c6-b0cb-4258-8100-63873aede5c7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:15.384667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65fa80-1c3c-4a15-b17f-767034c6851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:15.385617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65fa80-1c3c-4a15-b17f-767034c6851b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.385899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65fa80-1c3c-4a15-b17f-767034c6851b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.386255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65fa80-1c3c-4a15-b17f-767034c6851b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.389162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5d221-70f5-4a7c-9a86-f8fe3d7e9575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:15.390200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5d221-70f5-4a7c-9a86-f8fe3d7e9575 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.390531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5d221-70f5-4a7c-9a86-f8fe3d7e9575 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.390873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5d221-70f5-4a7c-9a86-f8fe3d7e9575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.401679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5d221-70f5-4a7c-9a86-f8fe3d7e9575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:15.408346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-19e5d221-70f5-4a7c-9a86-f8fe3d7e9575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:15.409523 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:15.410380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:15.411244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:15.416462 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 207/422] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:15.417560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968094-9090-4f1e-bdf4-9b6586fd8619 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.417965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968094-9090-4f1e-bdf4-9b6586fd8619 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.418246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968094-9090-4f1e-bdf4-9b6586fd8619 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.419733 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 208/423] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:15.424010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0968094-9090-4f1e-bdf4-9b6586fd8619 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:15.477763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65fa80-1c3c-4a15-b17f-767034c6851b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:15.479316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65fa80-1c3c-4a15-b17f-767034c6851b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:15.552065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0968094-9090-4f1e-bdf4-9b6586fd8619 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:15.587171 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 216/424] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:15.589086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d561-22f6-4cc8-94e8-08f0aecfc13e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.589531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d561-22f6-4cc8-94e8-08f0aecfc13e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.590151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d561-22f6-4cc8-94e8-08f0aecfc13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.599145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:15.599887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.600233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.600576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.601489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] RBAC: Adding query filter params (name=member) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:15.601878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:15.603379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:15.612006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3b27d561-22f6-4cc8-94e8-08f0aecfc13e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:15.613448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b27d561-22f6-4cc8-94e8-08f0aecfc13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:15.617387 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 209/425] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:15.618684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:15.623008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:15.671435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:15.694889 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 217/426] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:15.701082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27d561-22f6-4cc8-94e8-08f0aecfc13e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:15.760969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eb17e-7dad-4748-98df-94a9d632a8bc None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:15.798365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:15.799508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.799924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.800331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.801771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:15.803362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:15.805562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 210/427] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:15 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:15.806533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:15.837137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27d561-22f6-4cc8-94e8-08f0aecfc13e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:15.876681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:15.877698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.878119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.878569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.894256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:15.933456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee824f8-5d14-4c09-89be-0bc6367fe5c8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:15.946504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:15.970756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:15.971824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:15.972278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:15.972723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:15.972968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:15.974782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:15.984870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:15.993383 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:15.994288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 18 21:45:15.995083 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:15.997535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 211/428] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:15.998559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.114840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 218/429] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:16.115589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.130738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a813c-848d-44d1-897d-e8ce14d4a4b6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.162225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:16.168564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.169836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.170315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.170780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.172165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.173893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.176059 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 212/430] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:15 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:16.177174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.222200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:16.250770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64930c93-84a3-4c39-ad4d-08d30437b7e4 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.287427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f55121-f934-4359-9aa9-3f60ed2fe2a5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.298477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.299599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.299893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.300209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.301338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:16.301651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.303326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.315090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 219/431] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:16.317304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.332330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.333626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.334123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.334589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] PATH_INFO: `/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.336021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=e57c320ef8324d0b95d89216c9c6bc1e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.337748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.340043 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 213/432] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/projects/e57c320ef8324d0b95d89216c9c6bc1e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:16.341133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.420077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:16.451440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008830c-1663-49ea-ba2c-03c565831cc1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.456303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246abde-3bee-4400-9500-678607b5f1b2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.496856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151a31-a69f-4eb7-9d1c-e34790678aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.497458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.497578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151a31-a69f-4eb7-9d1c-e34790678aaa None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.497823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151a31-a69f-4eb7-9d1c-e34790678aaa None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.498102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151a31-a69f-4eb7-9d1c-e34790678aaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.498824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.499295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.499757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.500790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:16.501326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.502960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.513309 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 220/433] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=77c95569fa354b93b35fc5a694f02453 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:16.518181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.531316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:16.591636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151a31-a69f-4eb7-9d1c-e34790678aaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.593132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151a31-a69f-4eb7-9d1c-e34790678aaa None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.662540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db393c-7627-4ae8-90b8-b50097c7b090 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.669086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:16.713698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cec36-a474-4167-a164-50cf436d7045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.714763 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 214/434] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:16.715481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cec36-a474-4167-a164-50cf436d7045 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.715899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cec36-a474-4167-a164-50cf436d7045 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.716306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cec36-a474-4167-a164-50cf436d7045 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.716653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53f209-dda6-4f64-8bab-cef2c5f847bb None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.717052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53f209-dda6-4f64-8bab-cef2c5f847bb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.717427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53f209-dda6-4f64-8bab-cef2c5f847bb None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.718164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cec36-a474-4167-a164-50cf436d7045 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.723080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 215/435] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:16.723080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53f209-dda6-4f64-8bab-cef2c5f847bb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.724148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cec36-a474-4167-a164-50cf436d7045 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.726558 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 221/436] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:16.728867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963422-60f8-490a-af7d-a2687ddf6044 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.729198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963422-60f8-490a-af7d-a2687ddf6044 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.729477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4963422-60f8-490a-af7d-a2687ddf6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.755351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a4963422-60f8-490a-af7d-a2687ddf6044 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:16.756884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a4963422-60f8-490a-af7d-a2687ddf6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:16.842678 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 222/437] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:16.844010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4963422-60f8-490a-af7d-a2687ddf6044 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.850904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:16.853153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53f209-dda6-4f64-8bab-cef2c5f847bb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.888021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1c4d6-4fe5-45ad-a773-599af529602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.888886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c4d6-4fe5-45ad-a773-599af529602b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.889201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c4d6-4fe5-45ad-a773-599af529602b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.889473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c4d6-4fe5-45ad-a773-599af529602b None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.890637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1c4d6-4fe5-45ad-a773-599af529602b None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.892065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1c4d6-4fe5-45ad-a773-599af529602b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.893788 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 216/438] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:16.895095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d8e72-0d6b-4eda-8612-def72240811d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.895374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d8e72-0d6b-4eda-8612-def72240811d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.895644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d8e72-0d6b-4eda-8612-def72240811d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.896978 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 217/439] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:16.897617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d8e72-0d6b-4eda-8612-def72240811d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:16.933247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:16.950013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4963422-60f8-490a-af7d-a2687ddf6044 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:16.982091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:16.982672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:16.982947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:16.983492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:16.984322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:16.984626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:16.986112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:16.992339 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 223/440] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=e57c320ef8324d0b95d89216c9c6bc1e&role.id=0329a03140564541b142bbc7fc5111a8 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:16.993139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.003559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d8e72-0d6b-4eda-8612-def72240811d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.050603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96d5c5-d6b3-41c6-8fd1-f6a2c44843e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.051779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d5c5-d6b3-41c6-8fd1-f6a2c44843e8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.052085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d5c5-d6b3-41c6-8fd1-f6a2c44843e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.052332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96d5c5-d6b3-41c6-8fd1-f6a2c44843e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.070071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96d5c5-d6b3-41c6-8fd1-f6a2c44843e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-dd96d5c5-d6b3-41c6-8fd1-f6a2c44843e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:17.077911 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:17.078912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:17.079712 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 218/441] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:17.081528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01778c73-9d3b-4f83-925f-8b787cf0bdca None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.081528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01778c73-9d3b-4f83-925f-8b787cf0bdca None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.081528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01778c73-9d3b-4f83-925f-8b787cf0bdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.087049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:17.100632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-01778c73-9d3b-4f83-925f-8b787cf0bdca None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:17.102162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-01778c73-9d3b-4f83-925f-8b787cf0bdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:17.126796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9305881-5c75-4762-bbeb-c062601b59f2 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.164962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.165884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.166149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.166420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.167660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:17.169166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:17.175724 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 224/442] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:16 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:17.175724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.183180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 219/443] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:17.183906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01778c73-9d3b-4f83-925f-8b787cf0bdca None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.215618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:17.287445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc57ea-6dd5-436d-baf5-2c8fbce01447 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.315016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01778c73-9d3b-4f83-925f-8b787cf0bdca None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.326911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.327601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.327885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.328156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.328908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:17.329260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:17.331116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:17.333652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:17.341083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 225/444] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:17.344153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.356120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.356780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.357081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.357358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.358194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=0329a03140564541b142bbc7fc5111a8, scope.project.id=0b8863989e2c40f6810172d2e8d6e388) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:17.358491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:17.360934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:17.368353 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 220/445] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=0329a03140564541b142bbc7fc5111a8 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:17.370136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.470895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962d174-c964-4f29-9a1b-3a2df00cf19d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.495725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:17.508521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435111-40f2-485c-ba46-b6f51b54e0bf None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.518477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.519301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.519581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.519898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.532306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:17.540760 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:17.541773 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:17.542551 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:17.543837 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 226/446] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:17.549683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.556381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c3790-c420-4236-9681-69aa21170878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.557540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c3790-c420-4236-9681-69aa21170878 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.557540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c3790-c420-4236-9681-69aa21170878 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.557722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c3790-c420-4236-9681-69aa21170878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.624128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:17.643645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c3790-c420-4236-9681-69aa21170878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:17.645881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c3790-c420-4236-9681-69aa21170878 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:17.675345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6eeb-1429-4d82-b165-04a4ebeb4807 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.710077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.710867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.711149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.711427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.712184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:17.712497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:17.714065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:17.722636 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 227/447] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:17.728276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.750466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:17.765876 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 221/448] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:17.771815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c3790-c420-4236-9681-69aa21170878 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.839566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0d399-f4d9-4ffa-b8dd-6e40dff742a1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.859157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:17.873144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.873795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.874073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.874343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.875410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c3790-c420-4236-9681-69aa21170878 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:17.910014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:17.910877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:17.911154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:17.911424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] PATH_INFO: `/v3/projects/66f428458e264ccfa7aaee63beb4b0a3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:17.912593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] RBAC: Authorizing `identity:get_project(project_id=66f428458e264ccfa7aaee63beb4b0a3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:17.914060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:17.915728 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 222/449] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/projects/66f428458e264ccfa7aaee63beb4b0a3 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:17.921375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:17.942914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:17.944370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:17.978531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:18.020560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb372b-ae90-429b-9b83-d86b4f4e2389 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:18.043793 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 228/450] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 21:45:18.049319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:18.058190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:18.059051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:18.059327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:18.059598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] PATH_INFO: `/v3/groups/71f783bc1f51401ebbf78bf313482e05` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:18.060805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] RBAC: Authorizing `identity:get_group(group_id=71f783bc1f51401ebbf78bf313482e05)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:18.062295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:18.063909 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 223/451] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:17 2022] GET /identity/v3/groups/71f783bc1f51401ebbf78bf313482e05 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:18.069753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:18.070404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:18.150070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c91e3-0e11-4421-85d3-abc18ae882f1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:18.170614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430f67-c79a-4dc4-bf17-db7aad64fd37 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:18.183101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:18.183971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:18.184252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:18.184519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] PATH_INFO: `/v3/projects/0b8863989e2c40f6810172d2e8d6e388` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:18.185759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] RBAC: Authorizing `identity:get_project(project_id=0b8863989e2c40f6810172d2e8d6e388)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:18.187209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:18.188904 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 229/452] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:45:18 2022] GET /identity/v3/projects/0b8863989e2c40f6810172d2e8d6e388 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:18.194367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:18.196208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:18.206020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:18.206669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:18.206942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:18.207213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:18.208066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] RBAC: Adding query filter params (group.id=71f783bc1f51401ebbf78bf313482e05, role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=66f428458e264ccfa7aaee63beb4b0a3) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:18.208368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:18.209848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:18.215832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 224/453] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:18 2022] GET /identity/v3/role_assignments?group.id=71f783bc1f51401ebbf78bf313482e05&scope.project.id=66f428458e264ccfa7aaee63beb4b0a3&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:18.284968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:18.298499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7808-80e4-43a6-aee6-f672902c6a1f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:18.336003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8b5f1-6481-4484-9465-490debbac3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:18.336876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8b5f1-6481-4484-9465-490debbac3e8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:18.337189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8b5f1-6481-4484-9465-490debbac3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:18.337457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8b5f1-6481-4484-9465-490debbac3e8 None admin] PATH_INFO: `/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:18.338719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8b5f1-6481-4484-9465-490debbac3e8 None admin] RBAC: Authorizing `identity:get_group(group_id=6dc4d5506ebf41a4850caa4239e34a8a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:18.340189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8b5f1-6481-4484-9465-490debbac3e8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:18.341884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 230/454] 10.222.0.30 () {56 vars in 1180 bytes} [Sat Jun 18 21:45:18 2022] GET /identity/v3/groups/6dc4d5506ebf41a4850caa4239e34a8a => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:18.348145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:18.452470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f74b70-aeea-4376-b84b-0793c2c83716 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:18.486071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f21a05-39e1-4b5e-87c2-077950e4522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:18.486727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f21a05-39e1-4b5e-87c2-077950e4522a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:18.487006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f21a05-39e1-4b5e-87c2-077950e4522a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:18.487279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f21a05-39e1-4b5e-87c2-077950e4522a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:18.488106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f21a05-39e1-4b5e-87c2-077950e4522a None admin] RBAC: Adding query filter params (group.id=6dc4d5506ebf41a4850caa4239e34a8a, role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=0b8863989e2c40f6810172d2e8d6e388) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:18.488417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f21a05-39e1-4b5e-87c2-077950e4522a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:18.489941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f21a05-39e1-4b5e-87c2-077950e4522a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:18.495854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 225/455] 10.222.0.30 () {56 vars in 1376 bytes} [Sat Jun 18 21:45:18 2022] GET /identity/v3/role_assignments?group.id=6dc4d5506ebf41a4850caa4239e34a8a&scope.project.id=0b8863989e2c40f6810172d2e8d6e388&role.id=77c95569fa354b93b35fc5a694f02453 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:21.470446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe88f4-16ab-4348-8f1b-3c08b9331748 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:21.470963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe88f4-16ab-4348-8f1b-3c08b9331748 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:21.471038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe88f4-16ab-4348-8f1b-3c08b9331748 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:21.472568 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 231/456] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:21.478153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6d80-f260-4e6b-8087-6e070a0c5b58 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:21.478571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6d80-f260-4e6b-8087-6e070a0c5b58 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:21.478767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6d80-f260-4e6b-8087-6e070a0c5b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:21.496629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-baeb6d80-f260-4e6b-8087-6e070a0c5b58 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:21.497860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-baeb6d80-f260-4e6b-8087-6e070a0c5b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:21.565355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:21.591035 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 226/457] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:21.638582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe88f4-16ab-4348-8f1b-3c08b9331748 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:21.684026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6ba7-8c6b-4a88-9dd0-afac1bad7e9e None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:21.684349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6ba7-8c6b-4a88-9dd0-afac1bad7e9e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:21.684600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc6ba7-8c6b-4a88-9dd0-afac1bad7e9e None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:21.686285 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 227/458] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:21.722621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ce6e-bd2a-4808-a754-b14e6e3118bd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:21.722972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ce6e-bd2a-4808-a754-b14e6e3118bd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:21.723272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ce6e-bd2a-4808-a754-b14e6e3118bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:21.761532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-da23ce6e-bd2a-4808-a754-b14e6e3118bd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:21.762851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-da23ce6e-bd2a-4808-a754-b14e6e3118bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:21.765900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe88f4-16ab-4348-8f1b-3c08b9331748 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:21.843434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:21.844610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:21.845125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:21.845606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:21.865342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:21.867142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:21.889060 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 228/459] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:21.898044 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:21.898888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:21.899714 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:21.899714 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:21.899714 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:21.899714 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:21.904114 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 232/460] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:21.905522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ce6e-bd2a-4808-a754-b14e6e3118bd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:21.919940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:21.938784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:22.047402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ce6e-bd2a-4808-a754-b14e6e3118bd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.070033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:22.089170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db76e0-857e-41a6-938d-21c476b2133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:22.090301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db76e0-857e-41a6-938d-21c476b2133a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.090800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db76e0-857e-41a6-938d-21c476b2133a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.091264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db76e0-857e-41a6-938d-21c476b2133a None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.092309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db76e0-857e-41a6-938d-21c476b2133a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:22.092916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db76e0-857e-41a6-938d-21c476b2133a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:22.094549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db76e0-857e-41a6-938d-21c476b2133a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:22.099260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9bc46-85d6-4884-9ab5-807181ebdf98 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.108536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 229/461] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:22.110224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa55d-b04d-48d9-81a7-d0ecfe45f505 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.110703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa55d-b04d-48d9-81a7-d0ecfe45f505 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.111183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefa55d-b04d-48d9-81a7-d0ecfe45f505 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.116908 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 230/462] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:22.118439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40e492-b83a-4a8b-af58-486d08cfd05c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.119139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40e492-b83a-4a8b-af58-486d08cfd05c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.119770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40e492-b83a-4a8b-af58-486d08cfd05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.141528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9a40e492-b83a-4a8b-af58-486d08cfd05c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:22.143023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a40e492-b83a-4a8b-af58-486d08cfd05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:22.144807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:22.145804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.146089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.146367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.157370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:22.158952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:22.180755 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:22.181774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:22.182882 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:22.182882 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:22.182882 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:22.182882 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:22.184832 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 233/463] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:22.185805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:22.233064 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 231/464] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:22.233064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40e492-b83a-4a8b-af58-486d08cfd05c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:22.278660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:22.321783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7ba6-be42-4a50-8477-8b7a084703aa None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.348419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40e492-b83a-4a8b-af58-486d08cfd05c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.350787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:22.363974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:22.364658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.365318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.365593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.366444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:22.367920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:22.388269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65c2d7-5727-44d9-933f-6925432d5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:22.388924 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 234/465] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:45:22 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:22.389476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65c2d7-5727-44d9-933f-6925432d5c1a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.389756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65c2d7-5727-44d9-933f-6925432d5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.389851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:22.390127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65c2d7-5727-44d9-933f-6925432d5c1a None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.390949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65c2d7-5727-44d9-933f-6925432d5c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:22.391257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65c2d7-5727-44d9-933f-6925432d5c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:22.392783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65c2d7-5727-44d9-933f-6925432d5c1a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:22.411095 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 232/466] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:22.413505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4fcf-70d8-469c-9699-28a8dced21a3 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.413807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4fcf-70d8-469c-9699-28a8dced21a3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.414087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4fcf-70d8-469c-9699-28a8dced21a3 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.416106 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 233/467] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:22.419102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4fcf-70d8-469c-9699-28a8dced21a3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:22.528800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a7ef-70b8-4223-a236-da47c0c4ee37 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.549977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:22.562970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4fcf-70d8-469c-9699-28a8dced21a3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.579483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a97f-2b5a-46ae-95bc-79bef1358f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:22.581570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a97f-2b5a-46ae-95bc-79bef1358f3a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.582086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a97f-2b5a-46ae-95bc-79bef1358f3a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.582755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a97f-2b5a-46ae-95bc-79bef1358f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.596548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a97f-2b5a-46ae-95bc-79bef1358f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:22.598127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a97f-2b5a-46ae-95bc-79bef1358f3a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:22.604411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:22.605224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.605512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.605792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.606508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:22.607940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-02b1a97f-2b5a-46ae-95bc-79bef1358f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:22.617436 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:22.618431 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:22.619481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:22.619481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:22.619481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:22.619481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:22.621581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 235/468] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:22.623500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a626d-0e2a-4de5-918d-9a765cd8e605 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.623933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a626d-0e2a-4de5-918d-9a765cd8e605 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.624819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a626d-0e2a-4de5-918d-9a765cd8e605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.638344 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 234/469] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:45:22 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:22.639568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:22.650681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e44a626d-0e2a-4de5-918d-9a765cd8e605 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:22.653084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e44a626d-0e2a-4de5-918d-9a765cd8e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:22.667799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:22.763189 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 236/470] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:22.781505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738ce4a-d538-401d-8869-9d4edd62008b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.806436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a626d-0e2a-4de5-918d-9a765cd8e605 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:22.832474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:22.833095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:22.833382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:22.833656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:22.834404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:22.834709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:22.838639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:22.861578 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 235/471] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:22.867315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:22.961794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a626d-0e2a-4de5-918d-9a765cd8e605 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:22.965925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:22.975620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:23.007017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f17a0-e47c-4ba5-87f2-9ae8126cd0f6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:23.016915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418770-af2b-4fa8-892d-d4d5b6e65594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:23.017846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418770-af2b-4fa8-892d-d4d5b6e65594 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.018122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418770-af2b-4fa8-892d-d4d5b6e65594 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.018391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418770-af2b-4fa8-892d-d4d5b6e65594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.030856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418770-af2b-4fa8-892d-d4d5b6e65594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:23.032632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418770-af2b-4fa8-892d-d4d5b6e65594 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:23.051455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520548e8-e958-4b56-b24e-252f43635c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:23.052133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520548e8-e958-4b56-b24e-252f43635c39 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.052484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520548e8-e958-4b56-b24e-252f43635c39 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-91418770-af2b-4fa8-892d-d4d5b6e65594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:23.052599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:23.053491 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:23.054316 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:23.054316 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:23.054316 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:23.054316 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:23.054534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520548e8-e958-4b56-b24e-252f43635c39 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.054534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520548e8-e958-4b56-b24e-252f43635c39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:23.054650 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 237/472] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:23.058577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520548e8-e958-4b56-b24e-252f43635c39 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:23.058708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ffb94-4832-43e5-a7d3-e47463394126 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.058708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ffb94-4832-43e5-a7d3-e47463394126 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.058708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ffb94-4832-43e5-a7d3-e47463394126 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.058708 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 238/473] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:23.059271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ffb94-4832-43e5-a7d3-e47463394126 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:23.087700 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 236/474] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:45:22 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:23.093713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5f833-392e-477e-a6b5-c31395bf76d7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.094013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5f833-392e-477e-a6b5-c31395bf76d7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.094283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5f833-392e-477e-a6b5-c31395bf76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.146273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-11f5f833-392e-477e-a6b5-c31395bf76d7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:23.147517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-11f5f833-392e-477e-a6b5-c31395bf76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:23.210395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ffb94-4832-43e5-a7d3-e47463394126 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:23.252926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:23.254642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.255152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.255664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.256616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:23.257166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:23.258978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:23.274356 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 239/475] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:23.281201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:23.301555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:23.349206 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 237/476] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:23.380441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5f833-392e-477e-a6b5-c31395bf76d7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:23.432615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64188-96fc-444f-bc27-b9f38bcc0e7b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:23.462913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:23.476491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:23.477200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.477820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.478110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.478839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:23.480715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:23.504844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5f833-392e-477e-a6b5-c31395bf76d7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:23.506662 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 240/477] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:45:23 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:23.553185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:23.553917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.554203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.554484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.555358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:23.556843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:23.567994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.sql.core [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 18 21:45:23.567994 ncdv-master-1 devstack@keystone.service[91204]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 18 21:45:23.567994 ncdv-master-1 devstack@keystone.service[91204]: [parameters: {'id': 'e380b25509524200aa13b27a9744a762', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 18 21:45:23.567994 ncdv-master-1 devstack@keystone.service[91204]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91204) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 21:45:23.586459 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return ref.to_dict() Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 21:45:23.587420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application yield resource Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise self.value Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application session.commit() Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 21:45:23.588345 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.flush() Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application compat.raise_( Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 21:45:23.590046 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 21:45:23.592114 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 21:45:23.594103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [parameters: {'id': 'e380b25509524200aa13b27a9744a762', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:23.596121 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 18 21:45:23.598192 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:23.606363 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 238/478] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Jun 18 21:45:23 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:23.610634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:23.687185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:23.737021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f199c49-ba3d-4394-89f9-9e7530c3157f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:23.774742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25a6d-4b28-470b-bde3-90d0b730781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:23.775643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25a6d-4b28-470b-bde3-90d0b730781d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.775921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25a6d-4b28-470b-bde3-90d0b730781d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.776196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25a6d-4b28-470b-bde3-90d0b730781d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.788828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c25a6d-4b28-470b-bde3-90d0b730781d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-80c25a6d-4b28-470b-bde3-90d0b730781d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:23.796950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:23.797875 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:23.798690 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 241/479] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:45:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:23.804153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:23.912436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0965ac-c94e-4f7a-87bd-9c43fe805111 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:23.944924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:23.951951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c323f8-1e26-49ab-af70-15491cc17289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:23.952760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c323f8-1e26-49ab-af70-15491cc17289 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:23.953142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c323f8-1e26-49ab-af70-15491cc17289 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:23.953512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c323f8-1e26-49ab-af70-15491cc17289 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:23.954350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c323f8-1e26-49ab-af70-15491cc17289 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:23.955040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c323f8-1e26-49ab-af70-15491cc17289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:23.956498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c323f8-1e26-49ab-af70-15491cc17289 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:23.965864 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 239/480] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:25.013940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840821d7-b796-48df-b805-de052d8ce0b1 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:25.014650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840821d7-b796-48df-b805-de052d8ce0b1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:25.014650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840821d7-b796-48df-b805-de052d8ce0b1 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:25.016224 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 242/481] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:25.023311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd54a40-dc0d-4b76-96f2-964e22ace2e1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:25.023837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd54a40-dc0d-4b76-96f2-964e22ace2e1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:25.023951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd54a40-dc0d-4b76-96f2-964e22ace2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:25.058098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2bd54a40-dc0d-4b76-96f2-964e22ace2e1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:25.059297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2bd54a40-dc0d-4b76-96f2-964e22ace2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:25.162366 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 240/482] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:25.205529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840821d7-b796-48df-b805-de052d8ce0b1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:25.352767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840821d7-b796-48df-b805-de052d8ce0b1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:25.390784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:25.400996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d4cc-39da-4543-81e8-29fac8f223ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:25.401830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d4cc-39da-4543-81e8-29fac8f223ec None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:25.402107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d4cc-39da-4543-81e8-29fac8f223ec None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:25.402375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d4cc-39da-4543-81e8-29fac8f223ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:25.418086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d4cc-39da-4543-81e8-29fac8f223ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-c245d4cc-39da-4543-81e8-29fac8f223ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:25.425889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:25.426765 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:25.427578 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 243/483] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:25.434689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd54a40-dc0d-4b76-96f2-964e22ace2e1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:25.548950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd54a40-dc0d-4b76-96f2-964e22ace2e1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:25.572372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:25.585298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f19cf-947b-4465-983d-2abaa948fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:25.585980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f19cf-947b-4465-983d-2abaa948fa4b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:25.586262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f19cf-947b-4465-983d-2abaa948fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:25.586541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f19cf-947b-4465-983d-2abaa948fa4b None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:25.587303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f19cf-947b-4465-983d-2abaa948fa4b None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:25.587613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f19cf-947b-4465-983d-2abaa948fa4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:25.588987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f19cf-947b-4465-983d-2abaa948fa4b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:25.592906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e3f4-b84f-4573-897e-22b8b7b16d17 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:25.593233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e3f4-b84f-4573-897e-22b8b7b16d17 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:25.593511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6e3f4-b84f-4573-897e-22b8b7b16d17 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:25.595001 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 244/484] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:25.598044 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 241/485] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:25.603500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6e3f4-b84f-4573-897e-22b8b7b16d17 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:25.605433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e9d2d-95f3-4ba3-87c4-844ccce5151d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:25.605928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e9d2d-95f3-4ba3-87c4-844ccce5151d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:25.606419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e9d2d-95f3-4ba3-87c4-844ccce5151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:25.637437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-547e9d2d-95f3-4ba3-87c4-844ccce5151d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:25.639905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-547e9d2d-95f3-4ba3-87c4-844ccce5151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:25.763785 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 242/486] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:25.805715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6e3f4-b84f-4573-897e-22b8b7b16d17 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:25.855934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e9d2d-95f3-4ba3-87c4-844ccce5151d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:25.858669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:25.860593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:25.861108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:25.861599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:25.886346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:25.890176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:25.916428 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:25.918082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:25.918922 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:25.918922 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:25.918922 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:25.918922 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:25.918922 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 245/487] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:25.925167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.025948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e9d2d-95f3-4ba3-87c4-844ccce5151d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.030213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:26.042844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:26.077005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.077847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.078133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.078420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.099853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:26.110209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:26.111132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:26.112287 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:26.126837 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 243/488] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:26.142486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.175048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25816c5c-c534-4045-88fb-34b3017b2b08 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.244145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34504c5a-f4d6-4969-b164-cbf53a9c755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.244832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34504c5a-f4d6-4969-b164-cbf53a9c755f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.245149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34504c5a-f4d6-4969-b164-cbf53a9c755f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.245431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34504c5a-f4d6-4969-b164-cbf53a9c755f None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.246173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34504c5a-f4d6-4969-b164-cbf53a9c755f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:26.246481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34504c5a-f4d6-4969-b164-cbf53a9c755f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:26.247923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34504c5a-f4d6-4969-b164-cbf53a9c755f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:26.261486 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 246/489] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:26.262959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026cd21-201c-4b98-8b14-ed9455228192 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.263252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026cd21-201c-4b98-8b14-ed9455228192 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.263525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026cd21-201c-4b98-8b14-ed9455228192 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.265210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 247/490] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:26.267734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026cd21-201c-4b98-8b14-ed9455228192 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.379373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:26.381686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026cd21-201c-4b98-8b14-ed9455228192 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.417744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff0d79-814d-4ba0-998d-e300903c39cb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.430529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb408bc4-6fa7-44d8-946d-ddccf22e54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.431434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb408bc4-6fa7-44d8-946d-ddccf22e54b9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.431781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb408bc4-6fa7-44d8-946d-ddccf22e54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.432126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb408bc4-6fa7-44d8-946d-ddccf22e54b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.439963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb408bc4-6fa7-44d8-946d-ddccf22e54b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:26.441704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb408bc4-6fa7-44d8-946d-ddccf22e54b9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-cb408bc4-6fa7-44d8-946d-ddccf22e54b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:26.458834 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:26.459763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:26.460644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:26.461261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.461261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.461261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.461261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.461524 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 248/491] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:45:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:26.461589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:26.461589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:26.461716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aade7-e0b1-4cda-8b81-1c6a4e31b4db None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.464283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aade7-e0b1-4cda-8b81-1c6a4e31b4db None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.464400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:26.464488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aade7-e0b1-4cda-8b81-1c6a4e31b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.473663 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 244/492] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:26.474526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.482145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a54aade7-e0b1-4cda-8b81-1c6a4e31b4db None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:26.483515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a54aade7-e0b1-4cda-8b81-1c6a4e31b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:26.530909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:26.568473 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 249/493] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:26.568473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aade7-e0b1-4cda-8b81-1c6a4e31b4db None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.620513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653385e-62c2-445e-a970-bb670fc65123 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.655936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.656539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.656821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.657154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.658009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:26.658317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:26.659750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:26.679392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:26.693332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aade7-e0b1-4cda-8b81-1c6a4e31b4db None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.703100 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 245/494] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:45:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:26.703100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.737406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5a942-75c0-4ac6-beee-e7d2a6722d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.738472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a942-75c0-4ac6-beee-e7d2a6722d29 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.738758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a942-75c0-4ac6-beee-e7d2a6722d29 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.739036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5a942-75c0-4ac6-beee-e7d2a6722d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.750564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5a942-75c0-4ac6-beee-e7d2a6722d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:26.752046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5a942-75c0-4ac6-beee-e7d2a6722d29 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-38d5a942-75c0-4ac6-beee-e7d2a6722d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:26.769780 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:26.770779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:26.771644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:26.771644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:26.771644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:26.771644 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:26.771644 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 250/495] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:26.772331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433574d-5c71-4e78-8e5c-721bf67636b2 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.772491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433574d-5c71-4e78-8e5c-721bf67636b2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.772911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433574d-5c71-4e78-8e5c-721bf67636b2 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.778389 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 251/496] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:26.778389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433574d-5c71-4e78-8e5c-721bf67636b2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.811806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:26.818951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409de50e-80cb-44f6-96c6-c0e7c62c53d2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.854070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.854871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.855155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.855436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.867522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:26.875203 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:26.876067 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:26.876864 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 246/497] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:26.877568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:26.899869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433574d-5c71-4e78-8e5c-721bf67636b2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:26.937386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:26.937949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:26.938224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:26.938488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:26.950227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:26.987566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca194ce-d01d-48da-8e2d-85bcc2ce0acf None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.005656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.007134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.019882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36871f59-7c94-4d3a-b4e0-061f91d99a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.020542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36871f59-7c94-4d3a-b4e0-061f91d99a4a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.020819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36871f59-7c94-4d3a-b4e0-061f91d99a4a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.021127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36871f59-7c94-4d3a-b4e0-061f91d99a4a None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.021852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36871f59-7c94-4d3a-b4e0-061f91d99a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:27.022158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36871f59-7c94-4d3a-b4e0-061f91d99a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.023556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36871f59-7c94-4d3a-b4e0-061f91d99a4a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.036571 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 247/498] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:27.037869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aa261-de53-4c32-b631-537c8da5ee64 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.038154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aa261-de53-4c32-b631-537c8da5ee64 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.038428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938aa261-de53-4c32-b631-537c8da5ee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.054637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-938aa261-de53-4c32-b631-537c8da5ee64 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:27.055813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-938aa261-de53-4c32-b631-537c8da5ee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:27.065008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.111307 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 252/499] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:27.112716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.124426 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 248/500] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:27.125846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd2f57-9e0a-4514-9818-9b4f72601a79 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.126133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd2f57-9e0a-4514-9818-9b4f72601a79 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.126406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd2f57-9e0a-4514-9818-9b4f72601a79 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.127718 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 249/501] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:27.129814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd2f57-9e0a-4514-9818-9b4f72601a79 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.156711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.219544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3bbb5-7ea3-41fd-a19e-9fabf1ad9f8d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.241639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd2f57-9e0a-4514-9818-9b4f72601a79 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.252712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.253418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.253819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.254096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.254852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:27.255154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.256540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.264860 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 253/502] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:27.265677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.279936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7253c-27fb-4ad6-a289-fc38632109a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.280726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7253c-27fb-4ad6-a289-fc38632109a2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.280991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7253c-27fb-4ad6-a289-fc38632109a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.281285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7253c-27fb-4ad6-a289-fc38632109a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.288493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7253c-27fb-4ad6-a289-fc38632109a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.289961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7253c-27fb-4ad6-a289-fc38632109a2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-5bf7253c-27fb-4ad6-a289-fc38632109a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:27.305225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:27.306284 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:27.307213 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 250/503] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:27.307899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a3b2-1780-4b3c-9194-64079b82d77f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.308177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a3b2-1780-4b3c-9194-64079b82d77f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.308453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a3b2-1780-4b3c-9194-64079b82d77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.314711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.326218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f457a3b2-1780-4b3c-9194-64079b82d77f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:27.327420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f457a3b2-1780-4b3c-9194-64079b82d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:27.368500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fcc1b-2284-4cc2-9d2d-5301e90e75b1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.370172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.395248 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 251/504] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:27.396181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a3b2-1780-4b3c-9194-64079b82d77f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.411383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.412181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.412459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.412727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.423854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.425351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:27.443271 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:27.444322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:27.445556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:27.445556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:27.445556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:27.445556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:27.446880 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 254/505] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:27.447701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.493346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a3b2-1780-4b3c-9194-64079b82d77f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.526936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.527731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.528013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.528284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.530173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.539450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:27.544675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439a26-641e-49fd-9f0b-d2b2c2b25200 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:27.547065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:27.548048 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:27.548829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:27.549489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 252/506] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:27.549935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.580059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.580858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.581170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.581434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.592863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.594352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:27.610971 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:27.611827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:27.612675 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:27.612675 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:27.612675 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:27.612675 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:27.612675 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 255/507] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:27.613822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.622404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.650981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390cae-4563-4f3a-a2b6-85717e3e6669 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.683581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.684236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.684529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.684803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.685655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:27.685961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.687399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.705916 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 253/508] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:27.706535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.715130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c6dd4-e92c-4613-a161-e1016213a7d0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.749693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.750414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.750695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.750967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.758063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.761779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.763087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:27.779977 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:27.780838 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:27.781744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:27.781744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:27.781744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:27.781744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:27.781744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 256/509] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:27.782013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.807268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ca8a9-f83d-40c6-878a-e4acfa0351eb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.838386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.841737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.842469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.842755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.843059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.843787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:27.844090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.845497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.857057 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 254/510] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:27.857884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.879656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062eff-9f6c-42d1-aeb6-6be2babe190f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.912645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.913364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.913650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.913929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.914678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:27.914983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.916365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:27.924258 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 257/511] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:27.925055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:27.960184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9244d-d46f-4e97-b235-bab05ce5dd85 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:27.974859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:27.996164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:27.996831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:27.997148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:27.997428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:27.998158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:27.998471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:27.999887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.011446 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 255/512] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:28.012226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.023378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dc684-e3b9-4a94-a955-bc3d607cb2d7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.044794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.058911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.059561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.059845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.060122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.114323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dee84-7a61-4149-a9ba-9df5c1c4b544 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.130825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.132302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.150205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.150895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.151198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.151475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.152206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:28.152519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.153928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.165489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 256/513] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:28.166289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.197453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.231277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 258/514] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:28.232154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.255969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.265554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b0d6-4c91-4c9a-a24e-58efd865aea4 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.298506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.299304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.299580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.299851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.306515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.307950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:28.322542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:28.323380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:28.324223 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 257/515] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:28.324696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.338105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde26f4-6115-4618-a112-0fc2a1865b3d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.372844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.373659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.373939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.374210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.384055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.385551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:28.410050 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:28.410930 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:28.411784 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:28.411784 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:28.411784 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:28.411784 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:28.411784 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 259/516] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:28.412055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.417366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.427065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cc1c-61d7-4867-a4cf-11a746a0ab31 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.462785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.463576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.463852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.464118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.471109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.472569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.482258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:28.486852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:28.487741 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:28.488678 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 258/517] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:28.489291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.515159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd755-ace7-45aa-ba28-1e3740dc2cd1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.548646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.549335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.549608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.549893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.550652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.552071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.571789 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 260/518] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:45:28 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:28.572583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.589985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6133d-4ee6-4204-bea6-8c64ee2db1ac None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.629291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.630103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.630383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.630655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.642968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.644484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:28.664221 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:28.665185 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:28.666092 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:28.666092 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:28.666092 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:28.666092 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:28.666092 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 259/519] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:28.666669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.672574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.693278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1954f2-ac21-42cc-8503-cd60099e67b7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.728326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.740431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.741134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.741412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.741688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.742485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:28.742786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.744732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.763929 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 261/520] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:28.765790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.785576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f8e77-83ed-4d06-8674-6542c0885737 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.822643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.823374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.823653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.823932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.824700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:28.825011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.826406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.839622 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 260/521] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:28.840232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.878851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff88a-a25c-437c-a573-b6eef2d140a0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.900782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:28.914461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.915162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.915435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.915703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.916541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:28.916845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.918325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:28.943053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c115e4-1397-4c05-a663-ac1aafd043f4 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:28.953588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 262/522] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:28.954744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:28.986214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:28.987349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:28.988130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:28.988816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:28.989746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:28.990227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:28.992826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.003225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.007887 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 261/523] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:29.008958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.057196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a3d49-36b1-4aa8-9179-d93bc2352e74 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.094610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.095269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.095546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.095816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.096645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=578ca3087f9442d88152f65fad464f32) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:29.096950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.098489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.104370 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 263/524] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:28 2022] GET /identity/v3/role_assignments?user.id=578ca3087f9442d88152f65fad464f32&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:29.105023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.151592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ebc62-ca14-4da2-beed-cd42d579b3e6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.180620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.193543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.194767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.195276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.195767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.206188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.208139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:29.224451 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:29.225733 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 21:45:29.226613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:29.233889 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 262/525] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:29.235211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.241705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a292f-cd59-4254-b967-8697db327e92 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.256892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.292017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.292732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.293113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.294776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.350111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739aac9-cc82-487a-a100-631783e5c673 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.382246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.384220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.385133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.385940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.386219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.386489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.394271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.395768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:29.410750 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:29.411625 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:29.412474 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 263/526] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:29.413481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.471284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.506862 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 264/527] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:29.507780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.541609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8b67c-3a92-4fda-aa33-2d7355ec2bc9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.577519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.587555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.588948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.589352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.589718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.591458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:29.591863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.593559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.610530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6209b0-5264-42ec-8016-e299a02dec6a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.613179 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 264/528] 10.222.0.30 () {56 vars in 1139 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:29.614070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.645899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.646556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.646831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.647100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.647886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:29.648185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.649646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.662445 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 265/529] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:29.663300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.724154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b3e2-e2b0-49a2-a38f-1a732d273910 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.726047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.732053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.765452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.766109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb4d6-6627-47ab-a141-705702e4ea0b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.766288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.766522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.766795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.778062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.779621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:29.799454 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:29.800484 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:29.801372 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:29.801372 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:29.801372 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:29.801372 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:29.801372 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 265/530] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:29.801651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.809817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.810541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.810821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.811138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.884527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.886143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.908646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b405b3-f36f-47c4-ab2c-c893b696a176 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:29.945450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:29.946204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:29.946484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:29.946954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:29.947792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=14f94931805a4215b22237194803d41c) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:29.948102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:29.949756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:29.956078 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 266/531] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/role_assignments?user.id=14f94931805a4215b22237194803d41c&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:29.957098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:29.957406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:29.982728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:30.011643 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 266/532] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:30.022335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.082676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889d299-8be7-465f-8e10-aec8434a3c1b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.122096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.122857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.123138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.123408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.124139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:30.124438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.125953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.139771 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 267/533] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:30.153505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.188809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a1f9d-0ba1-41bc-8a0e-b81e58efb016 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.225404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.226345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.226623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.226889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.238111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.239756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.255648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:30.258906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:30.260237 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:30.261310 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:30.261310 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:30.261310 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:30.261310 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:30.261310 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 267/534] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:30.266228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.294250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:30.307864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3ee9-7a44-4a3c-8e01-2e04a498e627 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.379766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.380576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.380850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.381144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.382459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb0f45-8503-4a74-a9be-a9182da3b9c5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.388550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.390145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:30.414230 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:30.416355 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:30.418635 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 268/535] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:30.419725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.419725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.420010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.425139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.425139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:30.425139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.425669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.425830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.436097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 268/536] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:30.441907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.526709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:30.545570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34700ec7-7113-4b4a-91b3-6807c620ad4e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.568285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1df47-1073-45f6-92cf-ca3e2d1a6cff None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.608189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.609004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.609306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.609580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.623041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.624505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.634113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.634785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.635066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.635343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.636144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:30.636455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.638192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:30.654896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:30.656797 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:30.658893 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:30.665057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:30.666205 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 269/537] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:30.674297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 269/538] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:30.675762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.677477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.804068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199585-44fe-4112-beee-f939a030f45f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.814961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5cdf-e661-4b61-a786-c7b5dc762f69 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:30.848323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.848991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.849296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.849573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.851729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=028b67b31190461b96d35563506b6c8e) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:30.852047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.854430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.867133 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 270/539] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/role_assignments?user.id=028b67b31190461b96d35563506b6c8e&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:30.877435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ba0c0-eb0f-4895-9811-4d81fc3a8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:30.878125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ba0c0-eb0f-4895-9811-4d81fc3a8a94 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:30.878545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ba0c0-eb0f-4895-9811-4d81fc3a8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:30.878824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ba0c0-eb0f-4895-9811-4d81fc3a8a94 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:30.879639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ba0c0-eb0f-4895-9811-4d81fc3a8a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:30.880000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ba0c0-eb0f-4895-9811-4d81fc3a8a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:30.881519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ba0c0-eb0f-4895-9811-4d81fc3a8a94 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:30.900495 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 270/540] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:30.901928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:30.969472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:31.014166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f31e-2d70-4d72-a5b3-5d3b3bb5767d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:31.052113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b912ac-0b75-4249-b6e2-40619ad8719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:31.052790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b912ac-0b75-4249-b6e2-40619ad8719d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:31.053108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b912ac-0b75-4249-b6e2-40619ad8719d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:31.053398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b912ac-0b75-4249-b6e2-40619ad8719d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:31.054249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b912ac-0b75-4249-b6e2-40619ad8719d None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=9765a70014c74e61a93f84c801a10fa4) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:31.054567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b912ac-0b75-4249-b6e2-40619ad8719d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:31.056150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b912ac-0b75-4249-b6e2-40619ad8719d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:31.062595 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 271/541] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:30 2022] GET /identity/v3/role_assignments?user.id=9765a70014c74e61a93f84c801a10fa4&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:31.312366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41897-860c-430e-9839-5982269ae26a None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:31.312860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41897-860c-430e-9839-5982269ae26a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:31.312860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41897-860c-430e-9839-5982269ae26a None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:31.314593 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 271/542] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:31.319819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a441c5-cb24-48ab-8698-468a23c0cb49 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:31.320272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a441c5-cb24-48ab-8698-468a23c0cb49 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:31.320453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a441c5-cb24-48ab-8698-468a23c0cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:31.346307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f9a441c5-cb24-48ab-8698-468a23c0cb49 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:31.347598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f9a441c5-cb24-48ab-8698-468a23c0cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:31.429282 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 272/543] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:31.462041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41897-860c-430e-9839-5982269ae26a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:31.464995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:31.610389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41897-860c-430e-9839-5982269ae26a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:31.656850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61150a-9851-4ba1-ae46-9c231101d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:31.657699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61150a-9851-4ba1-ae46-9c231101d752 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:31.658282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61150a-9851-4ba1-ae46-9c231101d752 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:31.658571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61150a-9851-4ba1-ae46-9c231101d752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:31.676703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61150a-9851-4ba1-ae46-9c231101d752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-be61150a-9851-4ba1-ae46-9c231101d752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:31.684415 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:31.685323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:31.686101 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 272/544] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:31.691833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a441c5-cb24-48ab-8698-468a23c0cb49 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:31.747162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:31.802420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a441c5-cb24-48ab-8698-468a23c0cb49 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:31.848132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:31.849221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:31.849691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:31.850178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:31.851130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:31.851620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:31.851730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0989c56-760c-4f06-9b02-680d0cf0c7c1 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:31.851956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0989c56-760c-4f06-9b02-680d0cf0c7c1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:31.852243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0989c56-760c-4f06-9b02-680d0cf0c7c1 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:31.853719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:31.853900 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 273/545] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:31.861205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b3b9-26bb-4338-9f18-74617bd852f9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:31.861431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b3b9-26bb-4338-9f18-74617bd852f9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:31.861706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519b3b9-26bb-4338-9f18-74617bd852f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:31.863422 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 273/546] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:31.869971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:31.893602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8519b3b9-26bb-4338-9f18-74617bd852f9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:31.894968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8519b3b9-26bb-4338-9f18-74617bd852f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:31.993676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:32.014728 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 274/547] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:32.038334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a45b3d-0f6d-4075-8050-1d6f539dfdfa None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:32.049550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b3b9-26bb-4338-9f18-74617bd852f9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:32.060966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:32.095393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:32.096704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.097015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.097314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.120844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:32.122315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:32.153993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:32.154906 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:32.155753 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:32.155753 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:32.155753 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:32.155753 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:32.156389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 274/548] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:32.163559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:32.232825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519b3b9-26bb-4338-9f18-74617bd852f9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:32.289784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:32.290599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.290879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.291152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.312042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:32.325920 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:32.327681 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:32.328719 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 275/549] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:32.334713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:32.348072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67286-403b-4ba6-b055-84781dc665f9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:32.409802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:32.410408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.410691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.410963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.411710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:32.412014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:32.413458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:32.431103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:32.438030 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 275/550] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:32.442818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:32.503049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:32.518240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155f17-7ada-4fd1-97b3-fa55e86b76fc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:32.578373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:32.579378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.579675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.579952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.580736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:32.581070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:32.582536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:32.598252 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 276/551] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:32.605683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:32.630340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a587d-db39-4bf2-8611-0ae1becb3d49 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:32.686098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79aed8-da76-4d9b-bf89-e7d70b00908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:32.686820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79aed8-da76-4d9b-bf89-e7d70b00908e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.687104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79aed8-da76-4d9b-bf89-e7d70b00908e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.687379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79aed8-da76-4d9b-bf89-e7d70b00908e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.694875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79aed8-da76-4d9b-bf89-e7d70b00908e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:32.696385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79aed8-da76-4d9b-bf89-e7d70b00908e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6c79aed8-da76-4d9b-bf89-e7d70b00908e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:32.712279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:32.713590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:32.714576 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 276/552] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:32.720063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4bfba-6fef-47b2-b873-be6258ab7cc9 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.720284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4bfba-6fef-47b2-b873-be6258ab7cc9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.720652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4bfba-6fef-47b2-b873-be6258ab7cc9 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.722162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 277/553] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:32.722734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4bfba-6fef-47b2-b873-be6258ab7cc9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:32.748021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e89936-460b-4ccd-a4de-f64c8089dbf8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:32.764765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:32.788988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7007730-606f-48ab-bc42-5987eab22634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:32.790150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007730-606f-48ab-bc42-5987eab22634 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.790665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007730-606f-48ab-bc42-5987eab22634 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.791174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7007730-606f-48ab-bc42-5987eab22634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.802759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7007730-606f-48ab-bc42-5987eab22634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:32.804218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7007730-606f-48ab-bc42-5987eab22634 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a7007730-606f-48ab-bc42-5987eab22634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:32.823666 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:32.824568 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:32.825556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:32.825556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:32.825556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:32.825556 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:32.825556 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 277/554] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:32.826370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55803c6-98b2-48bb-b7cb-348cf31ec574 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.826654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55803c6-98b2-48bb-b7cb-348cf31ec574 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.826929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55803c6-98b2-48bb-b7cb-348cf31ec574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.827182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:32.841484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4bfba-6fef-47b2-b873-be6258ab7cc9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:32.845004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e55803c6-98b2-48bb-b7cb-348cf31ec574 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:32.846209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e55803c6-98b2-48bb-b7cb-348cf31ec574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:32.887072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:32.888059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:32.888567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:32.889053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:32.890101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:32.891083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:32.893202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:32.921436 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 278/556] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:32.921436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55803c6-98b2-48bb-b7cb-348cf31ec574 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:32.921679 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 278/556] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:32.923585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.034920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552655c-5cea-4c4d-8ab9-64253e3b165e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.038400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.046690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55803c6-98b2-48bb-b7cb-348cf31ec574 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.069901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.070558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.070832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.071302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.087816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.089169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.089674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.090168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.091118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:33.091743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.092180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.094315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.108042 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 279/557] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:33.109324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.145207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.146709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.220369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d88e-6673-4769-9425-560724ed17a8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.261440 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 279/558] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:33.261440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.268346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.269516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.270087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.270569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.282660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:33.291628 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:33.293117 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:33.294021 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:33.301744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 280/559] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:33.303148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.309250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.325712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.362068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470e69-e990-436b-bbf7-d1298a486107 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.396880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.397706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.397978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.398243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.405895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.407383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.423112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179060b3-ea34-4fac-9dd5-74e5da75ce7f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:33.423914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:33.425073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:33.426052 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 280/560] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:33.427312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.467381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.468566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.469078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.469618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.481826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.483591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:33.502622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:33.503631 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:33.504622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:33.504622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:33.504622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:33.504622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:33.511335 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 281/561] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:33.512594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.529063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dadb9-f563-4c74-9520-8c0e947b43b8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.538994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.567610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.568214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.568490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.568761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.569566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:33.569869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.571304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.585411 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 281/562] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:33.585411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.603859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.645355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0784d9-0ea1-4097-a8b4-18539eb1dd25 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.681231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.681899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.682178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.682442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.683273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:33.683573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.685008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.705329 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 282/563] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:33.705329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.710812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd9ef2-0285-41b7-ab44-d2c94c2698c8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.746648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e38b7-9290-4099-bbf4-4e1d0b281b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.747312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e38b7-9290-4099-bbf4-4e1d0b281b70 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.747592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e38b7-9290-4099-bbf4-4e1d0b281b70 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.747861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e38b7-9290-4099-bbf4-4e1d0b281b70 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.748583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e38b7-9290-4099-bbf4-4e1d0b281b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:33.748883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e38b7-9290-4099-bbf4-4e1d0b281b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.750299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e38b7-9290-4099-bbf4-4e1d0b281b70 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.762190 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 282/564] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:33.763455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119cfbb-77d5-40ab-af01-433e40bf1546 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.763744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119cfbb-77d5-40ab-af01-433e40bf1546 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.764014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119cfbb-77d5-40ab-af01-433e40bf1546 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.768817 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 283/565] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:33.768817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119cfbb-77d5-40ab-af01-433e40bf1546 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.798037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.816027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3bae4-4e2a-4b65-9158-8fdbf2051e7e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.842829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:33.852903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.853737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.854015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.854287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.864423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.865913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.868291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119cfbb-77d5-40ab-af01-433e40bf1546 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:33.884236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:33.885314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:33.886224 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:33.886224 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:33.886224 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:33.886224 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:33.886224 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 283/566] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:33.886224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:33.904743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1a574-690f-449f-8e75-30d8bbb376ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:33.905568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1a574-690f-449f-8e75-30d8bbb376ab None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.905845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1a574-690f-449f-8e75-30d8bbb376ab None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.906115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1a574-690f-449f-8e75-30d8bbb376ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.916161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1a574-690f-449f-8e75-30d8bbb376ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:33.917628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1a574-690f-449f-8e75-30d8bbb376ab None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-42b1a574-690f-449f-8e75-30d8bbb376ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:33.934718 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:33.935614 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:33.936514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:33.936514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:33.936514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:33.936514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:33.936514 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 284/567] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:33.937091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b190-54eb-45f3-ac8e-016aa2a4c555 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:33.937334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b190-54eb-45f3-ac8e-016aa2a4c555 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:33.937620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6b190-54eb-45f3-ac8e-016aa2a4c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:33.953187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d8c6b190-54eb-45f3-ac8e-016aa2a4c555 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:33.954673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d8c6b190-54eb-45f3-ac8e-016aa2a4c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:33.985677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4e3d-ed47-49bb-951e-2eb192775d53 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.020762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.020942 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 285/568] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:34.021732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.022063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.022225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aaff5-b19b-4889-b34b-b08e56b19706 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.022488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aaff5-b19b-4889-b34b-b08e56b19706 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.022602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.022789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aaff5-b19b-4889-b34b-b08e56b19706 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.026243 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 286/569] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:34.026243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aaff5-b19b-4889-b34b-b08e56b19706 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.037282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.038762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.052445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:34.052761 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:34.058968 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 284/570] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:34.059883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.097272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.145671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aaff5-b19b-4889-b34b-b08e56b19706 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.163320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0af53-3573-4785-be90-0a46844eac6e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.185562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939009-0742-4523-8f82-8ca79afd9d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.186221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939009-0742-4523-8f82-8ca79afd9d34 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.186497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939009-0742-4523-8f82-8ca79afd9d34 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.186765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939009-0742-4523-8f82-8ca79afd9d34 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.187471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939009-0742-4523-8f82-8ca79afd9d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:34.187788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939009-0742-4523-8f82-8ca79afd9d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.189186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939009-0742-4523-8f82-8ca79afd9d34 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.200656 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 287/571] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:34.201859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d92f7-66bf-4c57-bbe6-b461b0702f5b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.202139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d92f7-66bf-4c57-bbe6-b461b0702f5b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.202428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d92f7-66bf-4c57-bbe6-b461b0702f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.208338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.209005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.209313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.209588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.210312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:34.210615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.211989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.219700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c64d92f7-66bf-4c57-bbe6-b461b0702f5b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:34.220880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c64d92f7-66bf-4c57-bbe6-b461b0702f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:34.223961 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 285/572] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:34.224803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.287949 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 288/573] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:34.288798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d92f7-66bf-4c57-bbe6-b461b0702f5b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.291271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.325499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.330144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844ee5-109e-44bd-8f73-595fa2635468 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.363745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.364469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.364745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.365009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.374824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:34.382434 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:34.383350 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:34.384183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 286/574] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:34.384870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.398687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d92f7-66bf-4c57-bbe6-b461b0702f5b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.431947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.432611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.432888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.433187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.433985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:34.434300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.435751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.447114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 289/575] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:34.447897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.488139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b9f0b-d2a2-478d-a199-2b128d855a3b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.505903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.521017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.521839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.522113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.522381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.529963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.531410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.545015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93193a15-c232-4629-af83-e4a2b4f79f02 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:34.545287 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:34.546321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:34.547265 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 287/576] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:34.547898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.566437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.583796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.584595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.584866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.585168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.591813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.593278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:34.607035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:34.607904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:34.608795 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 290/577] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:34.609325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.648422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89ed12-6065-4aa3-a65e-cb6c0c970d90 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.680759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.681564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.681842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.682112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.692200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:34.699798 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:34.700777 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:34.701660 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 288/578] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:34.702377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.712904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8ac84-8707-47fe-bb3a-275c5f1925ab None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.736092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.747780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.748453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.748734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.749045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.749810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:34.750100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.751468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.759455 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 291/579] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:34.760233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.781507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:34.803523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f988d65-0e09-4f02-a62d-0c562391607e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.836562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.837242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.837519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.837793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.838613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=f2272ca86c294ec4aa96eccc1827d4e2) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:34.838918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.840370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.845979 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 289/580] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/role_assignments?user.id=f2272ca86c294ec4aa96eccc1827d4e2&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:34.846768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.860704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9b612-e876-46b7-b67f-0ed5b560856f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.899581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:34.900309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:34.900574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:34.900848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:34.901736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:34.902043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:34.903773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:34.923951 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 292/581] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:34.924821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:34.970385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8337-247b-4180-8a48-666d68b42934 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:34.980520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.012135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.012912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.013285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.013622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.014646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:35.015021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.016556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.031599 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 290/582] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:35.031599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.036464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.056154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f08cb-7007-4218-909f-19046719ae90 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.098860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.099990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.100518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.100795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.101722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:35.102028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.103985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.119520 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 293/583] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:35.119520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.143223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0800172-fa34-4029-bf04-86aaaa2f7688 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.183268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.184075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.184423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.184762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.195280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.196798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:35.214861 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:35.215961 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:35.217094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:35.217094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:35.217094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:35.217094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:35.222549 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 291/584] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:35.223080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.231825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25a39-d702-48f1-affb-7338eb9da458 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.234304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.269514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.270697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.271163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.271651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.282796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.284465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.289462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:35.302703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:35.303617 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:35.304505 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:35.304505 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:35.304505 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:35.304505 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:35.304505 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 294/585] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:35.305451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.343233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001b5a-8bde-433e-822d-607a06511183 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.382519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.383407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.384353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.384353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/578ca3087f9442d88152f65fad464f32/roles/3af3015fe5ba49eca4677c320084172b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.400454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=578ca3087f9442d88152f65fad464f32, role_id=3af3015fe5ba49eca4677c320084172b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.402050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.425068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 292/586] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:45:35 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/578ca3087f9442d88152f65fad464f32/roles/3af3015fe5ba49eca4677c320084172b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:35.425068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.428553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1629-52a3-4ac6-9218-9a95df1c08bf None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.485328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.486502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.487282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.487676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.504829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.506752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:35.531503 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:35.532441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:35.533347 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:35.533347 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:35.533347 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:35.533347 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:35.533347 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 295/587] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:35.534535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.550234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.562938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fb937-bc28-4095-86cd-7e549baf95a8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.567305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.612918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.613793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.614132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.614592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.615471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:35.615891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.618558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.632168 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 293/588] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:35.633185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.674007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406dff-d87c-45ac-ad4e-82644fc340c8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.719101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.719778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.720110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.720389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.721321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:35.721632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.723646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.740413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346f96e-c805-4ba9-b714-993ace3a2a06 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.740569 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 296/589] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:35.741695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.779913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.780690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.781056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.781399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.782190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:35.782572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.784108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.797730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 294/590] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:35.798685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.814854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.829504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:35.866459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f64d6-04fa-4f9a-8900-8b562ba3057f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.909591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0dcfe-63a3-46ab-9d06-efb950711294 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:35.915858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.917003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.918081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.918582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.929682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.932129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.949856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:35.950666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:35.950946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:35.951220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:35.953233 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:35.954514 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:45:35.955452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:35.958630 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 297/591] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:35.959788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:35.961525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:35.963091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:35.980767 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:35.981744 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:35.982635 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:35.983071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 295/592] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:35.983859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.079459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fbec7-81c3-4348-b339-4a8245fffbfe None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.084079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:36.101216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba628bc-90b3-426a-9f93-95c305cf841e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.110574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:36.119128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.120044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.120331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.120610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.128389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.130061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.138765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.139663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.140090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.140505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.141527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:36.142001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.143738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:36.147255 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:36.148389 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 298/593] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:36.149736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.166376 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 296/594] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Jun 18 21:45:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:36.167633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.277620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa76acc-729f-4d6e-b154-40d5d3a5b327 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.300445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adce85-571a-4d1a-9811-68b8ccb5409a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.334929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.335596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.335870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.336139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.336920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:36.337248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.338679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.343622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.344292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.344566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.344833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.345703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:36.346004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.347485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.355808 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 299/595] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:36.357005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.371896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:36.378682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 297/596] 10.222.0.30 () {56 vars in 1139 bytes} [Sat Jun 18 21:45:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:36.379820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.412192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:36.464262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbaa9c-b2a4-4220-ad11-ff6e6e5d0db1 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.496043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a6ec-71a9-48ef-92ce-5edf4904ca64 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.497277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.498072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.498357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.498631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.509563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.511006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:36.529283 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:36.530360 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:36.531453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:36.531453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:36.531453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:36.531453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:36.535052 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 300/597] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:36.535955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.536266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.537517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.537941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.538376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/14f94931805a4215b22237194803d41c/roles/3af3015fe5ba49eca4677c320084172b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.554579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=14f94931805a4215b22237194803d41c, role_id=3af3015fe5ba49eca4677c320084172b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.556436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.572112 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 298/598] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:45:36 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/14f94931805a4215b22237194803d41c/roles/3af3015fe5ba49eca4677c320084172b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:36.573756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.634671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:36.687538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:36.690833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf1a01-92bc-4e6b-9b15-7b084fd2e79a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.691240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98fd4a-a9c2-4514-8ef4-d568f394f62b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.732526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.733418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.733666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.733753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.734028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.734992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.735608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.736091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.737330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:36.737968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.739733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.748171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:36.750092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:36.754027 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 299/599] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:36.765080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:36.786470 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:36.787502 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:36.788410 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:36.788410 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:36.788410 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:36.788410 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:36.790394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 301/600] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:36.795934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:36.938352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f46c-7d83-4ee7-bb55-a5a3ed26de67 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.956150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:36.957062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4e35d-7de9-4525-ad0d-7f6ad8695b12 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:36.995812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.996848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.997377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.997953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:36.998321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:36.999140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:36.999353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:36.999453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:36.999679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.000165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:37.002160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:37.018920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:37.020384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:37.033487 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 302/601] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:37.046182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:37.050348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:37.051521 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:37.052637 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:37.054523 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 300/602] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:37.063233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:37.077507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:37.220849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb65ab9-2cae-4046-9bf3-8accc11b2477 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:37.259333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:37.260064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.260341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.260613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.261475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:37.261732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2b11-df49-4db7-bc85-b4e397095d01 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:37.261853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:37.263293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:37.277435 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 301/603] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:37.283849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:37.321437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:37.349072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cf2de-679c-4f59-bc4c-0a7b550c0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:37.349901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cf2de-679c-4f59-bc4c-0a7b550c0f41 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.350189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cf2de-679c-4f59-bc4c-0a7b550c0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.350464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cf2de-679c-4f59-bc4c-0a7b550c0f41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.369528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cf2de-679c-4f59-bc4c-0a7b550c0f41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:37.371010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cf2de-679c-4f59-bc4c-0a7b550c0f41 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-9f8cf2de-679c-4f59-bc4c-0a7b550c0f41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:37.385723 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:37.386639 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:37.387513 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:37.391647 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 303/604] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:37.392986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b3654-fb40-445d-883d-d1494e2fe5bc None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.393294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b3654-fb40-445d-883d-d1494e2fe5bc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.393649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b3654-fb40-445d-883d-d1494e2fe5bc None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.395258 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 304/605] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:37.395995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b3654-fb40-445d-883d-d1494e2fe5bc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:37.397692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faceb8-75fd-4e6b-8236-0c8b228b15a5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:37.444058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae58a2-49a9-4397-8bca-b4f83845c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:37.445817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae58a2-49a9-4397-8bca-b4f83845c7c3 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.446238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae58a2-49a9-4397-8bca-b4f83845c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.446647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae58a2-49a9-4397-8bca-b4f83845c7c3 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/028b67b31190461b96d35563506b6c8e/roles/3af3015fe5ba49eca4677c320084172b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.468057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae58a2-49a9-4397-8bca-b4f83845c7c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=028b67b31190461b96d35563506b6c8e, role_id=3af3015fe5ba49eca4677c320084172b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:37.470432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae58a2-49a9-4397-8bca-b4f83845c7c3 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:37.478704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:37.492458 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 302/606] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:45:37 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/028b67b31190461b96d35563506b6c8e/roles/3af3015fe5ba49eca4677c320084172b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:37.497374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1178c-b1d4-4929-be56-10df059dc4a6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.497374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1178c-b1d4-4929-be56-10df059dc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.497374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1178c-b1d4-4929-be56-10df059dc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.527745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c2b1178c-b1d4-4929-be56-10df059dc4a6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:37.528978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c2b1178c-b1d4-4929-be56-10df059dc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:37.536995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b3654-fb40-445d-883d-d1494e2fe5bc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:37.605019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:37.606639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.606928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.607208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.608021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:37.608336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:37.609845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:37.637494 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 305/607] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:37.644910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:37.669920 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 303/608] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:37.749154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1178c-b1d4-4929-be56-10df059dc4a6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:37.761329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:37.803525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969592b-7aa9-4f19-9a91-e6e867730939 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:37.835718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:37.841468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163175a8-5605-4e1a-9693-187e31745781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:37.843247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163175a8-5605-4e1a-9693-187e31745781 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.843549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163175a8-5605-4e1a-9693-187e31745781 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.843834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163175a8-5605-4e1a-9693-187e31745781 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/9765a70014c74e61a93f84c801a10fa4/roles/3af3015fe5ba49eca4677c320084172b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.860230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163175a8-5605-4e1a-9693-187e31745781 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=9765a70014c74e61a93f84c801a10fa4, role_id=3af3015fe5ba49eca4677c320084172b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:37.861736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163175a8-5605-4e1a-9693-187e31745781 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:37.879103 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 306/609] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:45:37 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/9765a70014c74e61a93f84c801a10fa4/roles/3af3015fe5ba49eca4677c320084172b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:45:37.890735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1178c-b1d4-4929-be56-10df059dc4a6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:37.933084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:37.934212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.934731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.935242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.948104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:37.957693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34a17-2efe-47b7-a444-a9e08872f741 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.958372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34a17-2efe-47b7-a444-a9e08872f741 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.958823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34a17-2efe-47b7-a444-a9e08872f741 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.960525 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 307/610] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:37.962817 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:37.963974 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:37.964996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:37.967159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda00486-1c5f-4181-88ba-143e0ef37a37 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:37.967540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda00486-1c5f-4181-88ba-143e0ef37a37 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:37.967835 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 304/611] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:37.967961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda00486-1c5f-4181-88ba-143e0ef37a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:37.974411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:37.998278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cda00486-1c5f-4181-88ba-143e0ef37a37 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:37.999983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cda00486-1c5f-4181-88ba-143e0ef37a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:38.084512 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 308/612] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:38.109260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda00486-1c5f-4181-88ba-143e0ef37a37 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:38.150428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:38.195304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2dff11-91f7-4e55-bb3a-f8fdeefdcc2f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:38.240114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda00486-1c5f-4181-88ba-143e0ef37a37 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:38.241136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131616-2367-4111-8640-36d127a19280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:38.241929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131616-2367-4111-8640-36d127a19280 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:38.243524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131616-2367-4111-8640-36d127a19280 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:38.243524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d131616-2367-4111-8640-36d127a19280 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:38.243524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131616-2367-4111-8640-36d127a19280 None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:38.244062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131616-2367-4111-8640-36d127a19280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:38.246525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d131616-2367-4111-8640-36d127a19280 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:38.260049 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 305/613] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:38.260232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:38.263046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131616-2367-4111-8640-36d127a19280 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:38.297306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:38.298162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:38.298441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:38.298713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:38.320424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:38.337580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:38.338589 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:38.339441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 309/614] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:38.344772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:38.383875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d131616-2367-4111-8640-36d127a19280 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:38.419673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:38.420846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:38.421361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:38.421927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:38.430548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:38.434791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:38.436704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:38.460622 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:38.461655 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:38.462571 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:38.462571 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:38.462571 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:38.462571 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:38.470114 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 306/615] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:38.477397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:38.611295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df760b-00ae-47dd-9dfe-619a52135c5f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:38.616578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8d24c-fa85-4afa-a6ab-a5e2c891a6d5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:38.652673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:38.653744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:38.654272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:38.654803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:38.655759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:38.656267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:38.658129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:38.671202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 307/616] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:38.677281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:38.701251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:38.701935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:38.702216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:38.702490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:38.703252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:38.703541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:38.705373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:38.725009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 310/617] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:38.728874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:38.730374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:38.788408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097ee69-d868-45ba-ad90-9774834ee27a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:38.805889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:38.827315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:38.828531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:38.829455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:38.829938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] PATH_INFO: `/v3/users/swift` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:38.838457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:38.840213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:38.856132 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:38.857166 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:38.858110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:38.861903 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 308/618] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:38.867969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:38.941272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff78aa-f09c-4c0c-8021-9cdc3ae43c76 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:38.977247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:38.978048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:38.978322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:38.978589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:38.995523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d66347-b7d7-4f84-a3c7-d4d1b65f512d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.000750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:39.002183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.003835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:39.034570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:39.035697 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:39.036634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:39.036634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:39.036634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:39.036634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:39.040405 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 311/619] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:39.043744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.044416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.044690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.044960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.045837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:39.046136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.046244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.047571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.065317 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 309/620] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Jun 18 21:45:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:39.070650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.174320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8417821-186e-4abf-9217-b7e6c48dd7d1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.213165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.214136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.214513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.214888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.226160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.227763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.230232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:39.248868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:39.250016 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:39.251118 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:39.251118 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:39.251118 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:39.251118 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:39.252880 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 310/621] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:39.258710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.283068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb0ea6-4681-490a-9b4a-ef9705ac5246 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.288986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:39.371980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be18bf-0e9d-46cc-9000-c50c586b0504 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.409337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.410162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.410546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.410916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.411750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:39.412175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.413689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.426484 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 311/622] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:39.430323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee366-f689-4806-b40c-1d00c20103dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.431251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee366-f689-4806-b40c-1d00c20103dd None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.431545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee366-f689-4806-b40c-1d00c20103dd None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.431821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee366-f689-4806-b40c-1d00c20103dd None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.432563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee366-f689-4806-b40c-1d00c20103dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:39.432866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee366-f689-4806-b40c-1d00c20103dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.434290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee366-f689-4806-b40c-1d00c20103dd None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.434416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.447541 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 312/623] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:39.448849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b87b-9c6c-4d95-aabe-e1f884592187 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.449160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b87b-9c6c-4d95-aabe-e1f884592187 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.449440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b87b-9c6c-4d95-aabe-e1f884592187 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.450895 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 313/624] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:39.457808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbc29-d961-41b0-a596-7af54ebe5ba0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.458159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbc29-d961-41b0-a596-7af54ebe5ba0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.458499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bbc29-d961-41b0-a596-7af54ebe5ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.480737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f37bbc29-d961-41b0-a596-7af54ebe5ba0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:39.482495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f37bbc29-d961-41b0-a596-7af54ebe5ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:39.523296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:39.554849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336106d-3a8c-429c-b262-cf38764694ad None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.569486 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 314/625] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:39.570588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bbc29-d961-41b0-a596-7af54ebe5ba0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.594289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.595085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.595363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.595633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.607384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.609503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:39.628384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:39.630528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 312/626] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:39.633967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.666839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:39.692282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bbc29-d961-41b0-a596-7af54ebe5ba0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.733503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.734708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.735162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.735580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.743824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.745561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.750274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c101ee-a9b8-436c-9750-7e0bcd4b8bce None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:39.761349 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:39.762477 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:39.763425 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:39.770626 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 315/627] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:39.771691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.793785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.795175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.795460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.795740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.797974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:39.812764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:39.823249 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:39.824194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:39.825359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:39.829159 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 313/628] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:39.830395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.889297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcc2d1-f7af-4daf-96a7-c7dda7e0cc90 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.925437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.926110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.926393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.926670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.927470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:39.927777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.929293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:39.932148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:39.941232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02222d52-3c27-4bb0-b0aa-760053d629b6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:39.949568 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 316/629] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:39.949568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:39.987381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:39.988472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:39.988762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:39.989061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:39.990190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:39.990504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:39.992291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:40.015518 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 314/630] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:40.017827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:40.092162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:40.101711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2bf8-78ab-4829-80c3-c545e877c340 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:40.140897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:40.141957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.142441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.142940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.144446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:40.144966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:40.146763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:40.154318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3406db7-6290-402a-8354-a5cf143b1082 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:40.160979 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 317/631] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:40.162163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:40.197163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:40.198322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.198601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.198877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/f2272ca86c294ec4aa96eccc1827d4e2/roles/3af3015fe5ba49eca4677c320084172b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.217929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=f2272ca86c294ec4aa96eccc1827d4e2, role_id=3af3015fe5ba49eca4677c320084172b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:40.219713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:40.232563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:40.249770 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 315/632] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:45:40 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/f2272ca86c294ec4aa96eccc1827d4e2/roles/3af3015fe5ba49eca4677c320084172b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:40.251397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:40.290223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f5ef-d498-4bd4-a04e-e6a986c65356 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:40.335856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e2ce6-e8d4-4651-a12b-d69e23c7ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:40.338043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e2ce6-e8d4-4651-a12b-d69e23c7ca80 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.338473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e2ce6-e8d4-4651-a12b-d69e23c7ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.339847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e2ce6-e8d4-4651-a12b-d69e23c7ca80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.480780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e2ce6-e8d4-4651-a12b-d69e23c7ca80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:40.482278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e2ce6-e8d4-4651-a12b-d69e23c7ca80 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:40.486231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9d0ec-90a6-402c-bde0-31efd423a5a9 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:40.488317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:40.530294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5caf2-3156-4634-b247-49b8b9966595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:40.531163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5caf2-3156-4634-b247-49b8b9966595 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.532112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5caf2-3156-4634-b247-49b8b9966595 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.532112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5caf2-3156-4634-b247-49b8b9966595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.542639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5caf2-3156-4634-b247-49b8b9966595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:40.544087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5caf2-3156-4634-b247-49b8b9966595 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:40.546962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e2b5caf2-3156-4634-b247-49b8b9966595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:40.562171 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:40.563093 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:40.563989 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:40.563989 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:40.563989 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:40.563989 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:40.563989 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 316/633] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:40.564907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd3b6-d18d-438e-b90c-1f045690c3d2 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.565276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd3b6-d18d-438e-b90c-1f045690c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.565550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cd3b6-d18d-438e-b90c-1f045690c3d2 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.566905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 317/634] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:40.567817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43635941-a50e-4d5f-a862-c2b62ece9df7 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.568099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43635941-a50e-4d5f-a862-c2b62ece9df7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.568366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43635941-a50e-4d5f-a862-c2b62ece9df7 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.573547 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 318/635] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:40.574151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43635941-a50e-4d5f-a862-c2b62ece9df7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:40.600606 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 318/636] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:40.601992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49945e-7a5e-4b74-82d5-976f20c4c563 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.602242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49945e-7a5e-4b74-82d5-976f20c4c563 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.602519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49945e-7a5e-4b74-82d5-976f20c4c563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.619506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6f49945e-7a5e-4b74-82d5-976f20c4c563 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:40.620701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6f49945e-7a5e-4b74-82d5-976f20c4c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:40.684451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43635941-a50e-4d5f-a862-c2b62ece9df7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:40.697057 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 319/637] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:40.697057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff4313-5bac-40fd-a7a7-04bfd22a8660 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.697057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff4313-5bac-40fd-a7a7-04bfd22a8660 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.697057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff4313-5bac-40fd-a7a7-04bfd22a8660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.715821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-16ff4313-5bac-40fd-a7a7-04bfd22a8660 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:40.717149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-16ff4313-5bac-40fd-a7a7-04bfd22a8660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:40.727110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:40.728047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.728533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.728981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.729925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:40.730404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:40.732014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:40.744550 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 319/638] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:40.745663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:40.762386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:40.796754 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 320/639] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:40.797671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff4313-5bac-40fd-a7a7-04bfd22a8660 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:40.818022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:40.870070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57a733-b4cd-4b65-9a31-86ae9ec6d775 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:40.903471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff4313-5bac-40fd-a7a7-04bfd22a8660 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:40.906322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:40.906523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.906787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.907062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.918393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:40.920526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:40.939932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:40.940864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:40.941170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:40.942892 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:40.944064 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:40.944064 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:40.944064 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:40.944064 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:40.944286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:40.944286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:40.944423 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 320/640] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:40.944423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:40.956324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:40.964243 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:40.965294 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:40.966204 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 321/641] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:40.966904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.029269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.056634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.066416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c470d0d-e732-4100-be4b-1e3293067557 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.082426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e851-2f50-4c62-866c-046aad772b5c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.100894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.101836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.102205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.102564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.110638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.112183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.118243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.119150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.119522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.119887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:41.126728 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:41.127931 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:41.128925 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 321/642] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:41.129595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.136537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:41.144378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:41.145552 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:41.146594 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 322/643] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:41.151170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.236032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4a51e-1358-4937-8c14-7fa3e9f6b328 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.258982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e3198-fb5e-477f-aee5-5bacd6737291 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.262008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.272254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.273060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.273451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.273813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.274669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:41.275058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.276967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.298596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 322/644] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:41.298596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.298873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.298873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.298873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.298873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.299207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:41.299207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.299207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.306584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.314054 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 323/645] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:41.314810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.411996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf173-b48d-41d7-b3e8-07425b9436bc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.423848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696270-b591-4076-998e-77ad1e7d24ed None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.447656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.448515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.448870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.449185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.450023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:41.450335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.451768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.460780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.461569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.461916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.462255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.463076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:41.463442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.464869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.470741 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 323/646] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:41.471684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.477799 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 324/647] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:41.478607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.521947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.548458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.579201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d02f71-a094-4f2e-b040-8de94953e4a0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.591183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dbf49-bc02-4fca-8f84-15ce970a8518 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.619484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.620401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.620906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.621351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.628921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.629762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.630044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.630317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.630511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.632530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.642306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.643784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:41.650792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:41.651684 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:41.652586 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 324/648] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:41.658446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:41.660944 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:41.661956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:41.662852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:41.662852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:41.662852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:41.662852 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:41.662852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 325/649] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:41.664915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.764088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72700904-0bc1-4bea-9f0e-0e58604430c4 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.766762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.773161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd67de-172d-4b6e-8823-fedad0b9a4ee None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.788947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:41.799254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.799891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.800171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.800611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.810808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:41.811608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:41.811884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:41.812157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:41.823372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.824840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:41.845722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:41.846629 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:41.847535 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:41.847535 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:41.847535 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:41.847535 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:41.848360 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 326/650] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:41.849228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.875183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:41.876644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:41.959447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaae9c-232c-48a3-a2cd-6fc7f318ee12 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:41.990751 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 325/651] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:41.991429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:41.995623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.000414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.001114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.001392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.001661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.002455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:42.002782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.004300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.016814 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 327/652] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:42.017584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.047958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.111946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdba5e9-cfeb-48a4-84ef-edb5e1517a23 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.135434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93f1a7-b951-4ec7-a02e-99e600486b04 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.148273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.148893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.149188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.149444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.150188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:42.150486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.151877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.164277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 326/653] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:42.165137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.173414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.174394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.174854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.175406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.176308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:42.176784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.178373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.190610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 328/654] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:42.191702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.234249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.273451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098df4b-68e5-4bbd-a368-4ec58db30f49 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.283285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.310414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83bbda-d7fb-4e3d-8176-0d3ce12bcaba None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.312251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.313046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.313346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.313616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.326952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.328497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.346021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.346835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.347182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:42.347293 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:42.348303 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:42.349359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:42.349359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:42.349359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:42.349359 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:42.349646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.349729 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 327/655] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:42.350529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=578ca3087f9442d88152f65fad464f32) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:42.350932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.352451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.354199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.359113 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 329/656] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/role_assignments?user.id=578ca3087f9442d88152f65fad464f32&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:42.370398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.499791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e9523-7037-4fea-8bb7-11bfd13538ed None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.501952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a9a5-e868-4474-9e72-9a30fb794c16 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.526533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.539567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.540362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.540645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.541023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.550053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.551523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.554204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.555761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.556208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.557925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:42.568006 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:42.568981 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:42.569962 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 330/657] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:42.570570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.575132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.576674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.586604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:42.598807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:42.599796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:42.600763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 328/658] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:42.601401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.699029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486efe0f-f4cd-497d-bac4-52e280b0ee3e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.722827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fbe99-4afd-438e-b4a7-3231f25bf3dc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.733586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.734259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.734542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.734821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.735547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:42.735855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.737306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.753682 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 331/659] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:42.753682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.762473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e849fe0-827b-434a-8b03-44b6ed1e274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.763167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849fe0-827b-434a-8b03-44b6ed1e274b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.763445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849fe0-827b-434a-8b03-44b6ed1e274b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.763719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e849fe0-827b-434a-8b03-44b6ed1e274b None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.764555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e849fe0-827b-434a-8b03-44b6ed1e274b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:42.765112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e849fe0-827b-434a-8b03-44b6ed1e274b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.766320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e849fe0-827b-434a-8b03-44b6ed1e274b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.783635 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 329/660] 10.222.0.30 () {56 vars in 1139 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:42.785023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01cda-c446-4595-ad99-ccc37d3c58d4 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.785346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01cda-c446-4595-ad99-ccc37d3c58d4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.785622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01cda-c446-4595-ad99-ccc37d3c58d4 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.786980 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 330/661] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:42.791514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01cda-c446-4595-ad99-ccc37d3c58d4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.825540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.829151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:42.861911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c359-92bc-4faa-87d3-752d355104e7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.895182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01cda-c446-4595-ad99-ccc37d3c58d4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:42.896741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.897746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.898088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.898370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.899206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:42.899507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.900924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.924398 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 332/662] 10.222.0.30 () {56 vars in 1137 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:42.925311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:42.931667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa1c6e-dfa7-4f85-8830-49e4218097fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:42.932472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa1c6e-dfa7-4f85-8830-49e4218097fc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.932753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa1c6e-dfa7-4f85-8830-49e4218097fc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.933022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa1c6e-dfa7-4f85-8830-49e4218097fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.940338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa1c6e-dfa7-4f85-8830-49e4218097fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:42.941848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa1c6e-dfa7-4f85-8830-49e4218097fc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a6aa1c6e-dfa7-4f85-8830-49e4218097fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:42.955905 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:42.957066 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:42.957972 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 331/663] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:42.958471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035751e-3e3d-48e8-aa21-e77c43b75fc7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:42.958471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035751e-3e3d-48e8-aa21-e77c43b75fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:42.958782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035751e-3e3d-48e8-aa21-e77c43b75fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:42.976777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5035751e-3e3d-48e8-aa21-e77c43b75fc7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:42.978005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5035751e-3e3d-48e8-aa21-e77c43b75fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:43.045766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e830-4cab-49d5-829c-dfba3ffc3a27 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.051808 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 332/664] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:43.062216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035751e-3e3d-48e8-aa21-e77c43b75fc7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.076866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.086932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.087587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.087864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.088137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.095711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.157092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.158728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.174766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035751e-3e3d-48e8-aa21-e77c43b75fc7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.214835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.215564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.215771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.216039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.265675 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 333/665] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:43.270266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.291461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.292924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.297297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.317502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.372731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd74f-4267-4f6c-a25d-12d127c99da9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.407607 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 333/666] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:43.407607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.418143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.418789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.419067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.419342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.420142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:43.420449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.421930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.435079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 334/667] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:43.436203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.520640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467b86e-8f86-471d-9e56-db38753692b6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.530005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.543580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17812b-5b3c-43dd-8cd9-b2ffd0a450c5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.545075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.556975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.557886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.558164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.558454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.568764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:43.576426 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:43.577411 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:43.578261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:43.581009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.581838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.582112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.582388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.582914 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 334/668] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:43.583806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.594204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.595640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:43.612653 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:43.613580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:43.614463 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:43.614463 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:43.614463 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:43.614463 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:43.614463 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 335/669] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:43.615312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.696148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6e711-eced-41f1-85db-c511910ed9b1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.734332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d425-4613-44b5-a147-d65d699bd0ea None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.735592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.737238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.737538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.737829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.750441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.752123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.769873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:43.770024 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:43.771254 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:43.772176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:43.772176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:43.772176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:43.772176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:43.772397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.772397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.772397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.772601 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 335/670] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:43.772601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.776425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=14f94931805a4215b22237194803d41c) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:43.776778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.778285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.793084 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 336/671] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/role_assignments?user.id=14f94931805a4215b22237194803d41c&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:43.793084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.795791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.838753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:43.905587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1220875-e2e0-464d-ab76-d5860f8d0356 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.919422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42edb6-e2c0-45f8-8e62-6cab6e290137 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:43.958122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.959182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.959727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.960209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.960314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:43.960897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:43.961209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:43.961481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:43.962030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:43.962222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:43.962496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.962904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:43.963888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.964766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:43.981672 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 336/672] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:43.982021 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 337/673] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:43.982853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:43.983337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.065972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:44.107886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610b0f0-49a6-4f28-a260-c81d12a44078 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.118116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:44.123742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11483468-f517-42a7-a0b7-d49c92a31a1e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.157511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.158194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.158475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.158788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.159522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:44.159924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.161287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.161427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.162187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.162550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.162976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.170341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.171969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.175145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 338/674] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:44.175999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:44.187634 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:44.188576 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:44.189707 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 337/675] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:44.191085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.301862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6e93d-cd47-4083-bc80-009c1faa2f67 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.308936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e59cfe-55c7-4530-8425-8d73546afffc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.331614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:44.344261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.345236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.345568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.345912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.357177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.357782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.358398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.358898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.359325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.359609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.368788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.370796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:44.378323 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:44.379429 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:44.380542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:44.380542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:44.380542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:44.380542 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:44.381687 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 339/676] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:44.382579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:44.389896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:44.390996 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:44.392116 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:44.394079 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 338/677] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:44.395566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.429848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:44.513508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a721c8-a056-4e86-a58b-51d542da4793 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.535098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d113b-8d2e-4047-b829-af4c438b46ad None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.549802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.550244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.550525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.550805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.551607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:44.551958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.553383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.566914 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 340/678] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:44.567686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.581386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.582717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.583203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.583956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.585682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:44.586488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.588472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.607736 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 339/679] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:44.609430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:44.613127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.678655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f34576-2887-453b-9c98-d47d9819cdb6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.716228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.716926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.717252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.717528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.718321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:44.718627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.720070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.721363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:44.735087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 341/680] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:44.735934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.750796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2172cd-01e3-40eb-b5a1-f6ac62476b9c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.797282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.799423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.800187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.800671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.802405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=9765a70014c74e61a93f84c801a10fa4) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:44.803187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.804843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.813700 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 340/681] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/role_assignments?user.id=9765a70014c74e61a93f84c801a10fa4&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:44.814946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.855484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:44.864822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a1ca2-50a8-40ea-b39d-20e3d7415137 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.910430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589db5ab-9064-456c-88b3-62ae364d3dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.911245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db5ab-9064-456c-88b3-62ae364d3dbe None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.911524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db5ab-9064-456c-88b3-62ae364d3dbe None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.911795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db5ab-9064-456c-88b3-62ae364d3dbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.922897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589db5ab-9064-456c-88b3-62ae364d3dbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.925363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589db5ab-9064-456c-88b3-62ae364d3dbe None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-589db5ab-9064-456c-88b3-62ae364d3dbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:44.941249 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:44.942394 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:44.943499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:44.944573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69fb6e-b0a4-4cb5-ba63-c2a650974bb4 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:44.947239 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 342/682] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:44.949322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72d0c-3369-4be6-b7bb-5c8fab38ae91 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.949883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72d0c-3369-4be6-b7bb-5c8fab38ae91 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.950572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72d0c-3369-4be6-b7bb-5c8fab38ae91 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.954144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 343/683] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:44.956004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d72d0c-3369-4be6-b7bb-5c8fab38ae91 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:44.990203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed991469-a03c-4b31-88dd-9618d62b9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:44.991049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed991469-a03c-4b31-88dd-9618d62b9c2e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:44.991285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed991469-a03c-4b31-88dd-9618d62b9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:44.991505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed991469-a03c-4b31-88dd-9618d62b9c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:44.992731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed991469-a03c-4b31-88dd-9618d62b9c2e None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=028b67b31190461b96d35563506b6c8e) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:44.992731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed991469-a03c-4b31-88dd-9618d62b9c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:44.994277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed991469-a03c-4b31-88dd-9618d62b9c2e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:45.001860 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 341/684] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/role_assignments?user.id=028b67b31190461b96d35563506b6c8e&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:45.003236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385127f-fb33-45d0-9be5-4ad34703dff4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.003520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385127f-fb33-45d0-9be5-4ad34703dff4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.003794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385127f-fb33-45d0-9be5-4ad34703dff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.017430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:45.025072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6385127f-fb33-45d0-9be5-4ad34703dff4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:45.026482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6385127f-fb33-45d0-9be5-4ad34703dff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:45.087467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d72d0c-3369-4be6-b7bb-5c8fab38ae91 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:45.114982 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 342/685] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:45.127506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:45.128532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.128996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.129510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.130551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:45.131044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:45.132840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:45.142154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385127f-fb33-45d0-9be5-4ad34703dff4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.156744 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 344/686] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Jun 18 21:45:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:45.162606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.183341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:45.282311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385127f-fb33-45d0-9be5-4ad34703dff4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:45.289234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974078ad-a8be-4b9d-8cd9-9b0887b55069 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:45.324160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:45.325297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.325708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.326143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.329723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:45.333137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:45.333916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.334293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.334715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.343927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:45.351799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:45.352938 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:45.354058 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:45.356441 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 343/687] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:45.362296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.427131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:45.429080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:45.461465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:45.476165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eaa32-c3b2-416b-83b8-fa94469f6cf6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:45.512588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:45.513591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.514015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.514431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.515320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:45.515770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:45.517342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:45.528557 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 344/688] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:45.534295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.534717 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 345/689] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:45.540166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.641401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bc4a5-e2a2-4e57-9335-1bb25e4e87fa None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:45.651104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:45.656477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:45.677306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:45.678575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.678575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.678838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.689620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:45.691192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:45.709601 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:45.710736 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:45.711829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:45.711829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:45.711829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:45.711829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:45.712741 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 346/690] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:45.718785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.745221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081cbc3-0a19-40d5-9fa9-e300fc7c3421 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:45.816342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:45.817272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.817552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.817820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.822380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d3e2-4403-4620-9d5d-ff9987a574ad None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:45.840953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:45.842476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:45.857798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:45.858475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:45.858758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:45.859033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:45.859764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:45.860064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:45.861517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:45.874252 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 347/691] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:45.879708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:45.881466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:45.882322 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:45.883291 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:45.883291 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:45.883291 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:45.883291 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:45.884868 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 345/692] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:45.890173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:45.909490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:45.985193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9331a9-2558-44b3-92e9-de3620ae08ee None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.020974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.021826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.022107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.022384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.029471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.030917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:46.045616 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:46.046517 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:46.047393 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 348/693] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:46.053008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:46.112417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62732d5-456c-4ebd-adb2-13e0b982a60d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.142280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:46.165492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:46.183558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0081c1-e9a9-4115-9680-1cc8acc38cb7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.193844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.194524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.194800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.195066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.195802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:46.196103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.197528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:46.222873 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 346/694] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:46.224588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:46.253453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.254144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.254424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.254699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.255513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:46.255815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.257338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:46.284155 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 349/695] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:46.291721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:46.375694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b220794-56b5-4734-af76-50fbe1fb80b1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.434259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.435611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.437631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.438977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.458146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.459936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:46.472645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fcfe6-902e-4fea-8727-2f966fcc373f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:46.481990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:46.482906 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:46.483844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:46.497735 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 347/696] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:45:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:46.500193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:46.539940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa6e10-bac9-44c4-8046-cefbca30dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.541235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6e10-bac9-44c4-8046-cefbca30dcdb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.541690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6e10-bac9-44c4-8046-cefbca30dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.542260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa6e10-bac9-44c4-8046-cefbca30dcdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.543731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa6e10-bac9-44c4-8046-cefbca30dcdb None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=f2272ca86c294ec4aa96eccc1827d4e2) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:46.544332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa6e10-bac9-44c4-8046-cefbca30dcdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.546437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa6e10-bac9-44c4-8046-cefbca30dcdb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:46.548275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:46.556458 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 350/697] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:46 2022] GET /identity/v3/role_assignments?user.id=f2272ca86c294ec4aa96eccc1827d4e2&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:46.558147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cb41-c2de-48d3-b419-a064eea8c37c None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.558592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cb41-c2de-48d3-b419-a064eea8c37c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.559022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cb41-c2de-48d3-b419-a064eea8c37c None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.561012 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 351/698] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:46.583156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1261872-879e-4ed4-a16e-84628ad48746 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.583737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1261872-879e-4ed4-a16e-84628ad48746 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.584187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1261872-879e-4ed4-a16e-84628ad48746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.618281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d1261872-879e-4ed4-a16e-84628ad48746 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:46.619838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d1261872-879e-4ed4-a16e-84628ad48746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:46.631220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:46.633963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b402927-a806-4080-bca2-f10640514a98 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.680709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.681433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.681714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.681982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.682849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:46.683155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.684715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:46.720960 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 348/699] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:45:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:46.724457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:46.739611 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 352/700] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:46.780729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1261872-879e-4ed4-a16e-84628ad48746 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:46.836076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:46.846958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb911c2-f147-44f9-b2ad-be350f8ba20d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.885020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.885860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.886235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.886602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.935140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1261872-879e-4ed4-a16e-84628ad48746 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:46.973081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:46.973971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:46.974346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:46.974737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:46.976257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.978623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:46.984833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:46.988755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:46.990471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:47.010378 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:47.011518 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:47.012638 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:47.012638 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:47.012638 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:47.012638 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:47.014097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 353/701] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:47.021280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:47.120066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:47.139054 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 349/702] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 21:45:47.144544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:47.157166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba2ff-17a7-46b8-b503-502b582bd145 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:47.196421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:47.197134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.197502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.197847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.198645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:47.199012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:47.200451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:47.213478 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 354/703] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:47.219541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:47.274941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:47.284883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90de6a-668b-40e4-ac7c-e5a89d513233 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:47.357148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:47.357950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.358227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.358494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.372516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e37293-01eb-445a-af31-d00c9a8b341f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:47.378567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:47.380053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:47.419480 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:47.420451 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:47.421454 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:47.421454 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:47.421454 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:47.421454 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:47.423277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 350/704] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:47.430149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:47.451053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:47.452272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.456868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.457439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.458403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:47.460119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:47.494953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:47.499887 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 355/705] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:45:47 2022] POST /identity/v3/users => generated 254 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:45:47.579501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23783d-f5d5-481a-af5c-ea4e1be7f703 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:47.623730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bba64-a3e4-4d95-8f42-e50e27886836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:47.624786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bba64-a3e4-4d95-8f42-e50e27886836 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.625311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bba64-a3e4-4d95-8f42-e50e27886836 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.625804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bba64-a3e4-4d95-8f42-e50e27886836 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.626765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bba64-a3e4-4d95-8f42-e50e27886836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:47.627409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bba64-a3e4-4d95-8f42-e50e27886836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:47.628980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bba64-a3e4-4d95-8f42-e50e27886836 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:47.645999 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 351/706] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:47.651378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:47.777608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b88b2b-2c7c-4b2c-a3d8-08f4c97ba461 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:47.793146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:47.802375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe2fb-a8e2-4bf2-b72b-f08fb588d4ea None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.802995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe2fb-a8e2-4bf2-b72b-f08fb588d4ea None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.803486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe2fb-a8e2-4bf2-b72b-f08fb588d4ea None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.805074 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 352/707] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:47.810493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82aa67-7742-4a73-9287-85ca26a26c7a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.810759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82aa67-7742-4a73-9287-85ca26a26c7a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.812675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82aa67-7742-4a73-9287-85ca26a26c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.832959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:47.833795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.834074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.834347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.839985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5b82aa67-7742-4a73-9287-85ca26a26c7a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:47.839985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5b82aa67-7742-4a73-9287-85ca26a26c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:47.847513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:47.849312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:47.867235 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:47.868206 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:47.869806 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 356/708] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:47.874618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:47.929242 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 353/709] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:47.934590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7ff8-aca3-4dca-8ee2-1b489d34b7b3 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.934879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7ff8-aca3-4dca-8ee2-1b489d34b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.935157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7ff8-aca3-4dca-8ee2-1b489d34b7b3 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.937461 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 354/710] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:47.942755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02dfea-89e2-4d77-9d41-21d7175cf2c9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:47.943043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02dfea-89e2-4d77-9d41-21d7175cf2c9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:47.943319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02dfea-89e2-4d77-9d41-21d7175cf2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:47.961286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cc02dfea-89e2-4d77-9d41-21d7175cf2c9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:47.962543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cc02dfea-89e2-4d77-9d41-21d7175cf2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:47.988643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:48.013525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884a801-dd18-4dc7-aaf8-5d60bb49023a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.042176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 355/711] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:48.043051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02dfea-89e2-4d77-9d41-21d7175cf2c9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:48.075295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.075965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.076241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.076512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.077346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:48.077652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.079433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.091903 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 357/712] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:48.092890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:48.121889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:48.189199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02dfea-89e2-4d77-9d41-21d7175cf2c9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.205537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be561939-ea04-42a5-9fbe-cbce1b0ed21f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.228283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.229458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.229949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.230394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.231379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.232979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.246381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.247202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.247481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.247760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.248416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:48.248810 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:48.249862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:45:48.250711 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:48.251536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.257215 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 356/713] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:48 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:48.258179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:48.265270 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:48.266418 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:48.267396 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 358/714] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Jun 18 21:45:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:48.268296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:48.293792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:48.376789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:48.390526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c771a4d-59b6-49a3-a602-5d196d64c9b0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.394429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f56ac-b8f0-4ec0-86cd-b09ea629c8c1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.428781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.429645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.429859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.430152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.430970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=578ca3087f9442d88152f65fad464f32) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:48.431281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.432801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.434442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.435487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.436413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.436956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.437935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] RBAC: Adding query filter params (name=network) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:48.438400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.439081 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 357/715] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:48 2022] GET /identity/v3/role_assignments?user.id=578ca3087f9442d88152f65fad464f32&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:48.440087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:48.440360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.447079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 359/716] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:45:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:48.456663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:48.582969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:48.599133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697720a-7248-47ae-9710-b4fc8d37ad34 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.640298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.641801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.642243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.642732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.643584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:48.644026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.645687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.652682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 358/717] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Jun 18 21:45:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:48.657945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:48.698372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1dca-b9e1-440f-9ee0-d9f57c8a35d3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.761427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68139dc5-dde7-4d95-9df1-f068d861e055 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:48.761758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c61ec-8425-402b-9427-8b9d163e4089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.762327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c61ec-8425-402b-9427-8b9d163e4089 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.762608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c61ec-8425-402b-9427-8b9d163e4089 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.762980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c61ec-8425-402b-9427-8b9d163e4089 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.763792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c61ec-8425-402b-9427-8b9d163e4089 None admin] RBAC: Adding query filter params (type=network) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:48.764104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c61ec-8425-402b-9427-8b9d163e4089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.765510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c61ec-8425-402b-9427-8b9d163e4089 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.780130 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 360/718] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:45:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:48.795739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334341d-322d-4e65-8e82-68349e21ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:48.796434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334341d-322d-4e65-8e82-68349e21ab11 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:48.796712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334341d-322d-4e65-8e82-68349e21ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:48.796985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334341d-322d-4e65-8e82-68349e21ab11 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:48.797760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334341d-322d-4e65-8e82-68349e21ab11 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:48.798060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334341d-322d-4e65-8e82-68349e21ab11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:48.799618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334341d-322d-4e65-8e82-68349e21ab11 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:48.806439 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 359/719] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Jun 18 21:45:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:49.683498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993178-a578-4b06-8225-a330b784eedc None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:49.684057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993178-a578-4b06-8225-a330b784eedc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:49.684057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03993178-a578-4b06-8225-a330b784eedc None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:49.685654 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 361/720] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:49.691224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944829a2-0db6-4b80-ae98-679f741f916c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:49.691655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944829a2-0db6-4b80-ae98-679f741f916c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:49.691828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944829a2-0db6-4b80-ae98-679f741f916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:49.714283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-944829a2-0db6-4b80-ae98-679f741f916c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:49.715465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-944829a2-0db6-4b80-ae98-679f741f916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:49.730795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:49.810723 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 360/721] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:49.848739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03993178-a578-4b06-8225-a330b784eedc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:49.877274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:49.989822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03993178-a578-4b06-8225-a330b784eedc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:50.058704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:50.059518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.059801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.060076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.071105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:50.079158 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:50.080182 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:50.081066 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 362/722] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:50.087871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944829a2-0db6-4b80-ae98-679f741f916c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:50.251435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944829a2-0db6-4b80-ae98-679f741f916c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:50.302078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6053991-2dab-48f7-a885-e252da99a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:50.303147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053991-2dab-48f7-a885-e252da99a700 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.303622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053991-2dab-48f7-a885-e252da99a700 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.304085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053991-2dab-48f7-a885-e252da99a700 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.305060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6053991-2dab-48f7-a885-e252da99a700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:50.305582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6053991-2dab-48f7-a885-e252da99a700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:50.307149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6053991-2dab-48f7-a885-e252da99a700 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:50.321490 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 361/723] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:50.328675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:50.387256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7efc3-3651-4248-94b5-8662e70df324 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.387581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7efc3-3651-4248-94b5-8662e70df324 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.387815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7efc3-3651-4248-94b5-8662e70df324 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.389273 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 362/724] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:50.394748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c33e0-9632-48cf-a82f-405b1bc477c8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.395032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c33e0-9632-48cf-a82f-405b1bc477c8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.395301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c33e0-9632-48cf-a82f-405b1bc477c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.425428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-052c33e0-9632-48cf-a82f-405b1bc477c8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:50.428511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-052c33e0-9632-48cf-a82f-405b1bc477c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:50.434207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:50.467003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:50.506336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96689023-4f0b-45e9-9a13-f52bc898ff96 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:50.518605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 363/725] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 21:45:50.546461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:50.547263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.547545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.547824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.556572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c33e0-9632-48cf-a82f-405b1bc477c8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:50.559877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:50.561547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:50.580274 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:50.581338 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:50.582222 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:50.582222 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:50.582222 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:50.582222 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:50.582222 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 363/726] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:50.586800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:50.715758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f150d2-1205-40b1-ada7-9dd906b48730 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:50.774353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:50.780720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c33e0-9632-48cf-a82f-405b1bc477c8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:50.786068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:50.786744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.787018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.787289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.788022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:50.788322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:50.789718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:50.812800 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 364/727] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:50.819034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:50.845681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:50.846497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.846775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.847046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.857207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:50.863706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:50.873433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:50.874401 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:50.875240 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 364/728] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:50.880892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:50.939144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052074ee-c31f-4968-bae8-9a3c861bc416 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:50.977584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:50.978675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:50.979094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:50.979500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:50.988534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:50.990203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:51.006491 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:51.007634 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:51.008809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:51.011177 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 365/729] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:51.022165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:51.116672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b738e-8ee2-41ec-b13a-56add241a995 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:51.148821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:51.154926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:51.155638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.155921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.156201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.157198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:51.158292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:51.159733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.169632 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 365/730] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:51.176753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:51.285569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:51.303035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922fe2-ff07-4ccd-8137-ac475eb6b7ae None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:51.306072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacbd6a-1d05-4073-ac86-fdf3ed1ca0b6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:51.367386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:51.368298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.368597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.368879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.369796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:51.370108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:51.371734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.397522 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 366/731] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Jun 18 21:45:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:51.399669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:51.401272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624d4e4-d10a-46cd-ba3b-a4cdd975ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:51.402091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d4e4-d10a-46cd-ba3b-a4cdd975ab34 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.402372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d4e4-d10a-46cd-ba3b-a4cdd975ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.402641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624d4e4-d10a-46cd-ba3b-a4cdd975ab34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.429939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624d4e4-d10a-46cd-ba3b-a4cdd975ab34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:51.431423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624d4e4-d10a-46cd-ba3b-a4cdd975ab34 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-8624d4e4-d10a-46cd-ba3b-a4cdd975ab34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:51.450142 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:51.451090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:51.451984 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:51.451984 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:51.451984 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:51.451984 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:51.451984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 366/732] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:51.457056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25206c-2708-49be-8250-ff7957a2e681 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.457056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25206c-2708-49be-8250-ff7957a2e681 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.457056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25206c-2708-49be-8250-ff7957a2e681 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.460487 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 367/733] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:51.461591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25206c-2708-49be-8250-ff7957a2e681 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:51.510858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f9f2-2921-42c8-acde-d0118db99f6b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:51.523715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:51.550871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:51.551472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.551755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.552033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.580298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25206c-2708-49be-8250-ff7957a2e681 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:51.594517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:51.620183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cec94-03ca-43b5-a028-a6a77681ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:51.621521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cec94-03ca-43b5-a028-a6a77681ccdb None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.622307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cec94-03ca-43b5-a028-a6a77681ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.622979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cec94-03ca-43b5-a028-a6a77681ccdb None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.623859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cec94-03ca-43b5-a028-a6a77681ccdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:51.624308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cec94-03ca-43b5-a028-a6a77681ccdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:51.626132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cec94-03ca-43b5-a028-a6a77681ccdb None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.628714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:51.630343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.645180 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 368/734] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:51.646509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bccc8-e93b-4523-a958-2faaf03f9205 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.646778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bccc8-e93b-4523-a958-2faaf03f9205 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.647053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bccc8-e93b-4523-a958-2faaf03f9205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.664827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8b3bccc8-e93b-4523-a958-2faaf03f9205 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:51.666706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8b3bccc8-e93b-4523-a958-2faaf03f9205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:51.745055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 369/735] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:51.745297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 367/736] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 21:45:51.745740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa8641-59c2-413e-a797-5c2343457d3e None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.745740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa8641-59c2-413e-a797-5c2343457d3e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.745740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa8641-59c2-413e-a797-5c2343457d3e None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.745975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:51.746067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 370/737] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:51.746285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa8641-59c2-413e-a797-5c2343457d3e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:51.757734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:51.847787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa8641-59c2-413e-a797-5c2343457d3e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:51.849244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:51.850166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5492d1-1bfa-4668-8824-1e99427cbc7d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:51.883041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:51.883571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127380dc-3056-44f2-88d1-1b945384d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:51.883841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.884117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.884386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.884502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127380dc-3056-44f2-88d1-1b945384d089 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.884666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127380dc-3056-44f2-88d1-1b945384d089 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.884943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127380dc-3056-44f2-88d1-1b945384d089 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.892283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127380dc-3056-44f2-88d1-1b945384d089 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:51.893808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127380dc-3056-44f2-88d1-1b945384d089 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.894567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:51.896010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-127380dc-3056-44f2-88d1-1b945384d089 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:51.908551 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:51.909724 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:45:51.910869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:51.913068 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:51.914562 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:51.916695 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:51.916695 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:51.916695 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:51.916695 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:51.917306 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 368/738] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:45:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:51.917450 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 371/739] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:51.917597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca6ac-7f31-4588-a4de-0e5a01f27500 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:51.917597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca6ac-7f31-4588-a4de-0e5a01f27500 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:51.917869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:51.918118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca6ac-7f31-4588-a4de-0e5a01f27500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:51.932458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-989ca6ac-7f31-4588-a4de-0e5a01f27500 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:51.933684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-989ca6ac-7f31-4588-a4de-0e5a01f27500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:51.997426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.003023 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 369/740] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:52.004369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b624af-7b97-4895-b1a8-e8fce1814e5d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.004667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b624af-7b97-4895-b1a8-e8fce1814e5d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.004938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b624af-7b97-4895-b1a8-e8fce1814e5d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.009221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 370/741] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:52.009221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b624af-7b97-4895-b1a8-e8fce1814e5d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.015678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91832381-0783-4c46-aea0-664b014047b5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.051725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.052530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.052796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.053104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.062973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:52.070652 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:52.071615 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:52.072450 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 372/742] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:52.073738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.088949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.118898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b624af-7b97-4895-b1a8-e8fce1814e5d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.152301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c8b2f-988d-429f-bfb1-866c7a8e365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.152971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c8b2f-988d-429f-bfb1-866c7a8e365f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.153281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c8b2f-988d-429f-bfb1-866c7a8e365f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.153555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c8b2f-988d-429f-bfb1-866c7a8e365f None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.154403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c8b2f-988d-429f-bfb1-866c7a8e365f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:52.154703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c8b2f-988d-429f-bfb1-866c7a8e365f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.156134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c8b2f-988d-429f-bfb1-866c7a8e365f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.172906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b2c4-9f1c-452d-b226-bbc5ffa1768c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.179046 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 371/743] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:52.179046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af9c6-0ad4-4e87-89b2-416c16d3524b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.179046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af9c6-0ad4-4e87-89b2-416c16d3524b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.179046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af9c6-0ad4-4e87-89b2-416c16d3524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.195512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ac4af9c6-0ad4-4e87-89b2-416c16d3524b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:52.196674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ac4af9c6-0ad4-4e87-89b2-416c16d3524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:52.208623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.209319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.209599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.209872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.210602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:52.210926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.212307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.224076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 373/744] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:52.224920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.252584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.266014 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 372/745] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 21:45:52.266817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4af9c6-0ad4-4e87-89b2-416c16d3524b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.298524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.324377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b8581-5c5f-4eb3-8e81-f5b8aef6ac96 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.357196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.357858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.358152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.358414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.359128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.360483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.372420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4af9c6-0ad4-4e87-89b2-416c16d3524b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.374623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 374/746] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:45:52 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:52.375419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.445211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.445907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.446195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.446497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.447249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:52.447551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.448989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.459089 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 373/747] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:52.462066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.491236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fa97e-ff59-4352-b2df-4100ea2cefb2 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.515476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.534537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.535235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.535483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.535754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.538939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.585467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262fa1-277a-4a13-aa66-89c6a5da84a2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.618412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.619890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.626412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.628581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.629357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.629830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.639157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.640636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:52.654903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:52.655780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:52.656698 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 374/748] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:52.657214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.729813 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 375/749] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 21:45:52.730725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.769222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.776252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068438e2-172c-4acd-ad13-2cd28e1015e8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.784167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:52.811678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.812588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.812865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.813166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.813942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.815418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.837066 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 375/750] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:45:52 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:45:52.837066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.859260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc1539-187e-41ed-a911-82149a5aa0b1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:52.914742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:52.915652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:52.915992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:52.916322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:52.928624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:52.930407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:52.951109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:52.952089 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:52.953388 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:52.953388 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:52.953388 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:52.953388 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:52.957746 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 376/751] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:52.958921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:52.965760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21104e8b-7340-462b-b7aa-30eb0e516a29 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.013156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.014108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.014387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.014661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.015731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:53.016065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.018022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.038187 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 376/752] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:53.038897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.062989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:53.073397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:53.090316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955a6c7-c89c-4858-a8b0-35748c63d19a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.126725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.127583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.127861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.128175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.139407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.140937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:53.160599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:53.161590 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:53.162481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:53.162481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:53.162481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:53.162481 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:53.162481 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 377/753] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:53.163192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.173904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9cd16-d676-4ad3-8160-6b7f105b5d25 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.220735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.222132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.222841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.223287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.224459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:53.225347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.227401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.243652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 377/754] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:53.245171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.269604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9291-19d5-45b2-aa0b-f09721797d37 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.315659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.316318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.316599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.316871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.317823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=f2272ca86c294ec4aa96eccc1827d4e2) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:53.318139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.319719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.321648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:53.326628 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 378/755] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/role_assignments?user.id=f2272ca86c294ec4aa96eccc1827d4e2&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:53.327189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.354128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:53.378153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0ac2f-cccf-4215-83fe-f76ce73a598d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.425417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.427031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.427533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.428023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.428992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:53.429522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.431159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.448009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 378/756] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:53.453862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.462366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94f839-29ec-4ac1-a24f-3bb53c324825 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.536900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.538324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.538822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.539339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.557620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.562806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:53.589851 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:53.590965 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:53.591949 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:53.598225 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 379/757] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:53.604235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.667181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39d3c-c5d5-42c7-9f7d-1def631353ad None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.673771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:53.729128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16e2d5-610d-436d-b88e-0408e178e16e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.745571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.746058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.746342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.746619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.754333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.756099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:53.771727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:53.772655 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:53.773591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 379/758] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:53.778571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.788993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:53.824880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.825847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.826295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.826714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.827693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:53.828445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.830125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.871126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 380/759] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:53.876211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:53.928768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67332ebb-2bcd-45a6-8aa4-9323481b4bcb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:53.982756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:53.983397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:53.983677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:53.983950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:53.984742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:53.985059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:53.986628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:53.989375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53de2d-3caa-490a-a1a5-bb8668982b23 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:54.006274 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 380/760] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:54.012247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:54.018104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:54.055873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:54.056681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.056962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.057272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.074618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:54.076099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:54.106804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:54.107735 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:54.108619 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:54.108619 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:54.108619 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:54.108619 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:54.109319 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 381/761] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:54.120473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:54.153415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:54.236291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a74a-0947-49a2-89ac-30fc06edcf58 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:54.245099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c441a-1ca5-4727-9fe1-e939f912546f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:54.299480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:54.300486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:54.301456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.302613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.303088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.303270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.303720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.304780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=7b4aee381e9f4ba3b2f7c8a82f1842be) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:54.305287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.306241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:54.306790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:54.308492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:54.309144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:54.310743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:54.325206 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 381/762] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:45:54 2022] GET /identity/v3/role_assignments?user.id=7b4aee381e9f4ba3b2f7c8a82f1842be&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:54.339142 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 382/763] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:54.345007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:54.462221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def05bde-a07a-44fb-9053-30afdcbbba87 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:54.492106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:54.503344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:54.504216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.508837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.509155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.517161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:54.518713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:54.535071 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:54.536049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:54.536931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 382/764] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:54.542496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:54.587975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:54.679759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bccf2-843d-4897-a2e7-d76fa3c11b51 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:54.715570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73745c35-f15a-4f8a-9ead-c6e52af9a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:54.716252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73745c35-f15a-4f8a-9ead-c6e52af9a442 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.716533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73745c35-f15a-4f8a-9ead-c6e52af9a442 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.716805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73745c35-f15a-4f8a-9ead-c6e52af9a442 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.717651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73745c35-f15a-4f8a-9ead-c6e52af9a442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:54.717964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73745c35-f15a-4f8a-9ead-c6e52af9a442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:54.719455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73745c35-f15a-4f8a-9ead-c6e52af9a442 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:54.736589 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 383/765] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:54.745185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:54.797813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba78c9-f028-48cb-9005-dfd6f0255dd5 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.798159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba78c9-f028-48cb-9005-dfd6f0255dd5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.798376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba78c9-f028-48cb-9005-dfd6f0255dd5 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.800085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 384/766] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:54.806634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa273c6-04c9-4a11-ab13-750c5536eaee None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.806965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa273c6-04c9-4a11-ab13-750c5536eaee None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.807220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa273c6-04c9-4a11-ab13-750c5536eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.842087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4aa273c6-04c9-4a11-ab13-750c5536eaee None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:54.843305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4aa273c6-04c9-4a11-ab13-750c5536eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:54.882638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41652e4-6a67-4195-b033-b80c156d1c07 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:54.943681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:54.944966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:54.945660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:54.946882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/578ca3087f9442d88152f65fad464f32/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:54.950921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=578ca3087f9442d88152f65fad464f32, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:54.952939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:54.957458 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 385/767] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:45:54.983221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 383/768] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:45:54 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/578ca3087f9442d88152f65fad464f32/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:45:54.984154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa273c6-04c9-4a11-ab13-750c5536eaee None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:55.011275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:55.134077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa273c6-04c9-4a11-ab13-750c5536eaee None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:55.179878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:55.180702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:55.180978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:55.181273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:55.181931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:55.183291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:55.200299 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:55.201379 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:55.202215 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 386/769] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Jun 18 21:45:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:55.208327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:55.301125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:55.354425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95a03b-ba2f-4867-8ef4-ce2692a57027 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:55.391615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:55.392429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:55.392710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:55.392982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:55.393731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:55.394037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:55.395396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:55.404741 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 384/770] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Jun 18 21:45:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:55.406094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:55.506615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:55.533491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88a114-a2b7-4dee-b8a5-3829a8408833 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:55.578657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:55.579246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:55.579525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:55.579965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:55.580682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:55.580985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:55.582375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:55.596944 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 387/771] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Jun 18 21:45:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:55.599244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:55.723064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f0245-5d34-4233-9c64-3f296b11c6d7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:55.741336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:55.760469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418cb6-4f48-453a-817d-1a7912e58c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:55.761191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418cb6-4f48-453a-817d-1a7912e58c9f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:55.761469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418cb6-4f48-453a-817d-1a7912e58c9f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:55.761740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418cb6-4f48-453a-817d-1a7912e58c9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:55.762556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32418cb6-4f48-453a-817d-1a7912e58c9f None admin] RBAC: Adding query filter params (interface=public, service_id=aa95f99e5a6f49aa9cea322cb1cd8da5, region_id=RegionOne) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:55.762866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32418cb6-4f48-453a-817d-1a7912e58c9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:55.764275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32418cb6-4f48-453a-817d-1a7912e58c9f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:55.777147 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 385/772] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:45:55 2022] GET /identity/v3/endpoints?service_id=aa95f99e5a6f49aa9cea322cb1cd8da5&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:55.778885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:55.879095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f96b33-1e5a-4d8a-876d-a4594556514d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:55.879279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f96b33-1e5a-4d8a-876d-a4594556514d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:55.879549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f96b33-1e5a-4d8a-876d-a4594556514d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:55.880970 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 386/773] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:55.885936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d858-2a4a-426f-a4c8-9a5d0d29508c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:55.886610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d858-2a4a-426f-a4c8-9a5d0d29508c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:55.886610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d858-2a4a-426f-a4c8-9a5d0d29508c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:55.899925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ed21e-b095-4f5d-a64f-e71d49021add None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:55.903300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cbe2d858-2a4a-426f-a4c8-9a5d0d29508c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:55.904490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cbe2d858-2a4a-426f-a4c8-9a5d0d29508c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:55.961896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:55.963330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:55.963816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:55.964286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:55.965239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:55.966914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:55.977171 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 388/774] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:45:55 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:55.988281 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 387/775] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:45:56.012538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.035513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:56.146964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3152086-07c3-4387-b542-bd7e97552b27 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.147475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3152086-07c3-4387-b542-bd7e97552b27 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.147890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3152086-07c3-4387-b542-bd7e97552b27 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.149454 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 388/776] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:45:56.157959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472be85-21c4-43a1-9471-56eaed59bbfe None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.158245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472be85-21c4-43a1-9471-56eaed59bbfe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.158523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472be85-21c4-43a1-9471-56eaed59bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.175988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1472be85-21c4-43a1-9471-56eaed59bbfe None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:56.177243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1472be85-21c4-43a1-9471-56eaed59bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:56.189362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a830d6-63e4-449b-9eb8-a75b13ecd046 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:56.225917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:56.227127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.227599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.228056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.228898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:56.230636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:56.242911 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:56.243975 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:45:56.244802 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:56.247716 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 389/777] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:56.253767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.261329 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 389/778] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:45:56.278890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472be85-21c4-43a1-9471-56eaed59bbfe None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.328467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:56.348726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:56.376297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49396a49-2622-4a52-9bf6-d8fc6f8591d8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:56.391706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472be85-21c4-43a1-9471-56eaed59bbfe None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:56.413184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:56.414614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.415048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.415465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.416348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] RBAC: Adding query filter params (name=network) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:56.416848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:56.418534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:56.425552 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 390/779] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:56.430904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.447145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:56.447963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.448237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.448501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.475075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:56.490829 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:56.491997 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:56.493076 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 390/780] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:56.500784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.540924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82f0d7-792c-40c7-9e6a-a025e3f1dda4 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:56.576259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:56.577291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.577767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.578488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.579434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] RBAC: Adding query filter params (type=network) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:56.579929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:56.581641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:56.592460 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 391/781] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:56.595614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.599997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:56.727741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a672b87-32a3-4b95-8efa-2124f210027c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:56.730132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:56.737056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eee64-dab8-4938-8ea9-2628dfd016de None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:56.764105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:56.764777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.765081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.765362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.766158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] RBAC: Adding query filter params (interface=public, service_id=9567b67743a6457390314f4d15eacf72, region_id=RegionOne) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:56.766701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:56.768211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:56.777521 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 392/782] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/endpoints?service_id=9567b67743a6457390314f4d15eacf72&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:56.783319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.834353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:56.835035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.835313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.835581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.836337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:56.836638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:56.838200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:56.859584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 391/783] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:56.864817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:56.865558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:56.896600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c51c-5135-41c9-9b4c-4f1a5fbae768 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:56.931340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:56.932012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:56.932295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:56.932568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:56.933291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:56.934775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:56.940433 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 393/784] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:57.093245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123c5b1-bee6-4e98-b388-48833f151307 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:57.158308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4073e-d622-4f3c-807a-62555e31ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:57.159130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4073e-d622-4f3c-807a-62555e31ce0f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.159407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4073e-d622-4f3c-807a-62555e31ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.159682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4073e-d622-4f3c-807a-62555e31ce0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.180057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4073e-d622-4f3c-807a-62555e31ce0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:57.181563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4073e-d622-4f3c-807a-62555e31ce0f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-81b4073e-d622-4f3c-807a-62555e31ce0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:57.198979 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:57.199895 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:57.200818 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:57.200818 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:57.200818 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:57.200818 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:57.200818 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 392/785] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:57.206188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:57.311542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bda407-029d-4e3e-baf2-193593d320d6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:57.344690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31795-712c-4509-bba0-42f1f8c19932 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.344979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31795-712c-4509-bba0-42f1f8c19932 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.345372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c31795-712c-4509-bba0-42f1f8c19932 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.346999 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 393/786] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:57.350545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:57.352003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0613e49-48c2-4b29-89af-de044d4beeef None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.352287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0613e49-48c2-4b29-89af-de044d4beeef None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.352561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0613e49-48c2-4b29-89af-de044d4beeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.353438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:57.354109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.354392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.354671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.357857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:57.358172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:57.359626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:57.371246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f0613e49-48c2-4b29-89af-de044d4beeef None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:57.372533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0613e49-48c2-4b29-89af-de044d4beeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:57.377627 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 394/787] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:57.381381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:57.385938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:57.481634 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 394/788] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:45:57.519593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0613e49-48c2-4b29-89af-de044d4beeef None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:57.584178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348048a-9d9d-44f0-81c5-20e143b1b3a6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:57.630647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:57.631807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.632093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.632376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.650371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:57.652224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:57.678077 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:57.679094 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:45:57.680033 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:57.681068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 395/789] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:57.691670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:57.708017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0613e49-48c2-4b29-89af-de044d4beeef None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:57.775878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:57.776749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.777049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.778322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.786168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:57.800957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:57.818183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:57.819244 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:57.820073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 395/790] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:45:57.828200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:57.847447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:57.882601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881a1ca-c73e-451d-91a4-8aa8ef74aa1e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:57.927043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0a6ff-a865-4d37-b6e3-e06fe656d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:57.927726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a6ff-a865-4d37-b6e3-e06fe656d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.928004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a6ff-a865-4d37-b6e3-e06fe656d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.928275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0a6ff-a865-4d37-b6e3-e06fe656d5c5 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.929139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0a6ff-a865-4d37-b6e3-e06fe656d5c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:57.929450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0a6ff-a865-4d37-b6e3-e06fe656d5c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:57.931013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0a6ff-a865-4d37-b6e3-e06fe656d5c5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:57.951199 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 396/791] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Jun 18 21:45:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:57.952532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012bbf-9ea3-45ce-84be-99fc85b4f04e None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:57.953156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012bbf-9ea3-45ce-84be-99fc85b4f04e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:57.953421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012bbf-9ea3-45ce-84be-99fc85b4f04e None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:57.959392 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 397/792] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:57.960372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012bbf-9ea3-45ce-84be-99fc85b4f04e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:57.971685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de52115-c8cc-4369-9a28-844f93212f1b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.007105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8e92d-583e-4ded-94c4-74653366110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.007780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8e92d-583e-4ded-94c4-74653366110b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.008060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8e92d-583e-4ded-94c4-74653366110b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.008336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8e92d-583e-4ded-94c4-74653366110b None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.009134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8e92d-583e-4ded-94c4-74653366110b None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:58.009541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8e92d-583e-4ded-94c4-74653366110b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.010930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8e92d-583e-4ded-94c4-74653366110b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.029252 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 396/793] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:45:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:58.029252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3f86e-8a62-437e-ba41-ad003ae6896b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.029252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3f86e-8a62-437e-ba41-ad003ae6896b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.029252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3f86e-8a62-437e-ba41-ad003ae6896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.047898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-77d3f86e-8a62-437e-ba41-ad003ae6896b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:58.049342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77d3f86e-8a62-437e-ba41-ad003ae6896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:58.073653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012bbf-9ea3-45ce-84be-99fc85b4f04e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.085235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.115927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.116735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.117011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.117429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.120609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.129723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.137218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.137425 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 397/794] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:45:58.138499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3f86e-8a62-437e-ba41-ad003ae6896b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:58.153485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:58.154563 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:58.155550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:58.155550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:58.155550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:58.155550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:58.155550 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 398/795] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:58.155836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.268732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3f86e-8a62-437e-ba41-ad003ae6896b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.268933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f9298-23c2-4c18-ad6c-54d34e27aff7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.305667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.305874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.306336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.306613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.306882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.307602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:58.307803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.307930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.308406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.308867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.309269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.320410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.321779 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 399/796] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:45:58.322423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.322723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:58.342462 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:58.343403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:58.344318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:58.344318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:58.344318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:58.344318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:58.345744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.352530 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 398/797] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:58.354600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.404859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.432492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353aa6-33ba-4df8-ac1b-28c33fb0998e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.465468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ed872-ff96-46a8-a95e-a672f312bc6d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.471878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.472858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.473306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.473809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.485533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:45:58.493843 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:58.494774 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:45:58.495611 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:58.498154 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 400/798] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:58.499312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.506667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.507483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.507760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.508034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.515776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.517328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:45:58.532391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:58.533396 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:58.534407 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 399/799] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:58.534901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.595006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.616235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7785d-7a72-4dee-af67-ba5ae6570f8d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.643130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22554c7b-47b9-4b0e-aad3-0dcfabd962aa None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.650701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.656075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.657060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.657731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.658198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.659256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:58.659838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.661568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.675844 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 401/800] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:58.677170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.693528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.694227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.694514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.694800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.695586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:58.695895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.697450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.712784 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 400/801] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:58.713973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.790166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66944b91-b37c-491f-b080-273dadfbc7af None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.822485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3199994-c264-47ee-9b0e-68e740f27689 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.827310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.828575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.829068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.829585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.830628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:58.831128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.832903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.842567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.846297 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 402/802] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:58.847503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.861435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.862596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.863020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.863481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:58.872146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:58.873924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:58.889916 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:58.890932 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:45:58.891903 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:58.899344 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 401/803] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:58.900452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:58.933272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:58.956282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2962b9-4725-4985-a2d3-1906ff5b6011 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:58.992336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:58.993201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:58.993486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:58.993752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.004747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.006299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.010988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed4cf9-f15c-4a0f-a444-7e11da935e46 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:59.024020 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:59.024991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:59.025932 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:59.025932 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:59.025932 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:59.025932 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:59.030137 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 403/804] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:59.030732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.058756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60565e7-7cbe-47bb-9646-fe5b9f43fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.059815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60565e7-7cbe-47bb-9646-fe5b9f43fb33 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.060273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60565e7-7cbe-47bb-9646-fe5b9f43fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.060424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60565e7-7cbe-47bb-9646-fe5b9f43fb33 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/f2272ca86c294ec4aa96eccc1827d4e2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.062594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60565e7-7cbe-47bb-9646-fe5b9f43fb33 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=f2272ca86c294ec4aa96eccc1827d4e2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.064210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60565e7-7cbe-47bb-9646-fe5b9f43fb33 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.080750 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 402/805] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:45:58 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/f2272ca86c294ec4aa96eccc1827d4e2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:45:59.082655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff9be-e64b-48a5-aa24-ec9e720b67c4 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.083022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff9be-e64b-48a5-aa24-ec9e720b67c4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.083380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff9be-e64b-48a5-aa24-ec9e720b67c4 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.089655 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 403/806] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:59.089655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ff9be-e64b-48a5-aa24-ec9e720b67c4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.097016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:59.154247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cb617-f97d-4a59-baf3-029aa2909226 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.196507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493a77-7c0f-4690-85b3-28b1df216108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.197272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493a77-7c0f-4690-85b3-28b1df216108 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.197626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493a77-7c0f-4690-85b3-28b1df216108 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.197980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493a77-7c0f-4690-85b3-28b1df216108 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.198972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493a77-7c0f-4690-85b3-28b1df216108 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:59.199356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493a77-7c0f-4690-85b3-28b1df216108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.201071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493a77-7c0f-4690-85b3-28b1df216108 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.208903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:59.225974 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 404/807] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:59.227737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e9e8-5f6e-4a3e-aba7-f59b92b9fddd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.228071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ff9be-e64b-48a5-aa24-ec9e720b67c4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.228200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e9e8-5f6e-4a3e-aba7-f59b92b9fddd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.228352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e9e8-5f6e-4a3e-aba7-f59b92b9fddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.250360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a683e9e8-5f6e-4a3e-aba7-f59b92b9fddd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:59.251997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a683e9e8-5f6e-4a3e-aba7-f59b92b9fddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:59.269940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.270729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.271087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.271468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.272432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:59.272803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.274559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.289906 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 404/808] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:59.290960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.345355 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 405/809] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:45:59.346837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e9e8-5f6e-4a3e-aba7-f59b92b9fddd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.401964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:59.420483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5318-29da-40d1-99a5-e1f298a5c78d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.464817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.465701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.465980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.466251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.472527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e9e8-5f6e-4a3e-aba7-f59b92b9fddd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.477136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.478649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.487840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:45:59.498489 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:59.499640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:59.500734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:45:59.500734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:45:59.500734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:45:59.500734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:59.502441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 405/810] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:59.502647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.513703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.514680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.515031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.515366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.523967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.525556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:45:59.541889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:59.543030 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:45:59.544194 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:45:59.546895 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 406/811] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:59.547278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.611802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517425b6-a64a-45ba-8762-6836c044ddc0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.649086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.649953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.650233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.650515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.651184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.652591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.654000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:59.658517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b86147-5809-46d7-84c0-0aa7fb29ad6f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:45:59.667132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:45:59.668139 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 18 21:45:59.668973 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:45:59.673366 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 406/812] 10.222.0.30 () {56 vars in 1129 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:45:59.674275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.700241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395628c3-4ce7-4ebd-abf3-c061d1981db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.700934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395628c3-4ce7-4ebd-abf3-c061d1981db8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.701247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395628c3-4ce7-4ebd-abf3-c061d1981db8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.701515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395628c3-4ce7-4ebd-abf3-c061d1981db8 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.702253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395628c3-4ce7-4ebd-abf3-c061d1981db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:59.702554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395628c3-4ce7-4ebd-abf3-c061d1981db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.704227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395628c3-4ce7-4ebd-abf3-c061d1981db8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.720886 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 407/813] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:59.720886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642b070-74ba-4c81-ae03-a18597be3314 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.720886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642b070-74ba-4c81-ae03-a18597be3314 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.720886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642b070-74ba-4c81-ae03-a18597be3314 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.720886 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 408/814] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:45:59.720886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642b070-74ba-4c81-ae03-a18597be3314 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.748361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:59.792348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e621d19-7df8-4bab-9b3a-7697effd0a54 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.826133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642b070-74ba-4c81-ae03-a18597be3314 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.828192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.828865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.829181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.829546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.830383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:59.830684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.832107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.851037 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 407/815] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:59.851684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.865978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed2987-26ae-4686-995d-260c94ead526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:45:59.866657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2987-26ae-4686-995d-260c94ead526 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.866948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2987-26ae-4686-995d-260c94ead526 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.867223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed2987-26ae-4686-995d-260c94ead526 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.867965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2987-26ae-4686-995d-260c94ead526 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:45:59.868268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2987-26ae-4686-995d-260c94ead526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:45:59.869730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed2987-26ae-4686-995d-260c94ead526 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:45:59.879238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 409/816] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:45:59.879238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fd15-c12a-4bfe-8c54-859c96020453 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:45:59.879238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fd15-c12a-4bfe-8c54-859c96020453 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:45:59.879238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313fd15-c12a-4bfe-8c54-859c96020453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:45:59.893512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0313fd15-c12a-4bfe-8c54-859c96020453 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:45:59.894733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0313fd15-c12a-4bfe-8c54-859c96020453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:45:59.912678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:45:59.965770 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 410/817] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:45:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:45:59.972350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ef35a-5e81-48f7-b852-67c07112f703 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:45:59.977947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fd15-c12a-4bfe-8c54-859c96020453 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:45:59.997484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:00.011257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.012035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.012308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.012575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.019477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.021000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:00.036656 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:00.037594 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 408/818] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:00.038501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.098333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313fd15-c12a-4bfe-8c54-859c96020453 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.133877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.134549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.135249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.135518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.149584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e8dff-fac4-4f94-be87-bcb2519c2028 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.163454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:00.185416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.186094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.186380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.186651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.187370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:00.187674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.189151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.193990 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 409/819] 10.222.0.30 () {56 vars in 1124 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:00.198771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.215047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.216839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.248856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:00.313500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beacca-71a7-4b61-92d8-e5b36ad38021 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.325070 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 411/820] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:45:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:00.325761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.355458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.356266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.356542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.356822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] PATH_INFO: `/v3/services/network` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.357532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.358929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:00.371313 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:00.373982 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 410/821] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:00.374808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.393235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:00.438389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7b9da-85cb-40ff-b6e7-300d35add7ee None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.480031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.480668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.481112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.481410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.482646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:00.483080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.484963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.490406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350709-45fd-4632-a3ba-d023c2bd9489 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.501258 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 412/822] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:00.502284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.505900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:00.533614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.534825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.535291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.535871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.537428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.539118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.573060 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 411/823] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:00.573060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.633367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a406919-a283-473b-b080-3ce4a88ac608 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.655002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:00.699785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.700855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.701234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.701664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.702331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef2ce2-851f-48ba-83f5-aa80daa5dee5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.717511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.719471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.743770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75915511-354a-472d-ba36-dda899679007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.744835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75915511-354a-472d-ba36-dda899679007 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.745343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75915511-354a-472d-ba36-dda899679007 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.745810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75915511-354a-472d-ba36-dda899679007 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:00.746449 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:00.747312 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:00.748204 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:00.748204 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:00.748204 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:00.748204 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:00.749301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75915511-354a-472d-ba36-dda899679007 None admin] RBAC: Adding query filter params (name=network) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:00.749824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75915511-354a-472d-ba36-dda899679007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.751748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75915511-354a-472d-ba36-dda899679007 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.752716 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 413/824] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:00.753761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.758956 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 412/825] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:00.760090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75915511-354a-472d-ba36-dda899679007 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.794778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:00.881594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75915511-354a-472d-ba36-dda899679007 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.890541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571cd8a-afdb-4429-9f18-57751a8789b2 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:00.917883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.918547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.918823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.919091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.919815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:00.920115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.922090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.940108 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 413/826] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:00.944749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:00.947309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:00.948239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:00.948515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:00.948781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/7b4aee381e9f4ba3b2f7c8a82f1842be/roles/3af3015fe5ba49eca4677c320084172b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:00.964730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=7b4aee381e9f4ba3b2f7c8a82f1842be, role_id=3af3015fe5ba49eca4677c320084172b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:00.966243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:00.985307 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 414/827] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:46:00 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/7b4aee381e9f4ba3b2f7c8a82f1842be/roles/3af3015fe5ba49eca4677c320084172b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:46:00.986539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:01.013010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:01.046792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:01.060977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d96d-16fc-4358-840c-fb07e0020bd8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:01.130995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:01.132165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.132676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.133177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.134095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] RBAC: Adding query filter params (type=network) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:01.134630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:01.136195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:01.145061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a70c5f-ca64-4e93-a27a-0ecf27882ebe None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:01.150817 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 414/828] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:01.169642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:01.187163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:01.187980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.188262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.188529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.196613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:01.198543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:01.214589 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:01.215574 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:01.216477 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:01.220040 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 415/829] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:01.222447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:01.330288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feb43c-134c-4a7f-b686-4ebcbe138bd8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:01.342973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:01.379801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddede760-aabd-4816-ae43-70cca2c97b1a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:01.382758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:01.383456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.383736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.384012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.384776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:01.386302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:01.410717 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 415/830] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:01.432019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48150d-bb12-4675-a999-fe5689060dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:01.432703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48150d-bb12-4675-a999-fe5689060dea None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.432981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48150d-bb12-4675-a999-fe5689060dea None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.433289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48150d-bb12-4675-a999-fe5689060dea None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.434080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48150d-bb12-4675-a999-fe5689060dea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:01.434445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48150d-bb12-4675-a999-fe5689060dea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:01.435986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48150d-bb12-4675-a999-fe5689060dea None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:01.454086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 416/831] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:01.457296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:01.470769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:01.604367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc1fb-aa99-443a-8e0c-1217f81433d2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:01.613839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de013346-f3c9-46de-956a-6620ee15c5fd None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.614227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de013346-f3c9-46de-956a-6620ee15c5fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.614559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de013346-f3c9-46de-956a-6620ee15c5fd None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.619963 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 417/832] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:01.623556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64e92e-04d4-4bd3-a8b0-30647cdb6a61 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.623842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64e92e-04d4-4bd3-a8b0-30647cdb6a61 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.624119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64e92e-04d4-4bd3-a8b0-30647cdb6a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.647699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:01.648431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.648719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.648997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.649888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=578ca3087f9442d88152f65fad464f32) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:01.650209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:01.651726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:01.658173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fa64e92e-04d4-4bd3-a8b0-30647cdb6a61 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:01.659381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fa64e92e-04d4-4bd3-a8b0-30647cdb6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:01.667587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 416/833] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:01 2022] GET /identity/v3/role_assignments?user.id=578ca3087f9442d88152f65fad464f32&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:01.743497 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 418/834] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:01.768365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:01.847788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:01.882421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838599ca-a953-44e2-8e8d-db33d3092745 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:01.920142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:01.920946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:01.921334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:01.921611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:01.933482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:01.941493 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:01.942549 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:01.943403 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 417/835] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:01.949534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64e92e-04d4-4bd3-a8b0-30647cdb6a61 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:02.010423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:02.061826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64e92e-04d4-4bd3-a8b0-30647cdb6a61 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:02.097932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:02.098603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:02.098878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:02.099146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:02.099890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:02.100190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:02.101601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:02.110375 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 419/836] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:02.116019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:02.220735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb1b6e-9099-4c31-b187-7df9960450aa None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:02.249769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:02.256573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:02.257400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:02.257674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:02.257942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:02.269713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:02.271153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:02.288020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:02.289850 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:02.291070 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:02.291070 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:02.291070 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:02.291070 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:02.291070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 418/837] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:02.295462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:02.402210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ac6a-2838-4e55-b222-b33c146df3e3 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:02.422674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:02.436821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:02.437567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:02.437788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:02.438062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:02.438893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:02.439197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:02.440575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:02.453444 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 420/838] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:02.462325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:02.570801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805a3bb-0f90-4747-ba21-5e922ef16b40 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:02.606862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:02.608042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:02.608524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:02.608992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:02.617663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:02.619366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:02.634318 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:02.635336 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 18 21:46:02.636303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:02.639066 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 419/839] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:46:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:02.644967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:02.759464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acec456-1f3f-4076-8831-c5308a075eb7 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:02.796392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:02.797093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:02.797381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:02.797657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:02.798595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:02.798903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:02.800356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:02.818397 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 421/840] 10.222.0.30 () {56 vars in 1135 bytes} [Sat Jun 18 21:46:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:02.824093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:02.873490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:02.932702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69ee0-05ab-4b5e-bee5-3e3e2003a2d0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:02.971187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac2c7c-9a8d-4700-a969-6c74d1e5b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:02.972212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2c7c-9a8d-4700-a969-6c74d1e5b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:02.972721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2c7c-9a8d-4700-a969-6c74d1e5b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:02.973215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2c7c-9a8d-4700-a969-6c74d1e5b9a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.045349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac2c7c-9a8d-4700-a969-6c74d1e5b9a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.047095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac2c7c-9a8d-4700-a969-6c74d1e5b9a6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.105684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:03.151297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 420/841] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:03.157350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.181088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162af5-fe0b-4aa8-882e-c5e4ca8e9c40 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.181388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162af5-fe0b-4aa8-882e-c5e4ca8e9c40 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.181650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162af5-fe0b-4aa8-882e-c5e4ca8e9c40 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.183308 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 421/842] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:03.189088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41c20-4287-47ed-96c7-c4cefafbe1e4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.189357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41c20-4287-47ed-96c7-c4cefafbe1e4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.189638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41c20-4287-47ed-96c7-c4cefafbe1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.204381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:03.210415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-aba41c20-4287-47ed-96c7-c4cefafbe1e4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:03.211942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aba41c20-4287-47ed-96c7-c4cefafbe1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:03.280206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e5378-d1ca-4ef3-86be-a53e4088a10f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:03.298738 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 422/843] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:03.322004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba41c20-4287-47ed-96c7-c4cefafbe1e4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.324901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:03.326807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.327236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.327968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.341452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.343527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:03.362600 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:03.363689 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:03.364830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:03.364830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:03.364830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:03.364830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:03.365704 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 422/844] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:03.371229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.413937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:03.453504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba41c20-4287-47ed-96c7-c4cefafbe1e4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:03.486238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293799a-24e5-4ea6-822e-43e4ab02a3f9 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:03.496347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:03.498074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.498524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.499225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.500309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.502075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.513251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:03.518096 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:03.519373 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:03.520225 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:03.523828 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 423/845] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:03.530306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.532841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:03.533615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.533903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.534276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.535301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:03.535611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.537895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.555091 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 423/846] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:03.560920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.648945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2c83d-fb9f-4cbe-85ed-c3e26f5a57b7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:03.667297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bdf6a-ebb2-41ed-9b30-dd7f8714d81b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:03.684135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:03.685085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.685444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.685856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.686706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:03.687113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.688693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.690826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:03.695306 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 424/847] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:03.701410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.710188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:03.711051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.711336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.712088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.721092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.722570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:03.743941 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:03.744937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:03.745913 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:03.750365 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 424/848] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:03.751272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.763849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:03.813741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd910d-4553-44e0-9bc0-1d0a12a7bfb8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:03.847821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0482828-d2de-4025-acd7-02096cdf1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:03.848500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0482828-d2de-4025-acd7-02096cdf1344 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.848781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0482828-d2de-4025-acd7-02096cdf1344 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.849075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0482828-d2de-4025-acd7-02096cdf1344 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.849795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0482828-d2de-4025-acd7-02096cdf1344 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:03.850097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0482828-d2de-4025-acd7-02096cdf1344 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.851473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0482828-d2de-4025-acd7-02096cdf1344 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.856034 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 425/849] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:03.857278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb28eb-3a91-417e-b003-a46eba153b5c None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.857568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb28eb-3a91-417e-b003-a46eba153b5c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.857846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb28eb-3a91-417e-b003-a46eba153b5c None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.859224 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 426/850] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:03.867000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da7732-8539-4232-a664-d1003f510e7e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:03.877059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1645-1d64-4c92-a0f2-643741804be4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.877059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1645-1d64-4c92-a0f2-643741804be4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.877059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1645-1d64-4c92-a0f2-643741804be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.895972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40ae1645-1d64-4c92-a0f2-643741804be4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:03.897234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40ae1645-1d64-4c92-a0f2-643741804be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:03.908900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:03.909547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:03.909930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:03.910214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:03.911021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:03.911431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:03.912917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:03.932178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 425/851] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:03.933339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:03.974048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:03.993137 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 427/852] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:04.010619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae1645-1d64-4c92-a0f2-643741804be4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.024880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:04.063209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c41aa-2746-418a-b4b2-a3c07d1ac3ad None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.102508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7be539-b459-4ad7-a678-c65ed5ca2143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.103175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7be539-b459-4ad7-a678-c65ed5ca2143 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.103457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7be539-b459-4ad7-a678-c65ed5ca2143 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.103732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7be539-b459-4ad7-a678-c65ed5ca2143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.104580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7be539-b459-4ad7-a678-c65ed5ca2143 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=f2272ca86c294ec4aa96eccc1827d4e2) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:04.104891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7be539-b459-4ad7-a678-c65ed5ca2143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.106398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7be539-b459-4ad7-a678-c65ed5ca2143 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:04.116566 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 426/853] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:03 2022] GET /identity/v3/role_assignments?user.id=f2272ca86c294ec4aa96eccc1827d4e2&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:04.147419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae1645-1d64-4c92-a0f2-643741804be4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.187293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963fd61-6c26-45c0-a9bc-1056204e75a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.188032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963fd61-6c26-45c0-a9bc-1056204e75a7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.188327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963fd61-6c26-45c0-a9bc-1056204e75a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.188641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963fd61-6c26-45c0-a9bc-1056204e75a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.201188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963fd61-6c26-45c0-a9bc-1056204e75a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-8963fd61-6c26-45c0-a9bc-1056204e75a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:04.209406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:04.210487 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:04.212273 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 428/854] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:04.214369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc26f1-15b7-4988-9b1b-2fe99b8d94c1 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.214369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc26f1-15b7-4988-9b1b-2fe99b8d94c1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.214369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc26f1-15b7-4988-9b1b-2fe99b8d94c1 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.215530 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 427/855] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:04.221139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5607c9d-3713-4ea5-9228-3b3135c3c088 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.221457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5607c9d-3713-4ea5-9228-3b3135c3c088 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.221685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5607c9d-3713-4ea5-9228-3b3135c3c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.222209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc26f1-15b7-4988-9b1b-2fe99b8d94c1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.239794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e5607c9d-3713-4ea5-9228-3b3135c3c088 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:04.241358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5607c9d-3713-4ea5-9228-3b3135c3c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:04.298626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:04.318627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 429/856] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:04.345069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5607c9d-3713-4ea5-9228-3b3135c3c088 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.348218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc26f1-15b7-4988-9b1b-2fe99b8d94c1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.393136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.393826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.394106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.394370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.395131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:04.395435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.396815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:04.398437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:04.411734 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 428/857] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:04.413942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.463476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5607c9d-3713-4ea5-9228-3b3135c3c088 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.499369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.500304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.500650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.501055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.501805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.503902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:04.518485 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:04.519515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:04.520406 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:04.523742 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 430/858] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:04.529999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.546939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a5ce-1397-4611-a5fb-995a576e5d0a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.590293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.592300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.593076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.593535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.606583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:04.608478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.610134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:04.629993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:04.630990 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:04.631874 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:04.631874 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:04.631874 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:04.631874 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:04.636164 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 429/859] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:04.636837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.654767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621111f9-a955-4be5-88f4-f2b69efbc645 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.694998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:04.704914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.705974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.706464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.706993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.708015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:04.708639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.710600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:04.720874 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 431/860] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:04.722466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.754788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeb45a-1b2e-44a9-891b-175a5dc8f3dc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.796275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.797366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.797904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.798386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.799307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:04.799817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.801428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:04.813930 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 430/861] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:04.820038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:04.859198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1291aa-c9a5-46b9-961e-62bcb70f0a76 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.878126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:04.907260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.908547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.909057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.909764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.911159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:04.911960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.914187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:04.921053 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 432/862] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:04.941105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6a255-0b9f-429a-9f00-89d4e6c42c1a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:04.952116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:04.981977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:04.982735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:04.983014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:04.983285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:04.993318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:04.994814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:05.010973 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:05.012034 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:05.013017 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 431/863] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:46:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:05.020503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:05.150644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fdd8-8c30-4a2f-89f5-e66befa54190 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:05.187598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:05.188602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:05.189079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:05.189513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:05.190524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:05.190991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:05.192586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:05.211767 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 433/864] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Jun 18 21:46:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:05.217562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:05.328329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17aea7-b6a0-4610-ac6b-b730d39c6744 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:05.364577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:05.365565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:05.366062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:05.366480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:05.401429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:05.434521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:05.436078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:05.534931 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 432/865] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:05.540464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:05.573944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:05.640511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559e91b-9001-4b73-834d-dd8228cee616 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:05.677824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:05.678635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:05.678916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:05.679191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:05.689910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:05.691356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:05.709912 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:05.710837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:05.711712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:05.711712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:05.711712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:05.711712 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:05.711712 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 434/866] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:05.716735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:05.790538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:05.824414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378039b4-54bb-4bda-84f5-92a7478d2bca None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:05.859743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:05.860479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:05.860757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:05.861055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:05.861772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:05.862072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:05.863444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:05.875177 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 433/867] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:05.880646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:05.965584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:05.985386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166bf1c-c9f0-4f43-bfca-41253a20095e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:06.025050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:06.025050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.025050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.025050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.031859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:06.035421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:06.047991 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:06.049093 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:06.050361 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 435/868] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:06.054913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:06.161669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b5dbe-d6b1-4a97-b22c-1be8c4dd95e9 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:06.197529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:06.204715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7f174-9048-443d-97e7-3913d62c36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:06.205699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7f174-9048-443d-97e7-3913d62c36a6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.206171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7f174-9048-443d-97e7-3913d62c36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.206670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7f174-9048-443d-97e7-3913d62c36a6 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.207475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7f174-9048-443d-97e7-3913d62c36a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:06.207784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7f174-9048-443d-97e7-3913d62c36a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:06.209564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7f174-9048-443d-97e7-3913d62c36a6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:06.222879 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 434/869] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:06.230139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:06.338530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4d8ea-207a-49af-aeed-4775057c53b7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:06.376854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bcb1b-fd6c-4a78-985b-1e269bead1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:06.377921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bcb1b-fd6c-4a78-985b-1e269bead1ce None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.378422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bcb1b-fd6c-4a78-985b-1e269bead1ce None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.378895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bcb1b-fd6c-4a78-985b-1e269bead1ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.379936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bcb1b-fd6c-4a78-985b-1e269bead1ce None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=7b4aee381e9f4ba3b2f7c8a82f1842be) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:06.380485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bcb1b-fd6c-4a78-985b-1e269bead1ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:06.382155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bcb1b-fd6c-4a78-985b-1e269bead1ce None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:06.388858 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 436/870] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:06 2022] GET /identity/v3/role_assignments?user.id=7b4aee381e9f4ba3b2f7c8a82f1842be&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:06.420663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0192-19b3-417c-836f-3b3ddc327242 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.420998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0192-19b3-417c-836f-3b3ddc327242 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.421309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0192-19b3-417c-836f-3b3ddc327242 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.423085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 435/871] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:06.428839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab9891-e007-49a1-9aa5-e81bdbf41dba None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.429190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab9891-e007-49a1-9aa5-e81bdbf41dba None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.429444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab9891-e007-49a1-9aa5-e81bdbf41dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.447382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dfab9891-e007-49a1-9aa5-e81bdbf41dba None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:06.448609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dfab9891-e007-49a1-9aa5-e81bdbf41dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:06.452040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:06.526495 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 437/872] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:06.551438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0192-19b3-417c-836f-3b3ddc327242 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:06.562804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72d05-5f47-4b63-a91c-89350961cbc8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.563406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72d05-5f47-4b63-a91c-89350961cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.563406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72d05-5f47-4b63-a91c-89350961cbc8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.565239 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 438/873] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:06.571101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffbda8-9462-4ca7-903e-be2bc6cbb543 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.572171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffbda8-9462-4ca7-903e-be2bc6cbb543 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.572450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffbda8-9462-4ca7-903e-be2bc6cbb543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.591409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d1ffbda8-9462-4ca7-903e-be2bc6cbb543 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:06.592912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d1ffbda8-9462-4ca7-903e-be2bc6cbb543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:06.670911 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 439/874] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:06.674169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0192-19b3-417c-836f-3b3ddc327242 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:06.693897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffbda8-9462-4ca7-903e-be2bc6cbb543 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:06.712786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:06.713493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.713772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.714044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.714768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:06.716162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:06.732308 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 436/875] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:46:06 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:06.793400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:06.832938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffbda8-9462-4ca7-903e-be2bc6cbb543 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:06.878020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:06.878762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:06.879039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:06.879310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:06.879972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:06.881398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:06.894504 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:06.895573 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:06.896423 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 440/876] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:06.903894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:06.963586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:07.021148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dea1f3-9e82-4a08-8f91-a74e79579944 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:07.058257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b589b57-ac1b-46cb-8695-ce9d8594ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:07.058929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589b57-ac1b-46cb-8695-ce9d8594ea18 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:07.059212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589b57-ac1b-46cb-8695-ce9d8594ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:07.059488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589b57-ac1b-46cb-8695-ce9d8594ea18 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:07.060209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b589b57-ac1b-46cb-8695-ce9d8594ea18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:07.060509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b589b57-ac1b-46cb-8695-ce9d8594ea18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:07.061929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b589b57-ac1b-46cb-8695-ce9d8594ea18 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:07.067544 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 437/877] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:07.073077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:07.176627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4fda3-399a-4296-b916-8e5c412e1def None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:07.207432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:07.215670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352af8a8-c2fd-4662-a09b-ee2c8d4fc289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:07.216708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af8a8-c2fd-4662-a09b-ee2c8d4fc289 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:07.216923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af8a8-c2fd-4662-a09b-ee2c8d4fc289 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:07.217232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af8a8-c2fd-4662-a09b-ee2c8d4fc289 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:07.217962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352af8a8-c2fd-4662-a09b-ee2c8d4fc289 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:07.218268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352af8a8-c2fd-4662-a09b-ee2c8d4fc289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:07.219811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352af8a8-c2fd-4662-a09b-ee2c8d4fc289 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:07.226011 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 441/878] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:07.462248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0bb14-e860-457b-a36f-59b2a6efbc8b None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:07.462760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0bb14-e860-457b-a36f-59b2a6efbc8b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:07.463149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0bb14-e860-457b-a36f-59b2a6efbc8b None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:07.464890 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 438/879] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:07.470285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b680b-d78b-4477-ad7d-63d37effe648 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:07.470577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b680b-d78b-4477-ad7d-63d37effe648 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:07.470852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b680b-d78b-4477-ad7d-63d37effe648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:07.488099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-165b680b-d78b-4477-ad7d-63d37effe648 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:07.489354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-165b680b-d78b-4477-ad7d-63d37effe648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:07.565536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 442/880] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:07.586829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0bb14-e860-457b-a36f-59b2a6efbc8b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:07.698609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0bb14-e860-457b-a36f-59b2a6efbc8b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:07.721857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:07.750165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a5a30-5a2c-44be-aa94-1b2cb25f5b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:07.751504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5a30-5a2c-44be-aa94-1b2cb25f5b06 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:07.752037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5a30-5a2c-44be-aa94-1b2cb25f5b06 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:07.752483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5a30-5a2c-44be-aa94-1b2cb25f5b06 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:07.753409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a5a30-5a2c-44be-aa94-1b2cb25f5b06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:07.755001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a5a30-5a2c-44be-aa94-1b2cb25f5b06 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:07.783198 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 439/881] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:46:07 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:08.888116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503091-e8a9-49bb-9ed7-0c7dbfdb01d0 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:08.888641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503091-e8a9-49bb-9ed7-0c7dbfdb01d0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:08.888641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87503091-e8a9-49bb-9ed7-0c7dbfdb01d0 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:08.890387 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 443/882] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:08.898572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c00f33-b9ab-461c-a585-011158f515c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:08.899432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c00f33-b9ab-461c-a585-011158f515c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:08.899927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c00f33-b9ab-461c-a585-011158f515c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:08.917433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a0c00f33-b9ab-461c-a585-011158f515c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:08.918971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a0c00f33-b9ab-461c-a585-011158f515c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:08.997132 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 440/883] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:09.018457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87503091-e8a9-49bb-9ed7-0c7dbfdb01d0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.141655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87503091-e8a9-49bb-9ed7-0c7dbfdb01d0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.166443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:09.177277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:09.178104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.178382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.178650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.189394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:09.198052 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:09.198989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:09.199857 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:09.203818 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 444/884] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Jun 18 21:46:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:09.205987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c00f33-b9ab-461c-a585-011158f515c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.303898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:09.309447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c00f33-b9ab-461c-a585-011158f515c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.352083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4718-d9fc-450d-90f2-d917052b5fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:09.352999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4718-d9fc-450d-90f2-d917052b5fbb None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.353447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4718-d9fc-450d-90f2-d917052b5fbb None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.353860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4718-d9fc-450d-90f2-d917052b5fbb None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.354776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4718-d9fc-450d-90f2-d917052b5fbb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:09.355227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4718-d9fc-450d-90f2-d917052b5fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:09.356747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4718-d9fc-450d-90f2-d917052b5fbb None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:09.365749 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 441/885] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Jun 18 21:46:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:09.371282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.395552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95d785-01b6-4ec2-af8c-eae21c45f883 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.395841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95d785-01b6-4ec2-af8c-eae21c45f883 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.396035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95d785-01b6-4ec2-af8c-eae21c45f883 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.397654 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 442/886] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:09.402761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd6d05-9519-452e-8a63-aeeac0705fcc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.403048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd6d05-9519-452e-8a63-aeeac0705fcc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.403401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd6d05-9519-452e-8a63-aeeac0705fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.421156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dedd6d05-9519-452e-8a63-aeeac0705fcc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:09.422877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dedd6d05-9519-452e-8a63-aeeac0705fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:09.481975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2427504-f610-44a9-aa6e-8cabc044305c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.504798 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 443/887] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:09.518059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:09.519183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.519711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.520179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.524752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd6d05-9519-452e-8a63-aeeac0705fcc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.532205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:09.534132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:09.552371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:09.553436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:09.554326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:09.554326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:09.554326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:09.554326 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:09.561115 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 445/888] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:09.562527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.599363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:09.621956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:09.633507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd6d05-9519-452e-8a63-aeeac0705fcc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.669862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ee83-349d-4c98-b835-95069f909d26 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.673863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9d390-4d92-44f9-b3d2-14ab6aab3c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:09.674679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9d390-4d92-44f9-b3d2-14ab6aab3c71 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.674957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9d390-4d92-44f9-b3d2-14ab6aab3c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.675228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9d390-4d92-44f9-b3d2-14ab6aab3c71 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.675885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9d390-4d92-44f9-b3d2-14ab6aab3c71 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:09.677278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9d390-4d92-44f9-b3d2-14ab6aab3c71 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-0db9d390-4d92-44f9-b3d2-14ab6aab3c71 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:09.690196 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:09.691213 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:09.692048 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:09.693707 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 444/889] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:09.696430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633b2a-a936-44cc-872b-9e7ea6bdb1fb None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.696430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633b2a-a936-44cc-872b-9e7ea6bdb1fb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.696430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633b2a-a936-44cc-872b-9e7ea6bdb1fb None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.696966 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 445/890] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:09.697725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633b2a-a936-44cc-872b-9e7ea6bdb1fb None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.713889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031fa9e-f59e-4ae7-8915-7f4834fe5109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:09.714573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fa9e-f59e-4ae7-8915-7f4834fe5109 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.714825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fa9e-f59e-4ae7-8915-7f4834fe5109 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.715099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fa9e-f59e-4ae7-8915-7f4834fe5109 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.715825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031fa9e-f59e-4ae7-8915-7f4834fe5109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:09.716123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031fa9e-f59e-4ae7-8915-7f4834fe5109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:09.717524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031fa9e-f59e-4ae7-8915-7f4834fe5109 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:09.734694 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 446/891] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:09.734694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37b6af-dbe8-4be5-94d6-b5258efdc9c5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.734694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37b6af-dbe8-4be5-94d6-b5258efdc9c5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.734694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37b6af-dbe8-4be5-94d6-b5258efdc9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.748921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0a37b6af-dbe8-4be5-94d6-b5258efdc9c5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:09.750126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0a37b6af-dbe8-4be5-94d6-b5258efdc9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:09.810052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633b2a-a936-44cc-872b-9e7ea6bdb1fb None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.819110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 447/892] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:09.819968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37b6af-dbe8-4be5-94d6-b5258efdc9c5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.855152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:09.855388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:09.856190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.856696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.856812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.857515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:09.857798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:09.859172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:09.864811 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 446/893] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:09.865630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:09.885452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:09.941615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37b6af-dbe8-4be5-94d6-b5258efdc9c5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.977940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:09.978783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:09.979067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:09.979338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:09.982496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00c08d-b703-404c-8117-c366b98738af None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:09.987964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:09.989490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:10.007821 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:10.008869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:10.009847 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:10.014096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 448/894] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:46:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:10.014804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.023388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.024070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.024345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.024614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.025358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.026832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.045088 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 447/895] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:46:09 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:10.045750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.132030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.153105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7a3f-71b6-45b0-849d-364fff2c739f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.156840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.190890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b0a8-8aee-48d0-a511-d27a0743bc01 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.198749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.199350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.199628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.199900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.200620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:10.201284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.205292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.217266 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 449/896] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:10.218994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.235828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc311b4-8f48-4f2b-8b1a-54fb0fdbef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.236560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc311b4-8f48-4f2b-8b1a-54fb0fdbef47 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.236838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc311b4-8f48-4f2b-8b1a-54fb0fdbef47 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.237138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc311b4-8f48-4f2b-8b1a-54fb0fdbef47 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.237992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc311b4-8f48-4f2b-8b1a-54fb0fdbef47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:10.238302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc311b4-8f48-4f2b-8b1a-54fb0fdbef47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.239752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc311b4-8f48-4f2b-8b1a-54fb0fdbef47 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.262714 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 448/897] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:10.262714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff11dd-b625-4722-9ea2-c1064fe9901c None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.262714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff11dd-b625-4722-9ea2-c1064fe9901c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.262714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff11dd-b625-4722-9ea2-c1064fe9901c None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.263393 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 449/898] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:10.268124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff11dd-b625-4722-9ea2-c1064fe9901c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.338600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50891-6256-4246-912c-8b5e5a6fe477 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.374961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff11dd-b625-4722-9ea2-c1064fe9901c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.376888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919670ce-f9ad-4449-9d4c-84325acedeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.377599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919670ce-f9ad-4449-9d4c-84325acedeeb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.377994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919670ce-f9ad-4449-9d4c-84325acedeeb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.378271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919670ce-f9ad-4449-9d4c-84325acedeeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.379076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919670ce-f9ad-4449-9d4c-84325acedeeb None admin] RBAC: Adding query filter params (interface=public, service_id=a975301378ab4aa4b73b873560d23aab, region_id=RegionOne) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:10.379381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919670ce-f9ad-4449-9d4c-84325acedeeb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.380750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919670ce-f9ad-4449-9d4c-84325acedeeb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.390627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 450/899] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/endpoints?service_id=a975301378ab4aa4b73b873560d23aab&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:10.392720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51adab2-ef18-4c15-a92e-cb41e75bcf68 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.393248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51adab2-ef18-4c15-a92e-cb41e75bcf68 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.393644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51adab2-ef18-4c15-a92e-cb41e75bcf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.408316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.411581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f51adab2-ef18-4c15-a92e-cb41e75bcf68 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:10.412758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f51adab2-ef18-4c15-a92e-cb41e75bcf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:10.415046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.415696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.415981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.416256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.423354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.482354 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 451/900] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:10.483286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51adab2-ef18-4c15-a92e-cb41e75bcf68 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.492944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.494575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.594027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51adab2-ef18-4c15-a92e-cb41e75bcf68 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.605616 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 450/901] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 18 21:46:10.605616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.633381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.635611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.636311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.636599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.636973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.637656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.639030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.645281 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 452/902] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:46:10.645901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.661452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.731133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe909-bdd7-4fcc-8a53-0a6ff9300283 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.779858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.781516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.782050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.782749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.783619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.784499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e5c1f-5e6d-47e8-9d5a-1ec021df70c8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.785495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:10.802486 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:10.803512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:10.804360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:10.806712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 451/903] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:10.812408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.841569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.842386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.842666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.842938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.855169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.856619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:10.879050 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:10.880009 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:10.881488 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:10.881488 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:10.881488 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:10.881488 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:10.881488 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 453/904] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:10.885828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:10.943135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.949635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb60351-717f-4e51-affb-f84cd404e103 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:10.982564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:10.988732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:10.989601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:10.989994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:10.990368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:10.991172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:10.991572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:10.993064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:10.998613 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 452/905] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:11.006364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:11.031100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2bfe-bb51-4c9a-88e7-042d7394b9c6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:11.067047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:11.067711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:11.067986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:11.068254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:11.068993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:11.069356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:11.070770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:11.083428 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 454/906] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:11.088765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:11.115030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbebfc0-1b77-4c3b-a374-669a6ffe9bb0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:11.150047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:11.150715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:11.151016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:11.151265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:11.151983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:11.152523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:11.154041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:11.165169 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 453/907] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:11.166068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:11.193729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:11.194779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcae9a-5b9a-482d-a711-db1a616d90c6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:11.217309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:11.232604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:11.233810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:11.234313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:11.234869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:11.242827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:11.244677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:11.261555 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:11.262538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:11.263438 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:11.270484 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 455/908] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:11.271675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:11.276242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ed772-86ed-491b-9ec9-1e64bace5fb5 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:11.311281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:11.311862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:11.312147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:11.312420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:11.313339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] RBAC: Adding query filter params (interface=public, service_id=7c665a91a88249ed83b61c8bb2e55381, region_id=RegionOne) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:11.313649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:11.315196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:11.325677 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 454/909] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:46:11 2022] GET /identity/v3/endpoints?service_id=7c665a91a88249ed83b61c8bb2e55381&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:11.326586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:11.377473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a33f7-9c84-442b-8f72-8172c81352ef None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:11.417780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:11.418451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:11.418729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:11.419000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:11.419791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:11.420092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:11.421760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:11.432015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:11.436182 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 456/910] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:11.442786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:11.447952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd074d46-8aa5-46fd-a6b0-ef6e19c89a87 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:11.483544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e3f9b-9fca-4ed2-9ae5-ee1d027e207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:11.484597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e3f9b-9fca-4ed2-9ae5-ee1d027e207d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:11.485168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e3f9b-9fca-4ed2-9ae5-ee1d027e207d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:11.485669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e3f9b-9fca-4ed2-9ae5-ee1d027e207d None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:11.486719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:11.487826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e3f9b-9fca-4ed2-9ae5-ee1d027e207d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:11.489766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e3f9b-9fca-4ed2-9ae5-ee1d027e207d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:11.497930 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 455/911] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:46:11 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:46:11.555976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f81d3-3107-4d97-b3be-41054c8f8d91 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:11.594849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6970421-4558-494a-9c0b-2e8291ab427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:11.595437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970421-4558-494a-9c0b-2e8291ab427c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:11.595718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970421-4558-494a-9c0b-2e8291ab427c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:11.595988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6970421-4558-494a-9c0b-2e8291ab427c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:11.596841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6970421-4558-494a-9c0b-2e8291ab427c None admin] RBAC: Adding query filter params (role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=7b4aee381e9f4ba3b2f7c8a82f1842be) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:11.597181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6970421-4558-494a-9c0b-2e8291ab427c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:11.598662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6970421-4558-494a-9c0b-2e8291ab427c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:11.605544 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 457/912] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:11 2022] GET /identity/v3/role_assignments?user.id=7b4aee381e9f4ba3b2f7c8a82f1842be&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:12.428581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874ae2-ccdf-4eb2-8936-d1f115df2df4 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:12.429136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874ae2-ccdf-4eb2-8936-d1f115df2df4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:12.429136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874ae2-ccdf-4eb2-8936-d1f115df2df4 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:12.430722 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 456/913] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:12.436169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb84f-e3ab-4048-ab15-3dd49dbcb5b0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:12.436576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb84f-e3ab-4048-ab15-3dd49dbcb5b0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:12.436742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb84f-e3ab-4048-ab15-3dd49dbcb5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:12.455897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-824bb84f-e3ab-4048-ab15-3dd49dbcb5b0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:12.457266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-824bb84f-e3ab-4048-ab15-3dd49dbcb5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:12.529840 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 458/914] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:12.553409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78874ae2-ccdf-4eb2-8936-d1f115df2df4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:12.660864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78874ae2-ccdf-4eb2-8936-d1f115df2df4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:12.696551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:12.697312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:12.697589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:12.697861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:12.698521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:12.699978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:12.712509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:12.714825 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:12.716750 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:12.721058 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 457/915] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:12.721237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb84f-e3ab-4048-ab15-3dd49dbcb5b0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:12.754888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:12.826908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb84f-e3ab-4048-ab15-3dd49dbcb5b0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:12.865204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:12.865886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:12.866166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:12.866440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:12.867157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:12.867464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:12.868846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:12.878545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 459/916] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:12.879890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:12.898775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:12.985796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140fa1-e9cd-4300-9cd9-bfad45599b12 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:13.018855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a6db-7ea8-4692-a92b-2f4dc5f722a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:13.019565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a6db-7ea8-4692-a92b-2f4dc5f722a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.019892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a6db-7ea8-4692-a92b-2f4dc5f722a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.020171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a6db-7ea8-4692-a92b-2f4dc5f722a0 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.020881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a6db-7ea8-4692-a92b-2f4dc5f722a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:13.021218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a6db-7ea8-4692-a92b-2f4dc5f722a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:13.028144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a6db-7ea8-4692-a92b-2f4dc5f722a0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:13.043434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 458/917] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:13.044824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:13.085074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c86bf2-b355-49c9-8b07-e48d3850e071 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.085074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c86bf2-b355-49c9-8b07-e48d3850e071 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.085074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c86bf2-b355-49c9-8b07-e48d3850e071 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.086398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 459/918] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:13.091369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc0809-9f20-4bd1-ad6c-9f6a318c3426 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.091887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc0809-9f20-4bd1-ad6c-9f6a318c3426 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.092357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc0809-9f20-4bd1-ad6c-9f6a318c3426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.110598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-39bc0809-9f20-4bd1-ad6c-9f6a318c3426 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:13.112114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-39bc0809-9f20-4bd1-ad6c-9f6a318c3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:13.152380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:13.155455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c447d-73b1-46a8-9dc2-b92c5e3f2117 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:13.193300 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 460/919] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:13.195195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:13.195567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.195848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.196130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.196931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] RBAC: Adding query filter params (interface=public, service_id=e38cf6f1f9924cd7b5d8e1af757995ea, region_id=RegionOne) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:13.197284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:13.198650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:13.208947 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 460/920] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:46:13 2022] GET /identity/v3/endpoints?service_id=e38cf6f1f9924cd7b5d8e1af757995ea&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:13.210330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc0809-9f20-4bd1-ad6c-9f6a318c3426 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:13.216747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:13.226579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:13.319955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc0809-9f20-4bd1-ad6c-9f6a318c3426 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:13.338057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ad894-b931-4886-831c-9815dc01f4f0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:13.355962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:13.356970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.357474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.357939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.358817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:13.360449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:13.368868 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 461/921] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:46:13 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:46:13.382699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:13.383944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.384421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.384909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.385823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:13.387462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:13.401014 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:13.402149 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 18 21:46:13.403005 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:13.406131 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 461/922] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:13.412418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:13.501465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:13.528381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc35b4-180c-424d-a47b-283f3fc8d8a0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:13.565840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:13.566865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.567338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.567801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.568703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:13.569359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:13.570968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:13.576733 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 462/923] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:13.583066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:13.615134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:13.699319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf714ee-d33d-45fb-97a2-9e969390aee7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:13.740424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd2b15-9cf5-4189-ab9f-6e82c20f3c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:13.741534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd2b15-9cf5-4189-ab9f-6e82c20f3c2f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.742050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd2b15-9cf5-4189-ab9f-6e82c20f3c2f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.742513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd2b15-9cf5-4189-ab9f-6e82c20f3c2f None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.743421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd2b15-9cf5-4189-ab9f-6e82c20f3c2f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:13.743943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd2b15-9cf5-4189-ab9f-6e82c20f3c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:13.745555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd2b15-9cf5-4189-ab9f-6e82c20f3c2f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:13.751659 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 462/924] 10.222.0.30 () {56 vars in 1114 bytes} [Sat Jun 18 21:46:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:13.757852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:13.862035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc48ab-6e9f-41ee-b376-f5ba3ecd7b15 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:13.897247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7dc5-5967-466e-8fba-1ce79842e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:13.898266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7dc5-5967-466e-8fba-1ce79842e91d None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.898740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7dc5-5967-466e-8fba-1ce79842e91d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.899206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7dc5-5967-466e-8fba-1ce79842e91d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.900150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7dc5-5967-466e-8fba-1ce79842e91d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:13.901745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7dc5-5967-466e-8fba-1ce79842e91d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:13.909717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:13.926094 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 463/925] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:13.952951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93adacd-3772-485a-b21f-f0e8e1d4cf25 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.952951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93adacd-3772-485a-b21f-f0e8e1d4cf25 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.952951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93adacd-3772-485a-b21f-f0e8e1d4cf25 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.954413 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 463/926] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:13.962969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4675f95-64c1-40af-bfe3-9be95b892de7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:13.963287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4675f95-64c1-40af-bfe3-9be95b892de7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:13.963530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4675f95-64c1-40af-bfe3-9be95b892de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:13.982510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b4675f95-64c1-40af-bfe3-9be95b892de7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:13.983716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4675f95-64c1-40af-bfe3-9be95b892de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:14.005485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1564-ce9c-4e1b-aa9c-d3678d96f96a None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.005857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1564-ce9c-4e1b-aa9c-d3678d96f96a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.006026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1564-ce9c-4e1b-aa9c-d3678d96f96a None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.007515 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 464/927] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:14.013934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c635d2-8e93-4c14-8cee-91c974a1cbc0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.014574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c635d2-8e93-4c14-8cee-91c974a1cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.015049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c635d2-8e93-4c14-8cee-91c974a1cbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.041139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-55c635d2-8e93-4c14-8cee-91c974a1cbc0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:14.042778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-55c635d2-8e93-4c14-8cee-91c974a1cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:14.086670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 464/928] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:14.110748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4675f95-64c1-40af-bfe3-9be95b892de7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.126215 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 465/929] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:14.150524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c635d2-8e93-4c14-8cee-91c974a1cbc0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.176269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:14.239954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4675f95-64c1-40af-bfe3-9be95b892de7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.267134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:14.268578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c635d2-8e93-4c14-8cee-91c974a1cbc0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.285492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.286470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.286747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.287016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.287677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:14.289699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:14.305222 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:14.306181 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:14.307032 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 465/930] 10.222.0.30 () {56 vars in 1132 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:14.314195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.315376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.316263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.316545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.316812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.330361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:14.340422 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:14.341403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:14.342238 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:14.344686 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 466/931] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:14.350809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.434504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1af55-7963-4f0c-a821-1b956c324fe9 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.437908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:14.460325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3eac7-fbd6-47b2-8833-7b02bc148a1c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.477093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.478274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.478695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.479487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.480343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:14.480807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:14.482940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:14.494516 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 466/932] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:14.495225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.508624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.510133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.510963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.511434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.512689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:14.513705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:14.516018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:14.528481 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 467/933] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:14.534223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.554834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:14.622631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d5cb2-c3de-401a-9baf-da5129943471 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.645267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfdcad-af50-49d4-93f1-2feb9b70ac78 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.666593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.667516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.667794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.668061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.669431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:14.669747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:14.671615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:14.679323 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 467/934] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:14.683296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.684818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.685461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.685741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.686025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.697823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:14.699133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:14.701159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:14.718684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:14.719692 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:14.720668 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:14.720668 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:14.720668 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:14.720668 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:14.720668 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 468/935] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:14.725741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:14.805692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec5fc-adb6-48b9-8609-3933278d640b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.820232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:14.843586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.844304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.844588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.844861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.845970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:14.847179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:14.861284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841238b5-22c9-46bf-8220-15987a9f4eb0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:14.877342 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 468/936] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:14.911198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:14.911877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:14.912161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:14.912434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:14.913256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:14.913561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:14.914994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:14.929521 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 469/937] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:14.934999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:15.065797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a665d1-7d45-40e1-9cdb-741031aa27d6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:15.107481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:15.108639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:15.109216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:15.109819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:15.118900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:15.120633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:15.135731 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:15.137643 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:15.138599 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:15.139656 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 469/938] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:46:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:15.146563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:15.203269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:15.254870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74306945-9f9b-4727-b3bc-664c0ac7f9df None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:15.290025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:15.290949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:15.291406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:15.291823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:15.292805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:15.293291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:15.294867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:15.313507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 470/939] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Jun 18 21:46:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:15.322142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:15.352710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:15.426970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e3aec-aeea-40e1-8c49-36f45ac8b734 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:15.460720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:15.461651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:15.461937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:15.462212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:15.472873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:15.474383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:15.491937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:15.492876 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:15.494245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:15.494245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:15.494245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:15.494245 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:15.494245 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 470/940] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:15.499270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:15.605871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e1a5b-2e40-4036-baba-2f5aba06286f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:15.619608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:15.649426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:15.650849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:15.651312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:15.651763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:15.652698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:15.653204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:15.654778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:15.667151 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 471/941] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:15.673227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:15.759011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:15.778381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cb38b-b21b-4df7-bef0-c379b3c5084b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:15.813664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47aeeb-6cf8-42d7-ace8-260a364dd0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:15.814632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47aeeb-6cf8-42d7-ace8-260a364dd0ff None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:15.814922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47aeeb-6cf8-42d7-ace8-260a364dd0ff None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:15.815198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47aeeb-6cf8-42d7-ace8-260a364dd0ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:15.822501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47aeeb-6cf8-42d7-ace8-260a364dd0ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:15.824094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47aeeb-6cf8-42d7-ace8-260a364dd0ff None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-2e47aeeb-6cf8-42d7-ace8-260a364dd0ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:15.839324 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:15.840255 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:15.841170 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 471/942] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:15.846701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:15.871523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ee9c3-c70c-4409-840c-915f7717cce5 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:15.871852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ee9c3-c70c-4409-840c-915f7717cce5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:15.872134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ee9c3-c70c-4409-840c-915f7717cce5 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:15.874032 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 472/943] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:15.879256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf009-b062-4de3-aa4a-a9d9e08b5c4f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:15.879539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf009-b062-4de3-aa4a-a9d9e08b5c4f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:15.879816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf009-b062-4de3-aa4a-a9d9e08b5c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:15.897687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-421bf009-b062-4de3-aa4a-a9d9e08b5c4f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:15.899007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-421bf009-b062-4de3-aa4a-a9d9e08b5c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:15.974990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff65c0-95e9-4fdf-ae1d-b42eaeee177c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:15.977075 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 473/944] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:16.010404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf009-b062-4de3-aa4a-a9d9e08b5c4f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:16.025903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.025903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.025903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.025903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.026314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:16.026314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.026711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.045069 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 472/945] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:16.046668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:16.080031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:16.117009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:16.156064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf009-b062-4de3-aa4a-a9d9e08b5c4f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:16.173706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3bacd-ec68-4482-8422-3e5461ac55d4 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:16.202733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.203965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.204267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.204539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.205407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.207402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.213688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b6236-ca07-4d9c-9a76-c25a2d5c8852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.215064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6236-ca07-4d9c-9a76-c25a2d5c8852 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.215549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6236-ca07-4d9c-9a76-c25a2d5c8852 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.216046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6236-ca07-4d9c-9a76-c25a2d5c8852 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/7b4aee381e9f4ba3b2f7c8a82f1842be/roles/09b0ad2b5ba643cb81ea8b022b7d6b4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.218700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b6236-ca07-4d9c-9a76-c25a2d5c8852 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=7b4aee381e9f4ba3b2f7c8a82f1842be, role_id=09b0ad2b5ba643cb81ea8b022b7d6b4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.220464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b6236-ca07-4d9c-9a76-c25a2d5c8852 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:16.221804 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:16.222801 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:16.223680 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 474/946] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:16.234291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:16.245279 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 473/947] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:46:16 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/7b4aee381e9f4ba3b2f7c8a82f1842be/roles/09b0ad2b5ba643cb81ea8b022b7d6b4b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:46:16.335403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2601-05d9-4a83-a16e-93d08a4e5f48 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.336097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2601-05d9-4a83-a16e-93d08a4e5f48 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.336628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2601-05d9-4a83-a16e-93d08a4e5f48 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.338683 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 474/948] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:16.347322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c33854-8101-4f6b-ac11-f4bb629eb351 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.348181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c33854-8101-4f6b-ac11-f4bb629eb351 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.349087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c33854-8101-4f6b-ac11-f4bb629eb351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.351587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1436cf-4542-4eec-9ec3-983995a6d7e8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:16.374332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-79c33854-8101-4f6b-ac11-f4bb629eb351 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:16.375946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-79c33854-8101-4f6b-ac11-f4bb629eb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:16.395135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.395979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.396273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.396546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.397318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:16.397616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.399900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.401424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:16.407624 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 475/949] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:16.414509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:16.477851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 475/950] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:16.502216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c33854-8101-4f6b-ac11-f4bb629eb351 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:16.520773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:16.541237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a4d84-a166-4c22-949d-abdb5b8450ab None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:16.588760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.590205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.591071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.591624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.592619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:16.593348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.595294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.603049 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 476/951] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:16.608773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:16.619793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c33854-8101-4f6b-ac11-f4bb629eb351 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:16.667525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.669236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.669971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.670881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.672118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.673168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:16.675754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.677433 ncdv-master-1 devstack@keystone.service[91204]: WARNING keystone.server.flask.common [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 18 21:46:16.700763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.sql.core [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 18 21:46:16.700763 ncdv-master-1 devstack@keystone.service[91204]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 21:46:16.700763 ncdv-master-1 devstack@keystone.service[91204]: [parameters: {'id': 'bb434d60905e4abe9e7ddf410a1226b4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 18 21:46:16.700763 ncdv-master-1 devstack@keystone.service[91204]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91204) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb434d60905e4abe9e7ddf410a1226b4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb434d60905e4abe9e7ddf410a1226b4. Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 21:46:16.709676 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 18 21:46:16.710499 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application yield resource Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise self.value Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application session.commit() Jun 18 21:46:16.711450 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.flush() Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application compat.raise_( Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 21:46:16.712358 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 21:46:16.713315 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 21:46:16.714125 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [parameters: {'id': 'bb434d60905e4abe9e7ddf410a1226b4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:16.714989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:16.715780 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb434d60905e4abe9e7ddf410a1226b4. Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.716719 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 476/952] 10.222.0.30 () {60 vars in 1140 bytes} [Sat Jun 18 21:46:16 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:16.719080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:16.736398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d0c4-82a9-4a02-8095-db65f35515e2 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:16.781999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.783521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.783978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.784641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.785818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.787996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.802232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:16.817810 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 477/953] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:46:16.838908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e470e2-2fa1-423a-8827-c845cfb1cf72 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:16.887113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23228d18-1c05-4bbd-8800-eb4fae0d5f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:16.887935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228d18-1c05-4bbd-8800-eb4fae0d5f3d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:16.888210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228d18-1c05-4bbd-8800-eb4fae0d5f3d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:16.888478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228d18-1c05-4bbd-8800-eb4fae0d5f3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:16.898371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23228d18-1c05-4bbd-8800-eb4fae0d5f3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:16.900185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23228d18-1c05-4bbd-8800-eb4fae0d5f3d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-23228d18-1c05-4bbd-8800-eb4fae0d5f3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:16.916420 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:16.917799 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:16.918975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 477/954] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:16.924424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:17.054980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814b0dc-7613-47d2-9364-aba97d7d2fab None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:17.073237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:17.093929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cc2cd-8168-493e-82d6-cc5ee3b61e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:17.094109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc2cd-8168-493e-82d6-cc5ee3b61e9f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:17.094332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc2cd-8168-493e-82d6-cc5ee3b61e9f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:17.094519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cc2cd-8168-493e-82d6-cc5ee3b61e9f None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:17.095282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc2cd-8168-493e-82d6-cc5ee3b61e9f None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:17.095583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc2cd-8168-493e-82d6-cc5ee3b61e9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:17.097019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cc2cd-8168-493e-82d6-cc5ee3b61e9f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:17.115585 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 478/955] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:17.396332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab60a-34f4-4277-afea-0900f5f1db11 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:17.396529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab60a-34f4-4277-afea-0900f5f1db11 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:17.396799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab60a-34f4-4277-afea-0900f5f1db11 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:17.398206 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 478/956] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:17.403970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecf55-78d6-4a36-b418-406454052364 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:17.404265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecf55-78d6-4a36-b418-406454052364 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:17.404548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ecf55-78d6-4a36-b418-406454052364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:17.421940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e71ecf55-78d6-4a36-b418-406454052364 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:17.423145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e71ecf55-78d6-4a36-b418-406454052364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:17.501139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 479/957] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:17.518431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ab60a-34f4-4277-afea-0900f5f1db11 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:17.620794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ab60a-34f4-4277-afea-0900f5f1db11 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:17.654011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:17.659931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:17.660750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:17.661050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:17.661353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:17.662021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:17.663418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:17.675734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:17.677277 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:17.678154 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 479/958] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:17.683446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ecf55-78d6-4a36-b418-406454052364 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:17.787228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ecf55-78d6-4a36-b418-406454052364 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:17.797550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:17.823663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95aabb-d07c-432b-871f-484cfccf7fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:17.824330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95aabb-d07c-432b-871f-484cfccf7fc9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:17.824609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95aabb-d07c-432b-871f-484cfccf7fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:17.824881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95aabb-d07c-432b-871f-484cfccf7fc9 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:17.825668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95aabb-d07c-432b-871f-484cfccf7fc9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:17.825969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95aabb-d07c-432b-871f-484cfccf7fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:17.827718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95aabb-d07c-432b-871f-484cfccf7fc9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:17.833163 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 480/959] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:17.838617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:17.945012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3367-7515-48c1-bcc2-6071c7d907ae None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:17.979531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50052de8-3e6a-45c3-a9bb-44af57cc5d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:17.980198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052de8-3e6a-45c3-a9bb-44af57cc5d12 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:17.980479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052de8-3e6a-45c3-a9bb-44af57cc5d12 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:17.980754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50052de8-3e6a-45c3-a9bb-44af57cc5d12 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:17.981500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052de8-3e6a-45c3-a9bb-44af57cc5d12 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:17.981806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052de8-3e6a-45c3-a9bb-44af57cc5d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:17.983172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50052de8-3e6a-45c3-a9bb-44af57cc5d12 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:17.988479 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 480/960] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:18.632825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558af8-24c0-442c-8120-678d67188173 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:18.633234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558af8-24c0-442c-8120-678d67188173 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:18.633436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558af8-24c0-442c-8120-678d67188173 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:18.635031 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 481/961] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:18.640047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde461d-34b2-4e01-88db-08ab549d89c3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:18.640337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde461d-34b2-4e01-88db-08ab549d89c3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:18.640715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde461d-34b2-4e01-88db-08ab549d89c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:18.657802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-edde461d-34b2-4e01-88db-08ab549d89c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:18.659295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-edde461d-34b2-4e01-88db-08ab549d89c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:18.719101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:18.736817 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 481/962] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:18.758139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558af8-24c0-442c-8120-678d67188173 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:18.865275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558af8-24c0-442c-8120-678d67188173 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:18.902124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:18.902871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:18.903160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:18.903440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:18.914565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:18.923314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:18.924233 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:18.925108 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 482/963] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Jun 18 21:46:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:18.930556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde461d-34b2-4e01-88db-08ab549d89c3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.046330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde461d-34b2-4e01-88db-08ab549d89c3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:19.085259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69e434-194f-482e-810c-118052054119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:19.085938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69e434-194f-482e-810c-118052054119 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.086215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69e434-194f-482e-810c-118052054119 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.086489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69e434-194f-482e-810c-118052054119 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.087243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69e434-194f-482e-810c-118052054119 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:19.087550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69e434-194f-482e-810c-118052054119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:19.088922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69e434-194f-482e-810c-118052054119 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:19.098021 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 482/964] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Jun 18 21:46:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:19.103610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.136839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:19.209204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35be7-d5e5-4cc6-a6c3-35d51f0c000e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:19.253574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d838b73-a0ae-4e50-84fc-f2df7cd697a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:19.254807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838b73-a0ae-4e50-84fc-f2df7cd697a0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.255312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838b73-a0ae-4e50-84fc-f2df7cd697a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.255808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d838b73-a0ae-4e50-84fc-f2df7cd697a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.267501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d838b73-a0ae-4e50-84fc-f2df7cd697a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:19.269324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d838b73-a0ae-4e50-84fc-f2df7cd697a0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1d838b73-a0ae-4e50-84fc-f2df7cd697a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:19.288837 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:19.289844 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:19.290748 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:19.290748 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:19.290748 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:19.290748 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:19.293306 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 483/965] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:19.301087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69e434-194f-482e-810c-118052054119 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.351758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:19.391866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040d08-4d32-4500-96fc-545dfc2b1513 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.392186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040d08-4d32-4500-96fc-545dfc2b1513 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.392518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040d08-4d32-4500-96fc-545dfc2b1513 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.394255 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 484/966] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:19.399185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99052-65e0-4945-9b83-9ce72f25faf6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.399471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99052-65e0-4945-9b83-9ce72f25faf6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.399744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99052-65e0-4945-9b83-9ce72f25faf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.401713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69e434-194f-482e-810c-118052054119 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:19.417129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5aa99052-65e0-4945-9b83-9ce72f25faf6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:19.418397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5aa99052-65e0-4945-9b83-9ce72f25faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:19.435428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:19.436095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.436371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.436642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.437429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:19.437735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:19.439106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:19.451484 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 483/967] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:19.458147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.505134 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 485/968] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:19.522293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919777-35c6-48ed-94b3-30b129e1df19 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.522580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919777-35c6-48ed-94b3-30b129e1df19 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.522852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919777-35c6-48ed-94b3-30b129e1df19 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.524499 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 486/969] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:19.525293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919777-35c6-48ed-94b3-30b129e1df19 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.543118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:19.568574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83f6e6-ab2d-42a5-9825-7d3bfafcc3eb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:19.579956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:19.604052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b179c9-e765-49d5-ae5d-f6d7f536fba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:19.604869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b179c9-e765-49d5-ae5d-f6d7f536fba1 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.605183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b179c9-e765-49d5-ae5d-f6d7f536fba1 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.605450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b179c9-e765-49d5-ae5d-f6d7f536fba1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.612720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b179c9-e765-49d5-ae5d-f6d7f536fba1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:19.614203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b179c9-e765-49d5-ae5d-f6d7f536fba1 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-25b179c9-e765-49d5-ae5d-f6d7f536fba1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:19.628993 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:19.629927 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:19.630899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 484/970] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:46:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:19.632099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41afb8b-7e59-4dfc-bb1d-d754add0ac95 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.632355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41afb8b-7e59-4dfc-bb1d-d754add0ac95 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.632628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41afb8b-7e59-4dfc-bb1d-d754add0ac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.641838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919777-35c6-48ed-94b3-30b129e1df19 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:19.649155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e41afb8b-7e59-4dfc-bb1d-d754add0ac95 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:19.650310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e41afb8b-7e59-4dfc-bb1d-d754add0ac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:19.677058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:19.677862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.678137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.678404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.679160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:19.680645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:19.694764 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:19.695779 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:19.702202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 487/971] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:19.703089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.721287 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 485/972] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:19.730304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41afb8b-7e59-4dfc-bb1d-d754add0ac95 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.786574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:19.808235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da523f4f-1a72-49d3-9e1f-1f106057cd52 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:19.843100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:19.843832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.844112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.844383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.845236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:19.845545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:19.846577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41afb8b-7e59-4dfc-bb1d-d754add0ac95 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:19.846985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:19.848603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:19.865848 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 488/973] 10.222.0.30 () {56 vars in 1149 bytes} [Sat Jun 18 21:46:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:19.869968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.885307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:19.886133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:19.886521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:19.886849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:19.887621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:19.887927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:19.889487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:19.899607 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 486/974] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:19.899607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:19.974492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8895-2b21-4d89-a93b-c83527cf4b00 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.002529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05540b69-d5c2-4128-b44f-ac672129a43e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.008987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.009687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.009963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.010262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.011000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.012464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.013760 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.server.flask.common [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 18 21:46:20.022016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.031073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.sql.core [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 18 21:46:20.031073 ncdv-master-1 devstack@keystone.service[91205]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 18 21:46:20.031073 ncdv-master-1 devstack@keystone.service[91205]: [parameters: {'user_id': 'b09d4b9d1c7146eb8b3b80b435ef4693', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 18 21:46:20.031073 ncdv-master-1 devstack@keystone.service[91205]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91205) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 21:46:20.043940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.044414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.044714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.044994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application conn.query(q) Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application result.read() Jun 18 21:46:20.050530 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 21:46:20.051433 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application next(self.gen) Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application yield resource Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application next(self.gen) Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise self.value Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application session.commit() Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 21:46:20.052419 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.session.flush() Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application compat.raise_( Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 21:46:20.053957 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 21:46:20.054900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application conn.query(q) Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application result.read() Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 21:46:20.055781 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b09d4b9d1c7146eb8b3b80b435ef4693', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:20.058215 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 18 21:46:20.060006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 489/975] 10.222.0.30 () {60 vars in 1131 bytes} [Sat Jun 18 21:46:19 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:20.063718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.082197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.123140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.124615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.172210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b3d5d-f30c-44c3-996e-14660e5fc90e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.212297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.212984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.213292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.213568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.214349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:20.214647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.216265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.225119 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 490/976] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:20.226139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.250952 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 487/977] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:20.250952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.299106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.317544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.341109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919a7df-6b38-4325-be29-7c7d0281a2c0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.357210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd39ed-4d26-47a1-a271-034fa18b1b84 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.379400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.380446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.380725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.381001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.388975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.390456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.394809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.395644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.396088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.396514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.397575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] RBAC: Adding query filter params (interface=admin, service_id=e38cf6f1f9924cd7b5d8e1af757995ea, region_id=RegionOne) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:20.398028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.399526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:20.404421 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:20.405594 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:20.406836 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 491/978] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:20.409174 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 488/979] 10.222.0.30 () {56 vars in 1249 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/endpoints?service_id=e38cf6f1f9924cd7b5d8e1af757995ea&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:20.411075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.411499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.510290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039bc1e-a6e2-4a76-b657-68ba5b5f593b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.511411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8f7a-d06f-405f-8251-8c0e14415962 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.534314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.537199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.545400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296e8b3-3c8c-4757-b78d-363b0b13de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.546121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296e8b3-3c8c-4757-b78d-363b0b13de0b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.546364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296e8b3-3c8c-4757-b78d-363b0b13de0b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.546642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296e8b3-3c8c-4757-b78d-363b0b13de0b None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.546937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.547450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296e8b3-3c8c-4757-b78d-363b0b13de0b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:20.547758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296e8b3-3c8c-4757-b78d-363b0b13de0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.547920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.548267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.548608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.549323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296e8b3-3c8c-4757-b78d-363b0b13de0b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.559663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.561127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:20.578109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:20.579045 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:20.584866 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:20.584866 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:20.584866 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:20.584866 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:20.584866 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 492/980] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:20.584866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.585266 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 489/981] 10.222.0.30 () {56 vars in 1101 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:20.585349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbde1f-69f9-41fb-9f70-cb7490104a4c None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.585574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbde1f-69f9-41fb-9f70-cb7490104a4c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.585852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbde1f-69f9-41fb-9f70-cb7490104a4c None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.587385 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 490/982] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:20.588192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbde1f-69f9-41fb-9f70-cb7490104a4c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.700473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e0244-63b5-4fd6-948f-6f15fb7b2b92 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.731976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbde1f-69f9-41fb-9f70-cb7490104a4c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.742060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67018a-1ef3-41b8-8b4f-8aff8b66dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.743247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67018a-1ef3-41b8-8b4f-8aff8b66dce8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.743715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67018a-1ef3-41b8-8b4f-8aff8b66dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.744322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67018a-1ef3-41b8-8b4f-8aff8b66dce8 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.745114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67018a-1ef3-41b8-8b4f-8aff8b66dce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.746530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67018a-1ef3-41b8-8b4f-8aff8b66dce8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.760950 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 493/983] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:46:20.760950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ec64-45d6-4c0c-bcda-47dcc5495d25 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.760950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ec64-45d6-4c0c-bcda-47dcc5495d25 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.760950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ec64-45d6-4c0c-bcda-47dcc5495d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.783853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ac4ec64-45d6-4c0c-bcda-47dcc5495d25 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:20.785647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ac4ec64-45d6-4c0c-bcda-47dcc5495d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:20.785790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.786490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.786770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.787047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:20.787975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:20.788358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:20.790845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:20.805576 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 491/984] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:20.811487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.827567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.875246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:20.889574 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 494/985] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:20.915127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4ec64-45d6-4c0c-bcda-47dcc5495d25 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:20.942556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5175b0-d98d-415e-9ae7-cce97c432b0b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:20.983099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:20.983907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:20.984251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:20.984526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:21.001776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:21.003250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:21.018987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:21.019922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:21.020908 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 492/986] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:21.026123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:21.040124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4ec64-45d6-4c0c-bcda-47dcc5495d25 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:21.078356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:21.078939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:21.079214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:21.079483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:21.080311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:21.081736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:21.097225 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 495/987] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:46:20 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:46:21.138387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4e2e2-831c-4727-a512-de0eb23c6472 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:21.148406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:21.189548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18010e8d-d9f4-4efc-b4e5-c0b626cc1e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:21.190230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010e8d-d9f4-4efc-b4e5-c0b626cc1e62 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:21.190505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010e8d-d9f4-4efc-b4e5-c0b626cc1e62 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:21.190777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18010e8d-d9f4-4efc-b4e5-c0b626cc1e62 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:21.191585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010e8d-d9f4-4efc-b4e5-c0b626cc1e62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:21.191889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010e8d-d9f4-4efc-b4e5-c0b626cc1e62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:21.193379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18010e8d-d9f4-4efc-b4e5-c0b626cc1e62 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:21.209212 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 493/988] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:21.213228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:21.250380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:21.331520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea808d8-353e-4683-b805-7018ef2e93e6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:21.365201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f070bf-bb9a-497b-862d-a934826af0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:21.365861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f070bf-bb9a-497b-862d-a934826af0a9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:21.366136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f070bf-bb9a-497b-862d-a934826af0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:21.366403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f070bf-bb9a-497b-862d-a934826af0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:21.367230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f070bf-bb9a-497b-862d-a934826af0a9 None admin] RBAC: Adding query filter params (role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=7b4aee381e9f4ba3b2f7c8a82f1842be) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:21.367538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f070bf-bb9a-497b-862d-a934826af0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:21.368962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f070bf-bb9a-497b-862d-a934826af0a9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:21.375364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 496/989] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:21 2022] GET /identity/v3/role_assignments?user.id=7b4aee381e9f4ba3b2f7c8a82f1842be&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:23.078917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9c22-b167-49da-a515-8c17d4cd9695 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.079439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9c22-b167-49da-a515-8c17d4cd9695 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.079439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9c22-b167-49da-a515-8c17d4cd9695 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.080881 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 494/990] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:23.086724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8244af-ff70-479f-a73f-2cea93e37166 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.087192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8244af-ff70-479f-a73f-2cea93e37166 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.087663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8244af-ff70-479f-a73f-2cea93e37166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.106843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6a8244af-ff70-479f-a73f-2cea93e37166 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:23.108039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6a8244af-ff70-479f-a73f-2cea93e37166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:23.183986 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 497/991] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:23.210153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a9c22-b167-49da-a515-8c17d4cd9695 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:23.329526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a9c22-b167-49da-a515-8c17d4cd9695 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:23.363496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebb997-4d54-40b9-bd2c-0ed618c8a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:23.364312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb997-4d54-40b9-bd2c-0ed618c8a7ca None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.364586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb997-4d54-40b9-bd2c-0ed618c8a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.364857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb997-4d54-40b9-bd2c-0ed618c8a7ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.365543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebb997-4d54-40b9-bd2c-0ed618c8a7ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:23.366900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebb997-4d54-40b9-bd2c-0ed618c8a7ca None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-e4ebb997-4d54-40b9-bd2c-0ed618c8a7ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:23.379057 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:23.380044 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:23.385915 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 495/992] 10.222.0.30 () {56 vars in 1126 bytes} [Sat Jun 18 21:46:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:23.388280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8244af-ff70-479f-a73f-2cea93e37166 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:23.419741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:23.508909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8244af-ff70-479f-a73f-2cea93e37166 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:23.513722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9adbd2-c3a6-441d-b804-54e847511bd0 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.514009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9adbd2-c3a6-441d-b804-54e847511bd0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.514307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9adbd2-c3a6-441d-b804-54e847511bd0 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.515912 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 496/993] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:23.522270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a316a0-2c4c-42e1-95d8-b445a48fa36d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.522548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a316a0-2c4c-42e1-95d8-b445a48fa36d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.522828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a316a0-2c4c-42e1-95d8-b445a48fa36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.539479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-04a316a0-2c4c-42e1-95d8-b445a48fa36d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:23.540665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-04a316a0-2c4c-42e1-95d8-b445a48fa36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:23.550798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:23.551781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.552237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.552743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.553749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:23.554271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:23.556049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:23.561430 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 498/994] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:23.565331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:23.568367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:23.617351 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 497/995] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:23.641827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a316a0-2c4c-42e1-95d8-b445a48fa36d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:23.666224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:23.681864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602efe5-78fd-47fe-9e53-ecae75da6a6f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:23.721447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:23.722275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.722499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.722763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.723475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:23.723813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:23.725231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:23.730432 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 499/996] 10.222.0.30 () {56 vars in 1122 bytes} [Sat Jun 18 21:46:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:23.736114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:23.763282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a316a0-2c4c-42e1-95d8-b445a48fa36d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:23.798195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe65eca-0be2-4702-bb71-7ec0a84d6a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:23.799006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65eca-0be2-4702-bb71-7ec0a84d6a7a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.799289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65eca-0be2-4702-bb71-7ec0a84d6a7a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.799565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe65eca-0be2-4702-bb71-7ec0a84d6a7a None admin] PATH_INFO: `/v3/services/compute` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.800225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe65eca-0be2-4702-bb71-7ec0a84d6a7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:23.801653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe65eca-0be2-4702-bb71-7ec0a84d6a7a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-5fe65eca-0be2-4702-bb71-7ec0a84d6a7a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:23.813298 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:23.814516 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:23.815869 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 498/997] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:23.816855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b942b0-24e4-416a-9ccf-bd2eec27e13f None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.816855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b942b0-24e4-416a-9ccf-bd2eec27e13f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.816855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b942b0-24e4-416a-9ccf-bd2eec27e13f None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.817570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 499/998] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:23.820449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b942b0-24e4-416a-9ccf-bd2eec27e13f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:23.842243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:23.845691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95179-fd83-44e4-b5f6-e5b5ed62ce10 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:23.881193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42005a94-df8d-430e-a775-24a05fe8054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:23.881777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42005a94-df8d-430e-a775-24a05fe8054e None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.882059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42005a94-df8d-430e-a775-24a05fe8054e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.882328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42005a94-df8d-430e-a775-24a05fe8054e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.883079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42005a94-df8d-430e-a775-24a05fe8054e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:23.884460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42005a94-df8d-430e-a775-24a05fe8054e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:23.899128 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 500/999] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:23.900421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb6f8-22f6-4b57-afae-4deecf8c3835 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.900714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb6f8-22f6-4b57-afae-4deecf8c3835 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.900989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb6f8-22f6-4b57-afae-4deecf8c3835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.918916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-551eb6f8-22f6-4b57-afae-4deecf8c3835 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:23.920151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-551eb6f8-22f6-4b57-afae-4deecf8c3835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:23.923748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:23.941421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b942b0-24e4-416a-9ccf-bd2eec27e13f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:23.983343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:23.984204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:23.984487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:23.984820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:23.985616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] RBAC: Adding query filter params (name=compute) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:23.985926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:23.987598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:23.998162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 500/1000] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:23.999339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:24.000231 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 501/1001] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:24.039872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb6f8-22f6-4b57-afae-4deecf8c3835 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:24.095733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:24.121082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8abe1-b0be-40f8-bef2-6ae6c79a9c6d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:24.157346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb6f8-22f6-4b57-afae-4deecf8c3835 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:24.165146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:24.166242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:24.166524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:24.166796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:24.167870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:24.168183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:24.169886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:24.175906 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 501/1002] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:24.182166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:24.192069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:24.192865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:24.193497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:24.193497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] PATH_INFO: `/v3/services/image` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:24.194139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:24.195519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:24.207472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:24.208485 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:24.209496 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 502/1003] 10.222.0.30 () {56 vars in 1105 bytes} [Sat Jun 18 21:46:24 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:24.214459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:24.219228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:24.296133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254d045-d704-4e2f-a57c-6af56af31d2c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:24.326366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1300a6c-a51a-4e28-80e8-823e53152903 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:24.331763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:24.332408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:24.332682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:24.332950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:24.333786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] RBAC: Adding query filter params (interface=public, service_id=b507d7eb94534531be73cf3c79495aac, region_id=RegionOne) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:24.334095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:24.335450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:24.341061 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 502/1004] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:46:24 2022] GET /identity/v3/endpoints?service_id=b507d7eb94534531be73cf3c79495aac&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:24.347289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:24.358531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:24.367033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:24.367703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:24.367984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:24.368256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:24.368960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] RBAC: Adding query filter params (name=image) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:24.369296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:24.370665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:24.380375 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 503/1005] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:24.382082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:24.450958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd005cb-8523-4b3d-ba3c-3e4c6e3c972c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:24.459384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:24.489342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26721a16-219c-4366-ba6d-f0f8103bf2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:24.490019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26721a16-219c-4366-ba6d-f0f8103bf2fd None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:24.490306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26721a16-219c-4366-ba6d-f0f8103bf2fd None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:24.490587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26721a16-219c-4366-ba6d-f0f8103bf2fd None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:24.491279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26721a16-219c-4366-ba6d-f0f8103bf2fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:24.492655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26721a16-219c-4366-ba6d-f0f8103bf2fd None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:24.495118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fff30b-3f31-4d29-8c65-f7231f3230bf None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:24.498987 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 503/1006] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:46:24 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:46:24.532377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53163aca-64ca-405c-8980-cf6cbc8e7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:24.533509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163aca-64ca-405c-8980-cf6cbc8e7864 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:24.534012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163aca-64ca-405c-8980-cf6cbc8e7864 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:24.534515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53163aca-64ca-405c-8980-cf6cbc8e7864 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:24.535444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53163aca-64ca-405c-8980-cf6cbc8e7864 None admin] RBAC: Adding query filter params (type=image) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:24.535947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53163aca-64ca-405c-8980-cf6cbc8e7864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:24.537615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53163aca-64ca-405c-8980-cf6cbc8e7864 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:24.543669 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 504/1007] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:26.232980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cb24-c364-4d85-88f2-bdb16205ee16 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.233590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cb24-c364-4d85-88f2-bdb16205ee16 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.233717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6cb24-c364-4d85-88f2-bdb16205ee16 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.235296 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 504/1008] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:26.240591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e8cce-d0bf-49c2-b8b5-2e9451f1d1fa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.240987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e8cce-d0bf-49c2-b8b5-2e9451f1d1fa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.241196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e8cce-d0bf-49c2-b8b5-2e9451f1d1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.258838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b81e8cce-d0bf-49c2-b8b5-2e9451f1d1fa None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:26.260027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b81e8cce-d0bf-49c2-b8b5-2e9451f1d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:26.336614 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 505/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:26.361386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6cb24-c364-4d85-88f2-bdb16205ee16 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:26.435649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:26.469277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6cb24-c364-4d85-88f2-bdb16205ee16 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:26.504709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faf7c1-8700-401f-80eb-fdcdf1fd48c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:26.505531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf7c1-8700-401f-80eb-fdcdf1fd48c8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.505811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf7c1-8700-401f-80eb-fdcdf1fd48c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.506084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf7c1-8700-401f-80eb-fdcdf1fd48c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.507261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faf7c1-8700-401f-80eb-fdcdf1fd48c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:26.508691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faf7c1-8700-401f-80eb-fdcdf1fd48c8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:26.510529 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 505/1010] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:26.516168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e8cce-d0bf-49c2-b8b5-2e9451f1d1fa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:26.577362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:26.627902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e8cce-d0bf-49c2-b8b5-2e9451f1d1fa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:26.665606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947281de-053f-4b55-8738-a6e492a31451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:26.666355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947281de-053f-4b55-8738-a6e492a31451 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.666697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947281de-053f-4b55-8738-a6e492a31451 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.667035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947281de-053f-4b55-8738-a6e492a31451 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.667806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947281de-053f-4b55-8738-a6e492a31451 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:26.669337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947281de-053f-4b55-8738-a6e492a31451 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:26.701062 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 506/1011] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:46:26 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:26.837807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9b464-09d1-4b02-8d80-c4a8edb528d5 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.838295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9b464-09d1-4b02-8d80-c4a8edb528d5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.838696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9b464-09d1-4b02-8d80-c4a8edb528d5 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.840293 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 506/1012] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:26.846371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48494-43d5-4ed4-9653-1f4c16cf3daa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.846660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48494-43d5-4ed4-9653-1f4c16cf3daa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.846941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48494-43d5-4ed4-9653-1f4c16cf3daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.857089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8abe73-cb91-4a70-9cf6-a3db03741590 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.857459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8abe73-cb91-4a70-9cf6-a3db03741590 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.857628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8abe73-cb91-4a70-9cf6-a3db03741590 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.859325 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 507/1013] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:26.864775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c9d3-31f1-450b-bc80-bf2382641754 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:26.865096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c9d3-31f1-450b-bc80-bf2382641754 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:26.865368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3c9d3-31f1-450b-bc80-bf2382641754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:26.865670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f9c48494-43d5-4ed4-9653-1f4c16cf3daa None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:26.866976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f9c48494-43d5-4ed4-9653-1f4c16cf3daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:26.885335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6da3c9d3-31f1-450b-bc80-bf2382641754 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:26.887172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6da3c9d3-31f1-450b-bc80-bf2382641754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:26.943059 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 507/1014] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:26.962497 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 508/1015] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:26.968172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48494-43d5-4ed4-9653-1f4c16cf3daa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:26.986321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3c9d3-31f1-450b-bc80-bf2382641754 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:27.018895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:27.058251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:27.086985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48494-43d5-4ed4-9653-1f4c16cf3daa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:27.092735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3c9d3-31f1-450b-bc80-bf2382641754 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:27.125157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:27.125965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:27.126249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:27.126525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:27.127168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:27.127698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:27.128361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:27.128540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:27.128636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:27.128917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:27.129670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:27.131021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:27.141888 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:27.142950 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:27.144466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 508/1016] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:27.148801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:27.151698 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 509/1017] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:46:26 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 21:46:27.264100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb5aa-83ea-46c6-85ae-d97acdf34723 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:27.274426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:27.313796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:27.314629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:27.314917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:27.315193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:27.316031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:27.316344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:27.317759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:27.326669 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 509/1018] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:27.330082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:27.443514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc73d2d-0eb1-4d4c-842e-f4506a4a8186 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:27.473925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:27.481297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bba749-8bb3-4cd3-8ae3-5267150cd02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:27.482017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba749-8bb3-4cd3-8ae3-5267150cd02c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:27.482300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba749-8bb3-4cd3-8ae3-5267150cd02c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:27.482572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bba749-8bb3-4cd3-8ae3-5267150cd02c None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:27.483284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bba749-8bb3-4cd3-8ae3-5267150cd02c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:27.483703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bba749-8bb3-4cd3-8ae3-5267150cd02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:27.485245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bba749-8bb3-4cd3-8ae3-5267150cd02c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:27.491056 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 510/1019] 10.222.0.30 () {56 vars in 1112 bytes} [Sat Jun 18 21:46:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:27.496558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:27.600231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefc08e-4360-44e2-8092-204fa699cc45 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:27.633583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3827-9835-45ca-8598-c8cde3895972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:27.634242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3827-9835-45ca-8598-c8cde3895972 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:27.634518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3827-9835-45ca-8598-c8cde3895972 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:27.634789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3827-9835-45ca-8598-c8cde3895972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:27.635535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3827-9835-45ca-8598-c8cde3895972 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:27.636906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3827-9835-45ca-8598-c8cde3895972 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:27.655768 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 510/1020] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:29.073266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ce8af-830f-42b2-99ec-ac17cf09dd5c None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.073838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ce8af-830f-42b2-99ec-ac17cf09dd5c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.073838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ce8af-830f-42b2-99ec-ac17cf09dd5c None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.075392 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 511/1021] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:29.081232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c9336-7e7f-4a82-962d-315451d8152b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.081700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c9336-7e7f-4a82-962d-315451d8152b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.081834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c9336-7e7f-4a82-962d-315451d8152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.100148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f43c9336-7e7f-4a82-962d-315451d8152b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:29.101477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f43c9336-7e7f-4a82-962d-315451d8152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:29.119785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:29.179717 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 511/1022] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:29.206767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ce8af-830f-42b2-99ec-ac17cf09dd5c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:29.327169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ce8af-830f-42b2-99ec-ac17cf09dd5c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:29.363245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe69a73-58c8-4192-8f0f-f2418de2569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:29.364066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69a73-58c8-4192-8f0f-f2418de2569b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.364343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69a73-58c8-4192-8f0f-f2418de2569b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.364621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69a73-58c8-4192-8f0f-f2418de2569b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.365871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69a73-58c8-4192-8f0f-f2418de2569b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:29.367334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69a73-58c8-4192-8f0f-f2418de2569b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:29.373671 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 512/1023] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:29.375026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c9336-7e7f-4a82-962d-315451d8152b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:29.476984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c9336-7e7f-4a82-962d-315451d8152b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:29.511775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:29.512455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.512752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.513009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.513754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:29.515246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:29.528247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70a24-047d-445e-b063-6f18ca074db0 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.528571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70a24-047d-445e-b063-6f18ca074db0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.528823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70a24-047d-445e-b063-6f18ca074db0 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.530544 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 513/1024] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:29.535447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d0183-0e8d-491c-b471-f051680765a9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.535744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d0183-0e8d-491c-b471-f051680765a9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.536023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d0183-0e8d-491c-b471-f051680765a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.545412 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 512/1025] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:46:29 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:29.562140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-330d0183-0e8d-491c-b471-f051680765a9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:29.563387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-330d0183-0e8d-491c-b471-f051680765a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:29.630645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:29.644199 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 514/1026] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:29.668501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:29.678147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:29.786222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bca48-5f7b-4277-b82d-9bb30b2c738f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:29.823428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:29.824268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.824550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.824824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] PATH_INFO: `/v3/services/image` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.825562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:29.827543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:29.840232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:29.841371 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:29.842323 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 513/1027] 10.222.0.30 () {56 vars in 1105 bytes} [Sat Jun 18 21:46:29 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:29.848150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d0183-0e8d-491c-b471-f051680765a9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:29.952437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d0183-0e8d-491c-b471-f051680765a9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:29.988742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25532e68-c2bb-4cc8-9c4e-33ab0517dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:29.989439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532e68-c2bb-4cc8-9c4e-33ab0517dc04 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:29.989698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532e68-c2bb-4cc8-9c4e-33ab0517dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:29.989992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532e68-c2bb-4cc8-9c4e-33ab0517dc04 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:29.990716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25532e68-c2bb-4cc8-9c4e-33ab0517dc04 None admin] RBAC: Adding query filter params (name=image) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:29.991021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25532e68-c2bb-4cc8-9c4e-33ab0517dc04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:29.992382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25532e68-c2bb-4cc8-9c4e-33ab0517dc04 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:29.997663 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 515/1028] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:30.003350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.063611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e6fb3-a69f-4a69-9315-aa31691af585 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.063902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e6fb3-a69f-4a69-9315-aa31691af585 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.064178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e6fb3-a69f-4a69-9315-aa31691af585 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.065582 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 516/1029] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:30.070448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc588-2048-4de2-886e-c08f7bcae66f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.070743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc588-2048-4de2-886e-c08f7bcae66f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.071011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc588-2048-4de2-886e-c08f7bcae66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.085583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:30.088158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d98fc588-2048-4de2-886e-c08f7bcae66f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:30.089415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d98fc588-2048-4de2-886e-c08f7bcae66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:30.122029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884280da-5dbc-497d-ae90-7e9af6c22ebf None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:30.154184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:30.166883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:30.167579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.167859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.168139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.168879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] RBAC: Adding query filter params (type=image) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:30.169215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:30.170647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:30.180680 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 514/1030] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:30.181770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.182327 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 517/1031] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:30.204017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fc588-2048-4de2-886e-c08f7bcae66f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.292642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b344f-71c4-498d-8cd4-06e0c1af8098 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:30.306428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fc588-2048-4de2-886e-c08f7bcae66f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:30.331597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:30.332247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.332530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.332800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.333634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] RBAC: Adding query filter params (interface=public, service_id=6425b68540054fa89381eeb7f3cc8acf, region_id=RegionOne) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:30.333942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:30.335302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:30.336757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:30.345959 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 515/1032] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/endpoints?service_id=6425b68540054fa89381eeb7f3cc8acf&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:30.346708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.347952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:30.348968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.349528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.350144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.361245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:30.369913 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:30.370840 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:30.371703 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 518/1033] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:30.377227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.428224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:30.453914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe6ed3-f133-43b6-b759-c37d16442b89 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:30.488165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:30.488533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28f09-25a0-4f76-9651-3f719101e752 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:30.488830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.489143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.489422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.490107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:30.491484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:30.498179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 516/1034] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:46:30.525493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:30.526240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.526516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.526785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.527595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:30.527894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:30.529370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:30.539338 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 519/1035] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:30.545002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.611697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:30.657026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85524021-4d58-4639-9107-d34d365c8f5c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:30.694906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:30.695698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.695972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.696244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.707397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:30.708843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:30.726239 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:30.727183 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:30.728125 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:30.728125 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:30.728125 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:30.728125 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:30.728125 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 517/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:30.733532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.838427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b48f-518b-42d2-9b5e-2d3b37eebaf8 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:30.847690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:30.874904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:30.875566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:30.875847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:30.876114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:30.876829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:30.877196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:30.878555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:30.891036 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 520/1037] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:30.896491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:30.999395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a8127-d2ad-4350-8e8f-feb677a7b7da None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:31.012416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:31.042716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:31.043519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:31.043796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:31.044064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:31.051724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:31.053204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:31.067506 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:31.068492 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:46:31.069593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:31.073415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 518/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:46:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:31.074811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:31.176588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16cb11-31b1-41d5-a4b5-1b3c316f090e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:31.210845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:31.211512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:31.211783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:31.212055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:31.212888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:31.213220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:31.214654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:31.234522 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 521/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:46:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:31.240023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:31.351090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102420c-128c-40f8-97c8-c56fe80c887f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:31.384306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:31.384950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:31.385252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:31.385523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:31.427534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:31.454318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:31.455797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:31.552755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 519/1040] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:31.558357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:31.587106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:31.662100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa536380-ca53-4c0f-9045-8ad5e57626e5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:31.697045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:31.697801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:31.698078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:31.698346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:31.710599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:31.712066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:31.731253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:31.732253 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:31.733648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:31.733648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:31.733648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:31.733648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:31.737211 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 522/1041] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:31.738241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:31.812061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:31.838315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406cfe-80e8-460c-b7ee-361a4923edeb None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:31.871925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8e367-be46-4854-91cc-399d48a12f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:31.872583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8e367-be46-4854-91cc-399d48a12f46 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:31.872840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8e367-be46-4854-91cc-399d48a12f46 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:31.873154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8e367-be46-4854-91cc-399d48a12f46 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:31.873873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8e367-be46-4854-91cc-399d48a12f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:31.874225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8e367-be46-4854-91cc-399d48a12f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:31.875585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8e367-be46-4854-91cc-399d48a12f46 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:31.887071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 520/1042] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:31.892637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:31.934949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a85b0-ec7e-4e73-9871-fc9e7dd87af3 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:31.935220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a85b0-ec7e-4e73-9871-fc9e7dd87af3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:31.935507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a85b0-ec7e-4e73-9871-fc9e7dd87af3 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:31.937085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 521/1043] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:31.941950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4b11c-303a-4148-b253-b24788d3ea2f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:31.942240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4b11c-303a-4148-b253-b24788d3ea2f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:31.942522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4b11c-303a-4148-b253-b24788d3ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:31.959305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d5d4b11c-303a-4148-b253-b24788d3ea2f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:31.960538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d5d4b11c-303a-4148-b253-b24788d3ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:31.976795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:32.000268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28484-7df9-4bab-949e-4521680d9c0e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:32.038148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 522/1044] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:32.038478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:32.039289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.039572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.039882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.047198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:32.048633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:32.062208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:32.063113 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:32.069296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:32.069741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4b11c-303a-4148-b253-b24788d3ea2f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:32.069819 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 523/1045] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:32.069819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:32.128983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:32.169163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4b11c-303a-4148-b253-b24788d3ea2f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:32.179728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739cbee-f582-4c92-98f1-7f8b5c9868db None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:32.204921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:32.206205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.206633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.207030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.220504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:32.220648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:32.221160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.221442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.221715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.222511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:32.222813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:32.224294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:32.228832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:32.229873 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:32.235972 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 523/1046] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:32.236709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:32.238344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:32.240669 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 524/1047] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:32.246459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:32.345506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50633e1-d434-4c94-bbe3-ffa05643dd1c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:32.358412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30c10-086b-4956-983b-28784c1a0375 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:32.369312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:32.381170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:32.381850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.382401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.382702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.383575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:32.383879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:32.385856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:32.394962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:32.395617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.396115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.396218 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 524/1048] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:32.396293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.397013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] RBAC: Adding query filter params (role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=578ca3087f9442d88152f65fad464f32) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:32.397324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:32.398750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:32.401710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:32.404967 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 525/1049] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/role_assignments?user.id=578ca3087f9442d88152f65fad464f32&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:32.513860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afec384-c243-4a40-85c8-9debf2710a47 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:32.551180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523de4ae-15e2-47df-815d-f85bb3f201f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:32.552078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de4ae-15e2-47df-815d-f85bb3f201f6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.552355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de4ae-15e2-47df-815d-f85bb3f201f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.552623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de4ae-15e2-47df-815d-f85bb3f201f6 None admin] PATH_INFO: `/v3/users/8bdcfa3ed13c4dc88c791ee1f8c55e25` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.570008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523de4ae-15e2-47df-815d-f85bb3f201f6 None admin] RBAC: Authorizing `identity:get_user(user_id=8bdcfa3ed13c4dc88c791ee1f8c55e25)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:32.571525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523de4ae-15e2-47df-815d-f85bb3f201f6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:32.573698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 525/1050] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/users/8bdcfa3ed13c4dc88c791ee1f8c55e25 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:32.580098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:32.649773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:32.690848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2107f-1e5b-4ddd-b589-fece444cec3f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:32.737962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:32.738609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.738884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.739152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.806142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dd1f2-b6a1-435d-b4df-81300663617e None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.806354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dd1f2-b6a1-435d-b4df-81300663617e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.806602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dd1f2-b6a1-435d-b4df-81300663617e None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.808138 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 526/1051] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:32.810239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:32.811710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:32.812778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e824d4-cd34-41b8-85b5-8c7fe53b9db4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:32.813089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e824d4-cd34-41b8-85b5-8c7fe53b9db4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:32.813367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e824d4-cd34-41b8-85b5-8c7fe53b9db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:32.830128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-74e824d4-cd34-41b8-85b5-8c7fe53b9db4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:32.831303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74e824d4-cd34-41b8-85b5-8c7fe53b9db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:32.873153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:32.876546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:32.904104 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 527/1052] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:32.925367 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 526/1053] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:32.931237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:32.931373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e824d4-cd34-41b8-85b5-8c7fe53b9db4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:33.042131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e824d4-cd34-41b8-85b5-8c7fe53b9db4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:33.043254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b80995-33ea-4bbd-95ed-5ce97ae71b2f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:33.077471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:33.078275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:33.078552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:33.078823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:33.079890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:33.080010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] RBAC: Authorizing `identity:get_project(project_id=ca67487998a54fdeae5fbf3007427f1b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:33.080689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:33.080969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:33.081290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] PATH_INFO: `/v3/services/image` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:33.081455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:33.081948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:33.083308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:33.083699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 527/1054] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:33.089496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:33.096981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:33.098102 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 18 21:46:33.098946 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:33.103200 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 528/1055] 10.222.0.30 () {56 vars in 1105 bytes} [Sat Jun 18 21:46:32 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:33.103836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:33.122042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:33.146752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:33.194691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138e305-b110-448e-a467-0b0e271b9f61 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:33.212488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4b73f-ee34-4c31-ba86-84b23e233655 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:33.230171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:33.230825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:33.231104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:33.231383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:33.232213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=ca67487998a54fdeae5fbf3007427f1b, user.id=8bdcfa3ed13c4dc88c791ee1f8c55e25) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:33.232520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:33.234029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:33.240123 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 528/1056] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:33 2022] GET /identity/v3/role_assignments?user.id=8bdcfa3ed13c4dc88c791ee1f8c55e25&scope.project.id=ca67487998a54fdeae5fbf3007427f1b&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:33.247269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:33.247959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:33.248241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:33.248516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:33.250751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] RBAC: Adding query filter params (name=image) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:33.250751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:33.251158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:33.261080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 529/1057] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:33.263322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:33.374774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:33.383381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f3795-ad42-4f43-9efe-4cdffe6ef4f3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:33.420244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6f526-fe83-4a93-8593-e5a4029c9d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:33.420961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f526-fe83-4a93-8593-e5a4029c9d80 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:33.421267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f526-fe83-4a93-8593-e5a4029c9d80 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:33.421534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f526-fe83-4a93-8593-e5a4029c9d80 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:33.422234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6f526-fe83-4a93-8593-e5a4029c9d80 None admin] RBAC: Adding query filter params (type=image) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:33.422533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6f526-fe83-4a93-8593-e5a4029c9d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:33.423893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6f526-fe83-4a93-8593-e5a4029c9d80 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:33.429654 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 529/1058] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:33.435351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:33.540787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba614b-6e47-4069-b454-5a906c7f416f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:33.542465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:33.578525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfd729-e905-4713-9e5a-5acc06990508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:33.579186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd729-e905-4713-9e5a-5acc06990508 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:33.579528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd729-e905-4713-9e5a-5acc06990508 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:33.579778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd729-e905-4713-9e5a-5acc06990508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:33.580577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfd729-e905-4713-9e5a-5acc06990508 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:33.581977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfd729-e905-4713-9e5a-5acc06990508 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:33.609076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 530/1059] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:46:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:34.672695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441da0-3b4d-4863-b1cf-0dcfdd96af14 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:34.673274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441da0-3b4d-4863-b1cf-0dcfdd96af14 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:34.673274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441da0-3b4d-4863-b1cf-0dcfdd96af14 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:34.674594 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 530/1060] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:34.680216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f778eb-731d-460a-b3ef-08a37de5ebd2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:34.680629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f778eb-731d-460a-b3ef-08a37de5ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:34.680726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f778eb-731d-460a-b3ef-08a37de5ebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:34.701763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-74f778eb-731d-460a-b3ef-08a37de5ebd2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:34.702952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74f778eb-731d-460a-b3ef-08a37de5ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:34.777625 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 531/1061] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:34.801568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61441da0-3b4d-4863-b1cf-0dcfdd96af14 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:34.902020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61441da0-3b4d-4863-b1cf-0dcfdd96af14 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:34.935580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:34.936360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:34.936598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:34.936900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:34.947082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:34.955416 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:34.956447 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:34.957873 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:34.961418 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 531/1062] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Jun 18 21:46:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:34.962783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f778eb-731d-460a-b3ef-08a37de5ebd2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.058688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:35.076924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f778eb-731d-460a-b3ef-08a37de5ebd2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.117840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.118518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.118795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.119244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.120584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:35.120895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:35.122766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:35.133844 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 532/1063] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Jun 18 21:46:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:35.139627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.159129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:35.247131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8397-0515-4554-af6b-2c3f094f464b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.281708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.282509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.282787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.283057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.294704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:35.296310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:35.315038 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:35.316065 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:35.316990 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:35.316990 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:35.316990 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:35.316990 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:35.321284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 532/1064] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:35.322618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.440193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3dcc8-5c2d-4e8e-a87f-196793b87fc2 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.475548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d6e78-5b99-44c9-9c69-d478092ddce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.476215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6e78-5b99-44c9-9c69-d478092ddce6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.476490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6e78-5b99-44c9-9c69-d478092ddce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.476757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6e78-5b99-44c9-9c69-d478092ddce6 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.477512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d6e78-5b99-44c9-9c69-d478092ddce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:35.477815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d6e78-5b99-44c9-9c69-d478092ddce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:35.479181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d6e78-5b99-44c9-9c69-d478092ddce6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:35.491179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 533/1065] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:35.497017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.536376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3725-a9be-4ae1-908e-d63e0359765d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.536565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3725-a9be-4ae1-908e-d63e0359765d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.536851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3725-a9be-4ae1-908e-d63e0359765d None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.538260 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 534/1066] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:35.543659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c825e-e309-4154-b3e0-86b7da287319 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.543946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c825e-e309-4154-b3e0-86b7da287319 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.544216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c825e-e309-4154-b3e0-86b7da287319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.555434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:35.561791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-835c825e-e309-4154-b3e0-86b7da287319 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:35.562973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-835c825e-e309-4154-b3e0-86b7da287319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:35.570427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:35.604704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a132-e0e3-4a01-9717-b14d9cac12e6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.636906 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 535/1067] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:35.639342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.640140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.640418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.640690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.648376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:35.649840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:35.660915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c825e-e309-4154-b3e0-86b7da287319 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:35.663684 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:35.664652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:35.665701 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 533/1068] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:46:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:35.670422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.776951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c825e-e309-4154-b3e0-86b7da287319 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.782193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dfedc-d452-4587-be02-fcda04441286 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.813554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.814285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.814583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.814853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.816323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:35.817657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:35.825483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.826471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.826814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.827092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.827936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:35.828157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:35.828258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:35.829698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:35.837389 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:35.838332 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:35.839232 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:35.839883 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 536/1069] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:35.845798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.856546 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 534/1070] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:46:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:35.856844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:35.950240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f676b-9b9a-4d57-b924-b01a496d9208 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.963643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f1fc5-5b21-40c9-b925-60849f7ab50a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:35.990502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722bafb-987f-4d60-b690-14c379a2ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.991172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722bafb-987f-4d60-b690-14c379a2ca1e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.991456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722bafb-987f-4d60-b690-14c379a2ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.991735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722bafb-987f-4d60-b690-14c379a2ca1e None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:35.992487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722bafb-987f-4d60-b690-14c379a2ca1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:35.992795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722bafb-987f-4d60-b690-14c379a2ca1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:35.994229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722bafb-987f-4d60-b690-14c379a2ca1e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:35.998010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2832ae8-b73d-44f7-b5a1-62539d792298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:35.998834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2832ae8-b73d-44f7-b5a1-62539d792298 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:35.999112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2832ae8-b73d-44f7-b5a1-62539d792298 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:35.999387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2832ae8-b73d-44f7-b5a1-62539d792298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.002461 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 537/1071] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:36.003851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f67ba-d5e9-4f98-87f2-9a86ea885902 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.004304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f67ba-d5e9-4f98-87f2-9a86ea885902 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.004737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f67ba-d5e9-4f98-87f2-9a86ea885902 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.006131 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 538/1072] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:36.008126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f67ba-d5e9-4f98-87f2-9a86ea885902 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.011362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2832ae8-b73d-44f7-b5a1-62539d792298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.012804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2832ae8-b73d-44f7-b5a1-62539d792298 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f2832ae8-b73d-44f7-b5a1-62539d792298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:36.030734 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:36.031837 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:36.033207 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:36.033207 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:36.033207 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:36.033207 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:36.033207 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 535/1073] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:36.033729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64765868-7a2c-4b0e-b5c4-daf5e3fdb5ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.034015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64765868-7a2c-4b0e-b5c4-daf5e3fdb5ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.034285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64765868-7a2c-4b0e-b5c4-daf5e3fdb5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.050380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-64765868-7a2c-4b0e-b5c4-daf5e3fdb5ff None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:36.051548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64765868-7a2c-4b0e-b5c4-daf5e3fdb5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:36.073976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.085479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.118191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f67ba-d5e9-4f98-87f2-9a86ea885902 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.119404 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 536/1074] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:36.121870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64765868-7a2c-4b0e-b5c4-daf5e3fdb5ff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.153594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.154484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.154763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.155086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] PATH_INFO: `/v3/users/8bdcfa3ed13c4dc88c791ee1f8c55e25` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.156321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] RBAC: Authorizing `identity:get_user(user_id=8bdcfa3ed13c4dc88c791ee1f8c55e25)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.157805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.159451 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 539/1075] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/users/8bdcfa3ed13c4dc88c791ee1f8c55e25 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:36.160224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.224970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64765868-7a2c-4b0e-b5c4-daf5e3fdb5ff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.258078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1bf6e-6fb4-43c2-a243-6f0941f791c1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.258236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.258741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.259022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.259296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.260086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:36.260397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.261793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.273221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 537/1076] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:36.274016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.287861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.297484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.298223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.298511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.298789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.305158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.368398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.369795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.373526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3786665-041b-4c20-a841-bfe38bd229f6 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.412880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.413778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.414048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.414317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.415514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] RBAC: Authorizing `identity:get_project(project_id=ca67487998a54fdeae5fbf3007427f1b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.416945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.418687 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 538/1077] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:36.419436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.467810 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 540/1078] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:36.472056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.496496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.517322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.521487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8753-5ea7-42fa-9b92-495fb63492d7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.558904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.559707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.559987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.560256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.567535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.568995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.581058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a04897-4376-4b88-a54e-03c590465dfa None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:36.583640 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:36.584694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 539/1079] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:36.590747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.625365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.626177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.626451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.626721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b/users/8bdcfa3ed13c4dc88c791ee1f8c55e25/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.628661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca67487998a54fdeae5fbf3007427f1b, user_id=8bdcfa3ed13c4dc88c791ee1f8c55e25, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.634171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.650643 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 541/1080] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:46:36 2022] PUT /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b/users/8bdcfa3ed13c4dc88c791ee1f8c55e25/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:46:36.651527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.704933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20ed9a-6e67-4594-b509-67ede2018f1f None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.749520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.750488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.751315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.751596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.751872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.764904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.766512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.767468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967972c-f485-4c41-96eb-021d449c9407 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:36.785844 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:36.787400 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:36.788580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:36.788580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:36.788580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:36.788580 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:36.788580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 540/1081] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:36.793507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.806996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:36.809230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.809920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.810193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.810464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.811291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:36.811593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.813050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.827038 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 542/1082] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:36.832853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:36.907172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf38530-d6ed-4ec7-af40-b3b8e9bb667e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.941395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfde704-c32a-435f-a89a-5501337c4869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.942069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfde704-c32a-435f-a89a-5501337c4869 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.942344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfde704-c32a-435f-a89a-5501337c4869 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.942625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfde704-c32a-435f-a89a-5501337c4869 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.943385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfde704-c32a-435f-a89a-5501337c4869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:36.943687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfde704-c32a-435f-a89a-5501337c4869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.945063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfde704-c32a-435f-a89a-5501337c4869 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:36.948241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4942f-8ecd-4cb6-bc0f-247bf4201124 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:36.957081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 541/1083] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:36.984731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870a531-f92b-46d3-bfe8-1a46b352a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:36.985687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870a531-f92b-46d3-bfe8-1a46b352a5ca None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:36.985965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870a531-f92b-46d3-bfe8-1a46b352a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:36.986303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870a531-f92b-46d3-bfe8-1a46b352a5ca None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/578ca3087f9442d88152f65fad464f32/roles/09b0ad2b5ba643cb81ea8b022b7d6b4b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:36.988699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870a531-f92b-46d3-bfe8-1a46b352a5ca None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=578ca3087f9442d88152f65fad464f32, role_id=09b0ad2b5ba643cb81ea8b022b7d6b4b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:36.990210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870a531-f92b-46d3-bfe8-1a46b352a5ca None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:37.006592 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 543/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:46:36 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/578ca3087f9442d88152f65fad464f32/roles/09b0ad2b5ba643cb81ea8b022b7d6b4b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:46:38.914597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461792ce-568a-421a-8a0f-fbc46b969098 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:38.915150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461792ce-568a-421a-8a0f-fbc46b969098 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:38.915150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461792ce-568a-421a-8a0f-fbc46b969098 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:38.916491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 542/1085] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:38.921896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b27f-a75c-4216-9124-c7a1d0438d71 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:38.922331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b27f-a75c-4216-9124-c7a1d0438d71 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:38.922557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860b27f-a75c-4216-9124-c7a1d0438d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:38.934751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:38.940649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7860b27f-a75c-4216-9124-c7a1d0438d71 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:38.942605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7860b27f-a75c-4216-9124-c7a1d0438d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:39.015055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 544/1086] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:39.039728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461792ce-568a-421a-8a0f-fbc46b969098 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.121241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:39.155953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461792ce-568a-421a-8a0f-fbc46b969098 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.192275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c407670-9027-4616-be5d-cf0605e995e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.192990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c407670-9027-4616-be5d-cf0605e995e6 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.193301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c407670-9027-4616-be5d-cf0605e995e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.193575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c407670-9027-4616-be5d-cf0605e995e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.205078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c407670-9027-4616-be5d-cf0605e995e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7c407670-9027-4616-be5d-cf0605e995e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:39.212572 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:39.213570 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:39.214440 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 543/1087] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:39.220159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860b27f-a75c-4216-9124-c7a1d0438d71 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.299498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2fdf-fbb0-4377-98dc-810bc6215f58 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.299740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2fdf-fbb0-4377-98dc-810bc6215f58 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.300050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2fdf-fbb0-4377-98dc-810bc6215f58 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.301450 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 544/1088] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:46:39.306530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda834-4c49-4033-9b5c-9c0dc1ea300b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.306810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda834-4c49-4033-9b5c-9c0dc1ea300b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.307077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fda834-4c49-4033-9b5c-9c0dc1ea300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.323772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-55fda834-4c49-4033-9b5c-9c0dc1ea300b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:39.325069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-55fda834-4c49-4033-9b5c-9c0dc1ea300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:39.325220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860b27f-a75c-4216-9124-c7a1d0438d71 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.361436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.362092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.362366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.362639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.363382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:39.363683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:39.365073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:39.367266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:39.374607 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 545/1089] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:39.380400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.393672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 545/1090] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:46:39.420183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fda834-4c49-4033-9b5c-9c0dc1ea300b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.477095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af49e5-01ba-4faf-a2de-9ec9c09eb20d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.477279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:39.514034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.514903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.515166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.515435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] PATH_INFO: `/v3/users/8bdcfa3ed13c4dc88c791ee1f8c55e25` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.516689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] RBAC: Authorizing `identity:get_user(user_id=8bdcfa3ed13c4dc88c791ee1f8c55e25)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:39.518158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:39.519797 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 546/1091] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/users/8bdcfa3ed13c4dc88c791ee1f8c55e25 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:39.519896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fda834-4c49-4033-9b5c-9c0dc1ea300b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.525421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.555808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.556637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.556920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.557218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.568179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:46:39.577188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:39.578239 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 18 21:46:39.579106 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:39.581400 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 546/1092] 10.222.0.30 () {56 vars in 1120 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:39.584360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.598744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:39.636560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367da5-dc83-4288-8c99-1fda15a0c72a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.669943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.670630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.670919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.671191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.682948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ee508-7cea-413b-8714-15e6f6dee8e9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.702743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:39.718160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.718826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.719112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.719383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.720139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:39.720439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:39.721853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:39.730004 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 547/1093] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:39.735589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.738808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:39.740281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:39.803108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:39.836586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8357a31-7b04-4d7a-aba6-c6242eab0a34 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.840306 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 547/1094] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 18 21:46:39.846249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.871220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.872145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.872442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.872718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.884367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:39.886253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:39.903914 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:39.904922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:39.906445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:39.906445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:39.906445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:39.906445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:39.906445 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 548/1095] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:39.910927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:39.945049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:39.949709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ddf30-891c-448c-bcf6-f82e8fc16579 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:39.989106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:39.989921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:39.990202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:39.990476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:39.991682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] RBAC: Authorizing `identity:get_project(project_id=ca67487998a54fdeae5fbf3007427f1b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:39.993170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:39.994889 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 548/1096] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:40.001016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:40.015046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e94b83-2e2c-4597-9ec7-3469afd35808 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:40.036025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:40.052733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:40.053435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:40.053717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:40.053991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:40.054719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:40.055012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:40.056392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:40.068133 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 549/1097] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:40.073876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:40.102141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e198f-da31-42c0-847a-1ac4d63d9f1c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:40.135134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:40.135784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:40.136064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:40.136338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:40.137200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=ca67487998a54fdeae5fbf3007427f1b, user.id=8bdcfa3ed13c4dc88c791ee1f8c55e25) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:40.137512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:40.138981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:40.144732 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 549/1098] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:40 2022] GET /identity/v3/role_assignments?user.id=8bdcfa3ed13c4dc88c791ee1f8c55e25&scope.project.id=ca67487998a54fdeae5fbf3007427f1b&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:40.165948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:40.173519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be42e1c-89d1-464f-8168-7d6cfb1dcabb None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:40.211344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:40.212169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:40.212447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:40.212719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] PATH_INFO: `/v3/users/nova` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:40.221297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:40.222765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:46:40.239595 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:40.240709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:46:40.247342 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 550/1099] 10.222.0.30 () {56 vars in 1093 bytes} [Sat Jun 18 21:46:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:46:40.248191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:40.351394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:40.355209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c48a-8083-42fb-bbb6-d30cd41e11dd None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:40.390844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:40.391522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:40.391804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:40.392097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:40.392919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:40.393342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:40.394787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:40.413071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 550/1100] 10.222.0.30 () {56 vars in 1133 bytes} [Sat Jun 18 21:46:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:40.418305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:40.525673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506df130-aedc-4498-afcf-971e6e7af79d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:40.561056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:40.561726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:40.562006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:40.562278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:40.587284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:40.631850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:40.633389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:40.730770 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 551/1101] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:40.736709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:40.839730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8185cfb-b063-4377-8141-5054ad11faf1 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:40.875252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:40.876040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:40.876316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:40.876556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:40.886880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:40.888341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:46:40.905947 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:40.906900 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:40.907830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:46:40.907830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:46:40.907830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:46:40.907830 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:40.907830 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 551/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:40.913000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:40.970585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:41.015600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980444-8c72-42f9-bcd0-ea86cebead00 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:41.053532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:41.054207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:41.054488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:41.054765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:41.055496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:41.055806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:41.057224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:41.068481 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 552/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:41.074158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:41.085359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:41.173251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957479-74db-4c0f-9392-c2a86d31639f None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:41.208039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:41.208815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:41.209119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:41.209392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:41.216160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:41.217663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:46:41.231219 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:46:41.232140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:46:41.233192 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 552/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:46:41.238446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:41.339720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e28b0-c61d-4726-a23a-82e019fc7b59 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:41.353610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:41.375951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadba0b6-95f1-427a-91ac-6246839b352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:41.376609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba0b6-95f1-427a-91ac-6246839b352f None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:41.376884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba0b6-95f1-427a-91ac-6246839b352f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:41.377188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba0b6-95f1-427a-91ac-6246839b352f None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:41.377978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadba0b6-95f1-427a-91ac-6246839b352f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:41.378279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadba0b6-95f1-427a-91ac-6246839b352f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:41.379722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadba0b6-95f1-427a-91ac-6246839b352f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:41.392378 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 553/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:41.398725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:41.471258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:41.504931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9735-ee3a-4197-b1cc-f950649d0d41 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:41.538086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa9c21-238f-4c8f-a339-b29ac7240862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:41.538737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa9c21-238f-4c8f-a339-b29ac7240862 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:41.539020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa9c21-238f-4c8f-a339-b29ac7240862 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:41.539297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa9c21-238f-4c8f-a339-b29ac7240862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:41.540132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa9c21-238f-4c8f-a339-b29ac7240862 None admin] RBAC: Adding query filter params (role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=578ca3087f9442d88152f65fad464f32) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:41.540496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa9c21-238f-4c8f-a339-b29ac7240862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:41.541973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa9c21-238f-4c8f-a339-b29ac7240862 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:41.547903 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 553/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:41 2022] GET /identity/v3/role_assignments?user.id=578ca3087f9442d88152f65fad464f32&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=09b0ad2b5ba643cb81ea8b022b7d6b4b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:42.474872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ac2d4-17e5-44eb-896f-76cefbb1bdd6 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:42.475732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ac2d4-17e5-44eb-896f-76cefbb1bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:42.475732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ac2d4-17e5-44eb-896f-76cefbb1bdd6 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:42.477996 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 554/1107] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:42.484371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289917f9-ef19-4636-80aa-3dc2034842c2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:42.484800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289917f9-ef19-4636-80aa-3dc2034842c2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:42.484938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289917f9-ef19-4636-80aa-3dc2034842c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:42.512175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-289917f9-ef19-4636-80aa-3dc2034842c2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:42.514050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-289917f9-ef19-4636-80aa-3dc2034842c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:42.587668 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 554/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:42.622061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ac2d4-17e5-44eb-896f-76cefbb1bdd6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:42.730338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ac2d4-17e5-44eb-896f-76cefbb1bdd6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:42.767828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcc45-f1e0-4aa6-bd8e-1dd4a0910bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:42.768601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcc45-f1e0-4aa6-bd8e-1dd4a0910bf0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:42.768873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcc45-f1e0-4aa6-bd8e-1dd4a0910bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:42.769172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcc45-f1e0-4aa6-bd8e-1dd4a0910bf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:42.770447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcc45-f1e0-4aa6-bd8e-1dd4a0910bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:42.771880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcc45-f1e0-4aa6-bd8e-1dd4a0910bf0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:42.773539 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 555/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:42.779671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289917f9-ef19-4636-80aa-3dc2034842c2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:42.849289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:42.894116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289917f9-ef19-4636-80aa-3dc2034842c2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:42.929154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424028ac-0037-4052-ae5d-5fe0e2dfb014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:42.929810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424028ac-0037-4052-ae5d-5fe0e2dfb014 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:42.930089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424028ac-0037-4052-ae5d-5fe0e2dfb014 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:42.930356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424028ac-0037-4052-ae5d-5fe0e2dfb014 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:42.931055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424028ac-0037-4052-ae5d-5fe0e2dfb014 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:42.932479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424028ac-0037-4052-ae5d-5fe0e2dfb014 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:42.954384 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 555/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:46:42 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:45.303396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca2980-3c7e-40ae-b874-5a19f6c970ca None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:45.303952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca2980-3c7e-40ae-b874-5a19f6c970ca None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:45.303952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca2980-3c7e-40ae-b874-5a19f6c970ca None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:45.305238 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 556/1111] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:45.312100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348033b-0b85-4c3c-8d57-85148eb72d76 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:45.312765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348033b-0b85-4c3c-8d57-85148eb72d76 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:45.312916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348033b-0b85-4c3c-8d57-85148eb72d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:45.340038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b348033b-0b85-4c3c-8d57-85148eb72d76 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:45.342062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b348033b-0b85-4c3c-8d57-85148eb72d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:45.411534 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 556/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:45.438524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca2980-3c7e-40ae-b874-5a19f6c970ca None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:45.489909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:45.562464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca2980-3c7e-40ae-b874-5a19f6c970ca None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:45.598485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:45.599328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:45.599604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:45.599867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] PATH_INFO: `/v3/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:45.601512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] RBAC: Authorizing `identity:get_role(role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:45.602892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:45.604258 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 557/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:45 2022] GET /identity/v3/roles/77c95569fa354b93b35fc5a694f02453 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:45.611665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348033b-0b85-4c3c-8d57-85148eb72d76 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:45.661920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:45.715482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348033b-0b85-4c3c-8d57-85148eb72d76 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:45.755713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:45.756586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:45.756866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:45.757169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] PATH_INFO: `/v3/users/9406e76dd18e48b1939f92588f6c5644` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:45.771040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] RBAC: Authorizing `identity:get_user(user_id=9406e76dd18e48b1939f92588f6c5644)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:45.772505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:45.774179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 557/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:45 2022] GET /identity/v3/users/9406e76dd18e48b1939f92588f6c5644 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:45.780333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:45.887518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65e436-3d4d-4878-8129-418551fe61b9 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:45.899717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:45.926118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:45.926759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:45.927037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:45.927308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:46.001601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:46.003035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:46.116058 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 558/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:46.122494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:46.228736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9af61-947d-465a-8183-434e81995f15 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:46.235992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:46.266228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f494d7a-d137-4d3d-83bd-d622b5654ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:46.267089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494d7a-d137-4d3d-83bd-d622b5654ec6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:46.267371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494d7a-d137-4d3d-83bd-d622b5654ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:46.267643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494d7a-d137-4d3d-83bd-d622b5654ec6 None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:46.268886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f494d7a-d137-4d3d-83bd-d622b5654ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=ca67487998a54fdeae5fbf3007427f1b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:46.270366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f494d7a-d137-4d3d-83bd-d622b5654ec6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:46.272048 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 558/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:46:46 2022] GET /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:46.278355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:46.291185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:46.395892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd854-7e5c-4ca4-8572-3eca3ac0db44 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:46.433653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb87f-2991-4aef-97b7-e4354afe3065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:46.434301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb87f-2991-4aef-97b7-e4354afe3065 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:46.434583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb87f-2991-4aef-97b7-e4354afe3065 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:46.434873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb87f-2991-4aef-97b7-e4354afe3065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:46.435708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb87f-2991-4aef-97b7-e4354afe3065 None admin] RBAC: Adding query filter params (role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=ca67487998a54fdeae5fbf3007427f1b, user.id=9406e76dd18e48b1939f92588f6c5644) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:46.436020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb87f-2991-4aef-97b7-e4354afe3065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:46.437501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb87f-2991-4aef-97b7-e4354afe3065 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:46.443358 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 559/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:46 2022] GET /identity/v3/role_assignments?user.id=9406e76dd18e48b1939f92588f6c5644&scope.project.id=ca67487998a54fdeae5fbf3007427f1b&role.id=77c95569fa354b93b35fc5a694f02453 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:48.690086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7bd2f-ebd6-4224-91dc-065dc19d8b54 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:48.690962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7bd2f-ebd6-4224-91dc-065dc19d8b54 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:48.690962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7bd2f-ebd6-4224-91dc-065dc19d8b54 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:48.693244 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 559/1118] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:48.699520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d56cb-2f4e-4fae-9012-27282233f908 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:48.700201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d56cb-2f4e-4fae-9012-27282233f908 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:48.700406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d56cb-2f4e-4fae-9012-27282233f908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:48.718874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9e9d56cb-2f4e-4fae-9012-27282233f908 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:48.720069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9e9d56cb-2f4e-4fae-9012-27282233f908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:48.789352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 560/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:48.815833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7bd2f-ebd6-4224-91dc-065dc19d8b54 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:48.929863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7bd2f-ebd6-4224-91dc-065dc19d8b54 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:48.969575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:48.970436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:48.970719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:48.970996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] PATH_INFO: `/v3/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:48.972652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] RBAC: Authorizing `identity:get_role(role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:48.974086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:48.975480 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 560/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:48 2022] GET /identity/v3/roles/77c95569fa354b93b35fc5a694f02453 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:48.981443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d56cb-2f4e-4fae-9012-27282233f908 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:48.984679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:49.086961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d56cb-2f4e-4fae-9012-27282233f908 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:49.122414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:49.123332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:49.123611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:49.123880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] PATH_INFO: `/v3/users/9406e76dd18e48b1939f92588f6c5644` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:49.125240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] RBAC: Authorizing `identity:get_user(user_id=9406e76dd18e48b1939f92588f6c5644)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:49.126687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:49.128309 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 561/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:48 2022] GET /identity/v3/users/9406e76dd18e48b1939f92588f6c5644 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:49.134575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:49.191984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:49.253539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75576e-34b1-4bf5-b95c-bd00416e9e83 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:49.289181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf61ee-489b-4660-8ece-2f171e41d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:49.290034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf61ee-489b-4660-8ece-2f171e41d69a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:49.290312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf61ee-489b-4660-8ece-2f171e41d69a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:49.290582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf61ee-489b-4660-8ece-2f171e41d69a None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:49.291819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf61ee-489b-4660-8ece-2f171e41d69a None admin] RBAC: Authorizing `identity:get_project(project_id=ca67487998a54fdeae5fbf3007427f1b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:49.293297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf61ee-489b-4660-8ece-2f171e41d69a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:49.295062 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 561/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:46:49 2022] GET /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:49.301324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:49.378939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:49.409968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b173789-5021-4f1a-b541-74040bb34469 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:49.445722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8192f-0aba-4ab1-b5bb-0c04dc53f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:49.446601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8192f-0aba-4ab1-b5bb-0c04dc53f1d5 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:49.446877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8192f-0aba-4ab1-b5bb-0c04dc53f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:49.447146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8192f-0aba-4ab1-b5bb-0c04dc53f1d5 None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b/users/9406e76dd18e48b1939f92588f6c5644/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:49.449760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8192f-0aba-4ab1-b5bb-0c04dc53f1d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca67487998a54fdeae5fbf3007427f1b, user_id=9406e76dd18e48b1939f92588f6c5644, role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:49.451576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8192f-0aba-4ab1-b5bb-0c04dc53f1d5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:49.467761 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 562/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:46:49 2022] PUT /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b/users/9406e76dd18e48b1939f92588f6c5644/roles/77c95569fa354b93b35fc5a694f02453 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:46:51.724461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998ae2-1a40-4d71-8f9d-43008d3c7414 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:51.725023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998ae2-1a40-4d71-8f9d-43008d3c7414 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:51.725023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf998ae2-1a40-4d71-8f9d-43008d3c7414 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:51.726425 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 562/1124] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:51.731855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d357d-ff27-47f5-b259-1ad1d2dfcede None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:51.732303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d357d-ff27-47f5-b259-1ad1d2dfcede None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:51.732525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d357d-ff27-47f5-b259-1ad1d2dfcede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:51.749926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-702d357d-ff27-47f5-b259-1ad1d2dfcede None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:51.751085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-702d357d-ff27-47f5-b259-1ad1d2dfcede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:51.820513 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 563/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:51.846296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998ae2-1a40-4d71-8f9d-43008d3c7414 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:51.955008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf998ae2-1a40-4d71-8f9d-43008d3c7414 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:51.965681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:51.992875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:51.993700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:51.993977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:51.994253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] PATH_INFO: `/v3/roles/77c95569fa354b93b35fc5a694f02453` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:51.995838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] RBAC: Authorizing `identity:get_role(role_id=77c95569fa354b93b35fc5a694f02453)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:51.997248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:51.998721 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 563/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:51 2022] GET /identity/v3/roles/77c95569fa354b93b35fc5a694f02453 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:52.007836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d357d-ff27-47f5-b259-1ad1d2dfcede None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:52.084537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:52.126638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d357d-ff27-47f5-b259-1ad1d2dfcede None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:52.161580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:52.162447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:52.162722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:52.162993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] PATH_INFO: `/v3/users/9406e76dd18e48b1939f92588f6c5644` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:52.164211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=9406e76dd18e48b1939f92588f6c5644)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:52.165688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:52.167321 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 564/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:46:52 2022] GET /identity/v3/users/9406e76dd18e48b1939f92588f6c5644 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:52.173673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:52.278105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3056-f144-4e51-b8eb-5e7f6be06fc8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:52.321527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:52.322449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:52.322818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:52.323161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:52.369973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:52.398383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:52.399855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:52.500691 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 564/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:46:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:46:52.507032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:52.616750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79683c26-6b86-41c0-85c8-c6901eb67ef1 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:52.646397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:52.655917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb899e4-7eb5-4b31-8a94-82c116db647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:52.656790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb899e4-7eb5-4b31-8a94-82c116db647a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:52.657074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb899e4-7eb5-4b31-8a94-82c116db647a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:52.657381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb899e4-7eb5-4b31-8a94-82c116db647a None admin] PATH_INFO: `/v3/projects/ca67487998a54fdeae5fbf3007427f1b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:52.658713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb899e4-7eb5-4b31-8a94-82c116db647a None admin] RBAC: Authorizing `identity:get_project(project_id=ca67487998a54fdeae5fbf3007427f1b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:52.660174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb899e4-7eb5-4b31-8a94-82c116db647a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:52.661940 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 565/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:46:52 2022] GET /identity/v3/projects/ca67487998a54fdeae5fbf3007427f1b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:52.668504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:52.749322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:52.772581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cfd93-fa8e-415d-b2bb-64b853797de8 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:52.810122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554267a-bbe9-44f2-87af-04ad8239e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:52.810874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554267a-bbe9-44f2-87af-04ad8239e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:52.811157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554267a-bbe9-44f2-87af-04ad8239e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:52.811431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554267a-bbe9-44f2-87af-04ad8239e1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:52.812278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554267a-bbe9-44f2-87af-04ad8239e1e8 None admin] RBAC: Adding query filter params (role.id=77c95569fa354b93b35fc5a694f02453, scope.project.id=ca67487998a54fdeae5fbf3007427f1b, user.id=9406e76dd18e48b1939f92588f6c5644) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:46:52.812592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554267a-bbe9-44f2-87af-04ad8239e1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:52.814073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554267a-bbe9-44f2-87af-04ad8239e1e8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:52.820112 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 565/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:46:52 2022] GET /identity/v3/role_assignments?user.id=9406e76dd18e48b1939f92588f6c5644&scope.project.id=ca67487998a54fdeae5fbf3007427f1b&role.id=77c95569fa354b93b35fc5a694f02453 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:55.106406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd6a-2611-4bfa-aaf3-aa2956cf23ff None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:55.106935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd6a-2611-4bfa-aaf3-aa2956cf23ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:55.106935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd6a-2611-4bfa-aaf3-aa2956cf23ff None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:55.108390 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 566/1131] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:55.116178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa6622-b005-4aec-a625-cd62ae794607 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:55.116930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa6622-b005-4aec-a625-cd62ae794607 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:55.117870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa6622-b005-4aec-a625-cd62ae794607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:55.139899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f4fa6622-b005-4aec-a625-cd62ae794607 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:55.141135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f4fa6622-b005-4aec-a625-cd62ae794607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:55.233205 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 566/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:55.258392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9fd6a-2611-4bfa-aaf3-aa2956cf23ff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:55.380809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9fd6a-2611-4bfa-aaf3-aa2956cf23ff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:55.418297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca3515-e290-4401-a960-5f98ffcb2172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:55.419085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3515-e290-4401-a960-5f98ffcb2172 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:55.419371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3515-e290-4401-a960-5f98ffcb2172 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:55.419644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3515-e290-4401-a960-5f98ffcb2172 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:55.420934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca3515-e290-4401-a960-5f98ffcb2172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:55.422440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca3515-e290-4401-a960-5f98ffcb2172 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:55.424051 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 567/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:46:55.430112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa6622-b005-4aec-a625-cd62ae794607 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:55.501505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:55.536068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa6622-b005-4aec-a625-cd62ae794607 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:55.572710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395718b7-b3b3-4dd5-a743-b007b52db33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:55.573402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395718b7-b3b3-4dd5-a743-b007b52db33d None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:55.573684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395718b7-b3b3-4dd5-a743-b007b52db33d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:55.573958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395718b7-b3b3-4dd5-a743-b007b52db33d None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:55.574695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395718b7-b3b3-4dd5-a743-b007b52db33d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:55.576554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395718b7-b3b3-4dd5-a743-b007b52db33d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:55.606778 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 567/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:46:55 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:46:57.931951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edf2f1-5153-4ce8-87b4-d39b676c0876 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:57.932821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edf2f1-5153-4ce8-87b4-d39b676c0876 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:57.932821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edf2f1-5153-4ce8-87b4-d39b676c0876 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:57.935027 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 568/1135] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:46:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:46:57.942315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f973bec-2cdf-4e5b-906a-ab9d723c8a28 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:57.942315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f973bec-2cdf-4e5b-906a-ab9d723c8a28 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:57.943004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f973bec-2cdf-4e5b-906a-ab9d723c8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:57.969318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1f973bec-2cdf-4e5b-906a-ab9d723c8a28 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:46:57.970498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1f973bec-2cdf-4e5b-906a-ab9d723c8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:46:58.038952 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 568/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:46:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:46:58.065495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edf2f1-5153-4ce8-87b4-d39b676c0876 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:58.139647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:58.177530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edf2f1-5153-4ce8-87b4-d39b676c0876 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:58.214104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c231050-eee2-457d-8ef2-ae52c3911cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:58.214887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231050-eee2-457d-8ef2-ae52c3911cb3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:58.215162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231050-eee2-457d-8ef2-ae52c3911cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:58.215432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231050-eee2-457d-8ef2-ae52c3911cb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:58.216621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c231050-eee2-457d-8ef2-ae52c3911cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:58.218192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c231050-eee2-457d-8ef2-ae52c3911cb3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:58.219806 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 569/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:46:58.228639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f973bec-2cdf-4e5b-906a-ab9d723c8a28 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:46:58.284337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:46:58.332521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f973bec-2cdf-4e5b-906a-ab9d723c8a28 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:46:58.369142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a583f-ac4d-4227-9b5e-94f811b2a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:46:58.369802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a583f-ac4d-4227-9b5e-94f811b2a7f4 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:46:58.370081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a583f-ac4d-4227-9b5e-94f811b2a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:46:58.370354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a583f-ac4d-4227-9b5e-94f811b2a7f4 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:46:58.371071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a583f-ac4d-4227-9b5e-94f811b2a7f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:46:58.372515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a583f-ac4d-4227-9b5e-94f811b2a7f4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:46:58.395406 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 569/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:46:58 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:47:00.746604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b2bb-dcf9-45b6-90c6-75adca26c485 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:00.747189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b2bb-dcf9-45b6-90c6-75adca26c485 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:00.747189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b2bb-dcf9-45b6-90c6-75adca26c485 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:00.748515 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 570/1139] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:00.754695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3988e7-789a-4b71-a3b7-498d8b23c2d4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:00.755394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3988e7-789a-4b71-a3b7-498d8b23c2d4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:00.755497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3988e7-789a-4b71-a3b7-498d8b23c2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:00.776690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3d3988e7-789a-4b71-a3b7-498d8b23c2d4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:00.777905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d3988e7-789a-4b71-a3b7-498d8b23c2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:00.846680 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 570/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:00.872175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b2bb-dcf9-45b6-90c6-75adca26c485 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:00.986031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b2bb-dcf9-45b6-90c6-75adca26c485 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:01.025762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:01.026485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:01.026762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:01.027032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:01.029567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:01.039420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:47:01.046964 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:47:01.048098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:47:01.049156 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 571/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:47:01.054519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3988e7-789a-4b71-a3b7-498d8b23c2d4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:01.096744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:01.160620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3988e7-789a-4b71-a3b7-498d8b23c2d4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:01.197683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:01.198337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:01.198574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:01.198871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:01.199615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:01.199918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:01.201633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:01.210869 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 571/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:01.219992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:01.330238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab412-b13b-41ab-9083-0da0aced92e5 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:01.366108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:01.366959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:01.367233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:01.367506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] PATH_INFO: `/v3/users/32d95b7ac71e4d66bbc14a3bd6b0d74d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:01.381090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] RBAC: Authorizing `identity:get_user(user_id=32d95b7ac71e4d66bbc14a3bd6b0d74d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:01.382544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:01.384160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 572/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:47:01 2022] GET /identity/v3/users/32d95b7ac71e4d66bbc14a3bd6b0d74d => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:01.390376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:01.496691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe46bf-7969-432e-9c7d-2175e8341e9d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:01.498292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:01.532073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:01.532704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:01.532987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:01.533299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:01.602037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:01.603507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:01.726383 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 572/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:47:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:47:01.732485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:01.788053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:01.836425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698681e-587c-4be3-8756-05fc6766cac2 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:01.871733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dc098-533d-4776-a013-f6aa20347cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:01.872521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc098-533d-4776-a013-f6aa20347cf2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:01.872794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc098-533d-4776-a013-f6aa20347cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:01.873078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dc098-533d-4776-a013-f6aa20347cf2 None admin] PATH_INFO: `/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:01.874463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dc098-533d-4776-a013-f6aa20347cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=9ab37b28b7f344ed8d69bf1812d0e98c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:01.875901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dc098-533d-4776-a013-f6aa20347cf2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:01.877632 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 573/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:47:01 2022] GET /identity/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:01.887103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:01.890113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:02.002842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069d06-c5cf-44ac-bba7-eaf615cb0d08 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:02.038000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe436ad4-1a3e-4615-ac59-aad6cd6a34cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:02.038653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe436ad4-1a3e-4615-ac59-aad6cd6a34cd None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:02.038930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe436ad4-1a3e-4615-ac59-aad6cd6a34cd None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:02.039195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe436ad4-1a3e-4615-ac59-aad6cd6a34cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:02.040019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe436ad4-1a3e-4615-ac59-aad6cd6a34cd None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=9ab37b28b7f344ed8d69bf1812d0e98c, user.id=32d95b7ac71e4d66bbc14a3bd6b0d74d) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:02.040321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe436ad4-1a3e-4615-ac59-aad6cd6a34cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:02.041788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe436ad4-1a3e-4615-ac59-aad6cd6a34cd None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:02.047985 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 573/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:47:01 2022] GET /identity/v3/role_assignments?user.id=32d95b7ac71e4d66bbc14a3bd6b0d74d&scope.project.id=9ab37b28b7f344ed8d69bf1812d0e98c&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:04.275647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41c4a-f557-4bb5-99db-e2c8b8f301cb None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:04.276197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41c4a-f557-4bb5-99db-e2c8b8f301cb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:04.276197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab41c4a-f557-4bb5-99db-e2c8b8f301cb None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:04.277587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 574/1147] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:04.283909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fed4a-6547-4563-aefb-b7bcb0707f02 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:04.284682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fed4a-6547-4563-aefb-b7bcb0707f02 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:04.284857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fed4a-6547-4563-aefb-b7bcb0707f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:04.308167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-713fed4a-6547-4563-aefb-b7bcb0707f02 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:04.309413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-713fed4a-6547-4563-aefb-b7bcb0707f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:04.369520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:04.378108 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 574/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:04.402636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab41c4a-f557-4bb5-99db-e2c8b8f301cb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:04.514588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab41c4a-f557-4bb5-99db-e2c8b8f301cb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:04.534931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:04.551176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:04.551976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:04.552252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:04.552507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:04.564211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:47:04.571769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:47:04.572838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:47:04.574453 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 575/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:47:04.581208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fed4a-6547-4563-aefb-b7bcb0707f02 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:04.683592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fed4a-6547-4563-aefb-b7bcb0707f02 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:04.719136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:04.719789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:04.720063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:04.720332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:04.721137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:04.721405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:04.722797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:04.731181 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 575/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:04.737571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:04.842327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc66041-a876-47a9-a2ed-84b53aadf0b3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:04.876680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:04.877588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:04.877875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:04.878131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] PATH_INFO: `/v3/users/32d95b7ac71e4d66bbc14a3bd6b0d74d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:04.879412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] RBAC: Authorizing `identity:get_user(user_id=32d95b7ac71e4d66bbc14a3bd6b0d74d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:04.880856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:04.882511 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 576/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:47:04 2022] GET /identity/v3/users/32d95b7ac71e4d66bbc14a3bd6b0d74d => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:04.889087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:04.959096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:05.001827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44584-9cf5-4e40-8ea3-8936ef0c91da None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:05.042868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07353687-88a3-4f07-adbb-fb9381674ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:05.044204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07353687-88a3-4f07-adbb-fb9381674ac8 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:05.044616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07353687-88a3-4f07-adbb-fb9381674ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:05.045017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07353687-88a3-4f07-adbb-fb9381674ac8 None admin] PATH_INFO: `/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:05.046608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07353687-88a3-4f07-adbb-fb9381674ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=9ab37b28b7f344ed8d69bf1812d0e98c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:05.048059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07353687-88a3-4f07-adbb-fb9381674ac8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:05.049822 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 576/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:47:04 2022] GET /identity/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:05.056163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:05.108194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:05.163975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36de3bb-9d69-49e7-845f-8d1f84658d3b None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:05.200149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1dc9d-efae-43ca-a8ec-6b62e4184273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:05.201052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1dc9d-efae-43ca-a8ec-6b62e4184273 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:05.201342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1dc9d-efae-43ca-a8ec-6b62e4184273 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:05.201980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1dc9d-efae-43ca-a8ec-6b62e4184273 None admin] PATH_INFO: `/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c/users/32d95b7ac71e4d66bbc14a3bd6b0d74d/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:05.203978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1dc9d-efae-43ca-a8ec-6b62e4184273 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ab37b28b7f344ed8d69bf1812d0e98c, user_id=32d95b7ac71e4d66bbc14a3bd6b0d74d, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:05.205472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1dc9d-efae-43ca-a8ec-6b62e4184273 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:05.220951 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 577/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:47:05 2022] PUT /identity/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c/users/32d95b7ac71e4d66bbc14a3bd6b0d74d/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:47:07.481837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f5f9-f0f6-436d-84b4-cd7c8a19b426 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:07.482441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f5f9-f0f6-436d-84b4-cd7c8a19b426 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:07.482441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6f5f9-f0f6-436d-84b4-cd7c8a19b426 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:07.483896 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 577/1154] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:07.490268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03e663-6b3d-4bfc-b4a3-ff804ee38285 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:07.491038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03e663-6b3d-4bfc-b4a3-ff804ee38285 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:07.491209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03e663-6b3d-4bfc-b4a3-ff804ee38285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:07.517145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ce03e663-6b3d-4bfc-b4a3-ff804ee38285 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:07.518337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce03e663-6b3d-4bfc-b4a3-ff804ee38285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:07.587905 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 578/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:07.621072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f5f9-f0f6-436d-84b4-cd7c8a19b426 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:07.726985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6f5f9-f0f6-436d-84b4-cd7c8a19b426 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:07.753350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:07.765425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:07.766626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:07.767007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:07.767370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:07.784103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:47:07.792683 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:47:07.793868 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:47:07.794902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 578/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:47:07.801382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03e663-6b3d-4bfc-b4a3-ff804ee38285 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:07.846629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:07.911704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03e663-6b3d-4bfc-b4a3-ff804ee38285 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:07.948277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:07.948928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:07.949229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:07.949496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:07.950239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:07.950540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:07.952244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:07.961114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 579/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:07.969710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:08.073275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d913-7010-4e71-93f0-39f63ca330e4 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:08.113241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:08.114103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:08.114365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:08.114660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] PATH_INFO: `/v3/users/32d95b7ac71e4d66bbc14a3bd6b0d74d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:08.115849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] RBAC: Authorizing `identity:get_user(user_id=32d95b7ac71e4d66bbc14a3bd6b0d74d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:08.117310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:08.121069 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 579/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:47:07 2022] GET /identity/v3/users/32d95b7ac71e4d66bbc14a3bd6b0d74d => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:47:08.124855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:08.225501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:08.228406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7869e-8926-4eeb-aaae-7e1efc9dda1a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:08.261048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:08.261706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:08.261982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:08.262249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:08.328156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:08.329575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:08.419715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:08.423807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 580/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:47:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:47:08.430179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:08.489357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:08.536033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7b3c1-9dd6-4324-8753-2f581359ea87 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:08.571253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb6bf6-be6b-45da-b322-3e9755844103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:08.572088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6bf6-be6b-45da-b322-3e9755844103 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:08.572365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6bf6-be6b-45da-b322-3e9755844103 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:08.572636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6bf6-be6b-45da-b322-3e9755844103 None admin] PATH_INFO: `/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:08.573949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb6bf6-be6b-45da-b322-3e9755844103 None admin] RBAC: Authorizing `identity:get_project(project_id=9ab37b28b7f344ed8d69bf1812d0e98c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:08.575388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb6bf6-be6b-45da-b322-3e9755844103 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:08.577440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 580/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:47:08 2022] GET /identity/v3/projects/9ab37b28b7f344ed8d69bf1812d0e98c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:08.583823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:08.688446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0d05-0a39-4e43-9506-1772489034d7 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:08.723648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e377f44-0834-4e58-91bf-ed50cb46ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:08.724299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e377f44-0834-4e58-91bf-ed50cb46ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:08.724580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e377f44-0834-4e58-91bf-ed50cb46ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:08.724857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e377f44-0834-4e58-91bf-ed50cb46ffb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:08.725732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e377f44-0834-4e58-91bf-ed50cb46ffb8 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=9ab37b28b7f344ed8d69bf1812d0e98c, user.id=32d95b7ac71e4d66bbc14a3bd6b0d74d) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:08.726043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e377f44-0834-4e58-91bf-ed50cb46ffb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:08.727505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e377f44-0834-4e58-91bf-ed50cb46ffb8 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:08.733662 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 581/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:47:08 2022] GET /identity/v3/role_assignments?user.id=32d95b7ac71e4d66bbc14a3bd6b0d74d&scope.project.id=9ab37b28b7f344ed8d69bf1812d0e98c&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:11.070170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c697941-a022-4f46-bc83-ac889c74b53f None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:11.070673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c697941-a022-4f46-bc83-ac889c74b53f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:11.070673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c697941-a022-4f46-bc83-ac889c74b53f None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:11.072100 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 581/1162] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:11.077870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad3a94-c20a-4d43-b019-663005b8ff8c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:11.078302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad3a94-c20a-4d43-b019-663005b8ff8c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:11.078393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad3a94-c20a-4d43-b019-663005b8ff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:11.099735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d0ad3a94-c20a-4d43-b019-663005b8ff8c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:11.101438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d0ad3a94-c20a-4d43-b019-663005b8ff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:11.166445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:11.175561 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 582/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:11.210635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c697941-a022-4f46-bc83-ac889c74b53f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:11.323564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c697941-a022-4f46-bc83-ac889c74b53f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:11.346733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:11.362133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:11.362784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:11.363074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:11.363356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:11.432312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:11.433793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:11.534347 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 582/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:47:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:47:11.541224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad3a94-c20a-4d43-b019-663005b8ff8c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:11.651373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad3a94-c20a-4d43-b019-663005b8ff8c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:11.687404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4052ace-8ebd-4897-9e9b-981a14d5858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:11.688215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052ace-8ebd-4897-9e9b-981a14d5858b None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:11.688488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052ace-8ebd-4897-9e9b-981a14d5858b None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:11.688760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4052ace-8ebd-4897-9e9b-981a14d5858b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:11.696143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4052ace-8ebd-4897-9e9b-981a14d5858b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:11.697639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4052ace-8ebd-4897-9e9b-981a14d5858b None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-d4052ace-8ebd-4897-9e9b-981a14d5858b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:47:11.712959 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:47:11.717176 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:47:11.718301 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 583/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:47:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:47:11.721914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:11.751525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:11.841919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01706657-a62d-4b54-bcd9-2830858e47e6 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:11.881062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0082b6-04df-48cd-9798-094d0b51dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:11.881736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0082b6-04df-48cd-9798-094d0b51dd68 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:11.882016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0082b6-04df-48cd-9798-094d0b51dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:11.882286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0082b6-04df-48cd-9798-094d0b51dd68 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:11.883006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0082b6-04df-48cd-9798-094d0b51dd68 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:11.883304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0082b6-04df-48cd-9798-094d0b51dd68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:11.884677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0082b6-04df-48cd-9798-094d0b51dd68 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:11.891977 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 583/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Sat Jun 18 21:47:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:14.164697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97482e-df34-4331-a307-a9f64fddc0c7 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:14.165611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97482e-df34-4331-a307-a9f64fddc0c7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:14.165611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97482e-df34-4331-a307-a9f64fddc0c7 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:14.167790 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 584/1167] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:14.176595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3743f3b-11ac-46b7-9ae6-4a12682dea68 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:14.177049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3743f3b-11ac-46b7-9ae6-4a12682dea68 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:14.177264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3743f3b-11ac-46b7-9ae6-4a12682dea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:14.203635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f3743f3b-11ac-46b7-9ae6-4a12682dea68 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:14.204815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f3743f3b-11ac-46b7-9ae6-4a12682dea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:14.287079 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 584/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:14.314901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97482e-df34-4331-a307-a9f64fddc0c7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:14.378872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:14.426725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97482e-df34-4331-a307-a9f64fddc0c7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:14.461522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bc288-6309-4d4e-ae62-723b37c248c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:14.462161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc288-6309-4d4e-ae62-723b37c248c0 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:14.462435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc288-6309-4d4e-ae62-723b37c248c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:14.462709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc288-6309-4d4e-ae62-723b37c248c0 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:14.463446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc288-6309-4d4e-ae62-723b37c248c0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:14.464807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bc288-6309-4d4e-ae62-723b37c248c0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:14.483622 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 585/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Sat Jun 18 21:47:14 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:47:16.793220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a7c9-6b5a-4329-badf-6bf42cb3406d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:16.793776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a7c9-6b5a-4329-badf-6bf42cb3406d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:16.793776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a7c9-6b5a-4329-badf-6bf42cb3406d None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:16.795147 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 585/1170] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:16.801577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64376836-587a-4795-a65e-97080836ca4e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:16.802005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64376836-587a-4795-a65e-97080836ca4e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:16.802146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64376836-587a-4795-a65e-97080836ca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:16.824503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-64376836-587a-4795-a65e-97080836ca4e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:16.825720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64376836-587a-4795-a65e-97080836ca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:16.899289 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 586/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:16.928135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a7c9-6b5a-4329-badf-6bf42cb3406d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:16.950044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:17.049070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a7c9-6b5a-4329-badf-6bf42cb3406d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:17.089494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485d1e-d947-49c1-b37e-f840f42270e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:17.090342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485d1e-d947-49c1-b37e-f840f42270e3 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:17.090615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485d1e-d947-49c1-b37e-f840f42270e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:17.090884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485d1e-d947-49c1-b37e-f840f42270e3 None admin] PATH_INFO: `/v3/domains/846c1a94873249df961b681f2addb190` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:17.101812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e485d1e-d947-49c1-b37e-f840f42270e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=846c1a94873249df961b681f2addb190)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:17.103292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e485d1e-d947-49c1-b37e-f840f42270e3 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:17.104912 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 586/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Sat Jun 18 21:47:16 2022] GET /identity/v3/domains/846c1a94873249df961b681f2addb190 => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:17.111611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64376836-587a-4795-a65e-97080836ca4e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:17.169794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:17.230839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64376836-587a-4795-a65e-97080836ca4e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:17.266599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68556aab-2a47-4782-9ac9-9bd729acb0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:17.267268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68556aab-2a47-4782-9ac9-9bd729acb0b5 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:17.267540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68556aab-2a47-4782-9ac9-9bd729acb0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:17.267810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68556aab-2a47-4782-9ac9-9bd729acb0b5 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:17.268512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68556aab-2a47-4782-9ac9-9bd729acb0b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:17.269965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68556aab-2a47-4782-9ac9-9bd729acb0b5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:17.300952 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 587/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:47:17 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:47:19.598701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c51a7b-60b8-4440-9ca6-30e6c3703407 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:19.599587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c51a7b-60b8-4440-9ca6-30e6c3703407 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:19.599587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c51a7b-60b8-4440-9ca6-30e6c3703407 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:19.601743 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 587/1174] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:19.609814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2379443-3f69-49e9-86b8-e9ddfb34b750 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:19.610275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2379443-3f69-49e9-86b8-e9ddfb34b750 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:19.610362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2379443-3f69-49e9-86b8-e9ddfb34b750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:19.629482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a2379443-3f69-49e9-86b8-e9ddfb34b750 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:19.630640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a2379443-3f69-49e9-86b8-e9ddfb34b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:19.698478 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 588/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:47:19.732765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c51a7b-60b8-4440-9ca6-30e6c3703407 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:19.823990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:19.855884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c51a7b-60b8-4440-9ca6-30e6c3703407 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:19.890625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187e5a5-a925-4b3f-8613-f8df3531df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:19.891483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187e5a5-a925-4b3f-8613-f8df3531df78 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:19.891760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187e5a5-a925-4b3f-8613-f8df3531df78 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:19.892029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187e5a5-a925-4b3f-8613-f8df3531df78 None admin] PATH_INFO: `/v3/domains/846c1a94873249df961b681f2addb190` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:19.893357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187e5a5-a925-4b3f-8613-f8df3531df78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=846c1a94873249df961b681f2addb190)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:19.894806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187e5a5-a925-4b3f-8613-f8df3531df78 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:19.896423 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 588/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Sat Jun 18 21:47:19 2022] GET /identity/v3/domains/846c1a94873249df961b681f2addb190 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:19.902778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2379443-3f69-49e9-86b8-e9ddfb34b750 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:19.932049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:20.025820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2379443-3f69-49e9-86b8-e9ddfb34b750 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:20.065081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f7ac-76ed-4d71-9844-0e9b02a2f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:20.065766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f7ac-76ed-4d71-9844-0e9b02a2f45f None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:20.066043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f7ac-76ed-4d71-9844-0e9b02a2f45f None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:20.066315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f7ac-76ed-4d71-9844-0e9b02a2f45f None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:20.067024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f7ac-76ed-4d71-9844-0e9b02a2f45f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:20.068495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f7ac-76ed-4d71-9844-0e9b02a2f45f None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:20.093209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 589/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:47:19 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:47:22.417139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e95af9-dec0-4733-991f-5422ac0c78c3 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:22.417717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e95af9-dec0-4733-991f-5422ac0c78c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:22.417717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e95af9-dec0-4733-991f-5422ac0c78c3 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:22.418975 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 589/1178] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:22.425614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f3f6-a6e5-4e24-8392-aa2fd76cf945 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:22.426349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f3f6-a6e5-4e24-8392-aa2fd76cf945 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:22.426501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2f3f6-a6e5-4e24-8392-aa2fd76cf945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:22.454119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6ca2f3f6-a6e5-4e24-8392-aa2fd76cf945 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:22.455293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6ca2f3f6-a6e5-4e24-8392-aa2fd76cf945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:22.525524 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 590/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:22.558554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e95af9-dec0-4733-991f-5422ac0c78c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:22.664900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e95af9-dec0-4733-991f-5422ac0c78c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:22.699860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:22.700575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:22.700855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:22.701156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:22.713344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:47:22.720993 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:47:22.722134 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:47:22.723270 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 590/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:47:22.728716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2f3f6-a6e5-4e24-8392-aa2fd76cf945 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:22.748946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:22.836919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2f3f6-a6e5-4e24-8392-aa2fd76cf945 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:22.888756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:22.889455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:22.889735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:22.890008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:22.890764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:22.891100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:22.892470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:22.901262 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 591/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:47:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:22.909430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:22.916136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:23.038578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5718-d7d8-4f87-905d-824768042c4d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:23.077847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:23.078723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:23.078999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:23.079275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] PATH_INFO: `/v3/users/5f2d672458a84b0a87289591cbf3ba50` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:23.092946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] RBAC: Authorizing `identity:get_user(user_id=5f2d672458a84b0a87289591cbf3ba50)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:23.095502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:23.097555 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 591/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:47:22 2022] GET /identity/v3/users/5f2d672458a84b0a87289591cbf3ba50 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:23.106402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:23.191653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:23.227100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294eeb-de84-4984-b295-643a0efa1417 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:23.273677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:23.274322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:23.274600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:23.274870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:23.359715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:23.361361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:23.439469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:23.475435 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 592/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:47:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:47:23.482737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:23.548630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:23.596314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3616-c478-425a-ae97-d97edaf5ef99 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:23.634031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23003d31-3a6f-4fe5-9837-66e574a3cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:23.634821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23003d31-3a6f-4fe5-9837-66e574a3cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:23.635100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23003d31-3a6f-4fe5-9837-66e574a3cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:23.635371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23003d31-3a6f-4fe5-9837-66e574a3cdf4 None admin] PATH_INFO: `/v3/projects/6b82227883c243f7b69225783b63cf88` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:23.637368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23003d31-3a6f-4fe5-9837-66e574a3cdf4 None admin] RBAC: Authorizing `identity:get_project(project_id=6b82227883c243f7b69225783b63cf88)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:23.639637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23003d31-3a6f-4fe5-9837-66e574a3cdf4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:23.643772 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 592/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:47:23 2022] GET /identity/v3/projects/6b82227883c243f7b69225783b63cf88 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:23.648879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:23.758246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f428-fd8e-4000-b045-55e9c005af9e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:23.794937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a54a6-4ee3-4ca7-98fd-3eadb9dacc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:23.795625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a54a6-4ee3-4ca7-98fd-3eadb9dacc70 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:23.795945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a54a6-4ee3-4ca7-98fd-3eadb9dacc70 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:23.796218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a54a6-4ee3-4ca7-98fd-3eadb9dacc70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:23.797170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a54a6-4ee3-4ca7-98fd-3eadb9dacc70 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=6b82227883c243f7b69225783b63cf88, user.id=5f2d672458a84b0a87289591cbf3ba50) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:23.797495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a54a6-4ee3-4ca7-98fd-3eadb9dacc70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:23.798955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a54a6-4ee3-4ca7-98fd-3eadb9dacc70 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:23.804588 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 593/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:47:23 2022] GET /identity/v3/role_assignments?user.id=5f2d672458a84b0a87289591cbf3ba50&scope.project.id=6b82227883c243f7b69225783b63cf88&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:26.069617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9f5c-a358-4950-8b87-577dd0dd0a78 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:26.070157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9f5c-a358-4950-8b87-577dd0dd0a78 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:26.070157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c9f5c-a358-4950-8b87-577dd0dd0a78 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:26.071532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 593/1186] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:26.077160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c2349-9210-44bd-9e4d-9bbbc3f7c6d4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:26.077983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c2349-9210-44bd-9e4d-9bbbc3f7c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:26.078082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c2349-9210-44bd-9e4d-9bbbc3f7c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:26.095874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b45c2349-9210-44bd-9e4d-9bbbc3f7c6d4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:26.097202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b45c2349-9210-44bd-9e4d-9bbbc3f7c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:26.128632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:26.167809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 594/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:26.192320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9f5c-a358-4950-8b87-577dd0dd0a78 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:26.306964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c9f5c-a358-4950-8b87-577dd0dd0a78 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:26.347473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:26.357658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:26.358863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:26.359144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:26.359409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:26.370332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:47:26.377822 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:47:26.378896 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:47:26.380211 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 594/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:47:26.388815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c2349-9210-44bd-9e4d-9bbbc3f7c6d4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:26.500715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c2349-9210-44bd-9e4d-9bbbc3f7c6d4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:26.535826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:26.536490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:26.536770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:26.537072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:26.537818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:26.538124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:26.539500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:26.547702 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 595/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:26.553832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:26.664416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076d0de-19a7-43a1-b59e-265f9fe41bec None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:26.699168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:26.700024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:26.700301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:26.700574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] PATH_INFO: `/v3/users/5f2d672458a84b0a87289591cbf3ba50` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:26.701867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] RBAC: Authorizing `identity:get_user(user_id=5f2d672458a84b0a87289591cbf3ba50)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:26.703643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:26.705284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 595/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:47:26 2022] GET /identity/v3/users/5f2d672458a84b0a87289591cbf3ba50 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:26.711283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:26.744271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:26.815150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45470e8c-6592-4c1d-b1a7-6032a5caf6cc None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:26.850300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fc9a-acf0-4fee-9a8b-40569ccd77e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:26.851165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fc9a-acf0-4fee-9a8b-40569ccd77e3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:26.851444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fc9a-acf0-4fee-9a8b-40569ccd77e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:26.851714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fc9a-acf0-4fee-9a8b-40569ccd77e3 None admin] PATH_INFO: `/v3/projects/6b82227883c243f7b69225783b63cf88` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:26.853053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25fc9a-acf0-4fee-9a8b-40569ccd77e3 None admin] RBAC: Authorizing `identity:get_project(project_id=6b82227883c243f7b69225783b63cf88)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:26.854504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25fc9a-acf0-4fee-9a8b-40569ccd77e3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:26.856206 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 596/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:47:26 2022] GET /identity/v3/projects/6b82227883c243f7b69225783b63cf88 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:26.862527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:26.926019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:26.980106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3039a-9a1e-4728-a17a-23ca28350d99 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:27.014993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407626f-cf62-42ac-bdbc-8d6094b16d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:27.015870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407626f-cf62-42ac-bdbc-8d6094b16d7a None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:27.016149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407626f-cf62-42ac-bdbc-8d6094b16d7a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:27.016423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407626f-cf62-42ac-bdbc-8d6094b16d7a None admin] PATH_INFO: `/v3/projects/6b82227883c243f7b69225783b63cf88/users/5f2d672458a84b0a87289591cbf3ba50/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:27.018652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407626f-cf62-42ac-bdbc-8d6094b16d7a None admin] RBAC: Authorizing `identity:create_grant(project_id=6b82227883c243f7b69225783b63cf88, user_id=5f2d672458a84b0a87289591cbf3ba50, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:27.020093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407626f-cf62-42ac-bdbc-8d6094b16d7a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:27.035078 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 596/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:47:26 2022] PUT /identity/v3/projects/6b82227883c243f7b69225783b63cf88/users/5f2d672458a84b0a87289591cbf3ba50/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:47:29.302258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb463c2-b47a-448b-8653-d5b723ca574f None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:29.302799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb463c2-b47a-448b-8653-d5b723ca574f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:29.302799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb463c2-b47a-448b-8653-d5b723ca574f None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:29.304093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 597/1193] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:47:29.310481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849c9a0-8d10-4a1f-b182-b7a16fe32f47 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:29.311181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849c9a0-8d10-4a1f-b182-b7a16fe32f47 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:29.311547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849c9a0-8d10-4a1f-b182-b7a16fe32f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:29.336395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b849c9a0-8d10-4a1f-b182-b7a16fe32f47 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:47:29.337643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b849c9a0-8d10-4a1f-b182-b7a16fe32f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:47:29.414469 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 597/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:47:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:47:29.439710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb463c2-b47a-448b-8653-d5b723ca574f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:29.555167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:29.560492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb463c2-b47a-448b-8653-d5b723ca574f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:29.596068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:29.596850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:29.597163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:29.597431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:29.608548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:47:29.616035 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:47:29.617208 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:47:29.618258 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 598/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:47:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:47:29.624213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849c9a0-8d10-4a1f-b182-b7a16fe32f47 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:29.672086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:29.729910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849c9a0-8d10-4a1f-b182-b7a16fe32f47 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:29.765728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:29.766391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:29.766671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:29.766970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:29.767720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:29.768021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:29.769426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:29.777617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 598/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:47:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:29.783593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:29.893368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16cb5b-163c-47bb-afcc-2ef3b4ffdab3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:29.928502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:29.929402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:29.929684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:29.929963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] PATH_INFO: `/v3/users/5f2d672458a84b0a87289591cbf3ba50` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:29.931272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] RBAC: Authorizing `identity:get_user(user_id=5f2d672458a84b0a87289591cbf3ba50)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:29.932722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:29.934370 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 599/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Sat Jun 18 21:47:29 2022] GET /identity/v3/users/5f2d672458a84b0a87289591cbf3ba50 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:29.940995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:30.050728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143309-1034-467d-9ba6-0ce56ea45c49 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:30.060949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:30.086864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:30.087496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:30.087774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:30.088041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:30.156223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:30.157640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:30.261653 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 599/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:47:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:47:30.268542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:30.301414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:30.387063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f44315-6ea0-459d-a838-85f3c1e2d65e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:30.424798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024b87b-f15c-481f-86ff-9539efc33a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:30.425626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024b87b-f15c-481f-86ff-9539efc33a80 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:30.425901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024b87b-f15c-481f-86ff-9539efc33a80 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:30.426165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024b87b-f15c-481f-86ff-9539efc33a80 None admin] PATH_INFO: `/v3/projects/6b82227883c243f7b69225783b63cf88` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:30.427449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024b87b-f15c-481f-86ff-9539efc33a80 None admin] RBAC: Authorizing `identity:get_project(project_id=6b82227883c243f7b69225783b63cf88)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:30.428893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024b87b-f15c-481f-86ff-9539efc33a80 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:30.430639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 600/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Sat Jun 18 21:47:30 2022] GET /identity/v3/projects/6b82227883c243f7b69225783b63cf88 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:30.437431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:47:30.449354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:30.552745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214d14-a90f-4cd8-b09d-ddd3690e54cb None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:47:30.587999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d9fc9-ebeb-4385-b5d1-a40fa6271fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:47:30.588645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d9fc9-ebeb-4385-b5d1-a40fa6271fe0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:47:30.588926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d9fc9-ebeb-4385-b5d1-a40fa6271fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:47:30.589229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d9fc9-ebeb-4385-b5d1-a40fa6271fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:47:30.590060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d9fc9-ebeb-4385-b5d1-a40fa6271fe0 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=6b82227883c243f7b69225783b63cf88, user.id=5f2d672458a84b0a87289591cbf3ba50) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:47:30.590366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d9fc9-ebeb-4385-b5d1-a40fa6271fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:47:30.591824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d9fc9-ebeb-4385-b5d1-a40fa6271fe0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:47:30.597690 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 600/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:47:30 2022] GET /identity/v3/role_assignments?user.id=5f2d672458a84b0a87289591cbf3ba50&scope.project.id=6b82227883c243f7b69225783b63cf88&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:47:40.419909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=53 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:47:40.595083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=63 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:32.716813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce776e73-9b50-4f1d-8f6a-831437efcbd3 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:32.717456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce776e73-9b50-4f1d-8f6a-831437efcbd3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:32.717456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce776e73-9b50-4f1d-8f6a-831437efcbd3 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:32.718894 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 601/1201] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:48:32.724372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f78ecd-216c-47a0-b779-e51de49b5780 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:32.724894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f78ecd-216c-47a0-b779-e51de49b5780 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:32.724894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f78ecd-216c-47a0-b779-e51de49b5780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:32.742628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b2f78ecd-216c-47a0-b779-e51de49b5780 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:48:32.743861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2f78ecd-216c-47a0-b779-e51de49b5780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:48:32.845583 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 601/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:48:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:48:32.873800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce776e73-9b50-4f1d-8f6a-831437efcbd3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:33.002400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce776e73-9b50-4f1d-8f6a-831437efcbd3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:33.046251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:33.047106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:33.047392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:33.047664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:33.059263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:33.060750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:33.080053 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:33.081582 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:33.089835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:33.089835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:33.089835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:33.089835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:33.089835 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 602/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:33.091872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f78ecd-216c-47a0-b779-e51de49b5780 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:33.224303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f78ecd-216c-47a0-b779-e51de49b5780 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:33.263145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:33.270101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a6f4c-d233-48c5-9ad8-20d64690f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:33.270777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6f4c-d233-48c5-9ad8-20d64690f89f None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:33.271083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6f4c-d233-48c5-9ad8-20d64690f89f None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:33.271355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a6f4c-d233-48c5-9ad8-20d64690f89f None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:33.272121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a6f4c-d233-48c5-9ad8-20d64690f89f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:33.272427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a6f4c-d233-48c5-9ad8-20d64690f89f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:33.273839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a6f4c-d233-48c5-9ad8-20d64690f89f None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:33.294579 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 602/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:33.300250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:33.368837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:33.421296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be871a-bc28-4afb-8633-204a80b33443 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:33.465075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912730c4-ecb2-4e6f-b472-f62cb281a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:33.465075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912730c4-ecb2-4e6f-b472-f62cb281a274 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:33.465075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912730c4-ecb2-4e6f-b472-f62cb281a274 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:33.465075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912730c4-ecb2-4e6f-b472-f62cb281a274 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:33.465542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912730c4-ecb2-4e6f-b472-f62cb281a274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:33.465901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912730c4-ecb2-4e6f-b472-f62cb281a274 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:33.496112 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 603/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Sat Jun 18 21:48:33 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:48:36.262910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831d00-0c4c-443c-b6d3-088c8aa0f1ad None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:36.263459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831d00-0c4c-443c-b6d3-088c8aa0f1ad None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:36.263459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84831d00-0c4c-443c-b6d3-088c8aa0f1ad None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:36.265009 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 603/1206] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:48:36.270817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5c3cd-fb46-4bea-9f50-610d34141272 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:36.271322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5c3cd-fb46-4bea-9f50-610d34141272 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:36.271413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5c3cd-fb46-4bea-9f50-610d34141272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:36.292228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-01b5c3cd-fb46-4bea-9f50-610d34141272 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:48:36.292228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-01b5c3cd-fb46-4bea-9f50-610d34141272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:48:36.371270 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 604/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:48:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:48:36.400191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84831d00-0c4c-443c-b6d3-088c8aa0f1ad None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:36.510208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84831d00-0c4c-443c-b6d3-088c8aa0f1ad None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:36.552801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:36.553586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:36.553869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:36.554142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:36.568520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:48:36.576862 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:36.578080 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:36.579028 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 604/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:48:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:36.585612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5c3cd-fb46-4bea-9f50-610d34141272 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:36.642153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:36.721540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5c3cd-fb46-4bea-9f50-610d34141272 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:36.765887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:36.766574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:36.766873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:36.767137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:36.767911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:36.768221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:36.769737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:36.781489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 605/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:48:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:36.787555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:36.844909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:36.907290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6f0c4-7117-499a-b095-b46ccbe1868a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:36.947171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:36.948018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:36.948342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:36.948565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:36.959670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:36.961258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:36.980314 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:36.982721 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:36.983715 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:36.983715 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:36.983715 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:36.983715 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:36.983715 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 605/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:36.987423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:37.098120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:37.102455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e71ca-4dec-47c2-8bb8-444f0626c702 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:37.140870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:37.141605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:37.141880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:37.142118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:37.142864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:37.143166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:37.144619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:37.161642 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 606/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:37.163662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:37.286404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bf475-a712-41c8-8ba5-a4a729e7e207 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:37.288552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:37.325996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:37.326905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:37.327240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:37.327518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:37.335518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:37.337165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:48:37.353468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:37.354898 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:37.355887 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 606/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:37.360849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:37.469614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190465b-9557-4338-9984-b52c5354d34d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:37.510467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:37.511381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:37.511689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:37.512156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:37.513308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:37.513700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:37.515187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:37.540110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 607/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Jun 18 21:48:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:37.542044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:37.656910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322adb7c-a48c-4a4e-abe8-dc1a1a84b4d4 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:37.697175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:37.697920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:37.698300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:37.698532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:37.733529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:37.782552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:37.784461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:37.916542 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 607/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:48:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:48:37.922801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:37.946191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:38.040548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34877ea7-b349-4e61-9955-5d4a58c8c990 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:38.086166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:38.087184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:38.087641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:38.087988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:38.101294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:38.102959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:38.128826 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:38.130279 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:38.131567 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:38.131567 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:38.131567 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:38.131567 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:38.133197 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 608/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:38.136025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:38.205143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:38.249467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d17dee-9ead-420e-b3e9-2dbea14fc161 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:38.290635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:38.291481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:38.291672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:38.291966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:38.292810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:38.293221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:38.294854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:38.312082 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 608/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:38.313678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:38.392787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:38.425833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a64c4-c320-4e4e-b778-762874d8c36c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:38.466407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:38.467710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:38.468258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:38.468841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:38.477356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:38.479073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:48:38.493645 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:38.494561 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:38.495461 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:38.497691 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 609/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:48:38.503212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:38.612009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f183a6-eba5-489a-b805-e8eb8963e296 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:38.635035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:38.648115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d3cbe-397e-448b-8311-51316a267018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:38.648921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3cbe-397e-448b-8311-51316a267018 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:38.649237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3cbe-397e-448b-8311-51316a267018 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:38.649527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3cbe-397e-448b-8311-51316a267018 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:38.650326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d3cbe-397e-448b-8311-51316a267018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:38.650632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d3cbe-397e-448b-8311-51316a267018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:38.652212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d3cbe-397e-448b-8311-51316a267018 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:38.670362 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 609/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:38.671708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:38.790402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247984b2-c7dd-46c3-b7aa-ac7b4751d17a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:38.821158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:38.828145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f64d86-3d83-4acc-abba-cb5adf83c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:38.828858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f64d86-3d83-4acc-abba-cb5adf83c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:38.829169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f64d86-3d83-4acc-abba-cb5adf83c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:38.829445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f64d86-3d83-4acc-abba-cb5adf83c3d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:38.830598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f64d86-3d83-4acc-abba-cb5adf83c3d5 None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=a0e2be3128404ad69b2be994caadf3bc) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:38.830911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f64d86-3d83-4acc-abba-cb5adf83c3d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:38.832346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f64d86-3d83-4acc-abba-cb5adf83c3d5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:38.838255 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 610/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:48:38 2022] GET /identity/v3/role_assignments?user.id=a0e2be3128404ad69b2be994caadf3bc&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:48:41.334743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037d32-254a-42df-9712-d324c2846a39 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:41.335328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037d32-254a-42df-9712-d324c2846a39 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:41.335328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037d32-254a-42df-9712-d324c2846a39 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:41.337080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 610/1220] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:48:41.343221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda94b3-97b9-40c3-9cc6-b4c2ddd917fe None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:41.343696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda94b3-97b9-40c3-9cc6-b4c2ddd917fe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:41.343793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda94b3-97b9-40c3-9cc6-b4c2ddd917fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:41.363405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-beda94b3-97b9-40c3-9cc6-b4c2ddd917fe None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:48:41.364593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-beda94b3-97b9-40c3-9cc6-b4c2ddd917fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:48:41.436378 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 611/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:48:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:48:41.464390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12037d32-254a-42df-9712-d324c2846a39 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:41.577731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12037d32-254a-42df-9712-d324c2846a39 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:41.612612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:41.613372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:41.613656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:41.613928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:41.629005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:48:41.636814 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:41.637840 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:41.643981 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 611/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:48:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:41.644711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda94b3-97b9-40c3-9cc6-b4c2ddd917fe None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:41.771464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda94b3-97b9-40c3-9cc6-b4c2ddd917fe None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:41.800775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:41.817185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:41.817898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:41.818321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:41.818546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:41.819801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:41.820111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:41.821677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:41.836044 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 612/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:48:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:41.837277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:41.887990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:41.950415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba50a-516b-422b-a470-452782a4ad3c None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:41.987867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:41.988744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:41.989026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:41.989326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:42.000984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:42.002458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:42.020783 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:42.021849 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:42.022792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:42.022792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:42.022792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:42.022792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:42.028710 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 612/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:42.028884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:42.147355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16597a4-948a-4b0a-abbd-2f5627eadaf0 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:42.184700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:42.185441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:42.185706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:42.185980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:42.186722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:42.187020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:42.188493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:42.201562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 613/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:42.207468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:42.323661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:42.333988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dccbd0-0746-45ef-ad8c-92d715eac677 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:42.373277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:42.374089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:42.374378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:42.374675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] PATH_INFO: `/v3/users/placement` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:42.383354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:42.384154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:48:42.399265 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:42.400313 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:42.402361 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 613/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:42.407437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:42.464351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:42.528653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87df9a-f04c-4869-baf2-35cf65a75d10 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:42.569748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:42.570700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:42.571153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:42.571591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:42.572632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:42.573130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:42.574774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:42.595621 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 614/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Jun 18 21:48:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:42.601564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:42.725260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea812b-c8b9-4cff-9085-80237ac1257d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:42.765072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:42.766023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:42.766314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:42.766590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:42.779444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:42.781306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:42.801100 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:42.802211 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:42.803229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:42.803229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:42.803229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:42.803229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:42.803229 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 614/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:42.808756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:42.913269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca4219-3bf4-4576-aafb-db75fc19e346 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:42.915631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:42.949872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:42.950541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:42.950819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:42.951096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:42.951826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:42.952130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:42.953930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:42.966841 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 615/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:42.973238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:42.983362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:43.082049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bef564-8447-42a1-b401-2ce39eb26415 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:43.117669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:43.118471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:43.118754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:43.119029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:43.125848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:43.127301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:48:43.141377 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:43.142515 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:43.143437 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 615/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:48:43.148469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:43.260247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfe95c-5ce3-4201-9ea3-48c28b246213 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:43.296975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b38f6-c983-4acf-8769-ca8a1d4c7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:43.297730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b38f6-c983-4acf-8769-ca8a1d4c7828 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:43.298057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b38f6-c983-4acf-8769-ca8a1d4c7828 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:43.298444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b38f6-c983-4acf-8769-ca8a1d4c7828 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:43.299221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b38f6-c983-4acf-8769-ca8a1d4c7828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:43.299525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b38f6-c983-4acf-8769-ca8a1d4c7828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:43.301116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b38f6-c983-4acf-8769-ca8a1d4c7828 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:43.313777 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 616/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:43.321219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:43.397631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:43.436088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cace986-75a6-433f-8d29-63dea826144b None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:43.472599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8e37b-a464-4264-b51a-28d571a1ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:43.473563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e37b-a464-4264-b51a-28d571a1ddbb None admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:43.473849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e37b-a464-4264-b51a-28d571a1ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:43.474130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e37b-a464-4264-b51a-28d571a1ddbb None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/a0e2be3128404ad69b2be994caadf3bc/roles/3af3015fe5ba49eca4677c320084172b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:43.491185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8e37b-a464-4264-b51a-28d571a1ddbb None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=a0e2be3128404ad69b2be994caadf3bc, role_id=3af3015fe5ba49eca4677c320084172b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:43.492652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8e37b-a464-4264-b51a-28d571a1ddbb None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:43.504822 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 616/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:48:43 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/a0e2be3128404ad69b2be994caadf3bc/roles/3af3015fe5ba49eca4677c320084172b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 21:48:45.892315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d083be-4d3d-4865-86d9-84fe56ae4f97 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:45.892924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d083be-4d3d-4865-86d9-84fe56ae4f97 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:45.892924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d083be-4d3d-4865-86d9-84fe56ae4f97 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:45.894408 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 617/1233] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:48:45.902442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b999fc-5309-44d4-a6e4-c1d651b2effd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:45.902442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b999fc-5309-44d4-a6e4-c1d651b2effd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:45.902442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b999fc-5309-44d4-a6e4-c1d651b2effd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:45.918818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-24b999fc-5309-44d4-a6e4-c1d651b2effd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:48:45.920255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-24b999fc-5309-44d4-a6e4-c1d651b2effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:48:45.996511 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 617/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:48:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:48:46.022105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d083be-4d3d-4865-86d9-84fe56ae4f97 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:46.050774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:46.138697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d083be-4d3d-4865-86d9-84fe56ae4f97 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:46.176019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:46.176736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:46.177013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:46.177308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:46.192921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:48:46.202443 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:46.203508 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:46.204659 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 618/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Sat Jun 18 21:48:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:46.211276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b999fc-5309-44d4-a6e4-c1d651b2effd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:46.262624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:46.319769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b999fc-5309-44d4-a6e4-c1d651b2effd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:46.357338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:46.358021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:46.358359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:46.358582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:46.359347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] RBAC: Adding query filter params (name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:46.359674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:46.361107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:46.370670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 618/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Sat Jun 18 21:48:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:48:46.376345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:46.465754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:46.489008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5753e9e-7117-49b3-86ac-76d51e4ee7bd None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:46.531665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:46.532471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:46.532757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:46.533062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:46.544937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:46.546540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:46.564902 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:46.566079 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:46.567049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:46.567049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:46.567049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:46.567049 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:46.567049 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 619/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:48:46.572535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:46.683290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77c5a4-6a21-4c3f-abb5-61ab7ab30e33 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:46.693660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:46.720767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:46.721398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:46.721678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:46.721978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:46.722835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:46.723126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:46.724636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:46.736761 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 619/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:46.743416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:46.877343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dda0b-200d-49ab-845b-55ab994b49ed None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:46.913021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:46.913958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:46.914237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:46.914506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:46.917433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:46.924171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:46.925934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:48:46.942127 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:46.943183 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:46.944122 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:46.949943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:46.950957 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 620/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:47.061851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd923f-68fb-4bf6-9fe9-ecc7f0f307ee None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:47.098272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:47.098949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:47.099235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:47.099511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:47.100428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:47.100761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:47.102644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:47.122589 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 620/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Jun 18 21:48:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:47.128737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:47.242377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714363cb-bfa3-4042-8299-b72dbc7b6621 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:47.278096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:47.278741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:47.279017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:47.279285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:47.347477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:47.357841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:47.359475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:47.470625 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 621/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:48:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:48:47.476861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:47.515444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:47.606264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b02c73-f75a-4e23-8b96-621903de6f75 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:47.645410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:47.646306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:47.646658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:47.646934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:47.658134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:47.659591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:47.677593 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:47.683796 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:47.684967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:47.684967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:47.684967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:47.684967 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:47.684967 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 621/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:47.685321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:47.806561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:47.818989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430d1f2-52a0-4307-afef-28842ad686bc None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:47.858631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:47.859603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:47.859944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:47.860214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:47.860990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:47.861403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:47.862941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:47.876351 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 622/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:47.882479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:47.990339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:48.021242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb873ff7-de7a-44e9-817a-06da5bfb51ca None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:48.065916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:48.066744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:48.067023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:48.067295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:48.076470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:48.077977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:48:48.094109 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:48.095466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:48.096483 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 622/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:48.102117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:48.219337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f05d7-73ac-4919-83ba-e2815ec57767 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:48.258385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724f084-5624-418d-8dd7-78d129c14aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:48.259171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724f084-5624-418d-8dd7-78d129c14aae None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:48.259515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724f084-5624-418d-8dd7-78d129c14aae None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:48.259957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724f084-5624-418d-8dd7-78d129c14aae None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:48.260877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724f084-5624-418d-8dd7-78d129c14aae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:48.261130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724f084-5624-418d-8dd7-78d129c14aae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:48.262882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724f084-5624-418d-8dd7-78d129c14aae None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:48.275453 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 623/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:48.282126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:48.397260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d43fc-cc8c-47fc-86d5-b0ac39befe13 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:48.437575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f632ccc-6778-47ed-bf15-17cc07a6a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:48.438444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f632ccc-6778-47ed-bf15-17cc07a6a4ae None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:48.438730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f632ccc-6778-47ed-bf15-17cc07a6a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:48.439024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f632ccc-6778-47ed-bf15-17cc07a6a4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:48.440083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f632ccc-6778-47ed-bf15-17cc07a6a4ae None admin] RBAC: Adding query filter params (role.id=3af3015fe5ba49eca4677c320084172b, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=a0e2be3128404ad69b2be994caadf3bc) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:48.440475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f632ccc-6778-47ed-bf15-17cc07a6a4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:48.442010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f632ccc-6778-47ed-bf15-17cc07a6a4ae None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:48.449253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 623/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:48:48 2022] GET /identity/v3/role_assignments?user.id=a0e2be3128404ad69b2be994caadf3bc&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=3af3015fe5ba49eca4677c320084172b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:51.034585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f35f-e80a-46db-a035-6a7e5a70f7c5 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:51.035050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f35f-e80a-46db-a035-6a7e5a70f7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:51.035050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f35f-e80a-46db-a035-6a7e5a70f7c5 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:51.036554 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 624/1247] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:48:51.041941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9992c1-b60c-4f41-b5bd-4d0babae89b3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:51.042373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9992c1-b60c-4f41-b5bd-4d0babae89b3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:51.042464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9992c1-b60c-4f41-b5bd-4d0babae89b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:51.047831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:51.061295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6f9992c1-b60c-4f41-b5bd-4d0babae89b3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:48:51.062480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6f9992c1-b60c-4f41-b5bd-4d0babae89b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:48:51.276593 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 624/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:48:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:48:51.306231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f35f-e80a-46db-a035-6a7e5a70f7c5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:51.328670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:51.431559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f35f-e80a-46db-a035-6a7e5a70f7c5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:51.473593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:51.474387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:51.474660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:51.474926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:51.486502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:48:51.493974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:51.495104 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:51.496102 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 625/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:51.501328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9992c1-b60c-4f41-b5bd-4d0babae89b3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:51.620326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9992c1-b60c-4f41-b5bd-4d0babae89b3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:51.655321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:51.661947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:51.663033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:51.663414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:51.663821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:51.664785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:51.665386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:51.667271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:51.680440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 625/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:51.689185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:51.784281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:51.813963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a77d64-4e07-408d-b00b-bfb5925381d3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:51.849645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:51.850476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:51.850754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:51.851070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:51.862540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:51.864011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:51.883870 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:51.884943 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:51.886095 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:51.886095 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:51.886095 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:51.886095 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:51.886095 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 626/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:48:51.892530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:51.997383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f542-8622-4829-9b95-14a28e3db910 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:52.039390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:52.040063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:52.040385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:52.040694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:52.041457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:52.041785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:52.043232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:52.056336 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 626/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:52.063030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:52.171444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798bdb7-d2e8-4520-bc3a-75974855b60d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:52.200224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:52.209497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:52.210308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:52.210579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:52.210845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:52.219727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:52.221199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:48:52.235835 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:52.237060 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:52.242989 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 627/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:52.244817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:52.304497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:52.352715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a60ac-8c69-4001-9723-414c9b7ca462 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:52.388792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:52.390005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:52.390345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:52.390623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:52.393573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:52.393915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:52.395485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:52.415137 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 627/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Jun 18 21:48:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:52.421259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:52.526289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d708-5b5f-431f-b752-73195cb35440 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:52.561567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:52.562308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:52.562622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:52.562905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:52.624816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:52.638788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:52.640285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:52.747753 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 628/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:48:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:48:52.753817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:52.873222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b439ef8-e48f-47e8-ba8e-258ec0f98bbc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:52.888339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:52.911736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:52.912554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:52.912832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:52.913134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:52.923919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:52.925423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:52.944353 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:52.945512 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:52.951497 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:52.951497 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:52.951497 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:52.951497 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:52.951497 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 628/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:52.951849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:53.051275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:53.065085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691ad3b-ecfc-4080-ad38-a9f993180ec3 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:53.100651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:53.101359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:53.101639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:53.101909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:53.102660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:53.102972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:53.104428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:53.117709 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 629/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:53.123734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:53.231951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f9e6-51b2-4bb8-afc6-bdf15661d005 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:53.271889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:53.272701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:53.272977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:53.273283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] PATH_INFO: `/v3/projects/service` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:53.280555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:53.282085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:48:53.296687 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:53.297889 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:48:53.299006 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 629/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:53.303830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:53.405711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbd580-ca23-4ebf-85f9-9aa262c4cb75 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:53.441231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ad2b2-7a82-4365-bf89-01391f457717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:53.441898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad2b2-7a82-4365-bf89-01391f457717 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:53.442174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad2b2-7a82-4365-bf89-01391f457717 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:53.442443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ad2b2-7a82-4365-bf89-01391f457717 None admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:53.443234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ad2b2-7a82-4365-bf89-01391f457717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:53.443537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ad2b2-7a82-4365-bf89-01391f457717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:53.445008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ad2b2-7a82-4365-bf89-01391f457717 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:53.457520 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 630/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:48:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:53.463610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:53.490008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:53.564538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05332-9981-426b-ba61-af3858c20aff None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:53.606023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32508-5d5a-4cc6-b569-142e67c8e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:53.606684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32508-5d5a-4cc6-b569-142e67c8e575 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:53.606964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32508-5d5a-4cc6-b569-142e67c8e575 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:53.607238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32508-5d5a-4cc6-b569-142e67c8e575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:53.608072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32508-5d5a-4cc6-b569-142e67c8e575 None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=a0e2be3128404ad69b2be994caadf3bc) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:53.608381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32508-5d5a-4cc6-b569-142e67c8e575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:53.609926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32508-5d5a-4cc6-b569-142e67c8e575 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:53.615752 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 630/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:48:53 2022] GET /identity/v3/role_assignments?user.id=a0e2be3128404ad69b2be994caadf3bc&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:55.875032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c5080-0620-4eec-bd06-9dc9fce9c98a None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:55.875667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c5080-0620-4eec-bd06-9dc9fce9c98a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:55.875667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c5080-0620-4eec-bd06-9dc9fce9c98a None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:55.877007 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 631/1261] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:48:55.883379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4aa2e-4bca-4abd-bdc9-fa4d4096e242 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:55.884066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4aa2e-4bca-4abd-bdc9-fa4d4096e242 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:55.884222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4aa2e-4bca-4abd-bdc9-fa4d4096e242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:55.909727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bac4aa2e-4bca-4abd-bdc9-fa4d4096e242 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:48:55.910903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bac4aa2e-4bca-4abd-bdc9-fa4d4096e242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:48:55.979254 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 631/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:48:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 18 21:48:56.003380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c5080-0620-4eec-bd06-9dc9fce9c98a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:56.016563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:56.126853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c5080-0620-4eec-bd06-9dc9fce9c98a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:56.162694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:56.163477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:56.163758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:56.164027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:56.175114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:48:56.182635 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:56.183694 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:56.184657 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 632/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:56.190910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4aa2e-4bca-4abd-bdc9-fa4d4096e242 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:56.215315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:56.306666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4aa2e-4bca-4abd-bdc9-fa4d4096e242 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:56.342947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:56.343612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:56.343896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:56.344212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:56.344967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:56.345306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:56.346688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:56.355322 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 632/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:48:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:56.361421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:56.439938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:56.486169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177551d-e51b-439c-bc2f-b6516cc3d07d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:56.521373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:56.522158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:56.522433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:56.522725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:56.533932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:56.535374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:56.552534 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:56.553606 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:56.554558 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:56.554558 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:56.554558 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:56.554558 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:56.554558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 633/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:56.559852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:56.647046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:56.667833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d588-d158-4145-b3a2-ba1faa1fbe1e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:56.702138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:56.702718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:56.702995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:56.703264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:56.704015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:56.704313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:56.706052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:56.718440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 633/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:56.724239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:56.850713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385498b8-09a7-437e-b82f-953d3a3eabda None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:56.873414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:56.888254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:56.889099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:56.889378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:56.889652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:56.898595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:56.900099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:48:56.914515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:56.915562 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:56.916679 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 634/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:56.921954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:57.023878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573526-16a4-4e9b-be05-3d6f4490ec98 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:57.064495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:57.065205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:57.065511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:57.065782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:57.066629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:57.066944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:57.068385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:57.077251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:57.086611 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 634/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Jun 18 21:48:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:57.092842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:57.204761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2daf-f85b-4981-a9e3-3c8d5bd48b8a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:57.244252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:57.245445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:57.245819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:57.246193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:57.258261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:57.259717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:48:57.276566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:57.277652 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:57.278722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:48:57.278722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:48:57.278722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:48:57.278722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:57.278722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 635/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:48:57.283736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:57.387460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7833f77-907d-41b0-9172-6b884453ebc9 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:57.423539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:57.424191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:57.424475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:57.424749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:57.425515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:57.425816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:57.427191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:57.439576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 635/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:57.446042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:57.489986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:57.555894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d74c8-7a2c-4a40-976b-e3bfe5ae5d26 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:57.590743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:57.591532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:57.591806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:57.592077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:57.599053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:57.600486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:48:57.619062 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:48:57.620089 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:48:57.621172 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 636/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:48:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 18 21:48:57.626183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:57.688836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:57.736888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbd97-8701-424d-93c2-089d39fdb9bc None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:57.780649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e68a19-b5f1-4ca7-a576-0d1eb3bba47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:57.781348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68a19-b5f1-4ca7-a576-0d1eb3bba47a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:57.781671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68a19-b5f1-4ca7-a576-0d1eb3bba47a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:57.781941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e68a19-b5f1-4ca7-a576-0d1eb3bba47a None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:57.782734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68a19-b5f1-4ca7-a576-0d1eb3bba47a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:48:57.783042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68a19-b5f1-4ca7-a576-0d1eb3bba47a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:57.784481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e68a19-b5f1-4ca7-a576-0d1eb3bba47a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:57.797726 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 636/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:48:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:48:57.803829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:48:57.896187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:48:57.905574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03968a84-3827-4664-b68a-4a0156214c7a None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:48:57.940937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f8da2-3489-48d2-829c-59a454323a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:48:57.941854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8da2-3489-48d2-829c-59a454323a46 None admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:48:57.942136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8da2-3489-48d2-829c-59a454323a46 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:48:57.942410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8da2-3489-48d2-829c-59a454323a46 None admin] PATH_INFO: `/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/a0e2be3128404ad69b2be994caadf3bc/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:48:57.944598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f8da2-3489-48d2-829c-59a454323a46 None admin] RBAC: Authorizing `identity:create_grant(project_id=7325bff278b145a5a9112160d2e00a5e, user_id=a0e2be3128404ad69b2be994caadf3bc, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:48:57.946078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f8da2-3489-48d2-829c-59a454323a46 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:48:57.962161 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 637/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Sat Jun 18 21:48:57 2022] PUT /identity/v3/projects/7325bff278b145a5a9112160d2e00a5e/users/a0e2be3128404ad69b2be994caadf3bc/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:49:00.229700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f9cb7-cf39-40aa-b44e-6bc67212cd51 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:00.230251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f9cb7-cf39-40aa-b44e-6bc67212cd51 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:00.230251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f9cb7-cf39-40aa-b44e-6bc67212cd51 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:00.231640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 637/1274] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:49:00.237976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bca80-1907-4e10-a021-17f470297c39 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:00.238691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bca80-1907-4e10-a021-17f470297c39 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:00.238855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bca80-1907-4e10-a021-17f470297c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:00.261232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1d5bca80-1907-4e10-a021-17f470297c39 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:49:00.262426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1d5bca80-1907-4e10-a021-17f470297c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:49:00.333639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 638/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:49:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:49:00.358698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f9cb7-cf39-40aa-b44e-6bc67212cd51 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:00.470358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f9cb7-cf39-40aa-b44e-6bc67212cd51 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:00.487641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:00.513203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:00.514353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:00.514704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:00.515118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:00.526554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 18 21:49:00.534082 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:00.535150 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:00.536472 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 638/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Sat Jun 18 21:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:00.541383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bca80-1907-4e10-a021-17f470297c39 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:00.624459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:00.644517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bca80-1907-4e10-a021-17f470297c39 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:00.682026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:00.682681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:00.682958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:00.683233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:00.683983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] RBAC: Adding query filter params (name=admin) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:00.684291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:00.685683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:00.693895 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 639/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Sat Jun 18 21:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:00.702942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:00.814594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562907-f72e-4b44-bf27-63a6a9fc906e None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:00.852737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:00.853559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:00.853851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:00.854130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:00.866949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:00.869224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:49:00.889140 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:00.890174 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:00.891236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:49:00.891236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:49:00.891236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:49:00.891236 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:00.891236 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 639/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:00.896438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:00.996876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee6d1-ad60-4eb7-af57-219e464427de None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:01.032684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:01.033478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:01.033754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:01.034025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:01.034707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:01.035044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:01.036394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:01.049415 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 640/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:01.055176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:01.088882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:01.164315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f3d3-7a88-461e-8ddc-a82d77337406 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:01.202467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:01.203272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:01.203552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:01.203849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:01.212079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:01.213593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 21:49:01.228456 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:01.229547 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:01.231088 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 640/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:49:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:01.235759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:01.239767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:01.339262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabea37-b4af-4234-a43f-7dac9250b16c None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:01.374335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:01.375004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:01.375383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:01.375736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:01.376574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:01.376883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:01.378342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:01.395491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 641/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Sat Jun 18 21:49:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:49:01.404753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:01.506039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:01.520717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ff6a9-6914-4417-ad88-acd1e22c325a None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:01.556963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:01.557634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:01.557920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:01.558193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:01.627439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:01.628889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:01.734694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:01.746285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 641/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Sat Jun 18 21:49:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 18 21:49:01.754047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:01.822050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:01.863233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f070903-b164-421f-9eec-de2ec8b0353d None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:01.899802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:01.900605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:01.900881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:01.901195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:01.911894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:01.913383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 21:49:01.931362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:01.932370 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:01.933648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 18 21:49:01.933648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 21:49:01.933648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 18 21:49:01.933648 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:49:01.933648 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 642/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:01.939126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:02.057309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53e426-52bb-43e5-94c2-9624db08ff91 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:02.092872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:02.093472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:02.093752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:02.093998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:02.094739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:02.095034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:02.096415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:02.108151 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 642/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Sat Jun 18 21:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:02.114883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:02.219458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cdf2-7fb1-47d4-a547-12f2da143a6e None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:02.233713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:02.256873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:02.257694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:02.257967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:02.258248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:02.265600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:02.267130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 18 21:49:02.281134 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:02.282217 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 18 21:49:02.283328 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 21:49:02.285214 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 643/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Sat Jun 18 21:49:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:02.288616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:02.347646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:02.398080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76d09d-1ad0-4878-8ce2-a0c978db7280 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:02.432629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e8d40-1ffa-443c-8d6e-a0ed5248e5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:02.433354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8d40-1ffa-443c-8d6e-a0ed5248e5b3 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:02.433634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8d40-1ffa-443c-8d6e-a0ed5248e5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:02.433904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e8d40-1ffa-443c-8d6e-a0ed5248e5b3 None admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:02.434695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e8d40-1ffa-443c-8d6e-a0ed5248e5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:02.434997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e8d40-1ffa-443c-8d6e-a0ed5248e5b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:02.436420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e8d40-1ffa-443c-8d6e-a0ed5248e5b3 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:02.448420 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 643/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Sat Jun 18 21:49:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:02.455279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:02.569366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8cf4f-2a78-4047-b41e-601ddba5d752 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:02.604400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582e013-0dc9-4d2b-aca2-1b4dfa0945cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:02.604971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582e013-0dc9-4d2b-aca2-1b4dfa0945cf None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:02.605277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582e013-0dc9-4d2b-aca2-1b4dfa0945cf None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:02.605555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582e013-0dc9-4d2b-aca2-1b4dfa0945cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:02.606389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582e013-0dc9-4d2b-aca2-1b4dfa0945cf None admin] RBAC: Adding query filter params (role.id=94ce583da5f6409cb8f3ec3771a2da17, scope.project.id=7325bff278b145a5a9112160d2e00a5e, user.id=a0e2be3128404ad69b2be994caadf3bc) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:02.606699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582e013-0dc9-4d2b-aca2-1b4dfa0945cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:02.608160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582e013-0dc9-4d2b-aca2-1b4dfa0945cf None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:02.614197 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 644/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Sat Jun 18 21:49:02 2022] GET /identity/v3/role_assignments?user.id=a0e2be3128404ad69b2be994caadf3bc&scope.project.id=7325bff278b145a5a9112160d2e00a5e&role.id=94ce583da5f6409cb8f3ec3771a2da17 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:04.909483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1c42-e257-404f-9fcd-b38385bffc52 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:04.910065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1c42-e257-404f-9fcd-b38385bffc52 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:04.910065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a1c42-e257-404f-9fcd-b38385bffc52 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:04.911488 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 644/1288] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:49:04.917318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c3c6-2fc0-4254-a3ab-e14f534fd5d2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:04.917740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c3c6-2fc0-4254-a3ab-e14f534fd5d2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:04.917926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273c3c6-2fc0-4254-a3ab-e14f534fd5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:04.934778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6273c3c6-2fc0-4254-a3ab-e14f534fd5d2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:49:04.935948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6273c3c6-2fc0-4254-a3ab-e14f534fd5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:49:04.966303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:05.007328 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 645/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:49:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:49:05.032009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a1c42-e257-404f-9fcd-b38385bffc52 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:05.139896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a1c42-e257-404f-9fcd-b38385bffc52 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:05.150778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:05.178662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:05.179385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:05.179665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:05.179937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] PATH_INFO: `/v3/services/placement` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:05.180614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:05.182032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:05.194390 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:05.195526 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:05.196418 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 645/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:49:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:05.202088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c3c6-2fc0-4254-a3ab-e14f534fd5d2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:05.303648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273c3c6-2fc0-4254-a3ab-e14f534fd5d2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:05.341994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce43417-cc91-4888-9b09-a61db703faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:05.342663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce43417-cc91-4888-9b09-a61db703faf2 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:05.342945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce43417-cc91-4888-9b09-a61db703faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:05.343221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce43417-cc91-4888-9b09-a61db703faf2 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:05.343964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce43417-cc91-4888-9b09-a61db703faf2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:05.344259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce43417-cc91-4888-9b09-a61db703faf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:05.345841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce43417-cc91-4888-9b09-a61db703faf2 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:05.354573 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 646/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Jun 18 21:49:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:05.361107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:05.466834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3becb-1824-4c55-918b-df6ada32618d None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:05.501714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969608d-6d81-44e1-979a-a975f25a2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:05.502360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969608d-6d81-44e1-979a-a975f25a2838 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:05.502635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969608d-6d81-44e1-979a-a975f25a2838 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:05.502914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969608d-6d81-44e1-979a-a975f25a2838 None admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:05.503615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969608d-6d81-44e1-979a-a975f25a2838 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:05.503921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969608d-6d81-44e1-979a-a975f25a2838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:05.505377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969608d-6d81-44e1-979a-a975f25a2838 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:05.510493 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 646/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Jun 18 21:49:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:07.825104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbb64-cce7-4bc6-8cfd-608a4da525d6 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:07.825825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbb64-cce7-4bc6-8cfd-608a4da525d6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:07.825984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbb64-cce7-4bc6-8cfd-608a4da525d6 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:07.828376 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 647/1293] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:49:07.834831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818d022-30f2-4f49-a68e-c7774b3a833d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:07.835240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818d022-30f2-4f49-a68e-c7774b3a833d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:07.835386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818d022-30f2-4f49-a68e-c7774b3a833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:07.856217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d818d022-30f2-4f49-a68e-c7774b3a833d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:49:07.857694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d818d022-30f2-4f49-a68e-c7774b3a833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:49:07.889657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:07.929754 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 647/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:49:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:49:07.954877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dbb64-cce7-4bc6-8cfd-608a4da525d6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:07.994740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:08.074885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dbb64-cce7-4bc6-8cfd-608a4da525d6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:08.110636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e397df9-7f68-4bbc-ac61-df93b6799ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:08.111233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397df9-7f68-4bbc-ac61-df93b6799ac5 None admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:08.111512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397df9-7f68-4bbc-ac61-df93b6799ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:08.111787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397df9-7f68-4bbc-ac61-df93b6799ac5 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:08.112507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397df9-7f68-4bbc-ac61-df93b6799ac5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:08.113940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397df9-7f68-4bbc-ac61-df93b6799ac5 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:08.130940 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 648/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Sat Jun 18 21:49:07 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:49:10.421590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c7ff-e317-4d4f-9ecf-5843fed34a8a None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:10.422189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c7ff-e317-4d4f-9ecf-5843fed34a8a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:10.422189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c7ff-e317-4d4f-9ecf-5843fed34a8a None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:10.423493 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 648/1296] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:49:10.430086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3856-a62c-471b-9b59-8e4106895329 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:10.430887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3856-a62c-471b-9b59-8e4106895329 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:10.431043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3856-a62c-471b-9b59-8e4106895329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:10.456771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-730b3856-a62c-471b-9b59-8e4106895329 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:49:10.458031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-730b3856-a62c-471b-9b59-8e4106895329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:49:10.535832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 649/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:49:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:49:10.564371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c7ff-e317-4d4f-9ecf-5843fed34a8a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:10.668766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c7ff-e317-4d4f-9ecf-5843fed34a8a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:10.708125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:10.708841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:10.709150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:10.709433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:10.710084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:10.711465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:10.724015 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:10.725261 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:10.726557 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 649/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:49:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:10.731361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b3856-a62c-471b-9b59-8e4106895329 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:10.750017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:10.833214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b3856-a62c-471b-9b59-8e4106895329 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:10.869406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:10.870058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:10.870332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:10.870605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:10.871317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:10.871622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:10.872992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:10.878569 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 650/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Jun 18 21:49:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:49:10.884757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:10.920179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:10.990040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea8630-585d-4e92-81cb-3ba2336a5c53 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:11.024411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41ea7e-6d62-49ae-a801-2b0e222968d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:11.025074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ea7e-6d62-49ae-a801-2b0e222968d2 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:11.025352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ea7e-6d62-49ae-a801-2b0e222968d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:11.025622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41ea7e-6d62-49ae-a801-2b0e222968d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:11.026408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41ea7e-6d62-49ae-a801-2b0e222968d2 None admin] RBAC: Adding query filter params (interface=public, service_id=af3b4c5edc764d748c5d52baac770f8d, region_id=RegionOne) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:11.026709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41ea7e-6d62-49ae-a801-2b0e222968d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:11.028084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41ea7e-6d62-49ae-a801-2b0e222968d2 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:11.035739 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 650/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Sat Jun 18 21:49:10 2022] GET /identity/v3/endpoints?service_id=af3b4c5edc764d748c5d52baac770f8d&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:49:11.045013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:11.133521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:11.156407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0b2bd-a18b-429e-b052-8251f2a84e78 None admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:11.191321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeabe3-9735-4723-b5c1-218e5a35c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:11.191975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeabe3-9735-4723-b5c1-218e5a35c0ef None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:11.192255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeabe3-9735-4723-b5c1-218e5a35c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:11.192529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeabe3-9735-4723-b5c1-218e5a35c0ef None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:11.193250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffeabe3-9735-4723-b5c1-218e5a35c0ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:11.194630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffeabe3-9735-4723-b5c1-218e5a35c0ef None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:11.201627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 651/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Sat Jun 18 21:49:11 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:49:13.464659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c801-2b92-462e-b124-c36cb72c1f26 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:13.465269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c801-2b92-462e-b124-c36cb72c1f26 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:13.465269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c801-2b92-462e-b124-c36cb72c1f26 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:13.466603 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 651/1302] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:49:13.472781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef34af-69d9-4736-9205-650ae2bd293a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:13.473386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef34af-69d9-4736-9205-650ae2bd293a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:13.473386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef34af-69d9-4736-9205-650ae2bd293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:13.499208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4aef34af-69d9-4736-9205-650ae2bd293a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:49:13.500439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4aef34af-69d9-4736-9205-650ae2bd293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:49:13.575533 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 652/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:49:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 21:49:13.600827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c801-2b92-462e-b124-c36cb72c1f26 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:13.701014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:13.714872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c801-2b92-462e-b124-c36cb72c1f26 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:13.751697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:13.752499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:13.752775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:13.753073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:13.753753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:13.755131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 21:49:13.769073 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 21:49:13.770207 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 21:49:13.771091 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 652/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Sat Jun 18 21:49:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 21:49:13.778271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef34af-69d9-4736-9205-650ae2bd293a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:13.861256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:13.885627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef34af-69d9-4736-9205-650ae2bd293a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:13.928525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87001af-dd3f-47d8-8698-5353fb08c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:13.929603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87001af-dd3f-47d8-8698-5353fb08c827 None admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:13.930032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87001af-dd3f-47d8-8698-5353fb08c827 None admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:13.930469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87001af-dd3f-47d8-8698-5353fb08c827 None admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:13.931656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87001af-dd3f-47d8-8698-5353fb08c827 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:49:13.932132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87001af-dd3f-47d8-8698-5353fb08c827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:13.934476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87001af-dd3f-47d8-8698-5353fb08c827 None admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:13.941178 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 653/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Sat Jun 18 21:49:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 21:49:13.946990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:49:14.050817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d23e-a481-4e31-be67-ed45436ccfa0 None admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:49:14.085587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0df4ad-0fb0-4476-be77-9677a02744d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:49:14.086236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df4ad-0fb0-4476-be77-9677a02744d8 None admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:49:14.086514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df4ad-0fb0-4476-be77-9677a02744d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:49:14.086782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df4ad-0fb0-4476-be77-9677a02744d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:49:14.087512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0df4ad-0fb0-4476-be77-9677a02744d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:49:14.088870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0df4ad-0fb0-4476-be77-9677a02744d8 None admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:49:14.112242 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 653/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Sat Jun 18 21:49:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:49:23.937580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=30 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:49:24.106175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:25.683060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cab82-c47a-4410-a55c-5326164b9f30 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:25.683612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cab82-c47a-4410-a55c-5326164b9f30 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:25.683612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cab82-c47a-4410-a55c-5326164b9f30 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:25.689759 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 654/1307] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:25.691351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57da8cf-e744-4ea3-b883-68e148e67206 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:25.691796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57da8cf-e744-4ea3-b883-68e148e67206 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:25.691889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57da8cf-e744-4ea3-b883-68e148e67206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:25.776778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f57da8cf-e744-4ea3-b883-68e148e67206 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:25.778103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f57da8cf-e744-4ea3-b883-68e148e67206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:25.888157 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 654/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:50:25.939636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7eb4c-a4eb-4493-84e4-7da852420321 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:25.939928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7eb4c-a4eb-4493-84e4-7da852420321 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:25.940196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7eb4c-a4eb-4493-84e4-7da852420321 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:25.942406 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 655/1309] 10.222.0.30 () {54 vars in 964 bytes} [Sat Jun 18 21:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:25.949167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0c33-4546-46e3-bee9-dd12814f26f3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:25.949466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0c33-4546-46e3-bee9-dd12814f26f3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:25.949748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a0c33-4546-46e3-bee9-dd12814f26f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:26.079142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0f4a0c33-4546-46e3-bee9-dd12814f26f3 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:26.081738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f4a0c33-4546-46e3-bee9-dd12814f26f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:26.119536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:26.195924 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 655/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Jun 18 21:50:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:50:26.205999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7eb4c-a4eb-4493-84e4-7da852420321 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:26.208149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4fe7eb4c-a4eb-4493-84e4-7da852420321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:26.323102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7eb4c-a4eb-4493-84e4-7da852420321 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:26.405929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15be32e-168a-46d6-82ab-f63ab1763d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:26.406608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be32e-168a-46d6-82ab-f63ab1763d2d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:26.406889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be32e-168a-46d6-82ab-f63ab1763d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:26.407160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be32e-168a-46d6-82ab-f63ab1763d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:26.408801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b15be32e-168a-46d6-82ab-f63ab1763d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:26.464556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:26.523021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15be32e-168a-46d6-82ab-f63ab1763d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:26.524592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15be32e-168a-46d6-82ab-f63ab1763d2d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:26.674272 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 656/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:29.256670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de7565-e8ba-4626-a1bf-64a32c4d7a23 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:29.257330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de7565-e8ba-4626-a1bf-64a32c4d7a23 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:29.257330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de7565-e8ba-4626-a1bf-64a32c4d7a23 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:29.258624 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 656/1312] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:29.264307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f1b6-176c-437f-adcc-a8fb315e4c47 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:29.264737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f1b6-176c-437f-adcc-a8fb315e4c47 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:29.264847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620f1b6-176c-437f-adcc-a8fb315e4c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:29.354072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3620f1b6-176c-437f-adcc-a8fb315e4c47 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:29.355191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3620f1b6-176c-437f-adcc-a8fb315e4c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:29.452157 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 657/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:29.491191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de7565-e8ba-4626-a1bf-64a32c4d7a23 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:29.492735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a3de7565-e8ba-4626-a1bf-64a32c4d7a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:29.600081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de7565-e8ba-4626-a1bf-64a32c4d7a23 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:29.675634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:29.678838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed4b0-6353-4cb4-b3b3-4718115516c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:29.679499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed4b0-6353-4cb4-b3b3-4718115516c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:29.679787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed4b0-6353-4cb4-b3b3-4718115516c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:29.680068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed4b0-6353-4cb4-b3b3-4718115516c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:29.682184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-237ed4b0-6353-4cb4-b3b3-4718115516c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:29.802506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed4b0-6353-4cb4-b3b3-4718115516c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:29.804062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed4b0-6353-4cb4-b3b3-4718115516c1 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:29.823211 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 657/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:32.492698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7abe-ec4b-4f80-978a-8ac8096e96f1 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:32.493264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7abe-ec4b-4f80-978a-8ac8096e96f1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:32.493264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7abe-ec4b-4f80-978a-8ac8096e96f1 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:32.494647 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 658/1315] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:32.500272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04e35-6d06-41e8-ad9e-7f9c5adc07e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:32.500718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04e35-6d06-41e8-ad9e-7f9c5adc07e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:32.500805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d04e35-6d06-41e8-ad9e-7f9c5adc07e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:32.566277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f1d04e35-6d06-41e8-ad9e-7f9c5adc07e1 None None] MFA Rules not processed for user `16910e694ce34571a8e3953471ac3733`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:32.567438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f1d04e35-6d06-41e8-ad9e-7f9c5adc07e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:32.623307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:32.672344 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 658/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:32.713190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e7abe-ec4b-4f80-978a-8ac8096e96f1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:32.714792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0f0e7abe-ec4b-4f80-978a-8ac8096e96f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:32.724949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:32.829423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e7abe-ec4b-4f80-978a-8ac8096e96f1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:32.907521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3f559-595a-4e57-a7ec-76f3bfc0a78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:32.908083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f559-595a-4e57-a7ec-76f3bfc0a78a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:32.908363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f559-595a-4e57-a7ec-76f3bfc0a78a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:32.908637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3f559-595a-4e57-a7ec-76f3bfc0a78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:32.910304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2de3f559-595a-4e57-a7ec-76f3bfc0a78a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:32.974290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:33.022734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3f559-595a-4e57-a7ec-76f3bfc0a78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:33.024274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3f559-595a-4e57-a7ec-76f3bfc0a78a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:33.046577 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 659/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:35.955151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef809b-8f1c-4ca1-9e29-fda49cfa49b1 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:35.955733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef809b-8f1c-4ca1-9e29-fda49cfa49b1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:35.955733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef809b-8f1c-4ca1-9e29-fda49cfa49b1 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:35.958850 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 659/1318] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:35.964207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5ee00-d5f5-4455-b0df-e39b7641513f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:35.964652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5ee00-d5f5-4455-b0df-e39b7641513f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:35.964767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5ee00-d5f5-4455-b0df-e39b7641513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:36.030683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fcf5ee00-d5f5-4455-b0df-e39b7641513f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:36.031934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fcf5ee00-d5f5-4455-b0df-e39b7641513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:36.142002 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 660/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:36.187966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef809b-8f1c-4ca1-9e29-fda49cfa49b1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:36.189583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2fef809b-8f1c-4ca1-9e29-fda49cfa49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:36.298720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef809b-8f1c-4ca1-9e29-fda49cfa49b1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:36.382960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce137b-b7ab-4049-b076-2d02d87258b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:36.383606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce137b-b7ab-4049-b076-2d02d87258b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:36.383884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce137b-b7ab-4049-b076-2d02d87258b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:36.384153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce137b-b7ab-4049-b076-2d02d87258b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:36.385857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-00ce137b-b7ab-4049-b076-2d02d87258b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:36.393650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:36.506408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce137b-b7ab-4049-b076-2d02d87258b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:36.507870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce137b-b7ab-4049-b076-2d02d87258b4 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:36.526513 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 660/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:39.510796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0a96-2db4-409a-824a-f1d194a27c81 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:39.511334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0a96-2db4-409a-824a-f1d194a27c81 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:39.511334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0a96-2db4-409a-824a-f1d194a27c81 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:39.512706 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 661/1321] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:39.518271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711486c-f67f-4307-93f9-72973d9b5acd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:39.518715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711486c-f67f-4307-93f9-72973d9b5acd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:39.518807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711486c-f67f-4307-93f9-72973d9b5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:39.583958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d711486c-f67f-4307-93f9-72973d9b5acd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:39.585188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d711486c-f67f-4307-93f9-72973d9b5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:39.646921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:39.686668 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 661/1322] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:39.723633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e0a96-2db4-409a-824a-f1d194a27c81 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:39.725189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-659e0a96-2db4-409a-824a-f1d194a27c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:39.745685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:39.836025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e0a96-2db4-409a-824a-f1d194a27c81 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:39.915911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74e637-3ef7-4317-8037-f2a03cf6713c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:39.916566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74e637-3ef7-4317-8037-f2a03cf6713c service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:39.916847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74e637-3ef7-4317-8037-f2a03cf6713c service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:39.917148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74e637-3ef7-4317-8037-f2a03cf6713c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:39.918781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ff74e637-3ef7-4317-8037-f2a03cf6713c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:39.988758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:40.029872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74e637-3ef7-4317-8037-f2a03cf6713c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:40.031414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74e637-3ef7-4317-8037-f2a03cf6713c service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:40.051407 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 662/1323] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:42.400560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606357-bd2c-4ba1-8735-3873a5ab3250 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:42.401286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606357-bd2c-4ba1-8735-3873a5ab3250 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:42.401286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606357-bd2c-4ba1-8735-3873a5ab3250 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:42.402521 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 662/1324] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:42.407981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b722a3-6358-49d0-8bec-36a9e00dda69 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:42.408426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b722a3-6358-49d0-8bec-36a9e00dda69 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:42.408536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b722a3-6358-49d0-8bec-36a9e00dda69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:42.475439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f3b722a3-6358-49d0-8bec-36a9e00dda69 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:42.476657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f3b722a3-6358-49d0-8bec-36a9e00dda69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:42.577688 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 663/1325] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:42.627677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b182a-877b-4ed4-ba57-abcff0c0b6b9 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:42.627922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b182a-877b-4ed4-ba57-abcff0c0b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:42.628234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b182a-877b-4ed4-ba57-abcff0c0b6b9 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:42.629662 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 663/1326] 10.222.0.30 () {54 vars in 964 bytes} [Sat Jun 18 21:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:42.635592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40503d14-cef2-4c78-8620-dafbe319d044 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:42.635879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40503d14-cef2-4c78-8620-dafbe319d044 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:42.636148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40503d14-cef2-4c78-8620-dafbe319d044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:42.667060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:42.712996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40503d14-cef2-4c78-8620-dafbe319d044 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:42.714240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40503d14-cef2-4c78-8620-dafbe319d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:42.795844 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 664/1327] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Jun 18 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:42.804929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b182a-877b-4ed4-ba57-abcff0c0b6b9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:42.806630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4c5b182a-877b-4ed4-ba57-abcff0c0b6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:42.911724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b182a-877b-4ed4-ba57-abcff0c0b6b9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:42.988958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1350c-f0e3-4fbc-a734-4be1fc8309e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:42.989639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1350c-f0e3-4fbc-a734-4be1fc8309e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:42.989915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1350c-f0e3-4fbc-a734-4be1fc8309e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:42.990165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1350c-f0e3-4fbc-a734-4be1fc8309e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:42.991783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dab1350c-f0e3-4fbc-a734-4be1fc8309e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:43.008660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:43.111891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1350c-f0e3-4fbc-a734-4be1fc8309e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:43.113418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1350c-f0e3-4fbc-a734-4be1fc8309e2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:43.132359 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 664/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:45.697990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04b17-59ae-481f-8306-e3c0eb51310b None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:45.698582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04b17-59ae-481f-8306-e3c0eb51310b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:45.698582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04b17-59ae-481f-8306-e3c0eb51310b None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:45.699918 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 665/1329] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:45.705290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1fcec-5cae-406f-a73b-a8a44f98cc50 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:45.705729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1fcec-5cae-406f-a73b-a8a44f98cc50 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:45.706022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1fcec-5cae-406f-a73b-a8a44f98cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:45.774576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-12e1fcec-5cae-406f-a73b-a8a44f98cc50 None None] MFA Rules not processed for user `16910e694ce34571a8e3953471ac3733`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:45.775870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-12e1fcec-5cae-406f-a73b-a8a44f98cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:45.845955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:45.878790 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 665/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:45.916828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04b17-59ae-481f-8306-e3c0eb51310b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:45.918463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-28c04b17-59ae-481f-8306-e3c0eb51310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:46.027967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04b17-59ae-481f-8306-e3c0eb51310b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:46.049191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:46.105735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c002e07-5c4a-45bf-b340-f4f1c22a1578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:46.106399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002e07-5c4a-45bf-b340-f4f1c22a1578 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:46.106681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002e07-5c4a-45bf-b340-f4f1c22a1578 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:46.106954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002e07-5c4a-45bf-b340-f4f1c22a1578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:46.108677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6c002e07-5c4a-45bf-b340-f4f1c22a1578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:46.226639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c002e07-5c4a-45bf-b340-f4f1c22a1578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:46.228090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c002e07-5c4a-45bf-b340-f4f1c22a1578 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:46.246753 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 666/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:48.786549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabb29-eba2-464e-be63-eb7e3036b500 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:48.786549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabb29-eba2-464e-be63-eb7e3036b500 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:48.786549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabb29-eba2-464e-be63-eb7e3036b500 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:48.787651 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 666/1332] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:48.793518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604603-5f84-418d-81e7-ef6d62480775 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:48.793887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604603-5f84-418d-81e7-ef6d62480775 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:48.794185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb604603-5f84-418d-81e7-ef6d62480775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:48.871081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:48.874907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eb604603-5f84-418d-81e7-ef6d62480775 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:48.877785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eb604603-5f84-418d-81e7-ef6d62480775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:48.980191 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 667/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:49.017542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabb29-eba2-464e-be63-eb7e3036b500 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:49.019609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bdaabb29-eba2-464e-be63-eb7e3036b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:49.129107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabb29-eba2-464e-be63-eb7e3036b500 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:49.205829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96202e8-de43-4bd5-9c5a-b3c4235d4aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:49.206489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96202e8-de43-4bd5-9c5a-b3c4235d4aeb service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:49.206761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96202e8-de43-4bd5-9c5a-b3c4235d4aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:49.207348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96202e8-de43-4bd5-9c5a-b3c4235d4aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:49.208995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f96202e8-de43-4bd5-9c5a-b3c4235d4aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:49.237787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:49.322094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96202e8-de43-4bd5-9c5a-b3c4235d4aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:49.323505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96202e8-de43-4bd5-9c5a-b3c4235d4aeb service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:49.343197 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 667/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:51.708164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3fdc9-eeac-4221-8246-dd4176952eb9 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:51.708716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3fdc9-eeac-4221-8246-dd4176952eb9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:51.708716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3fdc9-eeac-4221-8246-dd4176952eb9 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:51.710854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 668/1335] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:51.718920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264b21c-b6ca-4a29-9569-7fd0b1d173c1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:51.719387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264b21c-b6ca-4a29-9569-7fd0b1d173c1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:51.719488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264b21c-b6ca-4a29-9569-7fd0b1d173c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:51.789531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9264b21c-b6ca-4a29-9569-7fd0b1d173c1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:51.790738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9264b21c-b6ca-4a29-9569-7fd0b1d173c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:51.875029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:51.898507 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 668/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:50:51.939228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3fdc9-eeac-4221-8246-dd4176952eb9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:51.940809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-97a3fdc9-eeac-4221-8246-dd4176952eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:52.044992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3fdc9-eeac-4221-8246-dd4176952eb9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:52.073801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:52.123197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfaa98-752d-46d1-a6c2-21cbc7f5d967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:52.123848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfaa98-752d-46d1-a6c2-21cbc7f5d967 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:52.124122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfaa98-752d-46d1-a6c2-21cbc7f5d967 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:52.124389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfaa98-752d-46d1-a6c2-21cbc7f5d967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:52.126156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-59cfaa98-752d-46d1-a6c2-21cbc7f5d967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:52.239056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfaa98-752d-46d1-a6c2-21cbc7f5d967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:52.240422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfaa98-752d-46d1-a6c2-21cbc7f5d967 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:52.259185 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 669/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:50:55.177558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9824d-b0bd-4358-b491-254ff5478ad8 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:55.178102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9824d-b0bd-4358-b491-254ff5478ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:55.178102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9824d-b0bd-4358-b491-254ff5478ad8 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:55.179382 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 669/1338] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:50:55.185576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068f6e-0628-483f-b154-da2b1d906122 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:55.186553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068f6e-0628-483f-b154-da2b1d906122 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:55.186843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51068f6e-0628-483f-b154-da2b1d906122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:55.251671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-51068f6e-0628-483f-b154-da2b1d906122 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:50:55.252867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-51068f6e-0628-483f-b154-da2b1d906122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:55.261943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:55.355906 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 670/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:50:55.402390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9824d-b0bd-4358-b491-254ff5478ad8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:50:55.404767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d2b9824d-b0bd-4358-b491-254ff5478ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:55.519536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9824d-b0bd-4358-b491-254ff5478ad8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:50:55.597436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c5a3-803e-4da3-ae3b-1f4b2dfe61dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:50:55.598088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c5a3-803e-4da3-ae3b-1f4b2dfe61dd service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:50:55.598364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c5a3-803e-4da3-ae3b-1f4b2dfe61dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:50:55.598634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c5a3-803e-4da3-ae3b-1f4b2dfe61dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:50:55.600280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e523c5a3-803e-4da3-ae3b-1f4b2dfe61dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:50:55.637184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:50:55.715576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523c5a3-803e-4da3-ae3b-1f4b2dfe61dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:50:55.717018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523c5a3-803e-4da3-ae3b-1f4b2dfe61dd service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:50:55.735687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 670/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:50:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:00.096596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdfa04-f7cc-47db-959e-2eb9fb47fc88 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:00.097219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdfa04-f7cc-47db-959e-2eb9fb47fc88 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:00.097219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdfa04-f7cc-47db-959e-2eb9fb47fc88 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:00.098477 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 671/1341] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:00.103756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372de7-42fe-40e7-a25d-0067dc347694 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:00.104196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372de7-42fe-40e7-a25d-0067dc347694 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:00.104295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372de7-42fe-40e7-a25d-0067dc347694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:00.179959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4e372de7-42fe-40e7-a25d-0067dc347694 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:00.181205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4e372de7-42fe-40e7-a25d-0067dc347694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:00.275990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:00.289291 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 671/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:00.329064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdfa04-f7cc-47db-959e-2eb9fb47fc88 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:00.331698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-adbdfa04-f7cc-47db-959e-2eb9fb47fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:00.431533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdfa04-f7cc-47db-959e-2eb9fb47fc88 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:00.435623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81699571-aca5-4a07-b420-b4fef7fdaf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:00.436309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699571-aca5-4a07-b420-b4fef7fdaf23 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:00.436597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699571-aca5-4a07-b420-b4fef7fdaf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:00.436872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81699571-aca5-4a07-b420-b4fef7fdaf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:00.447671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81699571-aca5-4a07-b420-b4fef7fdaf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:00.449322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81699571-aca5-4a07-b420-b4fef7fdaf23 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:00.459969 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 672/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:03.351484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83a6b-bd25-4fe5-baf7-db939fef5c31 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:03.352012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83a6b-bd25-4fe5-baf7-db939fef5c31 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:03.352012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c83a6b-bd25-4fe5-baf7-db939fef5c31 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:03.353398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 672/1344] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:03.358830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998679b3-c0c3-4ed4-a9e9-119f62270e8a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:03.359252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998679b3-c0c3-4ed4-a9e9-119f62270e8a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:03.359547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998679b3-c0c3-4ed4-a9e9-119f62270e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:03.388843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-998679b3-c0c3-4ed4-a9e9-119f62270e8a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:03.390080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-998679b3-c0c3-4ed4-a9e9-119f62270e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:03.419479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:03.470596 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 673/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:51:03.510341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83a6b-bd25-4fe5-baf7-db939fef5c31 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:03.521849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c83a6b-bd25-4fe5-baf7-db939fef5c31 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:03.526427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09362-c970-4d37-a71c-ac5fb8515be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:03.527098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09362-c970-4d37-a71c-ac5fb8515be3 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:03.527378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09362-c970-4d37-a71c-ac5fb8515be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:03.527652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09362-c970-4d37-a71c-ac5fb8515be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:03.537965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c09362-c970-4d37-a71c-ac5fb8515be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:03.539427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c09362-c970-4d37-a71c-ac5fb8515be3 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:03.549514 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 673/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:08.065321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959f50a-09d0-4433-acbb-531c7709e440 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:08.065875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959f50a-09d0-4433-acbb-531c7709e440 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:08.065970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959f50a-09d0-4433-acbb-531c7709e440 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:08.067423 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 674/1347] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:08.072671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbefa-5da3-4ca2-96f1-3e99b2095834 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:08.073167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbefa-5da3-4ca2-96f1-3e99b2095834 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:08.073279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbefa-5da3-4ca2-96f1-3e99b2095834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:08.092234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-682bbefa-5da3-4ca2-96f1-3e99b2095834 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:08.093567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-682bbefa-5da3-4ca2-96f1-3e99b2095834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:08.102509 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 674/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:08.141590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959f50a-09d0-4433-acbb-531c7709e440 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:08.152514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959f50a-09d0-4433-acbb-531c7709e440 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:08.156041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49dd3a-00d5-410f-a8be-3fd9b84a3a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:08.156674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49dd3a-00d5-410f-a8be-3fd9b84a3a2f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:08.156971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49dd3a-00d5-410f-a8be-3fd9b84a3a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:08.157252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49dd3a-00d5-410f-a8be-3fd9b84a3a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:08.166223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49dd3a-00d5-410f-a8be-3fd9b84a3a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:08.167688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49dd3a-00d5-410f-a8be-3fd9b84a3a2f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:08.177060 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 675/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:13.651962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aee0c-1bd4-4f83-95c5-0f9c5784a049 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:13.652541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aee0c-1bd4-4f83-95c5-0f9c5784a049 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:13.652541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aee0c-1bd4-4f83-95c5-0f9c5784a049 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:13.654149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 675/1350] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 21:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:13.660573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd58d9-5ba9-41c5-ae52-f90330b09e16 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:13.661365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd58d9-5ba9-41c5-ae52-f90330b09e16 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:13.661814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd58d9-5ba9-41c5-ae52-f90330b09e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:13.731330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6fcd58d9-5ba9-41c5-ae52-f90330b09e16 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:13.732785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6fcd58d9-5ba9-41c5-ae52-f90330b09e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:13.819180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 676/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 21:51:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:18.086657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=13 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:18.268580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb8d7e-b100-49a3-8764-b1cd9cfbb3e0 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:18.269070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb8d7e-b100-49a3-8764-b1cd9cfbb3e0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:18.269500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb8d7e-b100-49a3-8764-b1cd9cfbb3e0 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:18.271065 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 676/1352] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 21:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:18.276823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42477-ee02-466c-9a3c-fd33f44a3cdb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:18.277371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42477-ee02-466c-9a3c-fd33f44a3cdb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:18.277371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42477-ee02-466c-9a3c-fd33f44a3cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:18.296300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-07d42477-ee02-466c-9a3c-fd33f44a3cdb None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:18.297447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-07d42477-ee02-466c-9a3c-fd33f44a3cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:18.306455 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 677/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 21:51:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:19.977547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aa950-e1ce-463a-9698-0e97a1b4566f None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:19.978157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aa950-e1ce-463a-9698-0e97a1b4566f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:19.978157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aa950-e1ce-463a-9698-0e97a1b4566f None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:19.979432 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 677/1354] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 21:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:19.985020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaf4fe-d1c1-4580-aa92-9f9d9b459c2b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:19.985543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaf4fe-d1c1-4580-aa92-9f9d9b459c2b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:19.985735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaf4fe-d1c1-4580-aa92-9f9d9b459c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:20.004756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9edaf4fe-d1c1-4580-aa92-9f9d9b459c2b None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:20.006114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9edaf4fe-d1c1-4580-aa92-9f9d9b459c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:20.015570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 678/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 21:51:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:23.815855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9e6c7-da42-4e51-ab46-77da72cf9c3b None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:23.816316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9e6c7-da42-4e51-ab46-77da72cf9c3b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:23.816435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9e6c7-da42-4e51-ab46-77da72cf9c3b None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:23.817757 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 678/1356] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:23.824946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581cde-155f-4f16-ae4b-d494ecf17bc9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:23.826057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581cde-155f-4f16-ae4b-d494ecf17bc9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:23.826337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77581cde-155f-4f16-ae4b-d494ecf17bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:23.846923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-77581cde-155f-4f16-ae4b-d494ecf17bc9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:23.848134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77581cde-155f-4f16-ae4b-d494ecf17bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:23.856977 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 679/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:23.914768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cae13-814c-4253-a3c9-5e17a52ebd87 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:23.915595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cae13-814c-4253-a3c9-5e17a52ebd87 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:23.916097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cae13-814c-4253-a3c9-5e17a52ebd87 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:23.918476 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 679/1358] 10.222.0.30 () {54 vars in 961 bytes} [Sat Jun 18 21:51:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:23.926995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56ff52-565b-4350-bc5f-d8ff5bcdae98 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:23.927631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56ff52-565b-4350-bc5f-d8ff5bcdae98 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:23.928513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56ff52-565b-4350-bc5f-d8ff5bcdae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:23.980136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:23.988710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bb56ff52-565b-4350-bc5f-d8ff5bcdae98 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:23.990127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bb56ff52-565b-4350-bc5f-d8ff5bcdae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:24.080399 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 680/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Jun 18 21:51:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:24.088903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cae13-814c-4253-a3c9-5e17a52ebd87 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:24.103534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cae13-814c-4253-a3c9-5e17a52ebd87 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:24.109318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdeb1d-8c69-48e5-ba95-0c8d312dab3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:24.110024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdeb1d-8c69-48e5-ba95-0c8d312dab3c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:24.110370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdeb1d-8c69-48e5-ba95-0c8d312dab3c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:24.110707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdeb1d-8c69-48e5-ba95-0c8d312dab3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:24.119079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdeb1d-8c69-48e5-ba95-0c8d312dab3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:24.120736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdeb1d-8c69-48e5-ba95-0c8d312dab3c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:24.130623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 680/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:26.664333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c496-b4e2-4977-b99e-7ee24be2d7d2 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:26.664851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c496-b4e2-4977-b99e-7ee24be2d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:26.664851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c496-b4e2-4977-b99e-7ee24be2d7d2 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:26.666198 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 681/1361] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:26.671574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5db9-36a0-4ecf-9057-79670899509a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:26.672022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5db9-36a0-4ecf-9057-79670899509a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:26.672121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5db9-36a0-4ecf-9057-79670899509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:26.691824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1a5e5db9-36a0-4ecf-9057-79670899509a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:26.693015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a5e5db9-36a0-4ecf-9057-79670899509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:26.701482 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 681/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:26.746275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156c496-b4e2-4977-b99e-7ee24be2d7d2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:26.762893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156c496-b4e2-4977-b99e-7ee24be2d7d2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:26.771345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f7c49-2822-4627-9741-2983698b9e9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:26.772667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f7c49-2822-4627-9741-2983698b9e9b service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:26.773063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f7c49-2822-4627-9741-2983698b9e9b service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:26.773460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f7c49-2822-4627-9741-2983698b9e9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:26.786767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f7c49-2822-4627-9741-2983698b9e9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:26.788609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f7c49-2822-4627-9741-2983698b9e9b service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:26.799222 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 682/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:29.396193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc7fe-4f6d-47f4-aab5-03e992553a50 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:29.397196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc7fe-4f6d-47f4-aab5-03e992553a50 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:29.397688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc7fe-4f6d-47f4-aab5-03e992553a50 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:29.399557 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 682/1364] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:29.405445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f6d6-6959-4783-8478-e3010614de5a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:29.406444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f6d6-6959-4783-8478-e3010614de5a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:29.406938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f6d6-6959-4783-8478-e3010614de5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:29.426392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0654f6d6-6959-4783-8478-e3010614de5a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:29.427941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0654f6d6-6959-4783-8478-e3010614de5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:29.435965 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 683/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:29.481391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f99855-4fa0-4d84-84e1-75e5b6f602da None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:29.481679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f99855-4fa0-4d84-84e1-75e5b6f602da None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:29.481954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f99855-4fa0-4d84-84e1-75e5b6f602da None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:29.483305 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 683/1366] 10.222.0.30 () {54 vars in 961 bytes} [Sat Jun 18 21:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:29.488782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d251-9641-47b6-a254-8766e59cc970 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:29.489168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d251-9641-47b6-a254-8766e59cc970 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:29.489503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7d251-9641-47b6-a254-8766e59cc970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:29.508498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f1a7d251-9641-47b6-a254-8766e59cc970 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:29.509696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f1a7d251-9641-47b6-a254-8766e59cc970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:29.520351 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 684/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Jun 18 21:51:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:51:29.527986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f99855-4fa0-4d84-84e1-75e5b6f602da None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:29.543872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f99855-4fa0-4d84-84e1-75e5b6f602da None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:29.550147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5c75e-54a4-45ad-bc89-37291d399e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:29.550788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c75e-54a4-45ad-bc89-37291d399e58 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:29.551068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c75e-54a4-45ad-bc89-37291d399e58 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:29.551342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5c75e-54a4-45ad-bc89-37291d399e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:29.559723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c75e-54a4-45ad-bc89-37291d399e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:29.561363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5c75e-54a4-45ad-bc89-37291d399e58 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:29.571267 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 684/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:32.008675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9538-0763-404f-8779-7df873bd64a5 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:32.009221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9538-0763-404f-8779-7df873bd64a5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:32.009439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba9538-0763-404f-8779-7df873bd64a5 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:32.011300 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 685/1369] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:32.017823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90769-e92f-48e8-9e8d-4dfb43ca9524 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:32.018686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90769-e92f-48e8-9e8d-4dfb43ca9524 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:32.019118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90769-e92f-48e8-9e8d-4dfb43ca9524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:32.058511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-eec90769-e92f-48e8-9e8d-4dfb43ca9524 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:32.060021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eec90769-e92f-48e8-9e8d-4dfb43ca9524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:32.075160 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 685/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:32.124955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba9538-0763-404f-8779-7df873bd64a5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:32.148440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba9538-0763-404f-8779-7df873bd64a5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:32.169936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e803a-cc60-46fd-bc61-17e6408bad7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:32.170908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e803a-cc60-46fd-bc61-17e6408bad7f service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:32.172443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e803a-cc60-46fd-bc61-17e6408bad7f service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:32.172797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e803a-cc60-46fd-bc61-17e6408bad7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:32.189496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e803a-cc60-46fd-bc61-17e6408bad7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:32.205119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e803a-cc60-46fd-bc61-17e6408bad7f service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:32.222816 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 686/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:34.718445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78231-d4e7-4ca3-a466-ea6dee5f3706 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:34.741897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78231-d4e7-4ca3-a466-ea6dee5f3706 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:34.741897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78231-d4e7-4ca3-a466-ea6dee5f3706 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:34.742123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726a74-c4fb-4ae8-8069-d132eefc4440 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:34.742123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726a74-c4fb-4ae8-8069-d132eefc4440 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:34.742123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726a74-c4fb-4ae8-8069-d132eefc4440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:34.744622 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 686/1372] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:34.744913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5d726a74-c4fb-4ae8-8069-d132eefc4440 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:34.746424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5d726a74-c4fb-4ae8-8069-d132eefc4440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:34.761609 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 687/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:34.802961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f78231-d4e7-4ca3-a466-ea6dee5f3706 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:34.818480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f78231-d4e7-4ca3-a466-ea6dee5f3706 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:34.824526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb206b90-efcb-464a-8a26-891b0a548196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:34.826331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb206b90-efcb-464a-8a26-891b0a548196 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:34.827788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb206b90-efcb-464a-8a26-891b0a548196 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:34.828298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb206b90-efcb-464a-8a26-891b0a548196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:34.838138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb206b90-efcb-464a-8a26-891b0a548196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:34.840782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb206b90-efcb-464a-8a26-891b0a548196 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:34.863955 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 687/1374] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:36.095286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9c46-cdec-4676-859a-1ac9d2ece6ae None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:36.096434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9c46-cdec-4676-859a-1ac9d2ece6ae None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:36.096542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9c46-cdec-4676-859a-1ac9d2ece6ae None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:36.098167 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 688/1375] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:36.103595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aacfe3-9ffe-445a-bc98-1155fbf064cc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:36.104545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aacfe3-9ffe-445a-bc98-1155fbf064cc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:36.104545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aacfe3-9ffe-445a-bc98-1155fbf064cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:36.122723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d6aacfe3-9ffe-445a-bc98-1155fbf064cc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:36.131165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d6aacfe3-9ffe-445a-bc98-1155fbf064cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:36.135701 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 688/1376] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:36.454701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691307-6e1e-43d1-8ec8-00117759777d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:36.454983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691307-6e1e-43d1-8ec8-00117759777d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:36.455437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b691307-6e1e-43d1-8ec8-00117759777d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:36.457546 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 689/1377] 10.222.0.30 () {54 vars in 963 bytes} [Sat Jun 18 21:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:36.462710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890aa00-e642-45c4-a79f-49fc39c20fe1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:36.463072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890aa00-e642-45c4-a79f-49fc39c20fe1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:36.463422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890aa00-e642-45c4-a79f-49fc39c20fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:36.517087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c890aa00-e642-45c4-a79f-49fc39c20fe1 None None] MFA Rules not processed for user `028b67b31190461b96d35563506b6c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:36.518420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c890aa00-e642-45c4-a79f-49fc39c20fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:36.581054 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 689/1378] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Jun 18 21:51:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:36.589065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b691307-6e1e-43d1-8ec8-00117759777d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:36.601278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b691307-6e1e-43d1-8ec8-00117759777d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:36.605181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89607ef-a399-46e6-ad42-dd70b0b0db6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:36.605874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89607ef-a399-46e6-ad42-dd70b0b0db6d service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:36.606380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89607ef-a399-46e6-ad42-dd70b0b0db6d service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:36.606677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89607ef-a399-46e6-ad42-dd70b0b0db6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:36.616411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89607ef-a399-46e6-ad42-dd70b0b0db6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:36.617871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89607ef-a399-46e6-ad42-dd70b0b0db6d service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:36.628234 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 690/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:37.425377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5796d-0a81-4560-8f2e-88067bcb90a6 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:37.425850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5796d-0a81-4560-8f2e-88067bcb90a6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:37.426044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5796d-0a81-4560-8f2e-88067bcb90a6 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:37.429896 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 690/1380] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:37.433199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe764c-309e-4f4f-80fc-76c20bb6ece9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:37.434112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe764c-309e-4f4f-80fc-76c20bb6ece9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:37.434671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe764c-309e-4f4f-80fc-76c20bb6ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:37.460693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a1fe764c-309e-4f4f-80fc-76c20bb6ece9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:37.462171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1fe764c-309e-4f4f-80fc-76c20bb6ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:37.470501 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 691/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:37.516220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5796d-0a81-4560-8f2e-88067bcb90a6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:37.531331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5796d-0a81-4560-8f2e-88067bcb90a6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:37.538784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0890caf-f55b-4463-b913-48b5f7c228e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:37.539514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890caf-f55b-4463-b913-48b5f7c228e8 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:37.539851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890caf-f55b-4463-b913-48b5f7c228e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:37.540202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890caf-f55b-4463-b913-48b5f7c228e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:37.549304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0890caf-f55b-4463-b913-48b5f7c228e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:37.551038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0890caf-f55b-4463-b913-48b5f7c228e8 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:37.562191 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 691/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:40.301652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469d86-a183-4589-9acf-0ff4e7958d2b None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:40.302276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469d86-a183-4589-9acf-0ff4e7958d2b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:40.302276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71469d86-a183-4589-9acf-0ff4e7958d2b None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:40.303600 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 692/1383] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:40.308968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf37b-5716-4372-9179-a62c34b05789 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:40.309450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf37b-5716-4372-9179-a62c34b05789 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:40.309567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf37b-5716-4372-9179-a62c34b05789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:40.328005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-eaecf37b-5716-4372-9179-a62c34b05789 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:40.329226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eaecf37b-5716-4372-9179-a62c34b05789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:40.337751 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 692/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:40.382213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71469d86-a183-4589-9acf-0ff4e7958d2b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:40.399346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71469d86-a183-4589-9acf-0ff4e7958d2b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:40.405868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083aa12-7bc5-4211-b291-13075ef6180a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:40.406517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083aa12-7bc5-4211-b291-13075ef6180a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:40.406799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083aa12-7bc5-4211-b291-13075ef6180a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:40.407077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083aa12-7bc5-4211-b291-13075ef6180a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:40.416329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083aa12-7bc5-4211-b291-13075ef6180a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:40.417976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083aa12-7bc5-4211-b291-13075ef6180a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:40.428628 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 693/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:42.755378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc7be-687b-4976-b947-22d03f2730ed None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:42.756001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc7be-687b-4976-b947-22d03f2730ed None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:42.756001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc7be-687b-4976-b947-22d03f2730ed None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:42.757315 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 693/1386] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:42.763878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b8dc-12b9-4cf5-91fb-9ac9632d3034 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:42.764383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b8dc-12b9-4cf5-91fb-9ac9632d3034 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:42.764478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88b8dc-12b9-4cf5-91fb-9ac9632d3034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:42.785279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1a88b8dc-12b9-4cf5-91fb-9ac9632d3034 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:42.786421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1a88b8dc-12b9-4cf5-91fb-9ac9632d3034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:42.794321 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 694/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:42.839931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc7be-687b-4976-b947-22d03f2730ed None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:42.856639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc7be-687b-4976-b947-22d03f2730ed None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:42.863068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef7f1b-81d1-47a6-a05a-7caf81e191b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:42.864045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef7f1b-81d1-47a6-a05a-7caf81e191b0 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:42.864406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef7f1b-81d1-47a6-a05a-7caf81e191b0 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:42.864749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef7f1b-81d1-47a6-a05a-7caf81e191b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:42.874914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef7f1b-81d1-47a6-a05a-7caf81e191b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:42.876851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef7f1b-81d1-47a6-a05a-7caf81e191b0 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:42.887640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 694/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:45.235980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15636f-6457-4146-a816-50da2f77543b None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:45.236614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15636f-6457-4146-a816-50da2f77543b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:45.236767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15636f-6457-4146-a816-50da2f77543b None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:45.238670 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 695/1389] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:45.246415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1817e-8d90-415e-9d1f-0f7e80febe72 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:45.246961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1817e-8d90-415e-9d1f-0f7e80febe72 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:45.246961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1817e-8d90-415e-9d1f-0f7e80febe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:45.265534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2eb1817e-8d90-415e-9d1f-0f7e80febe72 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:45.266792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2eb1817e-8d90-415e-9d1f-0f7e80febe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:45.274940 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 695/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:45.325410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15636f-6457-4146-a816-50da2f77543b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:45.341845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15636f-6457-4146-a816-50da2f77543b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:45.347609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053223a-b88f-48e6-bc6b-c8c94ee7c0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:45.348251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053223a-b88f-48e6-bc6b-c8c94ee7c0e1 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:45.348529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053223a-b88f-48e6-bc6b-c8c94ee7c0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:45.348802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053223a-b88f-48e6-bc6b-c8c94ee7c0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:45.357695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053223a-b88f-48e6-bc6b-c8c94ee7c0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:45.359283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053223a-b88f-48e6-bc6b-c8c94ee7c0e1 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:45.370404 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 696/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:47.724422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c8b5-5ee4-4ca3-be66-9b869478bbc9 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:47.725152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c8b5-5ee4-4ca3-be66-9b869478bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:47.725152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c8b5-5ee4-4ca3-be66-9b869478bbc9 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:47.726371 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 696/1392] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:47.731729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5950-7c61-42c0-a18a-97c3491435c7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:47.732214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5950-7c61-42c0-a18a-97c3491435c7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:47.732331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5950-7c61-42c0-a18a-97c3491435c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:47.751579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f44a5950-7c61-42c0-a18a-97c3491435c7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:47.752721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f44a5950-7c61-42c0-a18a-97c3491435c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:47.760846 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 697/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:47.818087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c8b5-5ee4-4ca3-be66-9b869478bbc9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:47.834484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c8b5-5ee4-4ca3-be66-9b869478bbc9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:47.840906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ba03d-1b16-4816-9b44-706bf2b9095f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:47.841671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba03d-1b16-4816-9b44-706bf2b9095f service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:47.841952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba03d-1b16-4816-9b44-706bf2b9095f service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:47.842226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ba03d-1b16-4816-9b44-706bf2b9095f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:47.854836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ba03d-1b16-4816-9b44-706bf2b9095f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:47.856861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ba03d-1b16-4816-9b44-706bf2b9095f service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:47.870438 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 697/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:50.398631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89a38-707c-4739-accf-2f989bcd569b None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:50.399265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89a38-707c-4739-accf-2f989bcd569b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:50.399377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89a38-707c-4739-accf-2f989bcd569b None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:50.401240 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 698/1395] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:50.408119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ebce0-0170-4ae9-bca5-741847906027 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:50.408803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ebce0-0170-4ae9-bca5-741847906027 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:50.408803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ebce0-0170-4ae9-bca5-741847906027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:50.415040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:50.431531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-795ebce0-0170-4ae9-bca5-741847906027 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:50.433501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-795ebce0-0170-4ae9-bca5-741847906027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:50.449649 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 698/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:50.516771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89a38-707c-4739-accf-2f989bcd569b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:50.533526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89a38-707c-4739-accf-2f989bcd569b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:50.539729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e51bf-c117-4b2e-8ed1-d35df0c8b311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:50.540380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e51bf-c117-4b2e-8ed1-d35df0c8b311 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:50.540656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e51bf-c117-4b2e-8ed1-d35df0c8b311 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:50.540926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e51bf-c117-4b2e-8ed1-d35df0c8b311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:50.550229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e51bf-c117-4b2e-8ed1-d35df0c8b311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:50.551805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e51bf-c117-4b2e-8ed1-d35df0c8b311 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:50.561340 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 699/1397] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:52.960597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1672-ba3b-4237-bad5-647fe20c3661 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:52.961322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1672-ba3b-4237-bad5-647fe20c3661 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:52.961322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1672-ba3b-4237-bad5-647fe20c3661 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:52.962594 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 699/1398] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:52.968175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685f45-ee99-4d9e-942c-b0ebcf28baf7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:52.968665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685f45-ee99-4d9e-942c-b0ebcf28baf7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:52.968855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09685f45-ee99-4d9e-942c-b0ebcf28baf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:52.981863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df0a54-846d-4a83-a710-061a17ee1795 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:52.982152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df0a54-846d-4a83-a710-061a17ee1795 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:52.982435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df0a54-846d-4a83-a710-061a17ee1795 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:52.983806 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 700/1399] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:51:52.987845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-09685f45-ee99-4d9e-942c-b0ebcf28baf7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:52.988846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5386-7132-4753-8714-dd32d110ca7e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:52.989195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5386-7132-4753-8714-dd32d110ca7e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:52.989469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5386-7132-4753-8714-dd32d110ca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:52.989825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-09685f45-ee99-4d9e-942c-b0ebcf28baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:52.998428 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 700/1400] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:53.007210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d14b5386-7132-4753-8714-dd32d110ca7e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:53.008414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d14b5386-7132-4753-8714-dd32d110ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:53.016387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 701/1401] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:51:53.045413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09685f45-ee99-4d9e-942c-b0ebcf28baf7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:53.058460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09685f45-ee99-4d9e-942c-b0ebcf28baf7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:53.064858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:53.065547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:53.065823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:53.066094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:53.073497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98585e00-aa2f-45d2-a65b-f2c4f01bd492 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:53.073901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98585e00-aa2f-45d2-a65b-f2c4f01bd492 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:53.074188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98585e00-aa2f-45d2-a65b-f2c4f01bd492 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:53.075146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:53.076029 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 702/1402] 10.222.0.30 () {54 vars in 962 bytes} [Sat Jun 18 21:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:53.076710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:53.080658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c4654-ed92-456f-affc-0f7db417845d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:53.080937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c4654-ed92-456f-affc-0f7db417845d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:53.081255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c4654-ed92-456f-affc-0f7db417845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:53.087323 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 701/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:53.131474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b23c4654-ed92-456f-affc-0f7db417845d None None] MFA Rules not processed for user `14f94931805a4215b22237194803d41c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:53.132661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b23c4654-ed92-456f-affc-0f7db417845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:53.201337 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 703/1404] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Jun 18 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:53.209707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:53.214516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:53.221061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66315de8-4560-45d8-a494-a8bf207b7c2e service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:53.225372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59039711-1545-46c5-80b3-81ee7ecd0d28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:53.226048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039711-1545-46c5-80b3-81ee7ecd0d28 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:53.226330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039711-1545-46c5-80b3-81ee7ecd0d28 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:53.226613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039711-1545-46c5-80b3-81ee7ecd0d28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:53.237168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039711-1545-46c5-80b3-81ee7ecd0d28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:53.238623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59039711-1545-46c5-80b3-81ee7ecd0d28 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:53.249738 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 702/1405] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:51:53.828145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae046b-d743-4e13-8fce-dc8857f7c65b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:53.828471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae046b-d743-4e13-8fce-dc8857f7c65b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:53.828717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae046b-d743-4e13-8fce-dc8857f7c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:53.876543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-18ae046b-d743-4e13-8fce-dc8857f7c65b None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:53.877791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-18ae046b-d743-4e13-8fce-dc8857f7c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:53.943856 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 704/1406] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:51:53.986233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742a5f-f42a-47be-915e-ed2893ccfa4d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:53.986766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742a5f-f42a-47be-915e-ed2893ccfa4d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:53.986766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742a5f-f42a-47be-915e-ed2893ccfa4d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:53.988205 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 703/1407] 10.222.0.30 () {54 vars in 942 bytes} [Sat Jun 18 21:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:51:53.994553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d111c-f79d-4fa9-9f2b-878036b936fa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:53.995009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d111c-f79d-4fa9-9f2b-878036b936fa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:53.995113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d111c-f79d-4fa9-9f2b-878036b936fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:54.051336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dc3d111c-f79d-4fa9-9f2b-878036b936fa None None] MFA Rules not processed for user `f2272ca86c294ec4aa96eccc1827d4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:51:54.052538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc3d111c-f79d-4fa9-9f2b-878036b936fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:51:54.061366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:54.130912 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 705/1408] 10.222.0.30 () {58 vars in 1039 bytes} [Sat Jun 18 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:51:54.140504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742a5f-f42a-47be-915e-ed2893ccfa4d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:51:54.154512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742a5f-f42a-47be-915e-ed2893ccfa4d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:51:54.159656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197fd89-fc09-445b-bec4-75665f33f9c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:51:54.160318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197fd89-fc09-445b-bec4-75665f33f9c5 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:51:54.160598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197fd89-fc09-445b-bec4-75665f33f9c5 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:51:54.160869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197fd89-fc09-445b-bec4-75665f33f9c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:51:54.169458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197fd89-fc09-445b-bec4-75665f33f9c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:51:54.171078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197fd89-fc09-445b-bec4-75665f33f9c5 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:51:54.179184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 704/1409] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 21:51:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 21:52:04.127322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=27 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:04.175826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=11 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:17.493979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb489107-b16e-4e38-b082-e385c511d533 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:17.494582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb489107-b16e-4e38-b082-e385c511d533 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:17.494582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb489107-b16e-4e38-b082-e385c511d533 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:17.496923 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 706/1410] 10.222.0.30 () {54 vars in 918 bytes} [Sat Jun 18 21:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:17.502252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e6c8-0741-43df-8729-3bf85afcaee3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:17.502699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e6c8-0741-43df-8729-3bf85afcaee3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:17.502817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e6c8-0741-43df-8729-3bf85afcaee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:17.522579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-03b9e6c8-0741-43df-8729-3bf85afcaee3 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:17.524179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-03b9e6c8-0741-43df-8729-3bf85afcaee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:17.534188 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 705/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Jun 18 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:17.553111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dadb2a-4c06-48ec-b465-1e8fe46f4a0b None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:17.553505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dadb2a-4c06-48ec-b465-1e8fe46f4a0b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:17.553907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dadb2a-4c06-48ec-b465-1e8fe46f4a0b None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:17.556024 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 707/1412] 10.222.0.30 () {54 vars in 918 bytes} [Sat Jun 18 21:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:17.562451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81bf56-425c-4ac2-b5da-3262c63d83ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:17.562735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81bf56-425c-4ac2-b5da-3262c63d83ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:17.563006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81bf56-425c-4ac2-b5da-3262c63d83ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:17.586017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4c81bf56-425c-4ac2-b5da-3262c63d83ff None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:17.587584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c81bf56-425c-4ac2-b5da-3262c63d83ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:17.601465 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 706/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Jun 18 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:20.404631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14cdc-1a0c-48e0-b16b-96527ef77cd5 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:20.405232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14cdc-1a0c-48e0-b16b-96527ef77cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:20.405232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da14cdc-1a0c-48e0-b16b-96527ef77cd5 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:20.406662 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:20.412983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2c9d-e634-4561-ba74-b5ff6b27724f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:20.413459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2c9d-e634-4561-ba74-b5ff6b27724f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:20.413577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2c9d-e634-4561-ba74-b5ff6b27724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:20.439579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8efe2c9d-e634-4561-ba74-b5ff6b27724f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:20.440810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8efe2c9d-e634-4561-ba74-b5ff6b27724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:20.450284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:20.496984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14cdc-1a0c-48e0-b16b-96527ef77cd5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:20.511923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da14cdc-1a0c-48e0-b16b-96527ef77cd5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:20.517857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ee685-ee71-455f-9a17-90ddb039b246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:20.518492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ee685-ee71-455f-9a17-90ddb039b246 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:20.518769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ee685-ee71-455f-9a17-90ddb039b246 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:20.519033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ee685-ee71-455f-9a17-90ddb039b246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:20.527358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ee685-ee71-455f-9a17-90ddb039b246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:20.529083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ee685-ee71-455f-9a17-90ddb039b246 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:20.538744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 709/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:21.507572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9d01-60e6-4f15-9f56-2c183e8e36a4 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:21.508453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9d01-60e6-4f15-9f56-2c183e8e36a4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:21.508453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b9d01-60e6-4f15-9f56-2c183e8e36a4 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:21.510700 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:21.516984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eaf10-2caf-4520-9fef-b33d739e9e57 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:21.517485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eaf10-2caf-4520-9fef-b33d739e9e57 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:21.517589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eaf10-2caf-4520-9fef-b33d739e9e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:21.535920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-983eaf10-2caf-4520-9fef-b33d739e9e57 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:21.537096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-983eaf10-2caf-4520-9fef-b33d739e9e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:21.545782 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:52:21.806960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b9d01-60e6-4f15-9f56-2c183e8e36a4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:21.823326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b9d01-60e6-4f15-9f56-2c183e8e36a4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:21.829399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d80bae-1830-42d4-9328-d4de72b904f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:21.830030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80bae-1830-42d4-9328-d4de72b904f6 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:21.830307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80bae-1830-42d4-9328-d4de72b904f6 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:21.830579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d80bae-1830-42d4-9328-d4de72b904f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:21.839122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80bae-1830-42d4-9328-d4de72b904f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:21.840694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d80bae-1830-42d4-9328-d4de72b904f6 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:21.850128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 709/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:22.754244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d790-bd44-4e55-8982-606d56efd37a None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:22.754831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d790-bd44-4e55-8982-606d56efd37a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:22.754831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d790-bd44-4e55-8982-606d56efd37a None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:22.756146 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:22.761345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f698-8aad-4525-8505-f88c551fa377 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:22.761778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f698-8aad-4525-8505-f88c551fa377 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:22.761936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f698-8aad-4525-8505-f88c551fa377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:22.782098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f639f698-8aad-4525-8505-f88c551fa377 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:22.783299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f639f698-8aad-4525-8505-f88c551fa377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:22.791677 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:22.954207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7d790-bd44-4e55-8982-606d56efd37a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:22.975389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7d790-bd44-4e55-8982-606d56efd37a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:22.981657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a163b08-3c04-4fff-ad03-1ef0a9ba5240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:22.982327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163b08-3c04-4fff-ad03-1ef0a9ba5240 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:22.982603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163b08-3c04-4fff-ad03-1ef0a9ba5240 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:22.982871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163b08-3c04-4fff-ad03-1ef0a9ba5240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:22.991167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a163b08-3c04-4fff-ad03-1ef0a9ba5240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:22.992780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a163b08-3c04-4fff-ad03-1ef0a9ba5240 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:23.002272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 712/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:23.868360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117dcd-2203-4dc9-bda0-6e942e9620fe None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:23.868922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117dcd-2203-4dc9-bda0-6e942e9620fe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:23.868922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117dcd-2203-4dc9-bda0-6e942e9620fe None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:23.871040 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:23.876491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c3ac0-b1e4-47ef-a552-86c3068dec3e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:23.876916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c3ac0-b1e4-47ef-a552-86c3068dec3e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:23.877220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c3ac0-b1e4-47ef-a552-86c3068dec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:23.897072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b79c3ac0-b1e4-47ef-a552-86c3068dec3e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:23.898284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b79c3ac0-b1e4-47ef-a552-86c3068dec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:23.907252 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:24.069488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117dcd-2203-4dc9-bda0-6e942e9620fe None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:24.086015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117dcd-2203-4dc9-bda0-6e942e9620fe None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:24.091692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee049d54-b65d-4e5e-9fd2-1441cb4e407b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:24.092362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049d54-b65d-4e5e-9fd2-1441cb4e407b service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:24.092670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049d54-b65d-4e5e-9fd2-1441cb4e407b service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:24.092947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee049d54-b65d-4e5e-9fd2-1441cb4e407b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:24.101501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049d54-b65d-4e5e-9fd2-1441cb4e407b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:24.103152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee049d54-b65d-4e5e-9fd2-1441cb4e407b service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:24.113061 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 712/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:25.014394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a84a63-abe8-4af8-a7f6-a53152eb2366 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:25.015687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a84a63-abe8-4af8-a7f6-a53152eb2366 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:25.015687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a84a63-abe8-4af8-a7f6-a53152eb2366 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:25.017393 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:25.023537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e306a7-f288-4fe0-9824-32540c80b9dc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:25.024010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e306a7-f288-4fe0-9824-32540c80b9dc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:25.024092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e306a7-f288-4fe0-9824-32540c80b9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:25.045217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-98e306a7-f288-4fe0-9824-32540c80b9dc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:25.046428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-98e306a7-f288-4fe0-9824-32540c80b9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:25.055145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:25.214979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a84a63-abe8-4af8-a7f6-a53152eb2366 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:25.232033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a84a63-abe8-4af8-a7f6-a53152eb2366 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:25.237872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae6aec-da3f-41f8-b963-95cb1637b582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:25.238502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6aec-da3f-41f8-b963-95cb1637b582 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:25.238811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6aec-da3f-41f8-b963-95cb1637b582 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:25.239083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6aec-da3f-41f8-b963-95cb1637b582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:25.247408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae6aec-da3f-41f8-b963-95cb1637b582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:25.249130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae6aec-da3f-41f8-b963-95cb1637b582 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:25.258749 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 715/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:26.077060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff150a-cd8d-463c-a857-2d7e60abf370 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:26.077856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff150a-cd8d-463c-a857-2d7e60abf370 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:26.078017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff150a-cd8d-463c-a857-2d7e60abf370 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:26.080207 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:26.085803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec820e36-ebe0-48fc-a88f-eb5496a5c7ff None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:26.086261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec820e36-ebe0-48fc-a88f-eb5496a5c7ff None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:26.086358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec820e36-ebe0-48fc-a88f-eb5496a5c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:26.106690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ec820e36-ebe0-48fc-a88f-eb5496a5c7ff None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:26.107871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ec820e36-ebe0-48fc-a88f-eb5496a5c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:26.116223 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:26.280489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff150a-cd8d-463c-a857-2d7e60abf370 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:26.296940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff150a-cd8d-463c-a857-2d7e60abf370 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:26.302854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993ef53-7165-4048-80de-d69867aaeaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:26.303488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ef53-7165-4048-80de-d69867aaeaa2 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:26.303773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ef53-7165-4048-80de-d69867aaeaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:26.304047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993ef53-7165-4048-80de-d69867aaeaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:26.313822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993ef53-7165-4048-80de-d69867aaeaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:26.316013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993ef53-7165-4048-80de-d69867aaeaa2 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:26.327968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 715/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:27.150424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782a4a0-0068-4e84-8ee2-7cda64ac7eec None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:27.151080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782a4a0-0068-4e84-8ee2-7cda64ac7eec None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:27.151080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782a4a0-0068-4e84-8ee2-7cda64ac7eec None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:27.152351 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 21:52:27.158353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202077-173e-4dbf-b4de-9706aab1b676 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:27.158821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202077-173e-4dbf-b4de-9706aab1b676 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:27.158926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13202077-173e-4dbf-b4de-9706aab1b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:27.178080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-13202077-173e-4dbf-b4de-9706aab1b676 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:27.179281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-13202077-173e-4dbf-b4de-9706aab1b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:27.188079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:27.355494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782a4a0-0068-4e84-8ee2-7cda64ac7eec None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:27.375756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782a4a0-0068-4e84-8ee2-7cda64ac7eec None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:27.382650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd7a9-2b8f-4a0f-aa7b-ab7b6d382dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:27.383296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd7a9-2b8f-4a0f-aa7b-ab7b6d382dcd service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:27.383582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd7a9-2b8f-4a0f-aa7b-ab7b6d382dcd service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:27.383855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd7a9-2b8f-4a0f-aa7b-ab7b6d382dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:27.392854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afd7a9-2b8f-4a0f-aa7b-ab7b6d382dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:27.394501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afd7a9-2b8f-4a0f-aa7b-ab7b6d382dcd service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:27.405415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 718/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:28.215403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddfcea-21c9-43bd-bc27-a7feb6e7c709 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:28.215960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddfcea-21c9-43bd-bc27-a7feb6e7c709 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:28.215960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddfcea-21c9-43bd-bc27-a7feb6e7c709 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:28.217382 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:28.222572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d681bd-021b-4071-8e5f-431c85e479bf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:28.223041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d681bd-021b-4071-8e5f-431c85e479bf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:28.223146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d681bd-021b-4071-8e5f-431c85e479bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:28.242132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f1d681bd-021b-4071-8e5f-431c85e479bf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:28.243333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f1d681bd-021b-4071-8e5f-431c85e479bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:28.251862 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:28.412868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddfcea-21c9-43bd-bc27-a7feb6e7c709 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:28.430095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddfcea-21c9-43bd-bc27-a7feb6e7c709 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:28.436260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe03efa-5883-41b2-bf2b-e7dcafa16160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:28.436903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03efa-5883-41b2-bf2b-e7dcafa16160 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:28.437211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03efa-5883-41b2-bf2b-e7dcafa16160 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:28.437490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03efa-5883-41b2-bf2b-e7dcafa16160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:28.446070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe03efa-5883-41b2-bf2b-e7dcafa16160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:28.447731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe03efa-5883-41b2-bf2b-e7dcafa16160 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:28.458046 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 718/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:29.271471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb4e6-48f9-4111-b4a9-3f9f2f4fea12 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:29.272042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb4e6-48f9-4111-b4a9-3f9f2f4fea12 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:29.272042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb4e6-48f9-4111-b4a9-3f9f2f4fea12 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:29.273353 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:29.278647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97854d-e06e-4a5c-84d0-bd59d056c397 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:29.279074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97854d-e06e-4a5c-84d0-bd59d056c397 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:29.279181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97854d-e06e-4a5c-84d0-bd59d056c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:29.298205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fb97854d-e06e-4a5c-84d0-bd59d056c397 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:29.299396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fb97854d-e06e-4a5c-84d0-bd59d056c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:29.308618 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:29.466354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb4e6-48f9-4111-b4a9-3f9f2f4fea12 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:29.481526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6deb4e6-48f9-4111-b4a9-3f9f2f4fea12 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:29.487075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374da9c0-b493-4418-997c-ea10eb65a4d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:29.487741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374da9c0-b493-4418-997c-ea10eb65a4d2 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:29.488023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374da9c0-b493-4418-997c-ea10eb65a4d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:29.488294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374da9c0-b493-4418-997c-ea10eb65a4d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:29.496497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374da9c0-b493-4418-997c-ea10eb65a4d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:29.498219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374da9c0-b493-4418-997c-ea10eb65a4d2 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:29.507709 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 721/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:31.689106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c481d3a-5236-498f-8f3f-0872cc0465aa None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:31.689850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c481d3a-5236-498f-8f3f-0872cc0465aa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:31.689850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c481d3a-5236-498f-8f3f-0872cc0465aa None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:31.691631 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:31.702029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861a9d-f792-4b0b-a2df-08a104c6d65e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:31.702782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861a9d-f792-4b0b-a2df-08a104c6d65e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:31.702935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861a9d-f792-4b0b-a2df-08a104c6d65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:31.726725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-23861a9d-f792-4b0b-a2df-08a104c6d65e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:31.727948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-23861a9d-f792-4b0b-a2df-08a104c6d65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:31.738464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:31.782013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c481d3a-5236-498f-8f3f-0872cc0465aa None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:31.793749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c481d3a-5236-498f-8f3f-0872cc0465aa None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:31.797556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4c630-c603-4961-8b6e-e9951d73fa3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:31.798197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c630-c603-4961-8b6e-e9951d73fa3c service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:31.798477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c630-c603-4961-8b6e-e9951d73fa3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:31.798750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4c630-c603-4961-8b6e-e9951d73fa3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:31.808153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c630-c603-4961-8b6e-e9951d73fa3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:31.809621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4c630-c603-4961-8b6e-e9951d73fa3c service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:31.819302 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 721/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:34.254611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960303-8994-4b50-84c5-e654a196f213 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:34.255196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960303-8994-4b50-84c5-e654a196f213 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:34.255196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960303-8994-4b50-84c5-e654a196f213 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:34.256567 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:34.262102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb393a0-d3cc-4f93-bbb6-60ed2c8c4a3e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:34.262542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb393a0-d3cc-4f93-bbb6-60ed2c8c4a3e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:34.262647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb393a0-d3cc-4f93-bbb6-60ed2c8c4a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:34.281080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5eb393a0-d3cc-4f93-bbb6-60ed2c8c4a3e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:34.282281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5eb393a0-d3cc-4f93-bbb6-60ed2c8c4a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:34.290568 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:34.330864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960303-8994-4b50-84c5-e654a196f213 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:34.348447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960303-8994-4b50-84c5-e654a196f213 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:34.354392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d3fcb-c9c9-473c-923d-3de28b8c1936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:34.355246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3fcb-c9c9-473c-923d-3de28b8c1936 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:34.355629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3fcb-c9c9-473c-923d-3de28b8c1936 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:34.355982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3fcb-c9c9-473c-923d-3de28b8c1936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:34.365426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d3fcb-c9c9-473c-923d-3de28b8c1936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:34.366873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d3fcb-c9c9-473c-923d-3de28b8c1936 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:34.376523 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 724/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:37.011938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f837b-f56c-4c73-b176-e85e97cdfcc8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:37.012459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f837b-f56c-4c73-b176-e85e97cdfcc8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:37.012459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f837b-f56c-4c73-b176-e85e97cdfcc8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:37.014763 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:37.020083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5669-7937-4d01-bdbf-f0d2c950316f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:37.020532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5669-7937-4d01-bdbf-f0d2c950316f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:37.020664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5669-7937-4d01-bdbf-f0d2c950316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:37.039476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8c6f5669-7937-4d01-bdbf-f0d2c950316f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:37.040668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c6f5669-7937-4d01-bdbf-f0d2c950316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:37.048845 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:37.089360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f837b-f56c-4c73-b176-e85e97cdfcc8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:37.091521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-763f837b-f56c-4c73-b176-e85e97cdfcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:37.106301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f837b-f56c-4c73-b176-e85e97cdfcc8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:37.110247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8ab0-7680-4291-a481-d05983967889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:37.110886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8ab0-7680-4291-a481-d05983967889 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:37.111170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8ab0-7680-4291-a481-d05983967889 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:37.111447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8ab0-7680-4291-a481-d05983967889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:37.120592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad8ab0-7680-4291-a481-d05983967889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:37.122049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad8ab0-7680-4291-a481-d05983967889 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:37.131613 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 724/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:39.585423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916afdde-1f86-4d89-ab31-2ec07e0cabc6 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:39.585977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916afdde-1f86-4d89-ab31-2ec07e0cabc6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:39.585977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916afdde-1f86-4d89-ab31-2ec07e0cabc6 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:39.588132 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:39.593630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa174b-cccd-4dc9-b11a-05eecd0044f0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:39.594116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa174b-cccd-4dc9-b11a-05eecd0044f0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:39.594220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa174b-cccd-4dc9-b11a-05eecd0044f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:39.615596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2eaa174b-cccd-4dc9-b11a-05eecd0044f0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:39.616802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2eaa174b-cccd-4dc9-b11a-05eecd0044f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:39.625154 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:39.665370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916afdde-1f86-4d89-ab31-2ec07e0cabc6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:39.678826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916afdde-1f86-4d89-ab31-2ec07e0cabc6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:39.683767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8223-7def-4d65-9988-8e0f5342b62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:39.684401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8223-7def-4d65-9988-8e0f5342b62b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:39.684707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8223-7def-4d65-9988-8e0f5342b62b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:39.684977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8223-7def-4d65-9988-8e0f5342b62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:39.694218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8223-7def-4d65-9988-8e0f5342b62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:39.695648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8223-7def-4d65-9988-8e0f5342b62b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:39.705255 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 727/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:42.152024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc9a3-b745-4fc2-b058-e692cf8937f2 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:42.152841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc9a3-b745-4fc2-b058-e692cf8937f2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:42.153395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc9a3-b745-4fc2-b058-e692cf8937f2 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:42.154788 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:42.161788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c7b1-f42e-4002-ab8e-7d8907711bce None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:42.162299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c7b1-f42e-4002-ab8e-7d8907711bce None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:42.162299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c7b1-f42e-4002-ab8e-7d8907711bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:42.189211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7c57c7b1-f42e-4002-ab8e-7d8907711bce None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:42.190421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7c57c7b1-f42e-4002-ab8e-7d8907711bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:42.199391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:52:42.239629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc9a3-b745-4fc2-b058-e692cf8937f2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:42.252105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc9a3-b745-4fc2-b058-e692cf8937f2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:42.255885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e813f-f5d7-4a6e-81b8-289b606f38d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:42.256527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e813f-f5d7-4a6e-81b8-289b606f38d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:42.256809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e813f-f5d7-4a6e-81b8-289b606f38d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:42.257089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e813f-f5d7-4a6e-81b8-289b606f38d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:42.266579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e813f-f5d7-4a6e-81b8-289b606f38d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:42.268012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e813f-f5d7-4a6e-81b8-289b606f38d3 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:42.277733 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 727/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:44.653960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e45a4b-0248-4803-b345-1125651e4e12 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:44.654550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e45a4b-0248-4803-b345-1125651e4e12 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:44.654550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e45a4b-0248-4803-b345-1125651e4e12 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:44.655966 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:44.662380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24c26e-094a-4337-a2da-65136b8172c8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:44.663031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24c26e-094a-4337-a2da-65136b8172c8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:44.663163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24c26e-094a-4337-a2da-65136b8172c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:44.673698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=70 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:44.689882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-da24c26e-094a-4337-a2da-65136b8172c8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:44.691081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-da24c26e-094a-4337-a2da-65136b8172c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:44.701389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:44.740691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e45a4b-0248-4803-b345-1125651e4e12 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:44.746844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=64 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:44.755942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e45a4b-0248-4803-b345-1125651e4e12 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:44.761751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1c5f2-49ee-4f35-b73e-4d9bc83a54ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:44.762735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1c5f2-49ee-4f35-b73e-4d9bc83a54ec service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:44.762994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1c5f2-49ee-4f35-b73e-4d9bc83a54ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:44.763273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1c5f2-49ee-4f35-b73e-4d9bc83a54ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:44.772874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1c5f2-49ee-4f35-b73e-4d9bc83a54ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:44.774357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1c5f2-49ee-4f35-b73e-4d9bc83a54ec service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:44.785160 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 730/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:47.154621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17db9-8bff-4e0b-9acc-0e6b3fd8e0eb None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:47.155499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17db9-8bff-4e0b-9acc-0e6b3fd8e0eb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:47.155499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17db9-8bff-4e0b-9acc-0e6b3fd8e0eb None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:47.157824 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:47.163298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc55a-113c-4354-9e84-734a6ddc6683 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:47.163776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc55a-113c-4354-9e84-734a6ddc6683 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:47.163872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc55a-113c-4354-9e84-734a6ddc6683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:47.182474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-63ddc55a-113c-4354-9e84-734a6ddc6683 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:47.183667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-63ddc55a-113c-4354-9e84-734a6ddc6683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:47.192091 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:47.237326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e17db9-8bff-4e0b-9acc-0e6b3fd8e0eb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:47.256856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e17db9-8bff-4e0b-9acc-0e6b3fd8e0eb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:47.262747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0887f15-d6e8-4656-ab25-8f13fd58bd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:47.263429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0887f15-d6e8-4656-ab25-8f13fd58bd31 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:47.263691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0887f15-d6e8-4656-ab25-8f13fd58bd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:47.263964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0887f15-d6e8-4656-ab25-8f13fd58bd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:47.274397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0887f15-d6e8-4656-ab25-8f13fd58bd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:47.275841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0887f15-d6e8-4656-ab25-8f13fd58bd31 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:47.286179 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 730/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:49.639427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d5b9-2ab3-46f9-8718-85e874475b2d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:49.640279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d5b9-2ab3-46f9-8718-85e874475b2d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:49.640279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d5b9-2ab3-46f9-8718-85e874475b2d None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:49.642564 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:49.651389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bffd0-c876-4d93-b4b8-6754d55e3183 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:49.651816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bffd0-c876-4d93-b4b8-6754d55e3183 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:49.651968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bffd0-c876-4d93-b4b8-6754d55e3183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:49.672319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7a8bffd0-c876-4d93-b4b8-6754d55e3183 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:49.673561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a8bffd0-c876-4d93-b4b8-6754d55e3183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:49.681849 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:49.724563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d5b9-2ab3-46f9-8718-85e874475b2d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:49.742505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d5b9-2ab3-46f9-8718-85e874475b2d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:49.748470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfeef3-551e-4b9d-8478-6fd0d56be396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:49.749153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfeef3-551e-4b9d-8478-6fd0d56be396 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:49.749438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfeef3-551e-4b9d-8478-6fd0d56be396 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:49.749708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfeef3-551e-4b9d-8478-6fd0d56be396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:49.758960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfeef3-551e-4b9d-8478-6fd0d56be396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:49.760402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfeef3-551e-4b9d-8478-6fd0d56be396 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:49.769980 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 733/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:52.111203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163148f-4083-42f9-b27c-a6e3da08bdd3 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:52.112077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163148f-4083-42f9-b27c-a6e3da08bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:52.112077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163148f-4083-42f9-b27c-a6e3da08bdd3 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:52.114349 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:52.122908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5d5f-3f49-4610-aeae-ef8a160ec4a6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:52.123661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5d5f-3f49-4610-aeae-ef8a160ec4a6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:52.123941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f5d5f-3f49-4610-aeae-ef8a160ec4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:52.143016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-309f5d5f-3f49-4610-aeae-ef8a160ec4a6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:52.144218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-309f5d5f-3f49-4610-aeae-ef8a160ec4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:52.153726 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:52.202043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163148f-4083-42f9-b27c-a6e3da08bdd3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:52.213953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163148f-4083-42f9-b27c-a6e3da08bdd3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:52.218152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b65d4b-84f3-4065-af99-483194de406d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:52.218795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65d4b-84f3-4065-af99-483194de406d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:52.219070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65d4b-84f3-4065-af99-483194de406d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:52.219361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b65d4b-84f3-4065-af99-483194de406d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:52.229534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b65d4b-84f3-4065-af99-483194de406d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:52.230973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b65d4b-84f3-4065-af99-483194de406d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:52.240773 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 733/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:54.552019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11259d5-5222-4e9d-9d3c-c7b49a3cd4e2 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:54.552607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11259d5-5222-4e9d-9d3c-c7b49a3cd4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:54.552607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11259d5-5222-4e9d-9d3c-c7b49a3cd4e2 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:54.553968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:52:54.560680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581acc3-4c08-43fe-a057-44c6c99fe5e8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:54.561156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581acc3-4c08-43fe-a057-44c6c99fe5e8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:54.561264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581acc3-4c08-43fe-a057-44c6c99fe5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:54.585273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a581acc3-4c08-43fe-a057-44c6c99fe5e8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:52:54.586474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a581acc3-4c08-43fe-a057-44c6c99fe5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:52:54.594430 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:52:54.632364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11259d5-5222-4e9d-9d3c-c7b49a3cd4e2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:52:54.645334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11259d5-5222-4e9d-9d3c-c7b49a3cd4e2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:52:54.649528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008d4f6-0717-431b-bba1-30496dab729c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:52:54.650166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008d4f6-0717-431b-bba1-30496dab729c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:52:54.650452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008d4f6-0717-431b-bba1-30496dab729c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:52:54.650727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008d4f6-0717-431b-bba1-30496dab729c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:52:54.660477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008d4f6-0717-431b-bba1-30496dab729c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:52:54.661951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008d4f6-0717-431b-bba1-30496dab729c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:52:54.671809 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 736/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:53:04.579130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=20 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:04.667271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=23 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:31.617653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b31f-2a55-4e8d-9120-c831067cf241 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:31.618288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b31f-2a55-4e8d-9120-c831067cf241 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:31.618288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b31f-2a55-4e8d-9120-c831067cf241 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:31.619582 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 735/1471] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:31.625009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1ce4-76d8-41e8-b29b-94538cfe3ead None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:31.625485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1ce4-76d8-41e8-b29b-94538cfe3ead None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:31.625612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1ce4-76d8-41e8-b29b-94538cfe3ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:31.643759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3aac1ce4-76d8-41e8-b29b-94538cfe3ead None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:31.644928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3aac1ce4-76d8-41e8-b29b-94538cfe3ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:31.653315 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 737/1472] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:53:31.704729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc09ec-4292-442f-9ef2-2a1679bd7dc2 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:31.705461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc09ec-4292-442f-9ef2-2a1679bd7dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:31.705871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc09ec-4292-442f-9ef2-2a1679bd7dc2 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:31.707994 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 736/1473] 10.222.0.30 () {54 vars in 962 bytes} [Sat Jun 18 21:53:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:31.713198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259765d-c5c7-4ffe-bb0a-aa743ad9c3b3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:31.713484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259765d-c5c7-4ffe-bb0a-aa743ad9c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:31.713871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259765d-c5c7-4ffe-bb0a-aa743ad9c3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:31.732737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a259765d-c5c7-4ffe-bb0a-aa743ad9c3b3 None None] MFA Rules not processed for user `14f94931805a4215b22237194803d41c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:31.733947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a259765d-c5c7-4ffe-bb0a-aa743ad9c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:31.740517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 738/1474] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Jun 18 21:53:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:53:31.747859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc09ec-4292-442f-9ef2-2a1679bd7dc2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:53:31.759877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc09ec-4292-442f-9ef2-2a1679bd7dc2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:53:31.764033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c81d6-807a-4ed2-8676-7318fd590d83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:53:31.764671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c81d6-807a-4ed2-8676-7318fd590d83 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:31.764950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c81d6-807a-4ed2-8676-7318fd590d83 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:31.765253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c81d6-807a-4ed2-8676-7318fd590d83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:31.774495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c81d6-807a-4ed2-8676-7318fd590d83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:53:31.775917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c81d6-807a-4ed2-8676-7318fd590d83 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:53:31.786941 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 737/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:53:34.177927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25416c3-8526-4919-97e4-8918d5ea7802 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:34.178476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25416c3-8526-4919-97e4-8918d5ea7802 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:34.178476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25416c3-8526-4919-97e4-8918d5ea7802 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:34.180003 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 739/1476] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:34.185721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312d0b-aca6-4879-9545-4fdafa4f69d6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:34.186178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312d0b-aca6-4879-9545-4fdafa4f69d6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:34.186288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312d0b-aca6-4879-9545-4fdafa4f69d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:34.211868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ca312d0b-aca6-4879-9545-4fdafa4f69d6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:34.213168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ca312d0b-aca6-4879-9545-4fdafa4f69d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:34.222325 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 738/1477] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:53:34.247041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25416c3-8526-4919-97e4-8918d5ea7802 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:53:34.261331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25416c3-8526-4919-97e4-8918d5ea7802 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:53:34.266254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356539-d8c2-4f37-b63e-4ec8ee085a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:53:34.266898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356539-d8c2-4f37-b63e-4ec8ee085a90 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:34.267134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356539-d8c2-4f37-b63e-4ec8ee085a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:34.267430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356539-d8c2-4f37-b63e-4ec8ee085a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:34.268133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14356539-d8c2-4f37-b63e-4ec8ee085a90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:53:34.269919 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-14356539-d8c2-4f37-b63e-4ec8ee085a90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:53:34.269919 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 21:53:34.269919 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 21:53:34.271048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14356539-d8c2-4f37-b63e-4ec8ee085a90 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:53:34.290323 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 740/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Sat Jun 18 21:53:34 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:53:36.639987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2059e-c60a-4c36-a903-d83b5553a096 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:36.640552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2059e-c60a-4c36-a903-d83b5553a096 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:36.640552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2059e-c60a-4c36-a903-d83b5553a096 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:36.641941 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 739/1479] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:36.648502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc4d1d-ccde-4027-be0c-fc1d5a9bc2b8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:36.649344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc4d1d-ccde-4027-be0c-fc1d5a9bc2b8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:36.649524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc4d1d-ccde-4027-be0c-fc1d5a9bc2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:36.675324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e5cc4d1d-ccde-4027-be0c-fc1d5a9bc2b8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:36.676503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e5cc4d1d-ccde-4027-be0c-fc1d5a9bc2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:36.685766 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 741/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:53:36.736464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2059e-c60a-4c36-a903-d83b5553a096 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:53:36.755555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2059e-c60a-4c36-a903-d83b5553a096 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:53:36.763473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272f2a5-caae-41c3-aa91-13067b979653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:53:36.764134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272f2a5-caae-41c3-aa91-13067b979653 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:36.764410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272f2a5-caae-41c3-aa91-13067b979653 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:36.764683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272f2a5-caae-41c3-aa91-13067b979653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:36.773989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272f2a5-caae-41c3-aa91-13067b979653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:53:36.776224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272f2a5-caae-41c3-aa91-13067b979653 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:53:36.788346 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 740/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:53:39.254229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca235a-2bff-4bfd-b107-ff44923c073b None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:39.254806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca235a-2bff-4bfd-b107-ff44923c073b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:39.254806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca235a-2bff-4bfd-b107-ff44923c073b None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:39.256079 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 742/1482] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:39.262573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7252a02-f581-4046-a0c6-6a7f9fd45e6e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:39.263341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7252a02-f581-4046-a0c6-6a7f9fd45e6e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:39.263504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7252a02-f581-4046-a0c6-6a7f9fd45e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:39.286247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a7252a02-f581-4046-a0c6-6a7f9fd45e6e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:39.287439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a7252a02-f581-4046-a0c6-6a7f9fd45e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:39.296170 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 741/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:53:39.333704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca235a-2bff-4bfd-b107-ff44923c073b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:53:39.345590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca235a-2bff-4bfd-b107-ff44923c073b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:53:39.349255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeab4b-9d0d-4ac8-8fa2-86e9a5729aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:53:39.349885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeab4b-9d0d-4ac8-8fa2-86e9a5729aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:39.350168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeab4b-9d0d-4ac8-8fa2-86e9a5729aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:39.350421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeab4b-9d0d-4ac8-8fa2-86e9a5729aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:39.360105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeab4b-9d0d-4ac8-8fa2-86e9a5729aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:53:39.361666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeab4b-9d0d-4ac8-8fa2-86e9a5729aa9 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:53:39.371614 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 743/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:53:41.720420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63963a4e-a883-4660-bc84-87e3fab1374a None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:41.721003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63963a4e-a883-4660-bc84-87e3fab1374a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:41.721003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63963a4e-a883-4660-bc84-87e3fab1374a None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:41.722379 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 742/1485] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:41.728403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907825d4-6470-44e3-bd8d-755957f2e316 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:41.728893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907825d4-6470-44e3-bd8d-755957f2e316 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:41.729368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907825d4-6470-44e3-bd8d-755957f2e316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:41.750938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-907825d4-6470-44e3-bd8d-755957f2e316 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:41.752141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-907825d4-6470-44e3-bd8d-755957f2e316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:41.761511 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 744/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:53:41.811061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63963a4e-a883-4660-bc84-87e3fab1374a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:53:41.822293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63963a4e-a883-4660-bc84-87e3fab1374a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:53:41.826257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca200b-f2ae-4a84-b0a0-7811986ca9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:53:41.826899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca200b-f2ae-4a84-b0a0-7811986ca9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:41.827175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca200b-f2ae-4a84-b0a0-7811986ca9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:41.827446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca200b-f2ae-4a84-b0a0-7811986ca9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:41.837699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca200b-f2ae-4a84-b0a0-7811986ca9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:53:41.839172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca200b-f2ae-4a84-b0a0-7811986ca9e5 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:53:41.849440 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 743/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 21:53:44.255486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b007e-6614-47e7-a243-a33df4025829 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:44.256056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b007e-6614-47e7-a243-a33df4025829 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:44.256056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b007e-6614-47e7-a243-a33df4025829 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:44.257465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 745/1488] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:44.263819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc6c5-e4b0-4b63-abe0-921d4515e47c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:44.264245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc6c5-e4b0-4b63-abe0-921d4515e47c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:44.264604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bc6c5-e4b0-4b63-abe0-921d4515e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:44.287479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-567bc6c5-e4b0-4b63-abe0-921d4515e47c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:44.288687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-567bc6c5-e4b0-4b63-abe0-921d4515e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:44.297400 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 744/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:53:44.338558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b007e-6614-47e7-a243-a33df4025829 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:53:44.351243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b007e-6614-47e7-a243-a33df4025829 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:53:44.355320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9fc9f-ac46-4bad-95d1-ff6a93ab0f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:53:44.355951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9fc9f-ac46-4bad-95d1-ff6a93ab0f81 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:44.356233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9fc9f-ac46-4bad-95d1-ff6a93ab0f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:44.356504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9fc9f-ac46-4bad-95d1-ff6a93ab0f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:44.367412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9fc9f-ac46-4bad-95d1-ff6a93ab0f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:53:44.368868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9fc9f-ac46-4bad-95d1-ff6a93ab0f81 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:53:44.378911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 746/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:53:46.880005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd9296-5f38-41ba-91f4-ec6e7eeddc48 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:46.880573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd9296-5f38-41ba-91f4-ec6e7eeddc48 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:46.880573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd9296-5f38-41ba-91f4-ec6e7eeddc48 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:46.882024 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 745/1491] 10.222.0.30 () {54 vars in 926 bytes} [Sat Jun 18 21:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:53:46.890604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e963a-0de6-4fcf-8f7c-704adb819b8c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:46.891064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e963a-0de6-4fcf-8f7c-704adb819b8c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:46.891169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e963a-0de6-4fcf-8f7c-704adb819b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:46.911552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9d2e963a-0de6-4fcf-8f7c-704adb819b8c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:53:46.912756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9d2e963a-0de6-4fcf-8f7c-704adb819b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:53:46.921271 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 747/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Sat Jun 18 21:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:53:46.961577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd9296-5f38-41ba-91f4-ec6e7eeddc48 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:53:46.973626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd9296-5f38-41ba-91f4-ec6e7eeddc48 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:53:46.977251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad899-0b0c-4eec-8df6-c605201a012b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:53:46.977892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad899-0b0c-4eec-8df6-c605201a012b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:53:46.978177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad899-0b0c-4eec-8df6-c605201a012b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:53:46.978453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad899-0b0c-4eec-8df6-c605201a012b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:53:46.988226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bad899-0b0c-4eec-8df6-c605201a012b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:53:46.989708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bad899-0b0c-4eec-8df6-c605201a012b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:53:46.999366 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 746/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:53:56.906193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=33 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:56.995134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=33 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:44.253487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acf4c-a082-442e-9e84-7b9f8f715bbf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.254075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acf4c-a082-442e-9e84-7b9f8f715bbf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.254075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acf4c-a082-442e-9e84-7b9f8f715bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.272666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e13acf4c-a082-442e-9e84-7b9f8f715bbf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:55:44.273880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e13acf4c-a082-442e-9e84-7b9f8f715bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:55:44.282433 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 748/1494] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 21:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:55:44.292870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aa33c-0f0a-459e-ae5a-d469d7525bff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.293447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aa33c-0f0a-459e-ae5a-d469d7525bff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.293447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aa33c-0f0a-459e-ae5a-d469d7525bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.320761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-767aa33c-0f0a-459e-ae5a-d469d7525bff None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:55:44.322092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-767aa33c-0f0a-459e-ae5a-d469d7525bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:55:44.331306 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 747/1495] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 21:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:55:44.335838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acf4c-a082-442e-9e84-7b9f8f715bbf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:44.346018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acf4c-a082-442e-9e84-7b9f8f715bbf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:44.351087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:44.351734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.352007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.352275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.353009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 21:55:44.353343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:44.354343 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:44.354343 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 21:55:44.354343 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 21:55:44.355218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:44.367536 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 749/1496] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 21:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:55:44.375657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aa33c-0f0a-459e-ae5a-d469d7525bff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:44.385419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aa33c-0f0a-459e-ae5a-d469d7525bff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:44.390602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:44.391271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.391546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.391819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.392502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:44.394264 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:44.394264 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 21:55:44.394264 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 21:55:44.395444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:44.434575 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 748/1497] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 21:55:44 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:55:44.439610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:44.455039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25b66-fbe7-4201-ae38-fad3a78923e0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:44.513832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:44.514427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.514696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.514970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.515662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:44.516686 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:44.516686 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 21:55:44.516686 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 21:55:44.517932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:44.539609 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 750/1498] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 21:55:44 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 21:55:44.543770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:44.553983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff419a-be6a-4933-b3cc-326cda57d595 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:44.558516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:44.559204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.559571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.559847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.560579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:44.561664 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:44.561664 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 21:55:44.561664 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 21:55:44.562562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:44.575330 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 749/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 21:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:55:44.579521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:44.589602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe65b8b-c2fb-40f7-be36-a58bee652404 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:44.594253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bcd9d-6fa8-4586-b71f-9798e736194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:44.594901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bcd9d-6fa8-4586-b71f-9798e736194b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.595179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bcd9d-6fa8-4586-b71f-9798e736194b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.595453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bcd9d-6fa8-4586-b71f-9798e736194b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.596176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bcd9d-6fa8-4586-b71f-9798e736194b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:44.597224 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-4d3bcd9d-6fa8-4586-b71f-9798e736194b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:44.597224 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 21:55:44.597224 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 21:55:44.598112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bcd9d-6fa8-4586-b71f-9798e736194b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:44.611247 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 751/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 21:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 21:55:44.615365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:44.625242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708bdf7-417a-4e76-b87c-e6f805f6b517 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:44.630219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae4758-9451-4f6b-8a1b-79b38b64e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:44.631106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae4758-9451-4f6b-8a1b-79b38b64e808 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.631369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae4758-9451-4f6b-8a1b-79b38b64e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.631639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae4758-9451-4f6b-8a1b-79b38b64e808 admin admin] PATH_INFO: `/v3/projects/36a2c933a76e44c4b6dbb95d9eb08770/users/73286b89f0d34c4eaf1930af9398d52e/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.647023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae4758-9451-4f6b-8a1b-79b38b64e808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a2c933a76e44c4b6dbb95d9eb08770, user_id=73286b89f0d34c4eaf1930af9398d52e, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:44.648048 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-e4ae4758-9451-4f6b-8a1b-79b38b64e808 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:44.648048 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 21:55:44.648048 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 21:55:44.650008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae4758-9451-4f6b-8a1b-79b38b64e808 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:44.667576 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 750/1501] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 21:55:44 2022] PUT /identity/v3/projects/36a2c933a76e44c4b6dbb95d9eb08770/users/73286b89f0d34c4eaf1930af9398d52e/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:55:44.678893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e163e4c-9532-42d0-a303-58354eac78d0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.679181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e163e4c-9532-42d0-a303-58354eac78d0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.679450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e163e4c-9532-42d0-a303-58354eac78d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.706038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0e163e4c-9532-42d0-a303-58354eac78d0 None None] MFA Rules not processed for user `73286b89f0d34c4eaf1930af9398d52e`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:55:44.707248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0e163e4c-9532-42d0-a303-58354eac78d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:55:44.774210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 752/1502] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 21:55:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:55:44.788508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef2843-5e0d-4111-90c4-a03f099ce617 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.788854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef2843-5e0d-4111-90c4-a03f099ce617 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.789293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef2843-5e0d-4111-90c4-a03f099ce617 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.791100 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 751/1503] 10.222.0.30 () {54 vars in 963 bytes} [Sat Jun 18 21:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:55:44.797448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca6e35-6aa8-46b0-ba05-f80182583d44 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.797735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca6e35-6aa8-46b0-ba05-f80182583d44 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.798008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca6e35-6aa8-46b0-ba05-f80182583d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.818282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-60ca6e35-6aa8-46b0-ba05-f80182583d44 None None] MFA Rules not processed for user `028b67b31190461b96d35563506b6c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:55:44.819495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-60ca6e35-6aa8-46b0-ba05-f80182583d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:55:44.862826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:44.873275 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 753/1504] 10.222.0.30 () {58 vars in 1060 bytes} [Sat Jun 18 21:55:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 21:55:44.885391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef2843-5e0d-4111-90c4-a03f099ce617 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:44.896812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef2843-5e0d-4111-90c4-a03f099ce617 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:44.901050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:44.901699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.901979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.902253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.910855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:44.912392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:44.922097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 752/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:55:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 21:55:44.964905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f24c-39e2-4bb8-9906-613ab1301f89 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:44.965231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f24c-39e2-4bb8-9906-613ab1301f89 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:44.965507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f24c-39e2-4bb8-9906-613ab1301f89 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:44.966807 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 754/1506] 10.222.0.30 () {52 vars in 829 bytes} [Sat Jun 18 21:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:55:44.970515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:45.038420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f9555-f485-4519-9daf-939b574e3ea6 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:45.043564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:45.044486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:45.044790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:45.045073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] PATH_INFO: `/v3/users/73286b89f0d34c4eaf1930af9398d52e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:45.046431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73286b89f0d34c4eaf1930af9398d52e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:45.047488 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:45.047488 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 21:55:45.047488 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 21:55:45.048702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:45.116924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73286b89f0d34c4eaf1930af9398d52e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.117676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73286b89f0d34c4eaf1930af9398d52e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.137819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73286b89f0d34c4eaf1930af9398d52e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.138696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73286b89f0d34c4eaf1930af9398d52e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.154043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73286b89f0d34c4eaf1930af9398d52e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.158151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:45.172507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 753/1507] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 21:55:44 2022] DELETE /identity/v3/users/73286b89f0d34c4eaf1930af9398d52e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:55:45.177054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:45.177351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:45.177632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:45.197008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:55:45.198226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:55:45.265007 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 755/1508] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 21:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:55:45.275633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:45.277387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:55:45.342307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b635026-540e-40c5-aaf0-dcc5d54baba4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:45.346782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37a6c-952b-4f72-ba1b-7ef48dbf352b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:45.347441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37a6c-952b-4f72-ba1b-7ef48dbf352b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:45.347743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37a6c-952b-4f72-ba1b-7ef48dbf352b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:45.348024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37a6c-952b-4f72-ba1b-7ef48dbf352b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:45.358125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a37a6c-952b-4f72-ba1b-7ef48dbf352b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:45.359576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a37a6c-952b-4f72-ba1b-7ef48dbf352b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:45.369400 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 754/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:55:45.714307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:55:45.716176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:55:45.730156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc5088-2d32-4395-a2d8-b7b593d7612f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:55:45.734846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:55:45.735793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:55:45.736095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:55:45.736353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] PATH_INFO: `/v3/projects/36a2c933a76e44c4b6dbb95d9eb08770` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:55:45.737566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a2c933a76e44c4b6dbb95d9eb08770)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:55:45.738597 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:55:45.738597 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 21:55:45.738597 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 21:55:45.741132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:55:45.805114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a2c933a76e44c4b6dbb95d9eb08770', 'request_id': 'req-89e7f159-6b98-4c11-9ed4-cf525ba6004b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.818335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a2c933a76e44c4b6dbb95d9eb08770', 'request_id': 'req-89e7f159-6b98-4c11-9ed4-cf525ba6004b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.828509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a2c933a76e44c4b6dbb95d9eb08770', 'request_id': 'req-89e7f159-6b98-4c11-9ed4-cf525ba6004b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.840625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] The token cache is being invalidate because project 36a2c933a76e44c4b6dbb95d9eb08770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 21:55:45.841241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.841889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e7f159-6b98-4c11-9ed4-cf525ba6004b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 21:55:45.843568 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 756/1510] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 21:55:45 2022] DELETE /identity/v3/projects/36a2c933a76e44c4b6dbb95d9eb08770 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 21:55:55.365232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:55:55.837175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:58:55.104221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834614f4-eb82-4601-a3a8-fb36841ccfe8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:58:55.105205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834614f4-eb82-4601-a3a8-fb36841ccfe8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:58:55.105205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834614f4-eb82-4601-a3a8-fb36841ccfe8 None None] PATH_INFO: `/v3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:58:55.107132 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 755/1511] 10.222.0.25 () {54 vars in 925 bytes} [Sat Jun 18 21:58:55 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:58:55.142728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ba8b-a013-4561-bd5c-79ed56287304 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:58:55.143221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ba8b-a013-4561-bd5c-79ed56287304 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:58:55.143333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ba8b-a013-4561-bd5c-79ed56287304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:58:55.164800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d209ba8b-a013-4561-bd5c-79ed56287304 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:58:55.166098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d209ba8b-a013-4561-bd5c-79ed56287304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:58:55.234745 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 757/1512] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Jun 18 21:58:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:58:59.263382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bef264-40c9-44e1-a4ec-834d6a73431d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:58:59.264004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bef264-40c9-44e1-a4ec-834d6a73431d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:58:59.264004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bef264-40c9-44e1-a4ec-834d6a73431d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:58:59.265419 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 756/1513] 10.222.0.30 () {54 vars in 960 bytes} [Sat Jun 18 21:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:58:59.270606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae125f7-c2e6-49b0-a5e5-15f855136528 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:58:59.271067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae125f7-c2e6-49b0-a5e5-15f855136528 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:58:59.271164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae125f7-c2e6-49b0-a5e5-15f855136528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:58:59.291102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3ae125f7-c2e6-49b0-a5e5-15f855136528 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:58:59.292304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3ae125f7-c2e6-49b0-a5e5-15f855136528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:58:59.301996 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 758/1514] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Jun 18 21:58:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:58:59.310017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bef264-40c9-44e1-a4ec-834d6a73431d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:58:59.325559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bef264-40c9-44e1-a4ec-834d6a73431d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:58:59.330785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b1778-1868-42fc-961a-81000b4526f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:58:59.331422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b1778-1868-42fc-961a-81000b4526f8 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:58:59.331707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b1778-1868-42fc-961a-81000b4526f8 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:58:59.331985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b1778-1868-42fc-961a-81000b4526f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:58:59.340359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b1778-1868-42fc-961a-81000b4526f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:58:59.341960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b1778-1868-42fc-961a-81000b4526f8 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:58:59.351572 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 757/1515] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:58:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:59:00.318200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19a04c-a03e-4e27-8e48-16956fc7239d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:00.318763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19a04c-a03e-4e27-8e48-16956fc7239d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:00.318763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19a04c-a03e-4e27-8e48-16956fc7239d None None] PATH_INFO: `/v3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:00.320074 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 759/1516] 10.222.0.26 () {54 vars in 925 bytes} [Sat Jun 18 21:59:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 21:59:00.327113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612081-f740-463c-b7bb-a7353259bcc6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:00.327731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612081-f740-463c-b7bb-a7353259bcc6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:00.327868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47612081-f740-463c-b7bb-a7353259bcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:00.348563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-47612081-f740-463c-b7bb-a7353259bcc6 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:59:00.349822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47612081-f740-463c-b7bb-a7353259bcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:59:00.360195 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 758/1517] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Jun 18 21:59:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:59:04.036694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19a04c-a03e-4e27-8e48-16956fc7239d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:59:04.052027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19a04c-a03e-4e27-8e48-16956fc7239d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:59:04.058391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0feb8b-9248-457e-96ec-02a1203828cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:59:04.059027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0feb8b-9248-457e-96ec-02a1203828cd service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:04.059306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0feb8b-9248-457e-96ec-02a1203828cd service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:04.059570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0feb8b-9248-457e-96ec-02a1203828cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:04.068356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0feb8b-9248-457e-96ec-02a1203828cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:59:04.069993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0feb8b-9248-457e-96ec-02a1203828cd service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:59:04.080064 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 760/1518] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:59:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:59:10.343248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:14.076013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=38 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:33.088603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f0f5-1500-48e1-88ca-be0ce09ae55b None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:33.089182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f0f5-1500-48e1-88ca-be0ce09ae55b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:33.089297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8f0f5-1500-48e1-88ca-be0ce09ae55b None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:33.092036 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 759/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:59:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:59:33.099352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751294a8-f240-4f73-af02-6ed039698e50 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:33.099773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751294a8-f240-4f73-af02-6ed039698e50 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:33.099911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751294a8-f240-4f73-af02-6ed039698e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:33.120346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-751294a8-f240-4f73-af02-6ed039698e50 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:59:33.122136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-751294a8-f240-4f73-af02-6ed039698e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:59:33.189891 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 761/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:59:33.357436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8f0f5-1500-48e1-88ca-be0ce09ae55b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:59:33.360628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-57f8f0f5-1500-48e1-88ca-be0ce09ae55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:59:33.450068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8f0f5-1500-48e1-88ca-be0ce09ae55b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:59:33.456181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b0020-a4bf-4151-8d7e-cd62a117142a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:59:33.456900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b0020-a4bf-4151-8d7e-cd62a117142a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:33.457203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b0020-a4bf-4151-8d7e-cd62a117142a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:33.457497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b0020-a4bf-4151-8d7e-cd62a117142a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:33.466317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b0020-a4bf-4151-8d7e-cd62a117142a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:59:33.467911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b0020-a4bf-4151-8d7e-cd62a117142a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:59:33.479373 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 760/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:59:34.313217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd32f-62ea-4638-a7d7-fa7fa81faaa9 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:34.314063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd32f-62ea-4638-a7d7-fa7fa81faaa9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:34.314063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd32f-62ea-4638-a7d7-fa7fa81faaa9 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:34.316172 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 18 21:59:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:59:34.321449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71825b-2ac4-470e-9e8b-65c0d1db3e79 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:34.321920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71825b-2ac4-470e-9e8b-65c0d1db3e79 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:34.321999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71825b-2ac4-470e-9e8b-65c0d1db3e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:34.342228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3c71825b-2ac4-470e-9e8b-65c0d1db3e79 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:59:34.343422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3c71825b-2ac4-470e-9e8b-65c0d1db3e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:59:34.352114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 18 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:59:34.511440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd32f-62ea-4638-a7d7-fa7fa81faaa9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:59:34.528328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd32f-62ea-4638-a7d7-fa7fa81faaa9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:59:34.534052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0ddd7-2f16-4228-bd6f-a4b5cc7be82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:59:34.534685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ddd7-2f16-4228-bd6f-a4b5cc7be82d service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:34.535050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ddd7-2f16-4228-bd6f-a4b5cc7be82d service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:34.535350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0ddd7-2f16-4228-bd6f-a4b5cc7be82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:34.543296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0ddd7-2f16-4228-bd6f-a4b5cc7be82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:59:34.544903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0ddd7-2f16-4228-bd6f-a4b5cc7be82d service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:59:34.554131 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 763/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:59:38.690403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfdb0c-57f2-4755-9ae3-f01ccef8331f None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:38.691325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfdb0c-57f2-4755-9ae3-f01ccef8331f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:38.691325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfdb0c-57f2-4755-9ae3-f01ccef8331f None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:38.693135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:59:38.699801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260ab1-3d83-4083-86d1-45379e0994eb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:38.700583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260ab1-3d83-4083-86d1-45379e0994eb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:38.700758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260ab1-3d83-4083-86d1-45379e0994eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:38.723096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-af260ab1-3d83-4083-86d1-45379e0994eb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:59:38.724303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-af260ab1-3d83-4083-86d1-45379e0994eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:59:38.733781 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:59:38.773349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfdb0c-57f2-4755-9ae3-f01ccef8331f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:59:38.776240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f2bfdb0c-57f2-4755-9ae3-f01ccef8331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:59:38.847039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfdb0c-57f2-4755-9ae3-f01ccef8331f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:59:38.850599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31876e1e-3f5b-4ad4-adb7-9a39cce41e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:59:38.851246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876e1e-3f5b-4ad4-adb7-9a39cce41e50 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:38.851535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876e1e-3f5b-4ad4-adb7-9a39cce41e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:38.851797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876e1e-3f5b-4ad4-adb7-9a39cce41e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:38.860706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31876e1e-3f5b-4ad4-adb7-9a39cce41e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:59:38.862161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31876e1e-3f5b-4ad4-adb7-9a39cce41e50 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:59:38.871471 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 763/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:59:41.137012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e136e-75aa-463c-9ec8-bac390d6223c None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:41.137603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e136e-75aa-463c-9ec8-bac390d6223c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:41.137603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e136e-75aa-463c-9ec8-bac390d6223c None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:41.139025 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 18 21:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 21:59:41.146340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb45ee-2cc7-4614-9b25-1a8c303d280b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:41.146791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb45ee-2cc7-4614-9b25-1a8c303d280b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:41.146917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb45ee-2cc7-4614-9b25-1a8c303d280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:41.165705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2fcb45ee-2cc7-4614-9b25-1a8c303d280b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 21:59:41.166889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2fcb45ee-2cc7-4614-9b25-1a8c303d280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 21:59:41.175432 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 18 21:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 21:59:41.217877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e136e-75aa-463c-9ec8-bac390d6223c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 21:59:41.230424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e136e-75aa-463c-9ec8-bac390d6223c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 21:59:41.235141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69e511-ea2c-4abb-8689-8f36e24a8df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 21:59:41.235829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69e511-ea2c-4abb-8689-8f36e24a8df3 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 21:59:41.236144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69e511-ea2c-4abb-8689-8f36e24a8df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 21:59:41.236416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69e511-ea2c-4abb-8689-8f36e24a8df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 21:59:41.246639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69e511-ea2c-4abb-8689-8f36e24a8df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 21:59:41.248124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69e511-ea2c-4abb-8689-8f36e24a8df3 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 21:59:41.258744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 766/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 21:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 21:59:51.160422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=66 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:51.253963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=42 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:00:30.840971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101cff-04df-4dcd-b8fb-b24fa48ceba3 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:00:30.841623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101cff-04df-4dcd-b8fb-b24fa48ceba3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:00:30.841623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101cff-04df-4dcd-b8fb-b24fa48ceba3 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:00:30.843239 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 765/1531] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:00:30.849635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15318-97ca-40c6-97d9-b4cfeddb0c3f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:00:30.850124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15318-97ca-40c6-97d9-b4cfeddb0c3f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:00:30.850230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15318-97ca-40c6-97d9-b4cfeddb0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:00:30.870856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6de15318-97ca-40c6-97d9-b4cfeddb0c3f None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:00:30.872049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6de15318-97ca-40c6-97d9-b4cfeddb0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:00:30.881836 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 767/1532] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:00:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:00:40.863689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:08.829087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98d42-bd6a-4ab0-8da8-99863cac0d3e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:08.829645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98d42-bd6a-4ab0-8da8-99863cac0d3e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:08.829645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98d42-bd6a-4ab0-8da8-99863cac0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:08.923981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e5e98d42-bd6a-4ab0-8da8-99863cac0d3e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:08.925258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5e98d42-bd6a-4ab0-8da8-99863cac0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.006988 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 766/1533] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.020349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed865485-cc74-4b54-bd8f-b6d7e69be5ef None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.021506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed865485-cc74-4b54-bd8f-b6d7e69be5ef None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.021997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed865485-cc74-4b54-bd8f-b6d7e69be5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.067798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ed865485-cc74-4b54-bd8f-b6d7e69be5ef None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.069380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ed865485-cc74-4b54-bd8f-b6d7e69be5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.084936 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 768/1534] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.090676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98d42-bd6a-4ab0-8da8-99863cac0d3e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.114776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98d42-bd6a-4ab0-8da8-99863cac0d3e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.133185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.133912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.134193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.134471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.135251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:09.135559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.136630 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:09.136630 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:01:09.136630 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:01:09.137577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.159018 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 767/1535] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:01:09.168544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed865485-cc74-4b54-bd8f-b6d7e69be5ef None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.183046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed865485-cc74-4b54-bd8f-b6d7e69be5ef None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.192501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7da5b9-5ae9-4b07-9e28-80bcbe0e6844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.193624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da5b9-5ae9-4b07-9e28-80bcbe0e6844 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.194991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da5b9-5ae9-4b07-9e28-80bcbe0e6844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.195516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da5b9-5ae9-4b07-9e28-80bcbe0e6844 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.196492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7da5b9-5ae9-4b07-9e28-80bcbe0e6844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.197819 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-ef7da5b9-5ae9-4b07-9e28-80bcbe0e6844 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:09.197819 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:01:09.197819 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:01:09.199410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7da5b9-5ae9-4b07-9e28-80bcbe0e6844 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.256103 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 769/1536] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:09.260524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.277316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680aa72-7b6b-4e1f-8ae5-7633579795ad admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.294242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7050e0-1353-4d93-846f-7aa119587f31 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.294242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7050e0-1353-4d93-846f-7aa119587f31 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.294242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7050e0-1353-4d93-846f-7aa119587f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.317808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9b7050e0-1353-4d93-846f-7aa119587f31 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.319387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9b7050e0-1353-4d93-846f-7aa119587f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.406781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cca7e-5214-4439-8d9f-66ec20044057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.408953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cca7e-5214-4439-8d9f-66ec20044057 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.409577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cca7e-5214-4439-8d9f-66ec20044057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.410454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cca7e-5214-4439-8d9f-66ec20044057 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.411446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cca7e-5214-4439-8d9f-66ec20044057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.412740 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-439cca7e-5214-4439-8d9f-66ec20044057 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:09.412740 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:01:09.412740 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:01:09.414325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cca7e-5214-4439-8d9f-66ec20044057 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.461269 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 768/1537] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:09.463190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1519a9-b3d7-4a3d-bf00-89a783620a56 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.463719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1519a9-b3d7-4a3d-bf00-89a783620a56 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.464258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1519a9-b3d7-4a3d-bf00-89a783620a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.474182 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 770/1538] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:09.475228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7050e0-1353-4d93-846f-7aa119587f31 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.500521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7050e0-1353-4d93-846f-7aa119587f31 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.517799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb75f8f-007a-4004-9558-943d51befa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.519070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1a1519a9-b3d7-4a3d-bf00-89a783620a56 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.519404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75f8f-007a-4004-9558-943d51befa97 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.519596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75f8f-007a-4004-9558-943d51befa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.519878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb75f8f-007a-4004-9558-943d51befa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.520632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb75f8f-007a-4004-9558-943d51befa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.521404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1a1519a9-b3d7-4a3d-bf00-89a783620a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.522305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb75f8f-007a-4004-9558-943d51befa97 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.539016 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 769/1539] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.540705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d4d8-59f1-4586-a219-d7c5f5c7845b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.541226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d4d8-59f1-4586-a219-d7c5f5c7845b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.541508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33d4d8-59f1-4586-a219-d7c5f5c7845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.542825 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 771/1540] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:09.544158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c2d9f-9762-46c8-8de0-4692bea6d95f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.544498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c2d9f-9762-46c8-8de0-4692bea6d95f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.544721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c2d9f-9762-46c8-8de0-4692bea6d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.575385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ea33d4d8-59f1-4586-a219-d7c5f5c7845b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.575385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ea33d4d8-59f1-4586-a219-d7c5f5c7845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.593580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 770/1541] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.595023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6153-d071-4b6e-9457-8e5a06c62628 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.595325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6153-d071-4b6e-9457-8e5a06c62628 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.595603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b6153-d071-4b6e-9457-8e5a06c62628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.598401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-af6c2d9f-9762-46c8-8de0-4692bea6d95f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.599991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-af6c2d9f-9762-46c8-8de0-4692bea6d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.616713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 772/1542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.618537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c2d9f-9762-46c8-8de0-4692bea6d95f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.626199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-694b6153-d071-4b6e-9457-8e5a06c62628 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.627703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-694b6153-d071-4b6e-9457-8e5a06c62628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.639593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c2d9f-9762-46c8-8de0-4692bea6d95f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.648465 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 771/1543] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.652681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97d57d-da8d-43c9-8e56-f5d6a3120c69 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.653347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97d57d-da8d-43c9-8e56-f5d6a3120c69 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.654217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577d97c-177d-48f3-96a1-6ac62407fda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.654734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97d57d-da8d-43c9-8e56-f5d6a3120c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.657324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d97c-177d-48f3-96a1-6ac62407fda6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.657834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d97c-177d-48f3-96a1-6ac62407fda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.658283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d97c-177d-48f3-96a1-6ac62407fda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.659253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d97c-177d-48f3-96a1-6ac62407fda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.661437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d97c-177d-48f3-96a1-6ac62407fda6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.673553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 773/1544] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:09.675869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8d2da-5795-42a5-8779-034a88c7cb3f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.675869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8d2da-5795-42a5-8779-034a88c7cb3f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.675869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8d2da-5795-42a5-8779-034a88c7cb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.680434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-be97d57d-da8d-43c9-8e56-f5d6a3120c69 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.681700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-be97d57d-da8d-43c9-8e56-f5d6a3120c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.698961 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 772/1545] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.700260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97d57d-da8d-43c9-8e56-f5d6a3120c69 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.701178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dab8d2da-5795-42a5-8779-034a88c7cb3f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.702366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dab8d2da-5795-42a5-8779-034a88c7cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.712054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97d57d-da8d-43c9-8e56-f5d6a3120c69 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.713118 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 774/1546] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.714430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516db6b4-ca8b-41dd-b136-56dfd18cf5a9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.714722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516db6b4-ca8b-41dd-b136-56dfd18cf5a9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.714997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516db6b4-ca8b-41dd-b136-56dfd18cf5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.717410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e750953-ab08-45f0-931e-48a870bd6f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.718080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e750953-ab08-45f0-931e-48a870bd6f28 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.718361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e750953-ab08-45f0-931e-48a870bd6f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.718633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e750953-ab08-45f0-931e-48a870bd6f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.719373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e750953-ab08-45f0-931e-48a870bd6f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:09.719685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e750953-ab08-45f0-931e-48a870bd6f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.721405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e750953-ab08-45f0-931e-48a870bd6f28 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.734599 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 773/1547] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:09.735055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-516db6b4-ca8b-41dd-b136-56dfd18cf5a9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.736020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcbf14-5e14-41e3-91dd-e760962ec381 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.736312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcbf14-5e14-41e3-91dd-e760962ec381 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.736587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcbf14-5e14-41e3-91dd-e760962ec381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.736834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-516db6b4-ca8b-41dd-b136-56dfd18cf5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.745533 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 775/1548] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.747088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0865ca-2a91-4fd1-b712-33dc5bd650a7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.747526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0865ca-2a91-4fd1-b712-33dc5bd650a7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.747933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0865ca-2a91-4fd1-b712-33dc5bd650a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.751588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:09.757845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2dbcbf14-5e14-41e3-91dd-e760962ec381 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.759954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2dbcbf14-5e14-41e3-91dd-e760962ec381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.769261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0b0865ca-2a91-4fd1-b712-33dc5bd650a7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.770640 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 774/1549] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.770753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0b0865ca-2a91-4fd1-b712-33dc5bd650a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.771441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcbf14-5e14-41e3-91dd-e760962ec381 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.782337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcbf14-5e14-41e3-91dd-e760962ec381 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.785729 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 776/1550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.786149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605244e-85d0-43a1-82b7-5e30364e0f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.786672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0865ca-2a91-4fd1-b712-33dc5bd650a7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.787037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605244e-85d0-43a1-82b7-5e30364e0f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.787362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605244e-85d0-43a1-82b7-5e30364e0f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.787583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605244e-85d0-43a1-82b7-5e30364e0f3c admin admin] PATH_INFO: `/v3/projects/05fb7827566a4697aafaabd852648009/users/527452ed2cd048bb95b0194a9ac5f919/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.798602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0865ca-2a91-4fd1-b712-33dc5bd650a7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.803435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605244e-85d0-43a1-82b7-5e30364e0f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05fb7827566a4697aafaabd852648009, user_id=527452ed2cd048bb95b0194a9ac5f919, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.806170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605244e-85d0-43a1-82b7-5e30364e0f3c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.809625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.810305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.810595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.810874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.811613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:09.811966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.814283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.824447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 775/1551] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:09 2022] PUT /identity/v3/projects/05fb7827566a4697aafaabd852648009/users/527452ed2cd048bb95b0194a9ac5f919/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:09.826083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1672f65-64de-449f-b7ed-1502c9b69ee1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.826373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1672f65-64de-449f-b7ed-1502c9b69ee1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.826736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1672f65-64de-449f-b7ed-1502c9b69ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.829172 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 777/1552] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:09.830181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.843562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc21393-28ea-4305-be02-bd3b63e5b177 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.851977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a1672f65-64de-449f-b7ed-1502c9b69ee1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.853214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1672f65-64de-449f-b7ed-1502c9b69ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:09.907790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c01e55-8d59-4ddb-a0fd-b12a7c6ef29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.909525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c01e55-8d59-4ddb-a0fd-b12a7c6ef29c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.910157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c01e55-8d59-4ddb-a0fd-b12a7c6ef29c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.910560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c01e55-8d59-4ddb-a0fd-b12a7c6ef29c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.911283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c01e55-8d59-4ddb-a0fd-b12a7c6ef29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.913579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c01e55-8d59-4ddb-a0fd-b12a7c6ef29c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.921426 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 776/1553] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:09.921426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1672f65-64de-449f-b7ed-1502c9b69ee1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.928987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1672f65-64de-449f-b7ed-1502c9b69ee1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.933991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:09.934706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.934987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.935263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.936013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:09.936318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:09.936409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:09.938048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:09.952435 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 777/1554] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:09.953759 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 778/1555] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:09.953990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:09.955390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e39bb-579f-45f0-998b-30fc030cc66d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:09.955854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e39bb-579f-45f0-998b-30fc030cc66d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:09.956358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e39bb-579f-45f0-998b-30fc030cc66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:09.971634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38bc1d-3cb2-4a66-9b58-36987c17bf02 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:09.984652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-771e39bb-579f-45f0-998b-30fc030cc66d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:09.985919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-771e39bb-579f-45f0-998b-30fc030cc66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:10.036676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2043f7-9070-414f-a5b4-84313b0f7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.037414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2043f7-9070-414f-a5b4-84313b0f7426 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.037910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2043f7-9070-414f-a5b4-84313b0f7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.038016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2043f7-9070-414f-a5b4-84313b0f7426 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.038911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2043f7-9070-414f-a5b4-84313b0f7426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:10.039220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2043f7-9070-414f-a5b4-84313b0f7426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.040998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2043f7-9070-414f-a5b4-84313b0f7426 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.045751 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 779/1556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:10.047139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14595-3c61-4b6c-9d31-b669f03d4528 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.047430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14595-3c61-4b6c-9d31-b669f03d4528 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.047712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c14595-3c61-4b6c-9d31-b669f03d4528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.061367 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 778/1557] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:10.061367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050740-573f-43a6-b8eb-9ae963882c9f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.061367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050740-573f-43a6-b8eb-9ae963882c9f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.061367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050740-573f-43a6-b8eb-9ae963882c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.067702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e5c14595-3c61-4b6c-9d31-b669f03d4528 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:10.068896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e5c14595-3c61-4b6c-9d31-b669f03d4528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:10.077064 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 780/1558] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:10.078136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14595-3c61-4b6c-9d31-b669f03d4528 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.084047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-62050740-573f-43a6-b8eb-9ae963882c9f None None] MFA Rules not processed for user `527452ed2cd048bb95b0194a9ac5f919`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:10.085291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-62050740-573f-43a6-b8eb-9ae963882c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:10.087797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c14595-3c61-4b6c-9d31-b669f03d4528 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.092543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.093330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.093625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.093895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.094727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.096617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.122548 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 781/1559] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.123771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.130951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:10.153949 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 779/1560] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:10.155062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050740-573f-43a6-b8eb-9ae963882c9f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.165441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050740-573f-43a6-b8eb-9ae963882c9f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.189070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39d55e-34be-4299-8be9-da7370ee82b4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.194878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.195557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.195856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.196110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.196859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:10.197201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.198983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.210905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 782/1561] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:10.211767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.221451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4edec-e4e4-4585-966b-80abef097da1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.223731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.224584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.224867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.225181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.225881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.226216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c758d-a641-45da-ad00-cf9f4c51bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.226860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c758d-a641-45da-ad00-cf9f4c51bda3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.227138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c758d-a641-45da-ad00-cf9f4c51bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.227413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c758d-a641-45da-ad00-cf9f4c51bda3 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.227832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.228118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c758d-a641-45da-ad00-cf9f4c51bda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.230180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c758d-a641-45da-ad00-cf9f4c51bda3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.251319 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 783/1562] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.252827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c15f-fe07-4a67-8703-1460f1c807c7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.253211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c15f-fe07-4a67-8703-1460f1c807c7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.253459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c15f-fe07-4a67-8703-1460f1c807c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.263328 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 780/1563] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.263328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.271921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c8c7c15f-fe07-4a67-8703-1460f1c807c7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:10.273184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c8c7c15f-fe07-4a67-8703-1460f1c807c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:10.313469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:10.324713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ff4e6-8ae3-4f5b-836e-d23c57a6bc32 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.329356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.330052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.330335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.330612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.331304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.333249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.337859 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 784/1564] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:10.337859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c15f-fe07-4a67-8703-1460f1c807c7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.346536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c15f-fe07-4a67-8703-1460f1c807c7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.351408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.352066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.352348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.352632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.353396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:10.353699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.355448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.365139 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 781/1565] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.365975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.375405 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 785/1566] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:10.375405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.385505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893e21f-19eb-44f7-9b71-1ae4fe465a57 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.429692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73907-d03c-4925-ad1b-a4027ec3a689 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.430791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:10.435911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.436604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.437184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.438263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.438983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.441401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.451428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.451947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.452224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.452495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.453251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.455585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.465641 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 782/1567] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.466635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.480201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ed16-2252-4e53-90aa-d687e7f14019 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.485805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.486253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 786/1568] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.486472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.486768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.487039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.487332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.487859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.490278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.520485 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 783/1569] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.521653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.552009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c266-c7e2-4d21-81f9-39137fbc9e96 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.586686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403f890-42f3-4274-a061-232861bdd0e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.591501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.592177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.592465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.592772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.593529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.595487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.608684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.609435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.609716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.610032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.610828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.612378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.617081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 784/1570] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.617993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.624456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:10.624456 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 787/1571] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:10.624456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.630236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4368d-088a-4316-b375-b9e3b0bcbc3a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.635359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.636022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.636304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.636581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.636718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad213a4e-67ce-4c0a-ae75-e5d203270e15 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.637324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:10.637648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.639260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.641589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.642230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.642510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.642786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.643468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.645462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.651562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 785/1572] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:10.652340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.669837 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 788/1573] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.669837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.670109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e96be-cd7e-4a5d-8d8f-220b600b5cbd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.673851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.674578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.674912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.675191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.675880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.677699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377eeaa-86ce-4edb-83c2-f6ef58bb8cd0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.677809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.682238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.682873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.683152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.683533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.684259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.685898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.697631 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 789/1574] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:10.698475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.706517 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 786/1575] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.707333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.709213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a12a75-0371-4a0b-8550-04d0348661fd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.765300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.765984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.766266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.766541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.767231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.769239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.774153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa354d-5013-4f0b-9503-2445a84a5be9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.779740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.780580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.781114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.781528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.782566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.784927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.789880 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 790/1576] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.790846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.800646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536031-c517-4dc9-8125-fcaa7ed8a411 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.805631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.806277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.806560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.806830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.807571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.811346 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 787/1577] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.811346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.811576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.819420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27464d81-3e06-46db-b178-2241c38fc552 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.823112 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 791/1578] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:10.823112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.824417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.825115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.825463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.825728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.826491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.828133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.830379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:10.830812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b181b-6e6b-4ae7-ad25-c85df07d81a0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.835685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.836333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.836637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.836950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.837633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.839524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.840503 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 788/1579] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:10.841583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.852342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a22ed-6b26-44a1-bfb1-8da8ef846f48 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.857528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.858358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.858613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.858921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.859936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.861696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.869256 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 792/1580] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.870163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.872502 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 789/1581] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:10.876112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.885970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f1a5-6ac8-49b8-a15c-7b11f76aa705 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.934019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ba11d-4b71-4069-905c-cad03c3e5324 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.938728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.939404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.939685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.939962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.940759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.942715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.943041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.943715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.943996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.944272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.944965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.946991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.952921 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 793/1582] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:10.953804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.964261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ef65d-6aaa-407a-afdd-6379e5c2a021 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.969001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.969727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.970009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.970281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.970992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.971757 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 790/1583] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:10 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:10.972713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.974311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.982793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b8907-c15a-4cc9-9c09-b4f1e4333e2a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:10.987894 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 794/1584] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:10.987894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:10.990669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:10.991304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:10.991591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:10.991973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:10.992680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:10.994340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:10.997192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43007a3b-a365-4b22-abae-8dc98bea63ae admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.001877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.002519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.002799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.003099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.003814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.007547 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 791/1585] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.007547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.007750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.015165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e57b7b-418e-4d46-8bcc-24df38b68d4e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.020787 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 795/1586] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.020787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.020975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.020975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.021165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.021465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] PATH_INFO: `/v3/projects/eef7682803134c0fbd77a6507f1afd58/users/148e3357369d426185e41f2538f657b2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.023897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:11.029571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc6291-a349-468e-b628-056a30c88a53 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.037918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.038685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.038966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.039233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.039946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.041382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef7682803134c0fbd77a6507f1afd58, user_id=148e3357369d426185e41f2538f657b2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.042097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.044058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.057545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 792/1587] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/eef7682803134c0fbd77a6507f1afd58/users/148e3357369d426185e41f2538f657b2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:11.058364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.064461 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 796/1588] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:11.064461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.077306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85893-331d-48d4-98a8-50411d85c7e7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.129391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24e20-f6dd-4a7b-874b-4e1384012043 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.133632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.133926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.134523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.134630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.134799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.134886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.135091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] PATH_INFO: `/v3/projects/454d2ab18dd84eaf8bbd1e2808159df7/users/75df001919794fd7a2e79cdfbd87cfd6/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.135178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.135835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.137509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.147373 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 793/1589] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.148172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.149826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454d2ab18dd84eaf8bbd1e2808159df7, user_id=75df001919794fd7a2e79cdfbd87cfd6, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.151156 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:11.151156 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:01:11.151156 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:01:11.153207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.157746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cc580-d3bc-474b-a337-f6e821a76e5c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.162533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.163242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.163545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.163802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.164517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.166128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.167391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 797/1590] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/454d2ab18dd84eaf8bbd1e2808159df7/users/75df001919794fd7a2e79cdfbd87cfd6/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:11.168138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.180908 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 794/1591] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.182273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.193066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec02da5-dbc6-4a83-b8b0-929f6b6200f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.217577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:11.237334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d9fc6-5362-4d18-b893-5d82931b0b52 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.243177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.244015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.244298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.244576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] PATH_INFO: `/v3/projects/2c58028484194776b7abe2610381a92a/users/1b306439e7bb4b46b0e877a70d9471e1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.252290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.253261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.253572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.253853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.254588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.256201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.259666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c58028484194776b7abe2610381a92a, user_id=1b306439e7bb4b46b0e877a70d9471e1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.262368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.271915 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 795/1592] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.272851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.277112 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 798/1593] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/2c58028484194776b7abe2610381a92a/users/1b306439e7bb4b46b0e877a70d9471e1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:11.280729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.285167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54615672-d95e-4f02-95f4-5ac4dc8f2588 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.333579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:11.345881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.346836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.347111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.347206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36595d2f-350a-4b4a-8f2c-bafb91f7b6d3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.347388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] PATH_INFO: `/v3/projects/33e8de4c73e54b0a8df321b3b3b65c28/users/65d884def116435eb153d424395308d2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.351855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4cf6e-6720-4712-9fea-f87ed5435e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.352528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cf6e-6720-4712-9fea-f87ed5435e65 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.352810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cf6e-6720-4712-9fea-f87ed5435e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.353124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cf6e-6720-4712-9fea-f87ed5435e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.353859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4cf6e-6720-4712-9fea-f87ed5435e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.355465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4cf6e-6720-4712-9fea-f87ed5435e65 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.361953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e8de4c73e54b0a8df321b3b3b65c28, user_id=65d884def116435eb153d424395308d2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.364712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.365519 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 799/1594] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.366739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d50bc-443b-4775-b842-cbf8700855e0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.367039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d50bc-443b-4775-b842-cbf8700855e0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.367311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d50bc-443b-4775-b842-cbf8700855e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.378576 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 796/1595] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/33e8de4c73e54b0a8df321b3b3b65c28/users/65d884def116435eb153d424395308d2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:11.379495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.394764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ce6d50bc-443b-4775-b842-cbf8700855e0 None None] MFA Rules not processed for user `148e3357369d426185e41f2538f657b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:11.396116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce6d50bc-443b-4775-b842-cbf8700855e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:11.451019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6eb9-3289-46ab-b5b6-a3756003504a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.456955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.457990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.458313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.458591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] PATH_INFO: `/v3/projects/dad7b33b97ba48a6a4989ff35985a4ca/users/79c12f29545c40ec955650696bb91a65/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.461328 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 800/1596] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:11.465908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe3e1-08e6-4b1a-8050-716340586721 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.466192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe3e1-08e6-4b1a-8050-716340586721 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.466464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabe3e1-08e6-4b1a-8050-716340586721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.473875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad7b33b97ba48a6a4989ff35985a4ca, user_id=79c12f29545c40ec955650696bb91a65, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.476555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.490013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 797/1597] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/dad7b33b97ba48a6a4989ff35985a4ca/users/79c12f29545c40ec955650696bb91a65/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:11.494201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.498040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9fabe3e1-08e6-4b1a-8050-716340586721 None None] MFA Rules not processed for user `75df001919794fd7a2e79cdfbd87cfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:11.499458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9fabe3e1-08e6-4b1a-8050-716340586721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:11.522012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:11.555595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffce8c-4f01-48bc-a6b0-f6ad2ff63c46 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.560423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.561150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.561437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.561715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.562461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.564070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.567950 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 801/1598] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:11.568841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabe3e1-08e6-4b1a-8050-716340586721 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.574950 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 798/1599] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.575950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.583764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabe3e1-08e6-4b1a-8050-716340586721 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.586490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f873619-dfa8-4959-852e-8cc29e558517 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.588760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ab760-49de-489a-a24c-53e0ece91ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.589760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab760-49de-489a-a24c-53e0ece91ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.590083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab760-49de-489a-a24c-53e0ece91ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.590355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab760-49de-489a-a24c-53e0ece91ea3 admin admin] PATH_INFO: `/v3/projects/d9f244c1df9c4ca19ec5fa57b7d94bc6/users/c9ae6d217f7344408eed23388dd337b7/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.591283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.591928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.592325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.592791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.593567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.595159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.605502 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 799/1600] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.605633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ab760-49de-489a-a24c-53e0ece91ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f244c1df9c4ca19ec5fa57b7d94bc6, user_id=c9ae6d217f7344408eed23388dd337b7, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.606379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.608181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ab760-49de-489a-a24c-53e0ece91ea3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.616601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6715512-c268-4e50-912c-40e248ffa13c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.632936 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 802/1601] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/d9f244c1df9c4ca19ec5fa57b7d94bc6/users/c9ae6d217f7344408eed23388dd337b7/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:11.632936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900077b-2044-4635-bd77-ea3b0629ef05 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.632936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900077b-2044-4635-bd77-ea3b0629ef05 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.632936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900077b-2044-4635-bd77-ea3b0629ef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.650789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b900077b-2044-4635-bd77-ea3b0629ef05 None None] MFA Rules not processed for user `65d884def116435eb153d424395308d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:11.652003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b900077b-2044-4635-bd77-ea3b0629ef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:11.676468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.677358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.677636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.677910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.678961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.680354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.684871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:11.694988 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 800/1602] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:11.695954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.706580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08a7a-eda0-4670-bbce-e968ae269c72 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.712566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.713375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.713653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.713978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.714666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.716760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.733247 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 803/1603] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:11.734784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942ea8-55c2-462b-89ac-00d59500e7ad None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.735078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942ea8-55c2-462b-89ac-00d59500e7ad None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.735668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942ea8-55c2-462b-89ac-00d59500e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.752153 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 801/1604] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:11.753378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.759406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-29942ea8-55c2-462b-89ac-00d59500e7ad None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:11.760608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-29942ea8-55c2-462b-89ac-00d59500e7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:11.827919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1fd8-827f-407b-9c8c-3190fba5471f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.833090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.833979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.834460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.834910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.835816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.837188 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 804/1605] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:11.838328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.838525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942ea8-55c2-462b-89ac-00d59500e7ad None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.848740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942ea8-55c2-462b-89ac-00d59500e7ad None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:11.854496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28befb53-f054-493d-9fbc-324539c783bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:11.855616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28befb53-f054-493d-9fbc-324539c783bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.856026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28befb53-f054-493d-9fbc-324539c783bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.856374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28befb53-f054-493d-9fbc-324539c783bc admin admin] PATH_INFO: `/v3/projects/1fb96b5dfee44bce9c62d65298d2f403/users/7c99f583b5ca45179c8d7706d5f156e9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.870678 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 802/1606] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:11.871549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:11.873215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28befb53-f054-493d-9fbc-324539c783bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb96b5dfee44bce9c62d65298d2f403, user_id=7c99f583b5ca45179c8d7706d5f156e9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:11.875897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28befb53-f054-493d-9fbc-324539c783bc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:11.885852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:11.893184 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 805/1607] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/1fb96b5dfee44bce9c62d65298d2f403/users/7c99f583b5ca45179c8d7706d5f156e9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:11.895010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560176e-70fe-434a-83bb-f61c7c7506a3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:11.895457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560176e-70fe-434a-83bb-f61c7c7506a3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:11.895729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560176e-70fe-434a-83bb-f61c7c7506a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:11.934645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7560176e-70fe-434a-83bb-f61c7c7506a3 None None] MFA Rules not processed for user `c9ae6d217f7344408eed23388dd337b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:11.936255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7560176e-70fe-434a-83bb-f61c7c7506a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:11.942036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d47fc-20c1-4f36-b8a7-d525eaabf5ee admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.011882 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 806/1608] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:12.012590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.012817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560176e-70fe-434a-83bb-f61c7c7506a3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.013560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.013846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.014252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] PATH_INFO: `/v3/projects/2c58028484194776b7abe2610381a92a/users/1b306439e7bb4b46b0e877a70d9471e1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.016860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c58028484194776b7abe2610381a92a, user_id=1b306439e7bb4b46b0e877a70d9471e1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.019614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.024543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560176e-70fe-434a-83bb-f61c7c7506a3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.029402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.030328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.030603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.030877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] PATH_INFO: `/v3/projects/f0bd5eb16df0471f880490e3b0c6e232/users/39db62b919d047eeb6f2594e7e54a818/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.036489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 803/1609] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:11 2022] PUT /identity/v3/projects/2c58028484194776b7abe2610381a92a/users/1b306439e7bb4b46b0e877a70d9471e1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:12.037440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.046608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bd5eb16df0471f880490e3b0c6e232, user_id=39db62b919d047eeb6f2594e7e54a818, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.049438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.064537 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 807/1610] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:12 2022] PUT /identity/v3/projects/f0bd5eb16df0471f880490e3b0c6e232/users/39db62b919d047eeb6f2594e7e54a818/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:12.065195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.078347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.112377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d931b4-3658-4f34-a8fe-538157f2ab48 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.131134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65faa-8818-4a24-8f5c-24b68285cbd6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.135785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.136526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.136742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.137012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.137758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.139696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.160757 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 808/1611] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:12.161612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.179693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.180357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.180636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.180913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.181686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.183593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.187625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.211899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 804/1612] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/projects => generated 401 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:12.212703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.248026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca05ba6-4e08-479b-8eae-e562ffc166da admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.279903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf59959-ea9f-40f7-af48-facefc27e205 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.284801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb437b3b-54ba-4755-a2aa-009969a4f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.285541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb437b3b-54ba-4755-a2aa-009969a4f9ea admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.285811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb437b3b-54ba-4755-a2aa-009969a4f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.286084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb437b3b-54ba-4755-a2aa-009969a4f9ea admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.286769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb437b3b-54ba-4755-a2aa-009969a4f9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.288649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb437b3b-54ba-4755-a2aa-009969a4f9ea admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.295834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.296486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.296763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.297069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.307360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.308878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.309011 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 805/1613] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:12.310255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d1c8-8e3e-45af-bee4-11f042535d61 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.310543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d1c8-8e3e-45af-bee4-11f042535d61 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.310941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8d1c8-8e3e-45af-bee4-11f042535d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.319726 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 809/1614] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:12.320573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.330684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7298aa-0b9c-4b43-97fa-cdb7d8927a77 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.335471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15924c61-cc77-4e93-9893-62dcc87cb689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.336139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924c61-cc77-4e93-9893-62dcc87cb689 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.336430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924c61-cc77-4e93-9893-62dcc87cb689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.336710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15924c61-cc77-4e93-9893-62dcc87cb689 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.337448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15924c61-cc77-4e93-9893-62dcc87cb689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.338690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a6f8d1c8-8e3e-45af-bee4-11f042535d61 None None] MFA Rules not processed for user `7c99f583b5ca45179c8d7706d5f156e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:12.339636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15924c61-cc77-4e93-9893-62dcc87cb689 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.340384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a6f8d1c8-8e3e-45af-bee4-11f042535d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:12.375021 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 810/1615] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:12.375021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48510c-a40e-47ad-909c-c2f37d80d745 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.375021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48510c-a40e-47ad-909c-c2f37d80d745 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.375021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48510c-a40e-47ad-909c-c2f37d80d745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.405797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ce48510c-a40e-47ad-909c-c2f37d80d745 None None] MFA Rules not processed for user `1b306439e7bb4b46b0e877a70d9471e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:12.407891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce48510c-a40e-47ad-909c-c2f37d80d745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:12.413394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.415807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 806/1616] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:12.417220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8064a-1659-44fb-a2d7-de104430cbb8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.417960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8064a-1659-44fb-a2d7-de104430cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.418290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8064a-1659-44fb-a2d7-de104430cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.447680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-48a8064a-1659-44fb-a2d7-de104430cbb8 None None] MFA Rules not processed for user `39db62b919d047eeb6f2594e7e54a818`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:12.448925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48a8064a-1659-44fb-a2d7-de104430cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:12.500731 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 811/1617] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:12.501636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48510c-a40e-47ad-909c-c2f37d80d745 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.518297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.536996 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 807/1618] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:12.536996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8064a-1659-44fb-a2d7-de104430cbb8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.585134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48510c-a40e-47ad-909c-c2f37d80d745 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.590841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.591746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.592207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.592478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.593295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.594916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.609577 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 812/1619] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:12.610474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.610936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8064a-1659-44fb-a2d7-de104430cbb8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.617634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.618501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.618647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.619187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.619886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.621445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42badb16-b6b0-49bc-9d15-f8daabeff13d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.622730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.627249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.628047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.628334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.628609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.629456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.631050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.643339 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 813/1620] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:12.644465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.649728 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 808/1621] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/users => generated 307 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:12.651804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.656416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5204b-8d55-4c83-adc0-455f9414643f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.662074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c7b4-b843-4fbd-ba38-9a7dc21fe120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.662376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca02ac2-acdc-4bbe-803b-6852bb7073b4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.662943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c7b4-b843-4fbd-ba38-9a7dc21fe120 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.663285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c7b4-b843-4fbd-ba38-9a7dc21fe120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.663621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c7b4-b843-4fbd-ba38-9a7dc21fe120 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.664400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c7b4-b843-4fbd-ba38-9a7dc21fe120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.666444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c7b4-b843-4fbd-ba38-9a7dc21fe120 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.667605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.668262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.668665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.668981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.669698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.671606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.695303 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 814/1622] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/users => generated 301 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:12.695303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55055fc0-d10b-4682-9013-1e4863345ed8 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.695303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55055fc0-d10b-4682-9013-1e4863345ed8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.695303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55055fc0-d10b-4682-9013-1e4863345ed8 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.698729 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 815/1623] 10.222.0.30 () {54 vars in 961 bytes} [Sat Jun 18 22:01:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:12.699788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55055fc0-d10b-4682-9013-1e4863345ed8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.703192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-55055fc0-d10b-4682-9013-1e4863345ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:12.716562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 809/1624] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:12.716562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.796555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93245e73-40bd-4fcf-8786-7b9486299d10 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.802759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.803658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.803934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.805479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] PATH_INFO: `/v3/projects/3e0e904279074da0b69e0dd451b4b3b7/users/8fddbab71bb146f0a99f28a80cc2471b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.812386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55055fc0-d10b-4682-9013-1e4863345ed8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.816819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.817668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.818049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.818421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.822220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0e904279074da0b69e0dd451b4b3b7, user_id=8fddbab71bb146f0a99f28a80cc2471b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.825734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.830735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.842883 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 810/1625] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:12 2022] PUT /identity/v3/projects/3e0e904279074da0b69e0dd451b4b3b7/users/8fddbab71bb146f0a99f28a80cc2471b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:12.843954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.889207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.890773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.897854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.903062 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 816/1626] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:12.904002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.916874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9e5e8-1058-475c-bbcb-993b67ec38e0 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.921819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.922515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.922780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.923049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.923898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.925946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.929332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40e29e-22e2-4917-8dd5-de285b87ed53 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.936287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328c8f8-1882-4e7e-8940-28cda52238a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.937666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328c8f8-1882-4e7e-8940-28cda52238a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.941188 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 817/1627] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:12.941188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:12.942331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328c8f8-1882-4e7e-8940-28cda52238a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.942935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328c8f8-1882-4e7e-8940-28cda52238a5 admin admin] PATH_INFO: `/v3/projects/144bae0b8f7a4d6ba5d1b6e4b41742a5/users/273d597843e74bf9a174ff58f2d27647/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.956988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d44d3d-2903-48df-82a7-4ab49b2e33a2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:12.963954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328c8f8-1882-4e7e-8940-28cda52238a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144bae0b8f7a4d6ba5d1b6e4b41742a5, user_id=273d597843e74bf9a174ff58f2d27647, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.964476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:12.965343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.965787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.966116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.966993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:12.967665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328c8f8-1882-4e7e-8940-28cda52238a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.968671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:12.983672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 811/1628] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:12 2022] PUT /identity/v3/projects/144bae0b8f7a4d6ba5d1b6e4b41742a5/users/273d597843e74bf9a174ff58f2d27647/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:12.985368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194d553-f16f-4773-b096-1dc17d0bedf0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:12.986169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194d553-f16f-4773-b096-1dc17d0bedf0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:12.986169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194d553-f16f-4773-b096-1dc17d0bedf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:12.987313 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 818/1629] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:12.988408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.002854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7be92-68e5-4305-b6a8-8825720f32a6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.010105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f194d553-f16f-4773-b096-1dc17d0bedf0 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:13.011453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f194d553-f16f-4773-b096-1dc17d0bedf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:13.076380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.077154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.077440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.077717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.078793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.081359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.097676 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 812/1630] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:13.099366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194d553-f16f-4773-b096-1dc17d0bedf0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.109864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194d553-f16f-4773-b096-1dc17d0bedf0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.114671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.115350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.115669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.116080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.116822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.118183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 819/1631] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:12 2022] POST /identity/v3/users => generated 302 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:13.119060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.121500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.131646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a9d52-8e17-4e4a-8413-c82f839fe7b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.132862 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 813/1632] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:13.133755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.140286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.142061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.142350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.142624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] PATH_INFO: `/v3/projects/ac397ade516d46dba09aa7a5376de6e6/users/cb1d29b5d2a94c1d9fda6d089d9270ee/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.146012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6ac72-ffce-4ed4-a0a3-258b6ddc7086 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.150900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.151571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.151850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.152122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.152853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.154753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.161742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac397ade516d46dba09aa7a5376de6e6, user_id=cb1d29b5d2a94c1d9fda6d089d9270ee, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.165236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.167631 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 814/1633] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:13.168445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.183115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c529c-f585-4206-aa17-45c657e7d7cd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.204178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 820/1634] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:13 2022] PUT /identity/v3/projects/ac397ade516d46dba09aa7a5376de6e6/users/cb1d29b5d2a94c1d9fda6d089d9270ee/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:13.206771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.282541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.283163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.283444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.283720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] PATH_INFO: `/v3/projects/b82f16206d8d4cd8b71a90ead54464c1/users/b1324392f6a94f0189bed37ed3548fb3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.304527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82f16206d8d4cd8b71a90ead54464c1, user_id=b1324392f6a94f0189bed37ed3548fb3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.308298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.309335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:13.333480 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 815/1635] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:13 2022] PUT /identity/v3/projects/b82f16206d8d4cd8b71a90ead54464c1/users/b1324392f6a94f0189bed37ed3548fb3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:13.335531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.337491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74ec66-808b-41ae-868d-a1b08238eee5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.372467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:13.425383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0650fc-4f78-4a00-bb95-cf070d355c10 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.431449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.432387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.432697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.433109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.434232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.435991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.436511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.437272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.437644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.438068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.453684 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 816/1636] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:13.454539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.466352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d8a32-e5d1-4636-b4fd-ff71c475e8af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.471677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.473010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.473231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.473627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] PATH_INFO: `/v3/projects/3e0e904279074da0b69e0dd451b4b3b7/users/8fddbab71bb146f0a99f28a80cc2471b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.475715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0e904279074da0b69e0dd451b4b3b7, user_id=8fddbab71bb146f0a99f28a80cc2471b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.478837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.498879 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 817/1637] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:13 2022] PUT /identity/v3/projects/3e0e904279074da0b69e0dd451b4b3b7/users/8fddbab71bb146f0a99f28a80cc2471b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:13.498879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.524684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.526670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.550069 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 821/1638] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:13.551154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.576679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103125a5-1c3c-45ad-8706-ab9d728d1767 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.587705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49132fa6-79d3-44d6-ae24-5f567d2f8a65 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.589687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.590778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.590979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.591359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.592202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.594000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.594828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.597127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.598615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.599206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] PATH_INFO: `/v3/projects/144bae0b8f7a4d6ba5d1b6e4b41742a5/users/273d597843e74bf9a174ff58f2d27647/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.604035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=144bae0b8f7a4d6ba5d1b6e4b41742a5, user_id=273d597843e74bf9a174ff58f2d27647, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.608806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.617712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 822/1639] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:13.621814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.625117 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 818/1640] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:13 2022] PUT /identity/v3/projects/144bae0b8f7a4d6ba5d1b6e4b41742a5/users/273d597843e74bf9a174ff58f2d27647/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:13.626164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.644945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd7beb-1b2a-441d-9f77-beb2579b19cc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.713907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27027efc-80bd-4c64-922f-fbf11525a13e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.723501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.724195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.725334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.725902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.727493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.730910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.751507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 819/1641] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:13.752628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.753878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.754779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.755067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.755345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] PATH_INFO: `/v3/users/39db62b919d047eeb6f2594e7e54a818` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.756558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39db62b919d047eeb6f2594e7e54a818)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.757620 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:13.757620 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:01:13.757620 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:01:13.758958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.767756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829584fb-6f46-4d81-bb09-48f1270b7686 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:13.775084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2b4b2-0083-46aa-80a3-51d1f460cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:13.776043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b4b2-0083-46aa-80a3-51d1f460cbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.776327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b4b2-0083-46aa-80a3-51d1f460cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.776600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b4b2-0083-46aa-80a3-51d1f460cbd8 admin admin] PATH_INFO: `/v3/projects/3a3d9319cec642258b50ead7ceaa63c0/users/19c4f91827a6448cbfe6afc32ea0a1ff/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.798855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2b4b2-0083-46aa-80a3-51d1f460cbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d9319cec642258b50ead7ceaa63c0, user_id=19c4f91827a6448cbfe6afc32ea0a1ff, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:13.803118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2b4b2-0083-46aa-80a3-51d1f460cbd8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:13.810958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:13.833889 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 820/1642] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:13 2022] PUT /identity/v3/projects/3a3d9319cec642258b50ead7ceaa63c0/users/19c4f91827a6448cbfe6afc32ea0a1ff/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:13.835933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb88f-12b4-4596-8294-a4908d753a52 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:13.836248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb88f-12b4-4596-8294-a4908d753a52 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:13.836776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb88f-12b4-4596-8294-a4908d753a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:13.867212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:13.881057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e47bb88f-12b4-4596-8294-a4908d753a52 None None] MFA Rules not processed for user `8fddbab71bb146f0a99f28a80cc2471b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:13.882546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e47bb88f-12b4-4596-8294-a4908d753a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:13.893186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39db62b919d047eeb6f2594e7e54a818'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:13.900299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39db62b919d047eeb6f2594e7e54a818'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:13.941839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39db62b919d047eeb6f2594e7e54a818'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:13.942757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39db62b919d047eeb6f2594e7e54a818'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:13.966003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39db62b919d047eeb6f2594e7e54a818'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:13.992296 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 823/1643] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:13 2022] DELETE /identity/v3/users/39db62b919d047eeb6f2594e7e54a818 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:13.993373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:13.996972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:13.999732 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 821/1644] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:14.001604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.002030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.002563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.049414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] MFA Rules not processed for user `273d597843e74bf9a174ff58f2d27647`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:14.050672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.097573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504640-1aaf-4daa-806b-71a67d166f65 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:14.103777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:14.104736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.105017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.105323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] PATH_INFO: `/v3/projects/ac397ade516d46dba09aa7a5376de6e6/users/cb1d29b5d2a94c1d9fda6d089d9270ee/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.108316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac397ade516d46dba09aa7a5376de6e6, user_id=cb1d29b5d2a94c1d9fda6d089d9270ee, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:14.111753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:14.133493 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 824/1645] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:13 2022] PUT /identity/v3/projects/ac397ade516d46dba09aa7a5376de6e6/users/cb1d29b5d2a94c1d9fda6d089d9270ee/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:14.134623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:14.136512 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 822/1646] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:14.137832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:14.139212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.141532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.171459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab152c-9ce8-41bb-a432-60e6ac40c73c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:14.284606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ea1ac-0e67-4354-aa20-66d405039111 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:14.289658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:14.290701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f541c-cbe4-40c4-bac0-d28171e9fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:14.290822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.290996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.291251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] PATH_INFO: `/v3/projects/b82f16206d8d4cd8b71a90ead54464c1/users/b1324392f6a94f0189bed37ed3548fb3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.291413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f541c-cbe4-40c4-bac0-d28171e9fced admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.291664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f541c-cbe4-40c4-bac0-d28171e9fced admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.291941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f541c-cbe4-40c4-bac0-d28171e9fced admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.292847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f541c-cbe4-40c4-bac0-d28171e9fced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:14.293323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82f16206d8d4cd8b71a90ead54464c1, user_id=b1324392f6a94f0189bed37ed3548fb3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:14.295128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f541c-cbe4-40c4-bac0-d28171e9fced admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:14.296658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:14.309758 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 823/1647] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:14.311732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e513-57b8-4117-944c-f769168352f2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.312001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e513-57b8-4117-944c-f769168352f2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.312258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302e513-57b8-4117-944c-f769168352f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.317139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 825/1648] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:14 2022] PUT /identity/v3/projects/b82f16206d8d4cd8b71a90ead54464c1/users/b1324392f6a94f0189bed37ed3548fb3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:14.326602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:14.328679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.336215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a302e513-57b8-4117-944c-f769168352f2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:14.337773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a302e513-57b8-4117-944c-f769168352f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.359824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.373054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.467335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab84aa8-b292-4632-9330-65e7dfd1b586 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:14.474452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:14.475101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.475415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.475674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.487893 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 824/1649] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:14.487893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce038815-7bfe-459f-bd86-62ea5c0340cd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.487893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce038815-7bfe-459f-bd86-62ea5c0340cd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.487893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce038815-7bfe-459f-bd86-62ea5c0340cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.533312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ce038815-7bfe-459f-bd86-62ea5c0340cd None None] MFA Rules not processed for user `cb1d29b5d2a94c1d9fda6d089d9270ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:14.542046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce038815-7bfe-459f-bd86-62ea5c0340cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.589882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:14.595105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:14.612331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 826/1650] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:14.613429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:14.633289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee227765-c59e-43e0-8449-de30f8c0df0c service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:14.638077 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 825/1651] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:14.640526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e01ab-a385-4955-ba85-a5e3b41d29a4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.640674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f757a-a16c-4ca7-85d8-832b5ea57356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:14.641402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e01ab-a385-4955-ba85-a5e3b41d29a4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.641516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f757a-a16c-4ca7-85d8-832b5ea57356 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.641876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e01ab-a385-4955-ba85-a5e3b41d29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.642115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f757a-a16c-4ca7-85d8-832b5ea57356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.642397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f757a-a16c-4ca7-85d8-832b5ea57356 admin admin] PATH_INFO: `/v3/projects/3a3d9319cec642258b50ead7ceaa63c0/users/19c4f91827a6448cbfe6afc32ea0a1ff/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.645210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f757a-a16c-4ca7-85d8-832b5ea57356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d9319cec642258b50ead7ceaa63c0, user_id=19c4f91827a6448cbfe6afc32ea0a1ff, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:14.648936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f757a-a16c-4ca7-85d8-832b5ea57356 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:14.669532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 827/1652] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:14 2022] PUT /identity/v3/projects/3a3d9319cec642258b50ead7ceaa63c0/users/19c4f91827a6448cbfe6afc32ea0a1ff/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:14.671510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d52-072d-4705-87a2-f3dc60da87c6 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.682473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d52-072d-4705-87a2-f3dc60da87c6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.682473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d52-072d-4705-87a2-f3dc60da87c6 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.682473 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 828/1653] 10.222.0.30 () {54 vars in 961 bytes} [Sat Jun 18 22:01:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:14.682473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946d52-072d-4705-87a2-f3dc60da87c6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:14.684317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f946d52-072d-4705-87a2-f3dc60da87c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.691873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-811e01ab-a385-4955-ba85-a5e3b41d29a4 None None] MFA Rules not processed for user `b1324392f6a94f0189bed37ed3548fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:14.693609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-811e01ab-a385-4955-ba85-a5e3b41d29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.764547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946d52-072d-4705-87a2-f3dc60da87c6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:14.771685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a0193-7267-4427-b7d0-a64eb51c9b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:14.772819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a0193-7267-4427-b7d0-a64eb51c9b09 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.773223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a0193-7267-4427-b7d0-a64eb51c9b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.773735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a0193-7267-4427-b7d0-a64eb51c9b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.786073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 826/1654] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:14.788825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbb8f-62df-4332-a1db-2fa5063c1b3b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.789295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbb8f-62df-4332-a1db-2fa5063c1b3b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.789738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bbb8f-62df-4332-a1db-2fa5063c1b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.840052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-000bbb8f-62df-4332-a1db-2fa5063c1b3b None None] MFA Rules not processed for user `19c4f91827a6448cbfe6afc32ea0a1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:14.842220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-000bbb8f-62df-4332-a1db-2fa5063c1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.866584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.879311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.895892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a0193-7267-4427-b7d0-a64eb51c9b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:14.897756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a0193-7267-4427-b7d0-a64eb51c9b09 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:14.909826 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 829/1655] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:14.911427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e2a6-400f-4505-b9b4-723c6bbd3b24 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.911782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e2a6-400f-4505-b9b4-723c6bbd3b24 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.912131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6e2a6-400f-4505-b9b4-723c6bbd3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.955376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-30e6e2a6-400f-4505-b9b4-723c6bbd3b24 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:14.956984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30e6e2a6-400f-4505-b9b4-723c6bbd3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:14.961200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 827/1656] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:14.962849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269889-dad3-43de-b2c5-07695ede3102 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:14.963674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269889-dad3-43de-b2c5-07695ede3102 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:14.964248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269889-dad3-43de-b2c5-07695ede3102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:14.987412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-06269889-dad3-43de-b2c5-07695ede3102 None None] MFA Rules not processed for user `c9ae6d217f7344408eed23388dd337b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:14.988843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-06269889-dad3-43de-b2c5-07695ede3102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.078637 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 828/1657] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:15.079943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269889-dad3-43de-b2c5-07695ede3102 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:15.095577 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 830/1658] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Jun 18 22:01:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:15.096803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e2a6-400f-4505-b9b4-723c6bbd3b24 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:15.106727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269889-dad3-43de-b2c5-07695ede3102 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:15.109795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6e2a6-400f-4505-b9b4-723c6bbd3b24 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:15.114925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:15.115851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.116296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.116597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.123644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:15.125364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.125757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.126174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.197228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:15.199349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:15.215331 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 829/1659] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:15.235035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:15.237287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:15.249826 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 831/1660] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:15.387211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:15.388882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.419563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:15.421271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.422059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76d046-275a-43ef-a930-7bf623a822ae service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:15.428906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:15.430467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.431024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.431739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] PATH_INFO: `/v3/projects/f0bd5eb16df0471f880490e3b0c6e232` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.434173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bd5eb16df0471f880490e3b0c6e232)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:15.436482 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:15.436482 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:01:15.436482 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:01:15.438206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:15.445384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb53742-6d08-489e-9805-52d007eade01 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:15.463035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:15.464325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.464605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.464887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] PATH_INFO: `/v3/users/148e3357369d426185e41f2538f657b2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.470249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148e3357369d426185e41f2538f657b2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:15.473135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:15.540920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:15.551634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bd5eb16df0471f880490e3b0c6e232', 'request_id': 'req-74f3f891-7521-4481-af85-013dec2680cc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.552236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148e3357369d426185e41f2538f657b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.554099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148e3357369d426185e41f2538f657b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.563805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:15.576757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148e3357369d426185e41f2538f657b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.578003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148e3357369d426185e41f2538f657b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.583218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bd5eb16df0471f880490e3b0c6e232', 'request_id': 'req-74f3f891-7521-4481-af85-013dec2680cc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.588064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148e3357369d426185e41f2538f657b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.602890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bd5eb16df0471f880490e3b0c6e232', 'request_id': 'req-74f3f891-7521-4481-af85-013dec2680cc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.608943 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 832/1661] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:15 2022] DELETE /identity/v3/users/148e3357369d426185e41f2538f657b2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:15.610460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:15.611838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.626357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] The token cache is being invalidate because project f0bd5eb16df0471f880490e3b0c6e232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:15.627011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.629171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:15.631479 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 830/1662] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:15 2022] DELETE /identity/v3/projects/f0bd5eb16df0471f880490e3b0c6e232 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:15.632619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:15.635110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.729603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682b2e-fb23-4589-840e-af118a8f1807 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:15.741416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ae63f-df99-4883-bf27-d037dfbbd5ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:15.742100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae63f-df99-4883-bf27-d037dfbbd5ca service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.742385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae63f-df99-4883-bf27-d037dfbbd5ca service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.743145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ae63f-df99-4883-bf27-d037dfbbd5ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.745748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-653ae63f-df99-4883-bf27-d037dfbbd5ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.785069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3f891-7521-4481-af85-013dec2680cc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:15.802688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96c9a9-6977-4877-80d3-be6cf182701a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:15.803724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96c9a9-6977-4877-80d3-be6cf182701a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.804209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96c9a9-6977-4877-80d3-be6cf182701a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.804699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96c9a9-6977-4877-80d3-be6cf182701a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.814567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-be96c9a9-6977-4877-80d3-be6cf182701a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.832813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ae63f-df99-4883-bf27-d037dfbbd5ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:15.834045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ae63f-df99-4883-bf27-d037dfbbd5ca service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:15.848345 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 833/1663] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:15.849903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.850190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.850465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.872237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:15.873761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:15.939248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96c9a9-6977-4877-80d3-be6cf182701a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:15.941595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96c9a9-6977-4877-80d3-be6cf182701a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:15.952637 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 831/1664] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:15.954213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fa30d-d3c4-4f3d-b45a-bdc1372fe67b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:15.954603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fa30d-d3c4-4f3d-b45a-bdc1372fe67b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:15.954984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fa30d-d3c4-4f3d-b45a-bdc1372fe67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:15.987208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fd7fa30d-d3c4-4f3d-b45a-bdc1372fe67b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:15.988931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fd7fa30d-d3c4-4f3d-b45a-bdc1372fe67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.039636 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 834/1665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:16.053015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.054554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.062540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:16.157695 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 832/1666] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:16.159434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687d242-18b2-41c4-94ad-5519329715e9 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.159734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687d242-18b2-41c4-94ad-5519329715e9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.160016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687d242-18b2-41c4-94ad-5519329715e9 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.161437 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 833/1667] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:16.162239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687d242-18b2-41c4-94ad-5519329715e9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.166774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c687d242-18b2-41c4-94ad-5519329715e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.194364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea21b69-d7ec-42ef-af0d-42c78b485f19 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.204677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687d242-18b2-41c4-94ad-5519329715e9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.206006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcdb01-4770-450f-ac2b-874adfeb6717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.206695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcdb01-4770-450f-ac2b-874adfeb6717 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.206973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcdb01-4770-450f-ac2b-874adfeb6717 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.207246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcdb01-4770-450f-ac2b-874adfeb6717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.215335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.216016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.216293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.217724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.218933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.227308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcdb01-4770-450f-ac2b-874adfeb6717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.228798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcdb01-4770-450f-ac2b-874adfeb6717 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.243411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:16.247313 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 835/1668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:01:16.248856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726392a-8147-41b1-8f01-87fbeef12cd6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.249173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726392a-8147-41b1-8f01-87fbeef12cd6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.249449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726392a-8147-41b1-8f01-87fbeef12cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.287211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2726392a-8147-41b1-8f01-87fbeef12cd6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:16.288194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2726392a-8147-41b1-8f01-87fbeef12cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.309577 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 836/1669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:16.310877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2d252-1d62-4c97-b60b-ad6a1de73090 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.311161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2d252-1d62-4c97-b60b-ad6a1de73090 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.311435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2d252-1d62-4c97-b60b-ad6a1de73090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.355890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b2b2d252-1d62-4c97-b60b-ad6a1de73090 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:16.356923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2b2d252-1d62-4c97-b60b-ad6a1de73090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.367436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.370298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.387708 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 837/1670] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:01:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:16.388579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2d252-1d62-4c97-b60b-ad6a1de73090 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.414307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2d252-1d62-4c97-b60b-ad6a1de73090 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.415551 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 834/1671] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:16.419602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.419978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.420414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.420696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.421281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.422050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:16.422357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.423989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.424376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.451886 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 838/1672] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:16.457079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.485607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0dcf-6094-4276-ba81-2c789e37cff8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.498885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.499655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.500078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.502328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.503352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.505962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.571579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf163dcc-282c-456e-aee2-0c87a3ae4691 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.587727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa2cbb-a9d9-41dd-baed-f22df34c5ecd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.587727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa2cbb-a9d9-41dd-baed-f22df34c5ecd service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.587727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa2cbb-a9d9-41dd-baed-f22df34c5ecd service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.587727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa2cbb-a9d9-41dd-baed-f22df34c5ecd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.589693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 839/1673] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:16 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:01:16.591085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.614962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa2cbb-a9d9-41dd-baed-f22df34c5ecd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.616644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa2cbb-a9d9-41dd-baed-f22df34c5ecd service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.665724 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 835/1674] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:16.667510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b8e4a-9f29-4611-bb74-1f65732c4b91 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.667637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b8e4a-9f29-4611-bb74-1f65732c4b91 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.667913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b8e4a-9f29-4611-bb74-1f65732c4b91 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.674896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a4466-4fc7-45e9-af8c-e86530710705 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.679370 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 836/1675] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:16.683072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.684303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.684410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9fccb-5a35-458a-9a34-fa5e9fb3ef23 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.684716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9fccb-5a35-458a-9a34-fa5e9fb3ef23 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.684944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.685126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9fccb-5a35-458a-9a34-fa5e9fb3ef23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.685466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.686686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.688598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.726237 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 840/1676] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:16 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:16.732007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.767070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4493f-d539-45e5-82fa-51a1c38c5b31 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.780586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.781326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.781607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.782011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.782629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.784336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.804008 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 841/1677] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:16.810957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-79a9fccb-5a35-458a-9a34-fa5e9fb3ef23 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:16.812100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-79a9fccb-5a35-458a-9a34-fa5e9fb3ef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:16.814856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.829088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c0805-5587-4b8f-9f47-72f8e2862f76 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.843032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.843751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.844044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.844327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.845114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.846839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:16.869464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 842/1678] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:16.874080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:16.896026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269711c-8c91-4ac2-90ca-bfba59222021 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:16.913333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f32ed4-2075-476c-8947-2f90dbebc713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:16.916050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f32ed4-2075-476c-8947-2f90dbebc713 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:16.916589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f32ed4-2075-476c-8947-2f90dbebc713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:16.916888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f32ed4-2075-476c-8947-2f90dbebc713 admin admin] PATH_INFO: `/v3/projects/f1268d05cf7c4cd09ffbb60c4bb7901e/users/bac09fe1a2be41cfb3e214c6bea1d3b9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:16.983437 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 837/1679] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:01:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:16.987483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f32ed4-2075-476c-8947-2f90dbebc713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1268d05cf7c4cd09ffbb60c4bb7901e, user_id=bac09fe1a2be41cfb3e214c6bea1d3b9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:16.991066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f32ed4-2075-476c-8947-2f90dbebc713 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:17.014631 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 843/1680] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:16 2022] PUT /identity/v3/projects/f1268d05cf7c4cd09ffbb60c4bb7901e/users/bac09fe1a2be41cfb3e214c6bea1d3b9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:17.027087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ade45-e8b2-4a3b-a19e-519240ab8f19 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.027734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ade45-e8b2-4a3b-a19e-519240ab8f19 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.028285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ade45-e8b2-4a3b-a19e-519240ab8f19 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.030813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 838/1681] 10.222.0.30 () {54 vars in 960 bytes} [Sat Jun 18 22:01:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:17.048954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c78070-f13f-4d8c-bd7f-ee836321023a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.049504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7052a-d9d3-431d-8d01-5cfd27186690 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.049825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7052a-d9d3-431d-8d01-5cfd27186690 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.050108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7052a-d9d3-431d-8d01-5cfd27186690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.051363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c78070-f13f-4d8c-bd7f-ee836321023a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.051648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c78070-f13f-4d8c-bd7f-ee836321023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.066375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:17.103161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-78b7052a-d9d3-431d-8d01-5cfd27186690 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:17.104787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-78b7052a-d9d3-431d-8d01-5cfd27186690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:17.122147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:17.133059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-53c78070-f13f-4d8c-bd7f-ee836321023a None None] MFA Rules not processed for user `bac09fe1a2be41cfb3e214c6bea1d3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:17.134346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-53c78070-f13f-4d8c-bd7f-ee836321023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:17.260990 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 839/1682] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Jun 18 22:01:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:17.275569 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 844/1683] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:17.276153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7052a-d9d3-431d-8d01-5cfd27186690 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:17.281502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c78070-f13f-4d8c-bd7f-ee836321023a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:17.305945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7052a-d9d3-431d-8d01-5cfd27186690 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:17.316643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:17.317304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.317591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.318020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.341443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:17.343106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:17.364984 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 840/1684] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:17.407456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:17.414561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:17.426643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c78070-f13f-4d8c-bd7f-ee836321023a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:17.436148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:17.437481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.437877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.438657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.439501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:17.442332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:17.475181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f81fa5-638e-497a-bb88-a3be542fb88c service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:17.489754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:17.491128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.491548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.491958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] PATH_INFO: `/v3/projects/eef7682803134c0fbd77a6507f1afd58` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.493536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef7682803134c0fbd77a6507f1afd58)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:17.497527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:17.509322 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 845/1685] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:17 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:17.512707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:17.618685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef7682803134c0fbd77a6507f1afd58', 'request_id': 'req-6165c53d-1708-4412-8bbc-e9868917676d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.631026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef7682803134c0fbd77a6507f1afd58', 'request_id': 'req-6165c53d-1708-4412-8bbc-e9868917676d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.649098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef7682803134c0fbd77a6507f1afd58', 'request_id': 'req-6165c53d-1708-4412-8bbc-e9868917676d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.666539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] The token cache is being invalidate because project eef7682803134c0fbd77a6507f1afd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:17.667039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.668018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.679810 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 841/1686] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:17 2022] DELETE /identity/v3/projects/eef7682803134c0fbd77a6507f1afd58 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:17.680417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:17.682255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:17.712036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bffc3-324c-46a4-86a5-5f2a3542b7ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:17.776009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:17.847373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c53d-1708-4412-8bbc-e9868917676d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:17.848161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:17.848938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.849903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.850312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.851084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:17.852330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:17.853255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.853540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.853814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] PATH_INFO: `/v3/users/8fddbab71bb146f0a99f28a80cc2471b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.853991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:17.861467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fddbab71bb146f0a99f28a80cc2471b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:17.863537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:17.880710 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 846/1687] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:17 2022] POST /identity/v3/users => generated 297 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:17.881900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:17.883838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:17.898146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4a419-182e-440d-9cd7-c69d15938eca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:17.903994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:17.905012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:17.905410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:17.906228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] PATH_INFO: `/v3/users/7c99f583b5ca45179c8d7706d5f156e9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:17.907728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c99f583b5ca45179c8d7706d5f156e9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:17.909015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:17.910090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:17.935257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fddbab71bb146f0a99f28a80cc2471b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.935993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fddbab71bb146f0a99f28a80cc2471b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.962228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fddbab71bb146f0a99f28a80cc2471b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.963604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fddbab71bb146f0a99f28a80cc2471b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.977143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c99f583b5ca45179c8d7706d5f156e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.977743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c99f583b5ca45179c8d7706d5f156e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:17.977902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d3d411-bc41-4922-b891-da29988cb1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fddbab71bb146f0a99f28a80cc2471b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.009677 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 842/1688] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:17 2022] DELETE /identity/v3/users/8fddbab71bb146f0a99f28a80cc2471b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:18.012381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a0368-5dd6-46d1-8847-bae85baad912 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.012381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a0368-5dd6-46d1-8847-bae85baad912 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.022355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c99f583b5ca45179c8d7706d5f156e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.027652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a0368-5dd6-46d1-8847-bae85baad912 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.035473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c99f583b5ca45179c8d7706d5f156e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.036518 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 843/1689] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:18 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:18.040508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde785b-4390-4cdf-9d47-044b6c5ddbe8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.040805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde785b-4390-4cdf-9d47-044b6c5ddbe8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.041113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde785b-4390-4cdf-9d47-044b6c5ddbe8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.046315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c99f583b5ca45179c8d7706d5f156e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.048762 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 844/1690] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:18.054307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde785b-4390-4cdf-9d47-044b6c5ddbe8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:18.061154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4bde785b-4390-4cdf-9d47-044b6c5ddbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.089510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 847/1691] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:17 2022] DELETE /identity/v3/users/7c99f583b5ca45179c8d7706d5f156e9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:18.093499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:18.096750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.248975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde785b-4390-4cdf-9d47-044b6c5ddbe8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:18.263402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f22db-4782-45a1-82c2-d01e3012915a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:18.281874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d95645-ad0c-461a-9279-550cbb195b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:18.282631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95645-ad0c-461a-9279-550cbb195b56 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.282974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95645-ad0c-461a-9279-550cbb195b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.283311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d95645-ad0c-461a-9279-550cbb195b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.284191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d95645-ad0c-461a-9279-550cbb195b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:18.289610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d95645-ad0c-461a-9279-550cbb195b56 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:18.323766 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 848/1692] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:18.325997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8cc7-16ab-49ca-94cc-d64723f5b02d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.326282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8cc7-16ab-49ca-94cc-d64723f5b02d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.326920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c8cc7-16ab-49ca-94cc-d64723f5b02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.368180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b28c8cc7-16ab-49ca-94cc-d64723f5b02d None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:18.369725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b28c8cc7-16ab-49ca-94cc-d64723f5b02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.394353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:18.467184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef3168-c3b9-40ef-9f00-e976f5125c54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:18.467863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3168-c3b9-40ef-9f00-e976f5125c54 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.468141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3168-c3b9-40ef-9f00-e976f5125c54 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.468420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef3168-c3b9-40ef-9f00-e976f5125c54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.474725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71ef3168-c3b9-40ef-9f00-e976f5125c54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.481464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 849/1693] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:01:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:18.491318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c003a27-21c9-414f-8572-bc76850addd4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.491621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c003a27-21c9-414f-8572-bc76850addd4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.491898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c003a27-21c9-414f-8572-bc76850addd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.507113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef3168-c3b9-40ef-9f00-e976f5125c54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:18.508711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef3168-c3b9-40ef-9f00-e976f5125c54 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:18.532123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7c003a27-21c9-414f-8572-bc76850addd4 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:18.546993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7c003a27-21c9-414f-8572-bc76850addd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.548032 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 845/1694] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:18.550092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.550092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.550092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.582352 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 850/1695] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:01:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:18.587375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c003a27-21c9-414f-8572-bc76850addd4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:18.616160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:18.625193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.630543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c003a27-21c9-414f-8572-bc76850addd4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:18.639421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:18.640337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.640670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.640957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] PATH_INFO: `/v3/projects/468a7ac79c9741f4b8dc48d1417cac5b/users/135d9c0f0d564c6b9f14ee85095e1ebe/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.648324 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 846/1696] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:18.649373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:18.654109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.667085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=468a7ac79c9741f4b8dc48d1417cac5b, user_id=135d9c0f0d564c6b9f14ee85095e1ebe, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:18.670868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:18.699230 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 851/1697] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:18 2022] PUT /identity/v3/projects/468a7ac79c9741f4b8dc48d1417cac5b/users/135d9c0f0d564c6b9f14ee85095e1ebe/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:18.700298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:18.702158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.729808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:18.788371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d510db-e0cb-47b5-ab8c-78b08af4b9a5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:18.809422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab349537-f869-4334-b63e-80e0929602fd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:18.817148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:18.818137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.818517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.818866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] PATH_INFO: `/v3/projects/3e0e904279074da0b69e0dd451b4b3b7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.821243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0e904279074da0b69e0dd451b4b3b7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:18.823479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:18.877023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:18.878010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:18.878301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:18.878663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:18.918421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0e904279074da0b69e0dd451b4b3b7', 'request_id': 'req-5f8bdad3-f76e-4785-8382-9aa0796fe854'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.926618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0e904279074da0b69e0dd451b4b3b7', 'request_id': 'req-5f8bdad3-f76e-4785-8382-9aa0796fe854'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.936549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0e904279074da0b69e0dd451b4b3b7', 'request_id': 'req-5f8bdad3-f76e-4785-8382-9aa0796fe854'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.953303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] The token cache is being invalidate because project 3e0e904279074da0b69e0dd451b4b3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:18.953639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.954340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:18.961426 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 852/1698] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:18 2022] DELETE /identity/v3/projects/3e0e904279074da0b69e0dd451b4b3b7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:18.961426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:18.962010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:18.976060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:18.978193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:18.982390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:19.004109 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 847/1699] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:19.005050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:19.014684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.037013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccb123-e7a4-4729-b3d8-55c1fa9f5ab8 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.055693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bdad3-f76e-4785-8382-9aa0796fe854 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.061397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70d79d-7940-4de4-b4d5-4b7c0a93942a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.062098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d79d-7940-4de4-b4d5-4b7c0a93942a service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.062353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d79d-7940-4de4-b4d5-4b7c0a93942a service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.062626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d79d-7940-4de4-b4d5-4b7c0a93942a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.065287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c70d79d-7940-4de4-b4d5-4b7c0a93942a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.080023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70d79d-7940-4de4-b4d5-4b7c0a93942a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.081891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70d79d-7940-4de4-b4d5-4b7c0a93942a service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.093627 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 853/1700] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:19.095085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.095435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.096086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.129445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] MFA Rules not processed for user `79c12f29545c40ec955650696bb91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:19.131519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.140808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.141712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.142235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.142697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.145054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.235091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:19.270651 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 854/1701] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:19.271579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:19.273145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.290656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1c6fd-c5bf-4ecd-8d4f-e08ca971617c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.291795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.293666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.296765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8867-c924-423e-bc29-509837ec95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.297687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8867-c924-423e-bc29-509837ec95d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.297966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8867-c924-423e-bc29-509837ec95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.298406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8867-c924-423e-bc29-509837ec95d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.299320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8867-c924-423e-bc29-509837ec95d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.301664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8867-c924-423e-bc29-509837ec95d1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.323860 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 855/1702] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:19.323860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.324487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.324584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.324663 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 848/1703] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:19.326553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:19.328442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.346969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22db7-3e57-4ac9-9f91-fac66091b3d7 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.355503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.356924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.357296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.357577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.358376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.360453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.372459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:19.373686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.393491 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 856/1704] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:19.394137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:19.401752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.425414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437172d0-d700-4de1-92dd-f964dc67b07b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.428618 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 849/1705] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:19 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:19.429568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:19.558800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.560054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.560332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.560601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] PATH_INFO: `/v3/users/527452ed2cd048bb95b0194a9ac5f919` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.565152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] RBAC: Authorizing `identity:delete_user(user_id=527452ed2cd048bb95b0194a9ac5f919)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.567417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.582112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e61724-d18f-4086-8084-f57e63ab22be admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.588381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468388-f141-4e41-bcc1-886699acf000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.590080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468388-f141-4e41-bcc1-886699acf000 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.590406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468388-f141-4e41-bcc1-886699acf000 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.590762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468388-f141-4e41-bcc1-886699acf000 admin admin] PATH_INFO: `/v3/projects/468a7ac79c9741f4b8dc48d1417cac5b/users/135d9c0f0d564c6b9f14ee85095e1ebe/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.593772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468388-f141-4e41-bcc1-886699acf000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468a7ac79c9741f4b8dc48d1417cac5b, user_id=135d9c0f0d564c6b9f14ee85095e1ebe, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.598173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468388-f141-4e41-bcc1-886699acf000 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.602276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:19.654696 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 850/1706] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:19 2022] PUT /identity/v3/projects/468a7ac79c9741f4b8dc48d1417cac5b/users/135d9c0f0d564c6b9f14ee85095e1ebe/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:19.666986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.669023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527452ed2cd048bb95b0194a9ac5f919'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.669751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.670096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527452ed2cd048bb95b0194a9ac5f919'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.670403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.691489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527452ed2cd048bb95b0194a9ac5f919'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.693386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527452ed2cd048bb95b0194a9ac5f919'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.703966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:19.707197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.711502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527452ed2cd048bb95b0194a9ac5f919'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.736495 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 857/1707] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:19 2022] DELETE /identity/v3/users/527452ed2cd048bb95b0194a9ac5f919 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:19.736495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:19.736495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.847087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 851/1708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:19.848168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:19.849836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.868204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361b400-4363-4bcb-a4bb-732ea2187df1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.871426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6f067-9b02-4238-8122-c483f3f8c0de admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:19.877813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.879073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.879174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161703a-aa3b-4d9a-8569-1486a9674618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:19.879395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.879687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] PATH_INFO: `/v3/users/65d884def116435eb153d424395308d2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.879842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161703a-aa3b-4d9a-8569-1486a9674618 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.880092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161703a-aa3b-4d9a-8569-1486a9674618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.880367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161703a-aa3b-4d9a-8569-1486a9674618 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.881269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161703a-aa3b-4d9a-8569-1486a9674618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.881365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d884def116435eb153d424395308d2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:19.883322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.883497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161703a-aa3b-4d9a-8569-1486a9674618 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:19.926343 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 858/1709] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:19 2022] POST /identity/v3/users => generated 307 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:19.929172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.929845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.930232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:19.947621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:19.950739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d884def116435eb153d424395308d2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.951383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d884def116435eb153d424395308d2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.967688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d884def116435eb153d424395308d2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.968554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d884def116435eb153d424395308d2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.969656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] MFA Rules not processed for user `135d9c0f0d564c6b9f14ee85095e1ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:19.971514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:19.978837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd0672b4-d411-43c1-bcf8-3dae30d9db55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d884def116435eb153d424395308d2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:19.994837 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 852/1710] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:19 2022] DELETE /identity/v3/users/65d884def116435eb153d424395308d2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:19.996281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530827a-e39b-4cb7-a720-71d701d6f686 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:19.996575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530827a-e39b-4cb7-a720-71d701d6f686 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:19.996904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530827a-e39b-4cb7-a720-71d701d6f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.017176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e530827a-e39b-4cb7-a720-71d701d6f686 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:20.018483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e530827a-e39b-4cb7-a720-71d701d6f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.062341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 859/1711] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:20.062341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.062341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.077901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe7f1-c698-4096-91ed-f153fd79f9ea None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.083326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:20.107823 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 853/1712] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:20.110497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.113348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.113752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.139267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] MFA Rules not processed for user `75df001919794fd7a2e79cdfbd87cfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:20.140478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.153050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.153743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.154026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.154298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.155040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:20.155346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.157258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.171126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 860/1713] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:20.172131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.173860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.188041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0564-0938-4018-a746-d295e47653f3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.194961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.195955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.196283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.196562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] PATH_INFO: `/v3/projects/1fb96b5dfee44bce9c62d65298d2f403` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.197871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb96b5dfee44bce9c62d65298d2f403)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.200355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.219670 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 854/1714] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:20.220998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.225410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.258623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322c85d-b7d1-4739-9419-5445b2215cab None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.282022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb96b5dfee44bce9c62d65298d2f403', 'request_id': 'req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.291301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb96b5dfee44bce9c62d65298d2f403', 'request_id': 'req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.324236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb96b5dfee44bce9c62d65298d2f403', 'request_id': 'req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.341930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.342843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.343275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.343636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.343996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] The token cache is being invalidate because project 1fb96b5dfee44bce9c62d65298d2f403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:20.344293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.344705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.345462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30feccac-d7d5-4a1b-8c5f-1b36acd22bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.346765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.349298 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 861/1715] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:20 2022] DELETE /identity/v3/projects/1fb96b5dfee44bce9c62d65298d2f403 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:20.352868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.353217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.353497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.361731 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 855/1716] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:20.362853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.364812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.371310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:20.393155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:20.394388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.413676 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 862/1717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:20.413676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.414224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.541825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887addd-e4a8-487c-82ba-5719ee1ac86a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.549099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549b648-7ba7-4a58-9cd3-6fadf117b452 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.562492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.563093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.563415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.564215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.566728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.567392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.567698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.567964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.569733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.570139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.586236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.588952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.601476 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 863/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:20.602328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.603727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.631503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f3c1-7913-4633-9b05-c5b7f5b75da7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.641907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.642682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.643143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.648720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.651854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.652896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.654590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.657420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.685063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:20.712910 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 856/1719] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:20.714176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 864/1720] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:20 2022] POST /identity/v3/projects => generated 395 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:20.719979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.721550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.723014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.726162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.749841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f5b31-cac9-44bf-99bf-cf53593dcb82 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.834143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.835096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.835381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.835757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] PATH_INFO: `/v3/users/19c4f91827a6448cbfe6afc32ea0a1ff` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.838279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c4f91827a6448cbfe6afc32ea0a1ff)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.840650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.894755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ecc62-f4ed-4653-b0f6-b8682ed7979a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:20.900588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:20.901595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:20.901898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:20.902166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] PATH_INFO: `/v3/projects/51d45e4edfc14265b9464ae54cdfa434/users/f74a0bfbb8f1410da348911a11bd27f4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:20.903274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:20.912385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c4f91827a6448cbfe6afc32ea0a1ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.914554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c4f91827a6448cbfe6afc32ea0a1ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.926133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d45e4edfc14265b9464ae54cdfa434, user_id=f74a0bfbb8f1410da348911a11bd27f4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:20.929213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:20.933083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c4f91827a6448cbfe6afc32ea0a1ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.935134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c4f91827a6448cbfe6afc32ea0a1ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.945505 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 865/1721] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:20 2022] PUT /identity/v3/projects/51d45e4edfc14265b9464ae54cdfa434/users/f74a0bfbb8f1410da348911a11bd27f4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:20.946151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c4f91827a6448cbfe6afc32ea0a1ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:20.946506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.949259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:20.967321 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 857/1722] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:20 2022] DELETE /identity/v3/users/19c4f91827a6448cbfe6afc32ea0a1ff => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:20.968283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:20.971230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.116944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f849f-4a05-4dc7-aba9-c7c9112f2ccf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.153519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c0ad-9c9f-4fdf-b574-8e5a3bb815cc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.162165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.163338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.163803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.165125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.167867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.174769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.175646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.175756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.175968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.179048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.246881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:21.263468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.265155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.266605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.267024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.281508 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 866/1723] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:21.282576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.283948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.296169 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 858/1724] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:21.298088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177cf7e-7a8e-462e-b770-9eeaead2fdc0 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.303380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.303832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.304113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.304385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.305111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.307062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.308649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.315292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.341656 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 867/1725] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:21 2022] POST /identity/v3/users => generated 298 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:21.342949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.348322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.364107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac9ec-27b1-419c-bf63-5c73853001a7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.364310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141064a0-7d58-4152-a50f-19ce2f9ed75a service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.369718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.370564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.370908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.371914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.372708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.374338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.376069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.378503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.380445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.381415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] PATH_INFO: `/v3/users/bac09fe1a2be41cfb3e214c6bea1d3b9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.384266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bac09fe1a2be41cfb3e214c6bea1d3b9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.392335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.404413 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 868/1726] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:21.405920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.410357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.429219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80274-c8e7-4685-9052-acf693283511 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.436117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.437519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.437848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.438121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] PATH_INFO: `/v3/projects/05fb7827566a4697aafaabd852648009` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.439922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05fb7827566a4697aafaabd852648009)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.442780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.511490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bac09fe1a2be41cfb3e214c6bea1d3b9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.512379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bac09fe1a2be41cfb3e214c6bea1d3b9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.516163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:21.534690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bac09fe1a2be41cfb3e214c6bea1d3b9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.537171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bac09fe1a2be41cfb3e214c6bea1d3b9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.543842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05fb7827566a4697aafaabd852648009', 'request_id': 'req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.548542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b06dee-d11a-4c06-8578-8e987266c6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bac09fe1a2be41cfb3e214c6bea1d3b9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.562984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05fb7827566a4697aafaabd852648009', 'request_id': 'req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.584161 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 859/1727] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:21 2022] DELETE /identity/v3/users/bac09fe1a2be41cfb3e214c6bea1d3b9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:21.585525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05fb7827566a4697aafaabd852648009', 'request_id': 'req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.589832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.593095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.593376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.609828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] The token cache is being invalidate because project 05fb7827566a4697aafaabd852648009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:21.610304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.611908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:21.614017 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 869/1728] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:21 2022] DELETE /identity/v3/projects/05fb7827566a4697aafaabd852648009 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:21.614907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.618414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.646386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:21.647613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.739544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c8ba-9d66-4a32-932f-f3cc0e9a94b1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.756394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 860/1729] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:01:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:21.757258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.762892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.831792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:21.846504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7580cb-5638-411d-932d-e9620fe030e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.847452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7580cb-5638-411d-932d-e9620fe030e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.847740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7580cb-5638-411d-932d-e9620fe030e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.848020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7580cb-5638-411d-932d-e9620fe030e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.848909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7580cb-5638-411d-932d-e9620fe030e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.850791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7580cb-5638-411d-932d-e9620fe030e8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.863754 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 870/1730] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:21.865270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.865821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.866111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.894932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:21.896694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.915608 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 871/1731] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:21.918915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.922001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:21.946354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889b2b3-3e84-47a3-a15d-cbc748332f6f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.952309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.953310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.953649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.953967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] PATH_INFO: `/v3/projects/51d45e4edfc14265b9464ae54cdfa434/users/f74a0bfbb8f1410da348911a11bd27f4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.957917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d45e4edfc14265b9464ae54cdfa434, user_id=f74a0bfbb8f1410da348911a11bd27f4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.960635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:21.963003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de698c94-af7d-499b-9bdb-3a6d83c2709e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:21.971833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:21.972944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:21.973264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:21.973669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] PATH_INFO: `/v3/users/1b306439e7bb4b46b0e877a70d9471e1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:21.975758 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 861/1732] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:21 2022] PUT /identity/v3/projects/51d45e4edfc14265b9464ae54cdfa434/users/f74a0bfbb8f1410da348911a11bd27f4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:21.976772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:21.978980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b306439e7bb4b46b0e877a70d9471e1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:21.982812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:22.094968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b306439e7bb4b46b0e877a70d9471e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.097464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b306439e7bb4b46b0e877a70d9471e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.121703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b306439e7bb4b46b0e877a70d9471e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.123033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b306439e7bb4b46b0e877a70d9471e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.131423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b306439e7bb4b46b0e877a70d9471e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.151674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 872/1733] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:21 2022] DELETE /identity/v3/users/1b306439e7bb4b46b0e877a70d9471e1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:22.153003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:22.162816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:22.173292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c99972-0083-4095-b7d2-781ddc1ed6b2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:22.207280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:22.325262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c9a83-a647-449a-a39f-49c9e76db650 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:22.333182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:22.335103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:22.335912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:22.336945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:22.340499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:22.341237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:22.343363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:22.344152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:22.345067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:22.346319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:22.350257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:22.376621 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 862/1734] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:22.377634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:22.382367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:22.409890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758a62-3786-49c0-bfec-05f4286ad245 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:22.433016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:22.433945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:22.434228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:22.435207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] PATH_INFO: `/v3/projects/3a3d9319cec642258b50ead7ceaa63c0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:22.436621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3d9319cec642258b50ead7ceaa63c0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:22.438641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:22.525497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:22.536369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:22.539211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:22.554109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3d9319cec642258b50ead7ceaa63c0', 'request_id': 'req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.558434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 873/1735] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:22.559378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:22.564358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3d9319cec642258b50ead7ceaa63c0', 'request_id': 'req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.567126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:22.583956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3d9319cec642258b50ead7ceaa63c0', 'request_id': 'req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.613974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] The token cache is being invalidate because project 3a3d9319cec642258b50ead7ceaa63c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:22.614226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.617388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:22.619367 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 863/1736] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:22 2022] DELETE /identity/v3/projects/3a3d9319cec642258b50ead7ceaa63c0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:22.620168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:22.628106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:22.776578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2e99e-c58b-428e-8a3f-9cd89224aada service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:22.905472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bf61f-4c8c-49bc-96ba-e1c622a984ce admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:22.928839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05069b60-e7e9-4fba-949e-457a410ec3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:22.929810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05069b60-e7e9-4fba-949e-457a410ec3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:22.930195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05069b60-e7e9-4fba-949e-457a410ec3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:22.930410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05069b60-e7e9-4fba-949e-457a410ec3bd admin admin] PATH_INFO: `/v3/projects/690879bad3004282a01b8f3ccb72c60e/users/8c8e9dbec8df4c4ea0ffbb1e9904dab3/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:22.960464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c934c-6e42-40b7-b3ce-d141ae2e82a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:22.961158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c934c-6e42-40b7-b3ce-d141ae2e82a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:22.961481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c934c-6e42-40b7-b3ce-d141ae2e82a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:22.961711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c934c-6e42-40b7-b3ce-d141ae2e82a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:22.966342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ee0c934c-6e42-40b7-b3ce-d141ae2e82a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:22.976447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05069b60-e7e9-4fba-949e-457a410ec3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=690879bad3004282a01b8f3ccb72c60e, user_id=8c8e9dbec8df4c4ea0ffbb1e9904dab3, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:22.992721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05069b60-e7e9-4fba-949e-457a410ec3bd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:23.006375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c934c-6e42-40b7-b3ce-d141ae2e82a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:23.012086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c934c-6e42-40b7-b3ce-d141ae2e82a9 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:23.020705 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 864/1737] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:22 2022] PUT /identity/v3/projects/690879bad3004282a01b8f3ccb72c60e/users/8c8e9dbec8df4c4ea0ffbb1e9904dab3/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:23.024100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd18910-5a08-480e-8292-0fe87b303e08 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.024100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd18910-5a08-480e-8292-0fe87b303e08 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.024100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd18910-5a08-480e-8292-0fe87b303e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.046493 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 874/1738] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:23.061418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b80ec7-c5c5-440e-bbee-a15a6801fa69 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.063537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b80ec7-c5c5-440e-bbee-a15a6801fa69 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.065893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b80ec7-c5c5-440e-bbee-a15a6801fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.113342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3bd18910-5a08-480e-8292-0fe87b303e08 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:23.118457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3bd18910-5a08-480e-8292-0fe87b303e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:23.147613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:23.196957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b0b80ec7-c5c5-440e-bbee-a15a6801fa69 None None] MFA Rules not processed for user `8c8e9dbec8df4c4ea0ffbb1e9904dab3`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:23.214837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b0b80ec7-c5c5-440e-bbee-a15a6801fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:23.290694 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 865/1739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:23.303308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9cc37-f2e2-4375-b2ad-3d251ec0cd4f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.303833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9cc37-f2e2-4375-b2ad-3d251ec0cd4f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.304227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9cc37-f2e2-4375-b2ad-3d251ec0cd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.377338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-10e9cc37-f2e2-4375-b2ad-3d251ec0cd4f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:23.379034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-10e9cc37-f2e2-4375-b2ad-3d251ec0cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:23.388677 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 866/1740] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:23.392721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9cc37-f2e2-4375-b2ad-3d251ec0cd4f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:23.445131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9cc37-f2e2-4375-b2ad-3d251ec0cd4f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:23.461101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:23.462734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.466416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.468210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.474809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:23.475329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:23.480743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:23.520078 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 867/1742] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:23.520329 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 875/1742] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:23.524215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:23.525241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b80ec7-c5c5-440e-bbee-a15a6801fa69 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:23.546122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccaf43-96ca-4282-93e7-82fe2cd7b317 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:23.553619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b80ec7-c5c5-440e-bbee-a15a6801fa69 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:23.561402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:23.562629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.563056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.564727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.565973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:23.567009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:23.568958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.573670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:23.574125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.574657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.579334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:23.582286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:23.669119 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 876/1743] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:23 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:23.673837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:23.682399 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 868/1744] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:23 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:23.683052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:23.741171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:23.876986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a77a4-aad4-4c25-928d-d33a8c3cb66a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:23.887369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:23.888074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.888358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.888636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.893269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:23.896202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc362d3f-09b8-4605-8f42-fc96903ed9b0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:23.897708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:23.914853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:23.919043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:23.919701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:23.920252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:23.921254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:23.927036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:23.947221 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 877/1745] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:23 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:23.948173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:23.954773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:23.996198 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 869/1746] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:23 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:23.997503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:24.020702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05bc3-9f5f-4406-ac80-4855f968e59c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:24.028740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154e12-2404-4a0d-bae9-3936ba0f0706 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:24.041436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:24.042228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.042616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.043195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.044008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:24.056628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:24.058529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:24.061841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.067494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.071940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] PATH_INFO: `/v3/projects/33e8de4c73e54b0a8df321b3b3b65c28` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.082566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e8de4c73e54b0a8df321b3b3b65c28)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:24.090093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 870/1747] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:24.091075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:24.093712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:24.112976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c85ba-44a6-4263-ae64-c75329240568 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:24.131342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:24.132435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.132779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.133348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.134007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:24.138203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:24.170564 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 871/1748] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:24.171584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:24.200827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc6aa-5470-4423-847c-0b96def2b040 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:24.213462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:24.214550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.215163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.215736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] PATH_INFO: `/v3/projects/6b0fc8e04b60468abb6ae87d02b5426d/users/50c195ac4cc240f6a1aff4753a974be0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.247212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0fc8e04b60468abb6ae87d02b5426d, user_id=50c195ac4cc240f6a1aff4753a974be0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:24.251068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:24.282415 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 872/1749] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:24 2022] PUT /identity/v3/projects/6b0fc8e04b60468abb6ae87d02b5426d/users/50c195ac4cc240f6a1aff4753a974be0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:24.283507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:24.327264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:24.366839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e8de4c73e54b0a8df321b3b3b65c28', 'request_id': 'req-43030713-2e44-4d53-96c0-99c20bd7ca20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:24.407990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e8de4c73e54b0a8df321b3b3b65c28', 'request_id': 'req-43030713-2e44-4d53-96c0-99c20bd7ca20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:24.438704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e8de4c73e54b0a8df321b3b3b65c28', 'request_id': 'req-43030713-2e44-4d53-96c0-99c20bd7ca20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:24.468320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] The token cache is being invalidate because project 33e8de4c73e54b0a8df321b3b3b65c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:24.469464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:24.474748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:24.476954 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 878/1750] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:23 2022] DELETE /identity/v3/projects/33e8de4c73e54b0a8df321b3b3b65c28 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:24.478013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:24.483378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:24.552939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80ff7a-9b79-4454-816f-f3fad4fedbac admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:24.688800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030713-2e44-4d53-96c0-99c20bd7ca20 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:24.704432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3572ab-5cb9-4a16-ac7c-5b3d35c4ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:24.705290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3572ab-5cb9-4a16-ac7c-5b3d35c4ef19 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.705507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3572ab-5cb9-4a16-ac7c-5b3d35c4ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.705841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3572ab-5cb9-4a16-ac7c-5b3d35c4ef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.706645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3572ab-5cb9-4a16-ac7c-5b3d35c4ef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:24.708628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3572ab-5cb9-4a16-ac7c-5b3d35c4ef19 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:24.735360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:24.736148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.736485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.736752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.737755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:24.739766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:24.752748 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 879/1751] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:24.754928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.755384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.755677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.780118 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 873/1752] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:24.781092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:24.796102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:24.815178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f0243-80e8-4492-8877-61d348e40a40 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:24.842321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:24.844918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:24.848757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:24.849430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] PATH_INFO: `/v3/projects/2c58028484194776b7abe2610381a92a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:24.852665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c58028484194776b7abe2610381a92a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:24.856224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:24.868027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:24.869524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:24.898721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:24.956615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c58028484194776b7abe2610381a92a', 'request_id': 'req-c0a8056d-082b-4018-9839-623ea1a42be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:24.974638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c58028484194776b7abe2610381a92a', 'request_id': 'req-c0a8056d-082b-4018-9839-623ea1a42be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:24.990551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c58028484194776b7abe2610381a92a', 'request_id': 'req-c0a8056d-082b-4018-9839-623ea1a42be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.004227 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 880/1753] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Jun 18 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:25.005484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:25.006806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.014185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] The token cache is being invalidate because project 2c58028484194776b7abe2610381a92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:25.014771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.019993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.022823 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 874/1754] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:24 2022] DELETE /identity/v3/projects/2c58028484194776b7abe2610381a92a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:25.024073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:25.033792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.049393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56784f-1531-42c1-9d24-2bfe25662e04 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:25.205562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:25.215133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:25.216180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:25.216589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:25.217059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] PATH_INFO: `/v3/users/cb1d29b5d2a94c1d9fda6d089d9270ee` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:25.218679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1d29b5d2a94c1d9fda6d089d9270ee)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:25.221609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:25.248373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8056d-082b-4018-9839-623ea1a42be6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:25.255814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:25.257221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:25.257627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:25.257912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] PATH_INFO: `/v3/projects/f1268d05cf7c4cd09ffbb60c4bb7901e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:25.259261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1268d05cf7c4cd09ffbb60c4bb7901e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:25.261400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:25.357651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1268d05cf7c4cd09ffbb60c4bb7901e', 'request_id': 'req-6db7f5b2-021f-46e9-ad50-29293a1431f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.368428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1d29b5d2a94c1d9fda6d089d9270ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.370271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1268d05cf7c4cd09ffbb60c4bb7901e', 'request_id': 'req-6db7f5b2-021f-46e9-ad50-29293a1431f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.370448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1d29b5d2a94c1d9fda6d089d9270ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.403342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1268d05cf7c4cd09ffbb60c4bb7901e', 'request_id': 'req-6db7f5b2-021f-46e9-ad50-29293a1431f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.404123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1d29b5d2a94c1d9fda6d089d9270ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.405064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1d29b5d2a94c1d9fda6d089d9270ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.425596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] The token cache is being invalidate because project f1268d05cf7c4cd09ffbb60c4bb7901e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:25.428081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.429724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.434743 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 875/1755] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:25 2022] DELETE /identity/v3/projects/f1268d05cf7c4cd09ffbb60c4bb7901e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:25.434743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:25.434994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1d29b5d2a94c1d9fda6d089d9270ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:25.436779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.471289 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 881/1756] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:25 2022] DELETE /identity/v3/users/cb1d29b5d2a94c1d9fda6d089d9270ee => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:25.472709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:25.474676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.583081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:25.618757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7f5b2-021f-46e9-ad50-29293a1431f4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:25.627996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d49b9-9984-4288-ad02-eb8d4430b8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:25.629339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d49b9-9984-4288-ad02-eb8d4430b8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:25.629747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d49b9-9984-4288-ad02-eb8d4430b8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:25.630173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d49b9-9984-4288-ad02-eb8d4430b8e6 admin admin] PATH_INFO: `/v3/projects/6b0fc8e04b60468abb6ae87d02b5426d/users/50c195ac4cc240f6a1aff4753a974be0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:25.632739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d49b9-9984-4288-ad02-eb8d4430b8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0fc8e04b60468abb6ae87d02b5426d, user_id=50c195ac4cc240f6a1aff4753a974be0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:25.633251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919f480-dc40-42ec-b276-73fdd946bc36 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:25.638005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d49b9-9984-4288-ad02-eb8d4430b8e6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:25.644721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:25.645776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:25.646140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:25.646610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] PATH_INFO: `/v3/projects/d1ed56bd0a424d64a6e4b5d6067ded28/users/2321466e250e4b8195d0d8ee6a55c98a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:25.665724 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 876/1757] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:25 2022] PUT /identity/v3/projects/6b0fc8e04b60468abb6ae87d02b5426d/users/50c195ac4cc240f6a1aff4753a974be0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:25.667834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:25.668413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:25.668839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:25.702845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:25.704564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.713306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ed56bd0a424d64a6e4b5d6067ded28, user_id=2321466e250e4b8195d0d8ee6a55c98a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:25.716230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:25.745911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 882/1758] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:25 2022] PUT /identity/v3/projects/d1ed56bd0a424d64a6e4b5d6067ded28/users/2321466e250e4b8195d0d8ee6a55c98a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:25.749462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:25.751671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.823408 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 877/1759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:25.824629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:25.828411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.871335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9e390-0371-417c-ba08-3ef1e58799cb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:25.877305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825f6f0-9b46-4f07-ac18-adb7ad065f7c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:25.881320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:25.886532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f7006-7f12-44c4-a8e7-45411152c838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:25.887215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7006-7f12-44c4-a8e7-45411152c838 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:25.887494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7006-7f12-44c4-a8e7-45411152c838 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:25.887760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7006-7f12-44c4-a8e7-45411152c838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:25.909297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e73f7006-7f12-44c4-a8e7-45411152c838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:25.937786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f7006-7f12-44c4-a8e7-45411152c838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:25.939256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f7006-7f12-44c4-a8e7-45411152c838 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:25.954868 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 883/1760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:25.956360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ab267-3127-4414-a5bf-b141e8251be2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:25.956645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ab267-3127-4414-a5bf-b141e8251be2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:25.956921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ab267-3127-4414-a5bf-b141e8251be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.048228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7c3ab267-3127-4414-a5bf-b141e8251be2 None None] MFA Rules not processed for user `50c195ac4cc240f6a1aff4753a974be0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:26.052977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7c3ab267-3127-4414-a5bf-b141e8251be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:26.070104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:26.075847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:26.075972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:26.076182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] PATH_INFO: `/v3/users/135d9c0f0d564c6b9f14ee85095e1ebe` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.088871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135d9c0f0d564c6b9f14ee85095e1ebe)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:26.090892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:26.168374 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 884/1761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:26.173558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0a02a-0ec6-420a-b164-90f58ad14579 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:26.173705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0a02a-0ec6-420a-b164-90f58ad14579 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:26.173892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0a02a-0ec6-420a-b164-90f58ad14579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.221684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-69e0a02a-0ec6-420a-b164-90f58ad14579 None None] MFA Rules not processed for user `2321466e250e4b8195d0d8ee6a55c98a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:26.222926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69e0a02a-0ec6-420a-b164-90f58ad14579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:26.288111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:26.315104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135d9c0f0d564c6b9f14ee85095e1ebe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:26.323486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135d9c0f0d564c6b9f14ee85095e1ebe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:26.334242 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 885/1762] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:26.335711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:26.336105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:26.336310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.377766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:26.386805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135d9c0f0d564c6b9f14ee85095e1ebe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:26.389385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135d9c0f0d564c6b9f14ee85095e1ebe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:26.395025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:26.418322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135d9c0f0d564c6b9f14ee85095e1ebe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:26.424238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 886/1763] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:26.425099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:26.428873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:26.444027 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 878/1764] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:25 2022] DELETE /identity/v3/users/135d9c0f0d564c6b9f14ee85095e1ebe => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:26.445859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:26.450383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:26.470332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07c820-60d9-4564-9207-354fca15f0e9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:26.645168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:26.645870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:26.646162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:26.646438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.647143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:26.654057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726961e-69bd-4758-bad0-3ffa2cb30114 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:26.654294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:26.661334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:26.662022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:26.662304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:26.662579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.663291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:26.665667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:26.716277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 887/1765] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:26 2022] POST /identity/v3/projects => generated 393 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:26.719142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:26.732248 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 879/1766] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:26 2022] POST /identity/v3/projects => generated 393 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:26.733193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:26.789679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:26.940926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bbd16-e4f1-45a5-8e5d-c0dfdc599934 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:26.955903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:26.960055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:26.961205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19b71e-986e-48e1-92c9-81ac0f372d4e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:26.961458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:26.961750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.964217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:26.964531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:26.970616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:26.971124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:26.971388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:26.971682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:26.971955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:26.973070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:26.975659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.008192 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 888/1767] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:27.010368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.011373 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 880/1768] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:26 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:27.013085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.032621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0999-da2f-43a7-8e0c-5b94a8902b22 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.037963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b705-f620-458f-82cb-105ea89d07a2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.042055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.044731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.046796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.049435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.049910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.055298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.055543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.055848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.056129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.056396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.061433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.064766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.086411 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 881/1769] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:27.088337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.101689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318034fb-533b-41ab-b009-ba31024e8321 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.120177 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 889/1770] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:27 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:27.120177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.124927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.125903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.126345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.126733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.127722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.131490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.159478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cf5f8-317a-4f0e-82fe-4ea20f75f29c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.164570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.165286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.165564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.165841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.166573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.168401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.203235 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 882/1771] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:27 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:27.203999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.208808 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 890/1772] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:27.209801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.234273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245acf6-4a3a-4a6a-80de-f8546169ead4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.328945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:27.487914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf20eb-d367-4700-aa3f-45d9f10e0947 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.491332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.492036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.492331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.492589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.493345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.496562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.508924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.509815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.510024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.518103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.525458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.539825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.602516 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 891/1773] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:27 2022] POST /identity/v3/users => generated 294 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:27.604100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.672000 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 883/1774] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:27.675618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.707574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:27.730136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecebad1-d572-4231-9ba9-0f1d4aab50e4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.763470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.764127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.764404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.764709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] PATH_INFO: `/v3/projects/1eaef672917e400b8359d0e28fd5e2aa/users/371af22921644f34a83cb16a2f3f119f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.775511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518122a6-896f-4bd0-8520-d437dfc85d68 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:27.780346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:27.781386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:27.781664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:27.781942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] PATH_INFO: `/v3/projects/ac397ade516d46dba09aa7a5376de6e6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:27.783224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac397ade516d46dba09aa7a5376de6e6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.785234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.798077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaef672917e400b8359d0e28fd5e2aa, user_id=371af22921644f34a83cb16a2f3f119f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:27.802212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:27.849517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 892/1775] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:27 2022] PUT /identity/v3/projects/1eaef672917e400b8359d0e28fd5e2aa/users/371af22921644f34a83cb16a2f3f119f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:27.849517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.908874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac397ade516d46dba09aa7a5376de6e6', 'request_id': 'req-43857f30-e146-44ab-b00e-5e722c95fe4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:27.922016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac397ade516d46dba09aa7a5376de6e6', 'request_id': 'req-43857f30-e146-44ab-b00e-5e722c95fe4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:27.940952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac397ade516d46dba09aa7a5376de6e6', 'request_id': 'req-43857f30-e146-44ab-b00e-5e722c95fe4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:27.942917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:27.962533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] The token cache is being invalidate because project ac397ade516d46dba09aa7a5376de6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:27.962900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:27.967216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:27.969251 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 884/1776] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:27 2022] DELETE /identity/v3/projects/ac397ade516d46dba09aa7a5376de6e6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:27.970104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:27.973726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:28.035905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7fac-abec-43f1-8e10-2493a5fe85bc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:28.129069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43857f30-e146-44ab-b00e-5e722c95fe4b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:28.133804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94039e-f15d-4885-b799-84c78a06e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:28.134770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94039e-f15d-4885-b799-84c78a06e389 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.134998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94039e-f15d-4885-b799-84c78a06e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.135316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94039e-f15d-4885-b799-84c78a06e389 admin admin] PATH_INFO: `/v3/projects/93903a1fae2841169b385954cc58d106/users/c21c57367e0c498387c7d729e7bdade3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.181929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94039e-f15d-4885-b799-84c78a06e389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93903a1fae2841169b385954cc58d106, user_id=c21c57367e0c498387c7d729e7bdade3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:28.185672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94039e-f15d-4885-b799-84c78a06e389 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:28.216041 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 885/1777] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:27 2022] PUT /identity/v3/projects/93903a1fae2841169b385954cc58d106/users/c21c57367e0c498387c7d729e7bdade3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:28.217602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.217887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.218156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.242776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c699011-0862-4d44-a4f9-6abbafb61a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:28.244270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c699011-0862-4d44-a4f9-6abbafb61a9f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.244640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c699011-0862-4d44-a4f9-6abbafb61a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.245100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c699011-0862-4d44-a4f9-6abbafb61a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.246056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c699011-0862-4d44-a4f9-6abbafb61a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:28.251899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c699011-0862-4d44-a4f9-6abbafb61a9f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:28.281786 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 893/1778] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:28.283708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22f02b-f7fc-414a-8ae5-c0e578acb5c0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.286572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] MFA Rules not processed for user `371af22921644f34a83cb16a2f3f119f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:28.287183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22f02b-f7fc-414a-8ae5-c0e578acb5c0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.287718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22f02b-f7fc-414a-8ae5-c0e578acb5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.287876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:28.348497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ff22f02b-f7fc-414a-8ae5-c0e578acb5c0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:28.349752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ff22f02b-f7fc-414a-8ae5-c0e578acb5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:28.403588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:28.450520 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 894/1779] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:28.452004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22f02b-f7fc-414a-8ae5-c0e578acb5c0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:28.470236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 886/1780] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:28.473545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:28.478695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:28.479902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22f02b-f7fc-414a-8ae5-c0e578acb5c0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:28.486046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e16a9-82a9-4b09-a7f1-e5cce4ab37df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:28.487030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e16a9-82a9-4b09-a7f1-e5cce4ab37df admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.487458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e16a9-82a9-4b09-a7f1-e5cce4ab37df admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.487877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e16a9-82a9-4b09-a7f1-e5cce4ab37df admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.488839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e16a9-82a9-4b09-a7f1-e5cce4ab37df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:28.493215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e16a9-82a9-4b09-a7f1-e5cce4ab37df admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:28.515482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccb11e-d9d7-414f-a727-eafe3a24196d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:28.532226 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 895/1781] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:28.535216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f763eb-5a5e-453c-b133-73ae47b5b840 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.535826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f763eb-5a5e-453c-b133-73ae47b5b840 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.536980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:28.537704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f763eb-5a5e-453c-b133-73ae47b5b840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.537813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.537974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.538245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.538993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:28.540613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:28.568326 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 887/1782] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:28.569337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:28.570639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-51f763eb-5a5e-453c-b133-73ae47b5b840 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:28.573004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-51f763eb-5a5e-453c-b133-73ae47b5b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:28.574258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:28.591018 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 896/1783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:28.591018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f763eb-5a5e-453c-b133-73ae47b5b840 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:28.618001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f763eb-5a5e-453c-b133-73ae47b5b840 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:28.645357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:28.647239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.648954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.649505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] PATH_INFO: `/v3/projects/93903a1fae2841169b385954cc58d106/users/c21c57367e0c498387c7d729e7bdade3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:28.657150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=93903a1fae2841169b385954cc58d106, user_id=c21c57367e0c498387c7d729e7bdade3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:28.667940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:28.689399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 897/1784] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:28 2022] PUT /identity/v3/projects/93903a1fae2841169b385954cc58d106/users/c21c57367e0c498387c7d729e7bdade3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:28.691103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:28.712064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:28.879401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951228-4aa3-4326-af36-d8629da60dfd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:28.900618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443a2d-5ed1-4004-9084-209462f531dc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:28.928694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:28.930058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:28.931104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:28.931645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] PATH_INFO: `/v3/projects/cd4b34fbbc864174bebcb365906f7473/users/180416961ad543378bc9b8747251998c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:29.022492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dd58b-30ef-4a46-b30b-bd32fa1bd50b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:29.028646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dd58b-30ef-4a46-b30b-bd32fa1bd50b service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:29.028823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dd58b-30ef-4a46-b30b-bd32fa1bd50b service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:29.034609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4b34fbbc864174bebcb365906f7473, user_id=180416961ad543378bc9b8747251998c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:29.036669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dd58b-30ef-4a46-b30b-bd32fa1bd50b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:29.043778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e1dd58b-30ef-4a46-b30b-bd32fa1bd50b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:29.053368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:29.084223 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 898/1785] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:28 2022] PUT /identity/v3/projects/cd4b34fbbc864174bebcb365906f7473/users/180416961ad543378bc9b8747251998c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:29.087494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:29.275442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dd58b-30ef-4a46-b30b-bd32fa1bd50b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:29.277593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dd58b-30ef-4a46-b30b-bd32fa1bd50b service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:29.320204 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 888/1786] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:29.321753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e0dc-b3d3-491f-baa8-37436b3bc71a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:29.322041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e0dc-b3d3-491f-baa8-37436b3bc71a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:29.322318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8e0dc-b3d3-491f-baa8-37436b3bc71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:29.407478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c71f-31a6-4751-8a01-f9483e61bf7d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:29.431579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22636c-fa8d-41c4-a9d4-5d2394db6ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:29.432436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-79a8e0dc-b3d3-491f-baa8-37436b3bc71a None None] MFA Rules not processed for user `c21c57367e0c498387c7d729e7bdade3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:29.432849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22636c-fa8d-41c4-a9d4-5d2394db6ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:29.433317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22636c-fa8d-41c4-a9d4-5d2394db6ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:29.433787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-79a8e0dc-b3d3-491f-baa8-37436b3bc71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:29.434063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22636c-fa8d-41c4-a9d4-5d2394db6ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:29.435202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22636c-fa8d-41c4-a9d4-5d2394db6ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:29.435811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22636c-fa8d-41c4-a9d4-5d2394db6ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:29.438455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22636c-fa8d-41c4-a9d4-5d2394db6ee9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:29.474360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 899/1787] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:29.486084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6826a-4bc4-49d2-9332-b937f1b60ef0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:29.487243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6826a-4bc4-49d2-9332-b937f1b60ef0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:29.488077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6826a-4bc4-49d2-9332-b937f1b60ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:29.612782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3ee6826a-4bc4-49d2-9332-b937f1b60ef0 None None] MFA Rules not processed for user `180416961ad543378bc9b8747251998c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:29.614968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3ee6826a-4bc4-49d2-9332-b937f1b60ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:29.640521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:29.665223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:29.727380 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 889/1788] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:29.733162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8e0dc-b3d3-491f-baa8-37436b3bc71a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:29.793712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8e0dc-b3d3-491f-baa8-37436b3bc71a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:29.800449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:29.801465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:29.801752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:29.802030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:29.803058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:29.805165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:29.862555 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 890/1789] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:29 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:29.868137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:29.882782 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 900/1790] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:29.887762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6826a-4bc4-49d2-9332-b937f1b60ef0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:29.908056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6826a-4bc4-49d2-9332-b937f1b60ef0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:30.101707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daffca-bfa1-4e74-b989-bcfa31b000a3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:30.117377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc04194-eb0c-493c-819d-e48ec2cb7c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:30.118427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04194-eb0c-493c-819d-e48ec2cb7c96 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:30.121217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04194-eb0c-493c-819d-e48ec2cb7c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:30.121764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04194-eb0c-493c-819d-e48ec2cb7c96 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:30.124404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc04194-eb0c-493c-819d-e48ec2cb7c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:30.129736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc04194-eb0c-493c-819d-e48ec2cb7c96 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:30.146941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:30.147669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:30.147958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:30.148367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:30.148954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:30.151274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:30.199416 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 891/1791] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:29 2022] POST /identity/v3/users => generated 286 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:30.203774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffda6f-c0e2-4bbf-9c74-d1630a2b2131 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:30.204272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffda6f-c0e2-4bbf-9c74-d1630a2b2131 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:30.204905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffda6f-c0e2-4bbf-9c74-d1630a2b2131 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:30.207865 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 892/1792] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:30.208966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffda6f-c0e2-4bbf-9c74-d1630a2b2131 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:30.211638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-20ffda6f-c0e2-4bbf-9c74-d1630a2b2131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:30.240856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffda6f-c0e2-4bbf-9c74-d1630a2b2131 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:30.247104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:30.248303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:30.248728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:30.249214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] PATH_INFO: `/v3/projects/468a7ac79c9741f4b8dc48d1417cac5b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:30.251252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468a7ac79c9741f4b8dc48d1417cac5b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:30.254176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:30.270197 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 901/1793] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:29 2022] POST /identity/v3/projects => generated 385 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:30.270197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:30.416646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468a7ac79c9741f4b8dc48d1417cac5b', 'request_id': 'req-336cb4a0-73e9-4584-94e1-505915d67773'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:30.437053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468a7ac79c9741f4b8dc48d1417cac5b', 'request_id': 'req-336cb4a0-73e9-4584-94e1-505915d67773'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:30.439077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609234-1c68-428b-a7f0-589b6542fcba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:30.454083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468a7ac79c9741f4b8dc48d1417cac5b', 'request_id': 'req-336cb4a0-73e9-4584-94e1-505915d67773'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:30.485760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] The token cache is being invalidate because project 468a7ac79c9741f4b8dc48d1417cac5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:30.485760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:30.492695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:30.500289 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 893/1794] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:30 2022] DELETE /identity/v3/projects/468a7ac79c9741f4b8dc48d1417cac5b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:30.512510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:01:30.515653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:30.641844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:30.706308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:30.707374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:30.708169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:30.708493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:30.708824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:30.709717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:30.711583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:30.764831 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 902/1795] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:30.765626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:30.788818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:30.831271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca07ff1-cfa6-458b-aa6c-0413d690f87f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:30.844701 ncdv-master-1 devstack@keystone.service[91204]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 18 22:01:30.849372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:30.854443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:30.854963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:30.855705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:30.855989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:30.856256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:30.857054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:30.859110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:30.931002 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 903/1796] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:30 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:30.931948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:30.945312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:31.019434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d08b9-9c56-4db7-b2ed-1ca1d7f831ef admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:31.046897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:31.048099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.048738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.049171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.056648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:31.150042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb4a0-73e9-4584-94e1-505915d67773 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:31.161393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6a25-0235-4744-81c7-6f6940252ee5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c195ac4cc240f6a1aff4753a974be0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b0fc8e04b60468abb6ae87d02b5426d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:31.166930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6a25-0235-4744-81c7-6f6940252ee5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.167239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6a25-0235-4744-81c7-6f6940252ee5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.167517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6a25-0235-4744-81c7-6f6940252ee5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] PATH_INFO: `/v3/projects/690879bad3004282a01b8f3ccb72c60e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.171974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6a25-0235-4744-81c7-6f6940252ee5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorizing `identity:get_project(project_id=690879bad3004282a01b8f3ccb72c60e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:31.179669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6a25-0235-4744-81c7-6f6940252ee5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:31.185369 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 894/1797] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:01:30 2022] GET /identity/v3/projects/690879bad3004282a01b8f3ccb72c60e => generated 395 bytes in 684 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:31.188664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.188962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.190704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.267947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:31.272628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:31.310164 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 895/1798] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:31.316807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:31.319719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:31.344957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:31.353672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:31.377649 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 904/1799] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:31.378630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:31.384160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de735b0d-de28-43e3-b225-a86e90f5a79c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:31.400329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6eeef-c990-4075-bbd2-8d525d1fbbe7 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:31.405918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ede35e-8442-45de-9e74-9664a753a125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:31.406646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede35e-8442-45de-9e74-9664a753a125 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.406930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede35e-8442-45de-9e74-9664a753a125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.407218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede35e-8442-45de-9e74-9664a753a125 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.409057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ede35e-8442-45de-9e74-9664a753a125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:31.410804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ede35e-8442-45de-9e74-9664a753a125 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:31.417859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:31.430104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.430104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.430104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.430104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:31.430104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:31.454063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 896/1800] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:31.455681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870edc11-66db-4333-bc29-83f1e51db133 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.456044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870edc11-66db-4333-bc29-83f1e51db133 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.456248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870edc11-66db-4333-bc29-83f1e51db133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.472666 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 905/1801] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:31.473851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:31.523403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a72e0-0630-4352-a769-094d1113a25e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:31.544581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-870edc11-66db-4333-bc29-83f1e51db133 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:31.545854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-870edc11-66db-4333-bc29-83f1e51db133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:31.546633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c2f2a-1ca4-4e17-b32b-024ee58a3ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:31.551048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2f2a-1ca4-4e17-b32b-024ee58a3ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.556973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2f2a-1ca4-4e17-b32b-024ee58a3ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.558636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2f2a-1ca4-4e17-b32b-024ee58a3ac6 admin admin] PATH_INFO: `/v3/projects/d6edcd41af0a4da89239e77e489b7791/users/d7864d63d66e4397a2b2602f25d925f4/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.591031 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 897/1802] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:31.592007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870edc11-66db-4333-bc29-83f1e51db133 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:31.617409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870edc11-66db-4333-bc29-83f1e51db133 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:31.635935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c2f2a-1ca4-4e17-b32b-024ee58a3ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6edcd41af0a4da89239e77e489b7791, user_id=d7864d63d66e4397a2b2602f25d925f4, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:31.643755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c2f2a-1ca4-4e17-b32b-024ee58a3ac6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:31.647903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778abe06-4b1b-43cb-93b1-7e4bcd6deb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:31.651910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778abe06-4b1b-43cb-93b1-7e4bcd6deb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.652826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778abe06-4b1b-43cb-93b1-7e4bcd6deb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.653993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778abe06-4b1b-43cb-93b1-7e4bcd6deb9f admin admin] PATH_INFO: `/v3/projects/f09753383d2f43b88dd409bc5ab81667/users/ecb9df4e8cab4ca99146a60c4034e486/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.688466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 906/1803] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:31 2022] PUT /identity/v3/projects/d6edcd41af0a4da89239e77e489b7791/users/d7864d63d66e4397a2b2602f25d925f4/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:31.691421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed151e19-99c4-4159-943c-fb04e5f7d892 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.691707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed151e19-99c4-4159-943c-fb04e5f7d892 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.696804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed151e19-99c4-4159-943c-fb04e5f7d892 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.708427 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 907/1804] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:31 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:31.709436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed151e19-99c4-4159-943c-fb04e5f7d892 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:31.731397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778abe06-4b1b-43cb-93b1-7e4bcd6deb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09753383d2f43b88dd409bc5ab81667, user_id=ecb9df4e8cab4ca99146a60c4034e486, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:31.752470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778abe06-4b1b-43cb-93b1-7e4bcd6deb9f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:31.809115 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 898/1805] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:31 2022] PUT /identity/v3/projects/f09753383d2f43b88dd409bc5ab81667/users/ecb9df4e8cab4ca99146a60c4034e486/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:31.809115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:31.809115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:31.809115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:31.922224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] MFA Rules not processed for user `d7864d63d66e4397a2b2602f25d925f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:31.924235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:31.951260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed151e19-99c4-4159-943c-fb04e5f7d892 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:32.072185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:32.161925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:32.162891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.163533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.165278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.166202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:32.169527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:32.172288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:32.203761 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 899/1806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:32.204856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:01:32.218729 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 908/1807] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:32.219997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:32.250826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:32.253124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae66a-505c-4c67-b9e1-5d1dfa8739e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:32.273891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298be347-e092-4a14-9080-67dcfa0dc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:32.274930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298be347-e092-4a14-9080-67dcfa0dc2cb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.275348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298be347-e092-4a14-9080-67dcfa0dc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.275759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298be347-e092-4a14-9080-67dcfa0dc2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.286948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298be347-e092-4a14-9080-67dcfa0dc2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:32.298234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298be347-e092-4a14-9080-67dcfa0dc2cb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:32.312908 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 909/1808] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:32.315047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a00e-78d3-47ba-9289-03c98101837f None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.315803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a00e-78d3-47ba-9289-03c98101837f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.316467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a00e-78d3-47ba-9289-03c98101837f None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.318656 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 910/1809] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:32.319585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a00e-78d3-47ba-9289-03c98101837f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:32.358913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a00e-78d3-47ba-9289-03c98101837f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:32.367199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:32.369568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.370153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.370581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.371735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:32.377681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:32.409892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:32.451296 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 911/1810] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:32 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:32.453694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:32.580467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffead27-fc71-420a-b974-a93e23ab66a2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:32.630595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af494b2-c35e-44c5-905b-409d0c5d46dd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:32.644841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:32.646015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.647929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.648370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.649294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:32.655479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:32.739854 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 912/1811] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:32 2022] POST /identity/v3/projects => generated 377 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:32.746978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:32.778139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c195ac4cc240f6a1aff4753a974be0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b0fc8e04b60468abb6ae87d02b5426d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:32.779095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.779387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.779673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] PATH_INFO: `/v3/projects/690879bad3004282a01b8f3ccb72c60e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.784455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorizing `identity:get_project(project_id=690879bad3004282a01b8f3ccb72c60e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:32.788336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:32.810071 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 900/1812] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:01:32 2022] GET /identity/v3/projects/690879bad3004282a01b8f3ccb72c60e => generated 395 bytes in 605 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:32.812955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:32.868472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848f30-0fc4-40e6-ac2d-e893f90460f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:32.876469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e8e29-04c1-4236-9da1-5553108c6c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:32.877782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2aadb8-208c-41c5-9362-fac0d58793ea tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:32.880672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8e29-04c1-4236-9da1-5553108c6c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.881429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8e29-04c1-4236-9da1-5553108c6c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.882379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e8e29-04c1-4236-9da1-5553108c6c9a admin admin] PATH_INFO: `/v3/projects/f09753383d2f43b88dd409bc5ab81667/users/ecb9df4e8cab4ca99146a60c4034e486/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.888206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e8e29-04c1-4236-9da1-5553108c6c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09753383d2f43b88dd409bc5ab81667, user_id=ecb9df4e8cab4ca99146a60c4034e486, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:32.902216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:32.902216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.902216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.902216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.906888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:32.909428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e8e29-04c1-4236-9da1-5553108c6c9a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:32.919760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:32.953548 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 913/1813] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:32 2022] PUT /identity/v3/projects/f09753383d2f43b88dd409bc5ab81667/users/ecb9df4e8cab4ca99146a60c4034e486/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:32.959566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50edd-e53b-4acd-8d9a-7fd405788259 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:32.961578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50edd-e53b-4acd-8d9a-7fd405788259 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:32.961921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50edd-e53b-4acd-8d9a-7fd405788259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:32.990579 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 901/1814] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:32 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:32.991586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:33.014835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96788a1a-e867-4786-ac59-243f58219f85 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:33.022453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:33.058898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d1f50edd-e53b-4acd-8d9a-7fd405788259 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:33.060590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1f50edd-e53b-4acd-8d9a-7fd405788259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:33.110287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:33.188161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:33.191019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:33.191557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:33.192822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:33.196959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:33.201250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:33.270741 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 914/1815] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:33.273435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:33.275713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:33.276105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:33.277675 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 902/1816] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:32 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:33.278788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:33.282425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:33.323941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13075eb6-a177-4789-9267-3c508b7d2491 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:33.345228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:33.346169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:33.346453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:33.346725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] PATH_INFO: `/v3/users/2321466e250e4b8195d0d8ee6a55c98a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:33.348280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2321466e250e4b8195d0d8ee6a55c98a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:33.351880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:33.356139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] MFA Rules not processed for user `ecb9df4e8cab4ca99146a60c4034e486`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:33.359884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:33.483705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2321466e250e4b8195d0d8ee6a55c98a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:33.486905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2321466e250e4b8195d0d8ee6a55c98a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:33.516466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2321466e250e4b8195d0d8ee6a55c98a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:33.524734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2321466e250e4b8195d0d8ee6a55c98a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:33.541416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80f82cd7-0f85-4c8a-89ff-c3c8dbc2ec04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2321466e250e4b8195d0d8ee6a55c98a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:33.579067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 915/1817] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:33.580617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:33.583100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:33.619936 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 903/1818] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:33 2022] DELETE /identity/v3/users/2321466e250e4b8195d0d8ee6a55c98a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:33.622512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03685e-88fc-432a-860a-08ee5932fe0c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:33.629818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663ecd-33a5-4974-adc9-5a139822e045 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:33.630664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663ecd-33a5-4974-adc9-5a139822e045 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:33.630790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663ecd-33a5-4974-adc9-5a139822e045 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:33.635913 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 904/1819] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:33 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:33.641361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97663ecd-33a5-4974-adc9-5a139822e045 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:33.645699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-97663ecd-33a5-4974-adc9-5a139822e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:33.716597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:33.717641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:33.718077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:33.718589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:33.719676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:33.721646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:33.755202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 916/1820] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:33.758840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:33.762125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:33.822238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:33.934558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97663ecd-33a5-4974-adc9-5a139822e045 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:33.957906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a05b-c182-40c7-89d3-1bb88031222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:33.960675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a05b-c182-40c7-89d3-1bb88031222a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:33.960837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a05b-c182-40c7-89d3-1bb88031222a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:33.961133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a05b-c182-40c7-89d3-1bb88031222a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:33.966608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a05b-c182-40c7-89d3-1bb88031222a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:33.971677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a05b-c182-40c7-89d3-1bb88031222a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.024265 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 905/1821] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:34.025971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6f5e-d2bd-4996-a44c-0a2b7c9cf16a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.026286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6f5e-d2bd-4996-a44c-0a2b7c9cf16a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.026573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6f5e-d2bd-4996-a44c-0a2b7c9cf16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.035227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b6ef-54e3-45b6-b958-2a3704f7524b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.055949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.056729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.056990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.060311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.069745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:34.103840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:34.106400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.112989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d49b6f5e-d2bd-4996-a44c-0a2b7c9cf16a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:34.118331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d49b6f5e-d2bd-4996-a44c-0a2b7c9cf16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:34.134245 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 917/1822] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:34.135164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:01:34.137678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:34.153980 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jun 18 22:01:34.154301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:34.156597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:34.192175 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 906/1823] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:34.193336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6f5e-d2bd-4996-a44c-0a2b7c9cf16a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:34.218846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6f5e-d2bd-4996-a44c-0a2b7c9cf16a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.239554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.243203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.243492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.243775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] PATH_INFO: `/v3/projects/a3e286d322464409a8ce89af7041777d/users/dc33955b63f643559995c4fb23fadcff/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.303205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e286d322464409a8ce89af7041777d, user_id=dc33955b63f643559995c4fb23fadcff, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:34.307213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ff88-7e36-441f-94f2-fa331a80f675 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.318130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.335509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c195ac4cc240f6a1aff4753a974be0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b0fc8e04b60468abb6ae87d02b5426d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.336694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.337153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.347467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] PATH_INFO: `/v3/projects/690879bad3004282a01b8f3ccb72c60e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.353792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorizing `identity:get_project(project_id=690879bad3004282a01b8f3ccb72c60e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:34.356649 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 907/1824] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:34 2022] PUT /identity/v3/projects/a3e286d322464409a8ce89af7041777d/users/dc33955b63f643559995c4fb23fadcff/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:34.359521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:34.368337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.368661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:34.391238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 918/1825] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:01:34 2022] GET /identity/v3/projects/690879bad3004282a01b8f3ccb72c60e => generated 395 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:34.392476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:34.405612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:34.609496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3d252-3a09-4602-b977-fd174ba46404 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.650140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5d9cc-a535-4ec2-9396-23a880c7dc7a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.664937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.665672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.665954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.666231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.666977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:34.668604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.712906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.713903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.714296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.714859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.722093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 908/1826] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:34.726224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:34.726855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:34.732637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:34.734431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.748682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 919/1827] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:34.749808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:34.759960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a886d2-193b-4656-8bcb-a7d877f8bb14 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.772310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.773086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.773356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.773632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.774380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:34.776071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.814257 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 909/1828] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:34.815705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:34.839328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325f989-2435-485a-8c03-0de91e5608cf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.859851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.861017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.861300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.861583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] PATH_INFO: `/v3/projects/19c65c1d6e44456da7eb18d05951f8b0/users/4fd4e2ebd7394448a308605cd990b761/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.895835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef9ed3-c0cb-4d07-9256-4e02c10f0874 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:34.904055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af189d49-98a3-4177-8e6f-0e4559052f57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:34.904774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af189d49-98a3-4177-8e6f-0e4559052f57 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:34.905148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af189d49-98a3-4177-8e6f-0e4559052f57 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:34.905444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af189d49-98a3-4177-8e6f-0e4559052f57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:34.918666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c65c1d6e44456da7eb18d05951f8b0, user_id=4fd4e2ebd7394448a308605cd990b761, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:34.921807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:34.964441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 910/1829] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:34 2022] PUT /identity/v3/projects/19c65c1d6e44456da7eb18d05951f8b0/users/4fd4e2ebd7394448a308605cd990b761/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:34.965570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:35.028218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af189d49-98a3-4177-8e6f-0e4559052f57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:35.034988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af189d49-98a3-4177-8e6f-0e4559052f57 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:35.058031 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 920/1830] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:35.059373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf19b63-1b19-4337-a672-7f34e700adae None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:35.059665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf19b63-1b19-4337-a672-7f34e700adae None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:35.059946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf19b63-1b19-4337-a672-7f34e700adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:35.141175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bcf19b63-1b19-4337-a672-7f34e700adae None None] MFA Rules not processed for user `4fd4e2ebd7394448a308605cd990b761`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:35.141175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bcf19b63-1b19-4337-a672-7f34e700adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:35.182106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c53a0-94f9-475b-8a6c-3b63ff3a5fe2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:35.195462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc01a1b-7d9b-483d-9871-b21f6f7b0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:35.196502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01a1b-7d9b-483d-9871-b21f6f7b0207 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:35.196664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01a1b-7d9b-483d-9871-b21f6f7b0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:35.197095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc01a1b-7d9b-483d-9871-b21f6f7b0207 admin admin] PATH_INFO: `/v3/projects/a3e286d322464409a8ce89af7041777d/users/dc33955b63f643559995c4fb23fadcff/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:35.213666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc01a1b-7d9b-483d-9871-b21f6f7b0207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e286d322464409a8ce89af7041777d, user_id=dc33955b63f643559995c4fb23fadcff, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:35.220690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc01a1b-7d9b-483d-9871-b21f6f7b0207 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:35.257560 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 911/1831] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:34 2022] PUT /identity/v3/projects/a3e286d322464409a8ce89af7041777d/users/dc33955b63f643559995c4fb23fadcff/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:35.259484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fcb62-05ea-466b-b4b8-cbc14e5075f5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:35.259945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fcb62-05ea-466b-b4b8-cbc14e5075f5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:35.260382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fcb62-05ea-466b-b4b8-cbc14e5075f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:35.301743 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 921/1832] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:35.303549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf19b63-1b19-4337-a672-7f34e700adae None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:35.320041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf19b63-1b19-4337-a672-7f34e700adae None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:35.342103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:35.348353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c06fcb62-05ea-466b-b4b8-cbc14e5075f5 None None] MFA Rules not processed for user `dc33955b63f643559995c4fb23fadcff`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:35.349796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c06fcb62-05ea-466b-b4b8-cbc14e5075f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:35.451619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:35.481655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:35.482504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:35.482855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:35.483200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:35.485573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:35.488902 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 912/1833] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:35.498112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:35.568401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fcb62-05ea-466b-b4b8-cbc14e5075f5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:35.570963 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 922/1834] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:35 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:35.586529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fcb62-05ea-466b-b4b8-cbc14e5075f5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:35.731299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:35.732748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:35.733814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:35.734285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:35.736515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:35.743941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:35.776037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:35.796460 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 913/1835] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:35 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:01:35.799145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:35.830003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87882f8-25a9-4c5b-a988-5b75d6fa0975 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:35.846803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:35.856324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:35.857647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:35.858477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:35.861154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:35.869369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:35.902329 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 914/1836] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:35.906089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:35.929963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604abdc-9cb8-430a-8104-0698b0264218 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:35.945637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:35.947017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:35.949090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:35.949405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] PATH_INFO: `/v3/projects/faf7f84a989a4297bd2286ce76be94ac/users/77b31aa7cd0047aa8f2ce31eb5e64f15/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:35.994028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf7f84a989a4297bd2286ce76be94ac, user_id=77b31aa7cd0047aa8f2ce31eb5e64f15, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:36.002905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49797f3f-1fe9-41fa-8916-f6d7d3f6d323 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:36.003310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:36.017854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:36.025834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:36.028842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:36.029333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:36.043212 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 915/1837] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:35 2022] PUT /identity/v3/projects/faf7f84a989a4297bd2286ce76be94ac/users/77b31aa7cd0047aa8f2ce31eb5e64f15/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:36.044821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:36.203977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:36.207488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:36.222285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4e9f-f642-46ae-8b3d-f72145062d31 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:36.241798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:36.242675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:36.242955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:36.243209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 923/1838] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:01:36.243331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:36.244138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:36.245844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:36.248710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:36.287383 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 916/1839] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:36.288353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:36.290642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed148-3a5c-439c-83f8-a32a4e110714 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:36.319519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ade1d-fe74-4417-932f-9af840835c70 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:36.333242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56be09d-7eb8-49e6-b21d-531b95472a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:36.334234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56be09d-7eb8-49e6-b21d-531b95472a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:36.334468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56be09d-7eb8-49e6-b21d-531b95472a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:36.335066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56be09d-7eb8-49e6-b21d-531b95472a6a admin admin] PATH_INFO: `/v3/projects/faf7f84a989a4297bd2286ce76be94ac/users/77b31aa7cd0047aa8f2ce31eb5e64f15/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:36.341235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56be09d-7eb8-49e6-b21d-531b95472a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf7f84a989a4297bd2286ce76be94ac, user_id=77b31aa7cd0047aa8f2ce31eb5e64f15, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:36.359099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56be09d-7eb8-49e6-b21d-531b95472a6a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:36.406961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:36.415110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 917/1840] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:36 2022] PUT /identity/v3/projects/faf7f84a989a4297bd2286ce76be94ac/users/77b31aa7cd0047aa8f2ce31eb5e64f15/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:36.428254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8638ba-0db0-4ae8-a5ad-e4bb7b181025 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:36.428756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8638ba-0db0-4ae8-a5ad-e4bb7b181025 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:36.429057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8638ba-0db0-4ae8-a5ad-e4bb7b181025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:36.498215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da313f9-0b1a-4662-b047-3b00cb86b32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:36.499388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da313f9-0b1a-4662-b047-3b00cb86b32e service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:36.499966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da313f9-0b1a-4662-b047-3b00cb86b32e service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:36.500837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da313f9-0b1a-4662-b047-3b00cb86b32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:36.504056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5da313f9-0b1a-4662-b047-3b00cb86b32e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:36.538533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bb8638ba-0db0-4ae8-a5ad-e4bb7b181025 None None] MFA Rules not processed for user `77b31aa7cd0047aa8f2ce31eb5e64f15`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:36.539877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bb8638ba-0db0-4ae8-a5ad-e4bb7b181025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:36.566206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:36.710301 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 918/1841] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:36.775241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da313f9-0b1a-4662-b047-3b00cb86b32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:36.777865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da313f9-0b1a-4662-b047-3b00cb86b32e service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:36.809687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 924/1842] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:36.922863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8638ba-0db0-4ae8-a5ad-e4bb7b181025 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:36.996249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71055bf-11d7-40be-92e3-783adece4cb7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:36.996728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71055bf-11d7-40be-92e3-783adece4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:36.997151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71055bf-11d7-40be-92e3-783adece4cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:37.093156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d71055bf-11d7-40be-92e3-783adece4cb7 None None] MFA Rules not processed for user `f74a0bfbb8f1410da348911a11bd27f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:37.097434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d71055bf-11d7-40be-92e3-783adece4cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:37.128224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8638ba-0db0-4ae8-a5ad-e4bb7b181025 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:37.137479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:37.138191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:37.138625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:37.139052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:37.151886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:37.153815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:37.190490 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 919/1843] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:37.193244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:37.207559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:37.340757 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 925/1844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:37.520752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2adc0-bfbe-4329-a3e1-703d855a83a3 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:37.526298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:37.527217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:37.527493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:37.527774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] PATH_INFO: `/v3/projects/d1ed56bd0a424d64a6e4b5d6067ded28` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:37.529680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ed56bd0a424d64a6e4b5d6067ded28)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:37.531668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:37.623752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71055bf-11d7-40be-92e3-783adece4cb7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:37.626802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:37.650471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71055bf-11d7-40be-92e3-783adece4cb7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:37.658836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ed56bd0a424d64a6e4b5d6067ded28', 'request_id': 'req-c54585ad-e8f3-4ad6-9ece-653112c5afe6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.682983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ed56bd0a424d64a6e4b5d6067ded28', 'request_id': 'req-c54585ad-e8f3-4ad6-9ece-653112c5afe6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.698572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ed56bd0a424d64a6e4b5d6067ded28', 'request_id': 'req-c54585ad-e8f3-4ad6-9ece-653112c5afe6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.714882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] The token cache is being invalidate because project d1ed56bd0a424d64a6e4b5d6067ded28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:37.715188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.715896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.721182 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 920/1845] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:37 2022] DELETE /identity/v3/projects/d1ed56bd0a424d64a6e4b5d6067ded28 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:37.722121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:37.724495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:37.789865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:37.819210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:37.820164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:37.820795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:37.821171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:37.823327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:37.823466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54585ad-e8f3-4ad6-9ece-653112c5afe6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:37.829324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:37.830427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:37.830775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:37.831147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] PATH_INFO: `/v3/users/c21c57367e0c498387c7d729e7bdade3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:37.832637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21c57367e0c498387c7d729e7bdade3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:37.834704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:37.904866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21c57367e0c498387c7d729e7bdade3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.907249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21c57367e0c498387c7d729e7bdade3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.928541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21c57367e0c498387c7d729e7bdade3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.929385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21c57367e0c498387c7d729e7bdade3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.930190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:37.932275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:37.944610 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 926/1846] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:37.950047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21c57367e0c498387c7d729e7bdade3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:37.972698 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 921/1847] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:37 2022] DELETE /identity/v3/users/c21c57367e0c498387c7d729e7bdade3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:38.042833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:38.045691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.074234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980c55f-8789-4d76-8eec-2c09a5c3954a service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:38.098490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:38.100298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.186025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:38.221850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:38.222562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:38.222843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:38.223120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:38.226462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.248704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0d871-8548-4f2a-b15e-1ec010db4be0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:38.262790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd9b5-f43a-4785-a38d-c5052cd22615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:38.263710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd9b5-f43a-4785-a38d-c5052cd22615 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:38.263994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd9b5-f43a-4785-a38d-c5052cd22615 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:38.264296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd9b5-f43a-4785-a38d-c5052cd22615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:38.269223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b77fd9b5-f43a-4785-a38d-c5052cd22615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.334265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:38.353492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:38.371888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 927/1848] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:38.390503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd9b5-f43a-4785-a38d-c5052cd22615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:38.401349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:38.402090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd9b5-f43a-4785-a38d-c5052cd22615 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:38.403497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.426732 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 922/1849] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:01:38.470172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:38.519481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811eabb-308a-454e-8e81-44a66403e218 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:38.533903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:38.534997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:38.535377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:38.535760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] PATH_INFO: `/v3/projects/93903a1fae2841169b385954cc58d106` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:38.539528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93903a1fae2841169b385954cc58d106)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:38.542454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:38.665841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93903a1fae2841169b385954cc58d106', 'request_id': 'req-bf4379cb-4c57-4a50-984b-af0629743d7f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:38.674413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93903a1fae2841169b385954cc58d106', 'request_id': 'req-bf4379cb-4c57-4a50-984b-af0629743d7f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:38.686541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93903a1fae2841169b385954cc58d106', 'request_id': 'req-bf4379cb-4c57-4a50-984b-af0629743d7f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:38.702289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] The token cache is being invalidate because project 93903a1fae2841169b385954cc58d106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:38.702774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:38.703878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4379cb-4c57-4a50-984b-af0629743d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:38.711014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 928/1850] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:38 2022] DELETE /identity/v3/projects/93903a1fae2841169b385954cc58d106 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:38.715781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46c4a7-5808-41ef-9d34-105e747f93c9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:38.716075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46c4a7-5808-41ef-9d34-105e747f93c9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:38.716356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46c4a7-5808-41ef-9d34-105e747f93c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:38.758189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7a46c4a7-5808-41ef-9d34-105e747f93c9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:38.759816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a46c4a7-5808-41ef-9d34-105e747f93c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.877086 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 923/1851] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:38.883149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea48-4dec-4b6c-af39-c5f33ac44ffe None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:38.883448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea48-4dec-4b6c-af39-c5f33ac44ffe None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:38.883729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea48-4dec-4b6c-af39-c5f33ac44ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:38.911397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-45ebea48-4dec-4b6c-af39-c5f33ac44ffe None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:38.921950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45ebea48-4dec-4b6c-af39-c5f33ac44ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.948536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:38.949061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:38.950313 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 929/1852] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:38.954531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:38.956379 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 924/1853] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:38.956649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebea48-4dec-4b6c-af39-c5f33ac44ffe None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:38.968876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:01:38.972930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebea48-4dec-4b6c-af39-c5f33ac44ffe None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:38.975830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:38.978506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:38.979392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:38.979928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:38.980316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:38.981336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:38.981747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:38.983853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.008720 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 930/1854] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:39.009971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.029874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc15d20-0152-4154-8e2a-37d6d5111889 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.042867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.043946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.044264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.045540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.046328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.051774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.099629 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 931/1855] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:39 2022] POST /identity/v3/projects => generated 409 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:39.100856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.124697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.126575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:39.146145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:39.204745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa0c9d-f3c0-488d-9c18-a5b343de2534 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.211339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.212277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.212724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.213470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.214350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.217328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.223749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604f2e5-7114-4412-b10b-462dd2c1485e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.252683 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 932/1856] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:39 2022] POST /identity/v3/users => generated 305 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:39.254660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.263215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:39.274148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3648-fcd0-493a-a104-688cf7efffc4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.283408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.284291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.286118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.286570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.287986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.291394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.322319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c195ac4cc240f6a1aff4753a974be0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b0fc8e04b60468abb6ae87d02b5426d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.324018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.324462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.324844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] PATH_INFO: `/v3/projects/690879bad3004282a01b8f3ccb72c60e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.326520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorizing `identity:get_project(project_id=690879bad3004282a01b8f3ccb72c60e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.330127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.336185 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 933/1857] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:39.337546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.339607 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 925/1858] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:01:38 2022] GET /identity/v3/projects/690879bad3004282a01b8f3ccb72c60e => generated 395 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:39.353810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1854f2-5247-4c25-8498-4ff3742ce97a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.362643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b472c7-5823-4a2a-89b4-49dfb5e6dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.363603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b472c7-5823-4a2a-89b4-49dfb5e6dd95 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.364164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b472c7-5823-4a2a-89b4-49dfb5e6dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.364616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b472c7-5823-4a2a-89b4-49dfb5e6dd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.369203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b472c7-5823-4a2a-89b4-49dfb5e6dd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.371512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b472c7-5823-4a2a-89b4-49dfb5e6dd95 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.406115 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 934/1859] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:39.411617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.434008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99bfb-262a-480a-b5da-a1c65f7cdea1 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.447183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f031dd-b4aa-4bd9-997d-2683d0118614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.450142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f031dd-b4aa-4bd9-997d-2683d0118614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.450511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f031dd-b4aa-4bd9-997d-2683d0118614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.450856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f031dd-b4aa-4bd9-997d-2683d0118614 admin admin] PATH_INFO: `/v3/projects/cad91b968301480cb579894515116b2b/users/30e56aae999c4c8186dcb51d4f2332e8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.486678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f031dd-b4aa-4bd9-997d-2683d0118614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad91b968301480cb579894515116b2b, user_id=30e56aae999c4c8186dcb51d4f2332e8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.493836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f031dd-b4aa-4bd9-997d-2683d0118614 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.494633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24341f09-0a15-4e5e-b839-b219975d7ed9 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.494977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24341f09-0a15-4e5e-b839-b219975d7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.495358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24341f09-0a15-4e5e-b839-b219975d7ed9 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.497173 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 935/1860] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:01:39.503172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24341f09-0a15-4e5e-b839-b219975d7ed9 None None] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:01:39.533136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 926/1861] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:39 2022] PUT /identity/v3/projects/cad91b968301480cb579894515116b2b/users/30e56aae999c4c8186dcb51d4f2332e8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:39.549694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.550018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.550344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.609505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] MFA Rules not processed for user `30e56aae999c4c8186dcb51d4f2332e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:39.611420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:39.704232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24341f09-0a15-4e5e-b839-b219975d7ed9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.720567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24341f09-0a15-4e5e-b839-b219975d7ed9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.778744 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 927/1862] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:39.780551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.782732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:39.824045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c195ac4cc240f6a1aff4753a974be0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b0fc8e04b60468abb6ae87d02b5426d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.825351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.825487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.825830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] PATH_INFO: `/v3/projects/690879bad3004282a01b8f3ccb72c60e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.827371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorizing `identity:get_project(project_id=690879bad3004282a01b8f3ccb72c60e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.830640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:39.832304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:39.834466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 936/1863] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:01:39 2022] GET /identity/v3/projects/690879bad3004282a01b8f3ccb72c60e => generated 395 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:39.836290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:39.890929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc4588-68aa-4e4d-9648-7322f0822550 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:39.901818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:39.902771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:39.903049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:39.903330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] PATH_INFO: `/v3/users/180416961ad543378bc9b8747251998c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:39.909647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=180416961ad543378bc9b8747251998c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:39.915708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.003477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450defe-3d81-44bd-94a5-34a3cef958d7 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.012519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e76112-7978-4593-8656-d50822faedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.013617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e76112-7978-4593-8656-d50822faedca admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.017134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e76112-7978-4593-8656-d50822faedca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.019127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e76112-7978-4593-8656-d50822faedca admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.021894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e76112-7978-4593-8656-d50822faedca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.026487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e76112-7978-4593-8656-d50822faedca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.050286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180416961ad543378bc9b8747251998c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:40.052219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180416961ad543378bc9b8747251998c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:40.090290 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 937/1864] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:39 2022] POST /identity/v3/projects => generated 409 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:40.091955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180416961ad543378bc9b8747251998c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:40.093292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180416961ad543378bc9b8747251998c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:40.095266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e76112-7978-4593-8656-d50822faedca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.100949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-94e76112-7978-4593-8656-d50822faedca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:40.118005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:40.125132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c42a9602-4ea5-4812-9847-64da65fd2c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180416961ad543378bc9b8747251998c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:40.158816 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 928/1865] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:39 2022] DELETE /identity/v3/users/180416961ad543378bc9b8747251998c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:40.160297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.160586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.160863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.183838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:40.185073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:40.229011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e76112-7978-4593-8656-d50822faedca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.277659 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 929/1866] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:40.277659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.287036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:40.314254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1808f6-9e82-4eab-a0e9-4b518fc91a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.315746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1808f6-9e82-4eab-a0e9-4b518fc91a79 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.316097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1808f6-9e82-4eab-a0e9-4b518fc91a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.316459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1808f6-9e82-4eab-a0e9-4b518fc91a79 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.317298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1808f6-9e82-4eab-a0e9-4b518fc91a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.320214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1808f6-9e82-4eab-a0e9-4b518fc91a79 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.352711 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 938/1867] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:40 2022] POST /identity/v3/users => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:01:40.353891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:40.357613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb1647-e42a-4e19-8da7-e248736eb096 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.358135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb1647-e42a-4e19-8da7-e248736eb096 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.358373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb1647-e42a-4e19-8da7-e248736eb096 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.364744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 939/1868] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:40.366475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb1647-e42a-4e19-8da7-e248736eb096 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.368220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3beb1647-e42a-4e19-8da7-e248736eb096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:40.396601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ef13-aafe-4431-a430-716ebb1d863f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.403711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.404419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.404700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.404971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.407092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:40.465438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb1647-e42a-4e19-8da7-e248736eb096 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.470865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.472123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.472421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.472789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.484540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.486438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.488987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.490784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.498047 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 940/1869] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:40.499215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.525675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97e70b-cc36-4bae-9b86-fa8e9c7cff3b service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.533715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 930/1870] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:40.535906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.537197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:01:40.538299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.538688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.539720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.541721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.543474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:40.545951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.565914 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 941/1871] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:40.566966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.581504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e35ab-1d6f-499c-b040-58101036ea3d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.587495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.589628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.590645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.591225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] PATH_INFO: `/v3/projects/cbe1001f3ee54a2cbda6b7db3dfeb15c/users/3d628825e0be4cf8a3ae0664014cdbef/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.608346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.614197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:40.633011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe1001f3ee54a2cbda6b7db3dfeb15c, user_id=3d628825e0be4cf8a3ae0664014cdbef, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.636066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.666364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 942/1872] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:40 2022] PUT /identity/v3/projects/cbe1001f3ee54a2cbda6b7db3dfeb15c/users/3d628825e0be4cf8a3ae0664014cdbef/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:40.672842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.688854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:40.764396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f47d3-56aa-4c62-be02-0b0b2f63b6e7 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.823004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f61c4e-7a7c-46e6-8f3b-a2d8400954d7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.838834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41181143-0038-4c91-941a-c2dd636252f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.840433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c195ac4cc240f6a1aff4753a974be0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b0fc8e04b60468abb6ae87d02b5426d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.841767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.842048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41181143-0038-4c91-941a-c2dd636252f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.842163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.842493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] PATH_INFO: `/v3/projects/1eaef672917e400b8359d0e28fd5e2aa` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.842622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41181143-0038-4c91-941a-c2dd636252f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.844235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41181143-0038-4c91-941a-c2dd636252f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.844871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorizing `identity:get_project(project_id=1eaef672917e400b8359d0e28fd5e2aa)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.846931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41181143-0038-4c91-941a-c2dd636252f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.848000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.850767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41181143-0038-4c91-941a-c2dd636252f1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.861532 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 931/1873] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:01:40 2022] GET /identity/v3/projects/1eaef672917e400b8359d0e28fd5e2aa => generated 393 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:40.883930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:40.884555 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 943/1874] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:01:40.898285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb880ee-02d0-4f8f-9b60-ed7369f12209 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:40.913284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:40.916102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.918609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.919184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] PATH_INFO: `/v3/projects/cbe1001f3ee54a2cbda6b7db3dfeb15c/users/3d628825e0be4cf8a3ae0664014cdbef/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.933383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe1001f3ee54a2cbda6b7db3dfeb15c, user_id=3d628825e0be4cf8a3ae0664014cdbef, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:40.946907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:40.964310 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 932/1875] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:40 2022] PUT /identity/v3/projects/cbe1001f3ee54a2cbda6b7db3dfeb15c/users/3d628825e0be4cf8a3ae0664014cdbef/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:01:40.977950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22decdde-cca8-4336-9729-7583347f208f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:40.978578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22decdde-cca8-4336-9729-7583347f208f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:40.978924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22decdde-cca8-4336-9729-7583347f208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:40.991071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:41.003855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:41.080196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:41.086090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-22decdde-cca8-4336-9729-7583347f208f None None] MFA Rules not processed for user `3d628825e0be4cf8a3ae0664014cdbef`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:41.087545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22decdde-cca8-4336-9729-7583347f208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:41.187705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf4b0-e076-4ef5-9c48-64247ba12612 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:41.193595 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 944/1876] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:41.194579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22decdde-cca8-4336-9729-7583347f208f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:41.196700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22decdde-cca8-4336-9729-7583347f208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:41.222872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:41.223962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:41.224244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:41.224523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] PATH_INFO: `/v3/projects/cd4b34fbbc864174bebcb365906f7473` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:41.227996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4b34fbbc864174bebcb365906f7473)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:41.229293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22decdde-cca8-4336-9729-7583347f208f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:41.231257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:41.246099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:41.248295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:41.251245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:41.251928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] PATH_INFO: `/v3/users/8c8e9dbec8df4c4ea0ffbb1e9904dab3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:41.255496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8e9dbec8df4c4ea0ffbb1e9904dab3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:41.261665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:41.335033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4b34fbbc864174bebcb365906f7473', 'request_id': 'req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.344516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4b34fbbc864174bebcb365906f7473', 'request_id': 'req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.356620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4b34fbbc864174bebcb365906f7473', 'request_id': 'req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.383699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] The token cache is being invalidate because project cd4b34fbbc864174bebcb365906f7473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:41.384013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.384926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.385384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8e9dbec8df4c4ea0ffbb1e9904dab3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.387077 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 933/1877] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:40 2022] DELETE /identity/v3/projects/cd4b34fbbc864174bebcb365906f7473 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:41.387574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8e9dbec8df4c4ea0ffbb1e9904dab3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.387919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:41.389442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:41.425924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8e9dbec8df4c4ea0ffbb1e9904dab3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.429361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8e9dbec8df4c4ea0ffbb1e9904dab3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.448683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8e9dbec8df4c4ea0ffbb1e9904dab3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.471187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:41.479253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 945/1878] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:41 2022] DELETE /identity/v3/users/8c8e9dbec8df4c4ea0ffbb1e9904dab3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:41.485887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:41.487551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:41.546741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca993ea-c54d-4b83-a1af-34ebc2f3ee79 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:41.609448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889bfd-98fc-4ca5-8cd4-ea7f5f8cdf13 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:41.619934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:41.621641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:41.622809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:41.623398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] PATH_INFO: `/v3/users/ecb9df4e8cab4ca99146a60c4034e486` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:41.626513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb9df4e8cab4ca99146a60c4034e486)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:41.640678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:41.642545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:41.677849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:41.680078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:41.680616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:41.681182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] PATH_INFO: `/v3/users/30e56aae999c4c8186dcb51d4f2332e8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:41.705086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e56aae999c4c8186dcb51d4f2332e8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:41.706582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:41.750082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb9df4e8cab4ca99146a60c4034e486'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.751323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb9df4e8cab4ca99146a60c4034e486'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.786418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb9df4e8cab4ca99146a60c4034e486'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.787285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb9df4e8cab4ca99146a60c4034e486'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.801277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-daab0fd5-19ae-4338-8a43-9134f21ac570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb9df4e8cab4ca99146a60c4034e486'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.816040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e56aae999c4c8186dcb51d4f2332e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.816996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e56aae999c4c8186dcb51d4f2332e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.837155 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 946/1879] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:41 2022] DELETE /identity/v3/users/ecb9df4e8cab4ca99146a60c4034e486 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:41.838888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503f08-5338-4ef9-899c-408649e1c481 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:41.839188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503f08-5338-4ef9-899c-408649e1c481 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:41.839468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2503f08-5338-4ef9-899c-408649e1c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:41.870876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e56aae999c4c8186dcb51d4f2332e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.872547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e56aae999c4c8186dcb51d4f2332e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.887164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e2503f08-5338-4ef9-899c-408649e1c481 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:41.889134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e2503f08-5338-4ef9-899c-408649e1c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:41.906441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-adf8bdd9-aab2-4d2e-b179-0502f91dd8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e56aae999c4c8186dcb51d4f2332e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:41.939639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 934/1880] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:41 2022] DELETE /identity/v3/users/30e56aae999c4c8186dcb51d4f2332e8 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:41.941409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:41.941697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:41.941977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:41.972198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] MFA Rules not processed for user `79c12f29545c40ec955650696bb91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:41.973476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:42.080968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 947/1881] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:42.094541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1d32-408d-4b0f-90e0-5bc090e4e6dc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:42.097635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1d32-408d-4b0f-90e0-5bc090e4e6dc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:42.097958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1d32-408d-4b0f-90e0-5bc090e4e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:42.129291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 935/1882] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:42.130957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:42.132528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:42.147247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cf7f1d32-408d-4b0f-90e0-5bc090e4e6dc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:42.148603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cf7f1d32-408d-4b0f-90e0-5bc090e4e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:42.196514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:42.234169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036a385-1043-4db4-b0df-7b4c80cf647e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:42.239332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7987a-f5a2-47a4-ae78-072d36b453df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:42.240138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7987a-f5a2-47a4-ae78-072d36b453df service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:42.240539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7987a-f5a2-47a4-ae78-072d36b453df service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:42.240888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7987a-f5a2-47a4-ae78-072d36b453df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:42.309464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 948/1883] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:42.326876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f1d32-408d-4b0f-90e0-5bc090e4e6dc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:42.330698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:42.347264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f1d32-408d-4b0f-90e0-5bc090e4e6dc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:42.352666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:42.353901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:42.354200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:42.354483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:42.368954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:42.371515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:42.379169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7987a-f5a2-47a4-ae78-072d36b453df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:42.381060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7987a-f5a2-47a4-ae78-072d36b453df service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:42.390081 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 949/1884] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:42.396717 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 936/1885] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:42.629915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:42.631599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:42.649502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be12f-22e1-4563-9dee-35a4527b2af7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:42.664589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:42.665393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:42.665677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:42.666019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] PATH_INFO: `/v3/projects/f09753383d2f43b88dd409bc5ab81667` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:42.667321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09753383d2f43b88dd409bc5ab81667)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:42.669486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:42.731948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09753383d2f43b88dd409bc5ab81667', 'request_id': 'req-ef17864a-80b0-41b4-83d9-39817c75986c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:42.744454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09753383d2f43b88dd409bc5ab81667', 'request_id': 'req-ef17864a-80b0-41b4-83d9-39817c75986c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:42.768447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09753383d2f43b88dd409bc5ab81667', 'request_id': 'req-ef17864a-80b0-41b4-83d9-39817c75986c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:42.788594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] The token cache is being invalidate because project f09753383d2f43b88dd409bc5ab81667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:42.789201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:42.790733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef17864a-80b0-41b4-83d9-39817c75986c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:42.793072 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 950/1886] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:42 2022] DELETE /identity/v3/projects/f09753383d2f43b88dd409bc5ab81667 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:42.798450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef600f2-2142-4348-9cf8-0293984a74c1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:42.799085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef600f2-2142-4348-9cf8-0293984a74c1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:42.799540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef600f2-2142-4348-9cf8-0293984a74c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:42.823786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cef600f2-2142-4348-9cf8-0293984a74c1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:42.825347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cef600f2-2142-4348-9cf8-0293984a74c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:42.930031 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 937/1887] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:42.930700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:42.931314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:42.931676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:42.960212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:42.961883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:42.979846 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 951/1888] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:42.984039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef600f2-2142-4348-9cf8-0293984a74c1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:42.998901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef600f2-2142-4348-9cf8-0293984a74c1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.000261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.001842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.034427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ef635-a695-45e9-9f79-face8ec804fc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.043263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.044586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.045111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.045836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] PATH_INFO: `/v3/projects/cad91b968301480cb579894515116b2b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.047965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad91b968301480cb579894515116b2b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.051486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d54069-5e53-44fe-8018-d40daaa1d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.051864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.056961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d54069-5e53-44fe-8018-d40daaa1d0ad admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.057354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d54069-5e53-44fe-8018-d40daaa1d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.057635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d54069-5e53-44fe-8018-d40daaa1d0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.059264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d54069-5e53-44fe-8018-d40daaa1d0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:43.060868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d54069-5e53-44fe-8018-d40daaa1d0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.067475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d54069-5e53-44fe-8018-d40daaa1d0ad admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.095876 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 938/1889] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:43.095876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1a02-0cbf-4dce-b1b1-f1c4b620a382 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.095876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1a02-0cbf-4dce-b1b1-f1c4b620a382 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.095876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1a02-0cbf-4dce-b1b1-f1c4b620a382 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.096207 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 939/1890] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:43.097123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee1a02-0cbf-4dce-b1b1-f1c4b620a382 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.117181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee1a02-0cbf-4dce-b1b1-f1c4b620a382 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.124686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad91b968301480cb579894515116b2b', 'request_id': 'req-496ba1f8-85c1-4839-989a-6f1d394cf770'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.133476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad91b968301480cb579894515116b2b', 'request_id': 'req-496ba1f8-85c1-4839-989a-6f1d394cf770'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.146966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad91b968301480cb579894515116b2b', 'request_id': 'req-496ba1f8-85c1-4839-989a-6f1d394cf770'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.163546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] The token cache is being invalidate because project cad91b968301480cb579894515116b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:43.163903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.164724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-496ba1f8-85c1-4839-989a-6f1d394cf770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.166606 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 952/1891] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:42 2022] DELETE /identity/v3/projects/cad91b968301480cb579894515116b2b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:43.168401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.173224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.175297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.193231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:43.206566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:43.208544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.213933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.215467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.216086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.216528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.217796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.222139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.251388 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 940/1892] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:43 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:43.254447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.256593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.270035 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 953/1893] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:43.270935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.272240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.287267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21cc0a-150b-42d0-a511-73946bb51eab None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.317950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:43.340714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ed2c-2e4d-48a8-a855-dd716a02ec6a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.346324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.347275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.347557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.347835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] PATH_INFO: `/v3/users/3d628825e0be4cf8a3ae0664014cdbef` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.348346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.349201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d628825e0be4cf8a3ae0664014cdbef)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.349307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.349565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.349844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] PATH_INFO: `/v3/projects/690879bad3004282a01b8f3ccb72c60e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.351042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690879bad3004282a01b8f3ccb72c60e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.351266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.353537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.403226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d628825e0be4cf8a3ae0664014cdbef'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.403937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d628825e0be4cf8a3ae0664014cdbef'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.407605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690879bad3004282a01b8f3ccb72c60e', 'request_id': 'req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.413864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690879bad3004282a01b8f3ccb72c60e', 'request_id': 'req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.416245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d628825e0be4cf8a3ae0664014cdbef'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.417004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d628825e0be4cf8a3ae0664014cdbef'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.421826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690879bad3004282a01b8f3ccb72c60e', 'request_id': 'req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.424632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d628825e0be4cf8a3ae0664014cdbef'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.432432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] The token cache is being invalidate because project 690879bad3004282a01b8f3ccb72c60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:43.432712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.433422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.437924 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 954/1894] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:43 2022] DELETE /identity/v3/projects/690879bad3004282a01b8f3ccb72c60e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:43.437924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.437924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.446116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 941/1895] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:43 2022] DELETE /identity/v3/users/3d628825e0be4cf8a3ae0664014cdbef => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:43.447567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.450909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.515697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:43.539204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb5391-a9c1-475f-8379-97632d58bee6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.542319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102cbd-31c5-4976-a86e-19eb1cc2ad24 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.547361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.548253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.548402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.548879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.549239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.549341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.549663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.550109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] PATH_INFO: `/v3/users/4fd4e2ebd7394448a308605cd990b761` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.550353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.551674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd4e2ebd7394448a308605cd990b761)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.553510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.554025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.581081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 942/1896] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:43 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:43.582156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.584103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.619898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd4e2ebd7394448a308605cd990b761'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.620996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd4e2ebd7394448a308605cd990b761'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.636880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd4e2ebd7394448a308605cd990b761'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.638034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd4e2ebd7394448a308605cd990b761'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.645248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:43.646689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd4e2ebd7394448a308605cd990b761'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.652758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d6ee4-d2ee-489d-827d-643641976738 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.665087 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 955/1897] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:43 2022] DELETE /identity/v3/users/4fd4e2ebd7394448a308605cd990b761 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:43.666873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.669534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.670577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.672647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.673178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.673498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.682404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.706156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.707655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.730354 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 943/1898] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:43.742278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.743754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.777305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b446-2756-44eb-bf21-9ca0a3432022 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.781836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9fe25-ff68-40dd-bdf4-9b11fc582797 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:43.782365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.783261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.783680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.783982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] PATH_INFO: `/v3/users/50c195ac4cc240f6a1aff4753a974be0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.785241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c195ac4cc240f6a1aff4753a974be0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.787701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.796228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076ead4-13cc-413b-863e-8a74b6e4e1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:43.796931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076ead4-13cc-413b-863e-8a74b6e4e1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.799091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076ead4-13cc-413b-863e-8a74b6e4e1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.799385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076ead4-13cc-413b-863e-8a74b6e4e1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.800487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076ead4-13cc-413b-863e-8a74b6e4e1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:43.805968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076ead4-13cc-413b-863e-8a74b6e4e1b7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:43.836957 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 944/1899] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:43.838574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:43.838757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:43.838985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:43.863633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c195ac4cc240f6a1aff4753a974be0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.864332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c195ac4cc240f6a1aff4753a974be0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.869602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:43.870828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.879723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c195ac4cc240f6a1aff4753a974be0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.880365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c195ac4cc240f6a1aff4753a974be0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.884691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:43.891851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 945/1900] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:43.893439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c195ac4cc240f6a1aff4753a974be0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:43.903805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.906590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.933535 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 956/1901] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:43 2022] DELETE /identity/v3/users/50c195ac4cc240f6a1aff4753a974be0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:43.934884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:43.936398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:43.950313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20924ad-1d51-43ab-b5bd-ef4699bb68de None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.029921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77ca08-4f85-4d92-a03b-b8b51bf2c357 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.036737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.037783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.038290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.039647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.120306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.122063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.126562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.127919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.129235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.129885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.131149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.134083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.134676 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 957/1902] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:44.135593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:44.137297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.151459 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 946/1903] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:44.154033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdc01b-43ec-4608-aa75-a8dc5c2df5a7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.156482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:44.161538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.163207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.163497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.163845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] PATH_INFO: `/v3/projects/cbe1001f3ee54a2cbda6b7db3dfeb15c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.165473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe1001f3ee54a2cbda6b7db3dfeb15c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.167559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.185942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0e7e3-7c3d-4659-a681-1f13c7715fd0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.201736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8b7e8-d5ff-40d6-ad43-b405d3c9c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.202674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b7e8-d5ff-40d6-ad43-b405d3c9c2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.203009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b7e8-d5ff-40d6-ad43-b405d3c9c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.203777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b7e8-d5ff-40d6-ad43-b405d3c9c2e3 admin admin] PATH_INFO: `/v3/projects/25a0af8dee334c1daf0a086760e05589/users/65775c0439914096ad0ac53dd291ae96/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.235954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe1001f3ee54a2cbda6b7db3dfeb15c', 'request_id': 'req-bbdb08d2-0ed1-424b-a028-364e00f5e611'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:44.241072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8b7e8-d5ff-40d6-ad43-b405d3c9c2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a0af8dee334c1daf0a086760e05589, user_id=65775c0439914096ad0ac53dd291ae96, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.248209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8b7e8-d5ff-40d6-ad43-b405d3c9c2e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.252894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe1001f3ee54a2cbda6b7db3dfeb15c', 'request_id': 'req-bbdb08d2-0ed1-424b-a028-364e00f5e611'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:44.271012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe1001f3ee54a2cbda6b7db3dfeb15c', 'request_id': 'req-bbdb08d2-0ed1-424b-a028-364e00f5e611'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:44.290570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 947/1904] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:44 2022] PUT /identity/v3/projects/25a0af8dee334c1daf0a086760e05589/users/65775c0439914096ad0ac53dd291ae96/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:44.302590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] The token cache is being invalidate because project cbe1001f3ee54a2cbda6b7db3dfeb15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:44.302915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:44.303311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ecd33-2b0d-4854-b793-1d2ca308694e None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.303613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ecd33-2b0d-4854-b793-1d2ca308694e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.303895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ecd33-2b0d-4854-b793-1d2ca308694e None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.304863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbdb08d2-0ed1-424b-a028-364e00f5e611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:44.306014 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 948/1905] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:01:44.307207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372eb62-4aad-4b0d-b2fb-9846975dc90d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.307491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372eb62-4aad-4b0d-b2fb-9846975dc90d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.307768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372eb62-4aad-4b0d-b2fb-9846975dc90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.310642 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 958/1906] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:44 2022] DELETE /identity/v3/projects/cbe1001f3ee54a2cbda6b7db3dfeb15c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:44.320019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c698d-ccfe-4d47-bdb5-7f15a4fb5cf9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.320455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c698d-ccfe-4d47-bdb5-7f15a4fb5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.320852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c698d-ccfe-4d47-bdb5-7f15a4fb5cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.356581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3372eb62-4aad-4b0d-b2fb-9846975dc90d None None] MFA Rules not processed for user `65775c0439914096ad0ac53dd291ae96`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:44.358613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3372eb62-4aad-4b0d-b2fb-9846975dc90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.366144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3b3c698d-ccfe-4d47-bdb5-7f15a4fb5cf9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:44.370573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b3c698d-ccfe-4d47-bdb5-7f15a4fb5cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.418617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:44.563478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 959/1907] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:44.566446 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 949/1908] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:44.566632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db196c-47e8-4693-8ff1-66c6435e235d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.566632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db196c-47e8-4693-8ff1-66c6435e235d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.567126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db196c-47e8-4693-8ff1-66c6435e235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.568145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.568470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.568795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.608233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c9db196c-47e8-4693-8ff1-66c6435e235d None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:44.609991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c9db196c-47e8-4693-8ff1-66c6435e235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.617386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:44.618855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.642805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 950/1909] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:44.644170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:44.647068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.675508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6364a-91b9-4c16-b0e7-d831863c887e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.689584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.690667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.690950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.691228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.692280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.695453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.766170 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 960/1910] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:44.767629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db196c-47e8-4693-8ff1-66c6435e235d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:44.774010 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 951/1911] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:44 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:44.774953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:44.781351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.781993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db196c-47e8-4693-8ff1-66c6435e235d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.792315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:44.882999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96cb9c-7e55-41ea-8bc8-aec150cc8aec admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.898697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.900932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.901241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.901525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] PATH_INFO: `/v3/projects/6b0fc8e04b60468abb6ae87d02b5426d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.908209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0fc8e04b60468abb6ae87d02b5426d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.911770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.913068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.913910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.914265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.914582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.915437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:44.915860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.917861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.932759 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 961/1912] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:44.933553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:44.945133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadfb5e-3f1e-4cfd-a0d6-1ef66b7145cf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:44.950738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:44.951697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:44.952009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:44.952379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:44.953248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:44.956026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:44.977505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0fc8e04b60468abb6ae87d02b5426d', 'request_id': 'req-3b684a36-1c9d-4c66-bcaa-44d7006aed26'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:44.984412 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 962/1913] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:44 2022] POST /identity/v3/users => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:44.984922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0fc8e04b60468abb6ae87d02b5426d', 'request_id': 'req-3b684a36-1c9d-4c66-bcaa-44d7006aed26'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:44.985316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:44.989460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:44.995291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0fc8e04b60468abb6ae87d02b5426d', 'request_id': 'req-3b684a36-1c9d-4c66-bcaa-44d7006aed26'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.009466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] The token cache is being invalidate because project 6b0fc8e04b60468abb6ae87d02b5426d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:45.009780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.010362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a364f0-cb6f-4a4b-b371-bce0af45c008 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.010628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.012885 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 952/1914] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:44 2022] DELETE /identity/v3/projects/6b0fc8e04b60468abb6ae87d02b5426d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:45.013829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.019055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.047543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:45.087617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.088833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.089404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.089685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] PATH_INFO: `/v3/projects/19c65c1d6e44456da7eb18d05951f8b0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.092813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c65c1d6e44456da7eb18d05951f8b0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.094999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.120869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b684a36-1c9d-4c66-bcaa-44d7006aed26 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.128175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.128865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.129188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.129475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.131657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.146554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.148176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.153748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c65c1d6e44456da7eb18d05951f8b0', 'request_id': 'req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.160930 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 953/1915] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:45.161100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c65c1d6e44456da7eb18d05951f8b0', 'request_id': 'req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.162113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.163698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.171655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c65c1d6e44456da7eb18d05951f8b0', 'request_id': 'req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.179591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f0356-01fb-44d7-8982-a6ac3747a756 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.185593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] The token cache is being invalidate because project 19c65c1d6e44456da7eb18d05951f8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:45.186323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.186602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.188925 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 963/1916] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:44 2022] DELETE /identity/v3/projects/19c65c1d6e44456da7eb18d05951f8b0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:45.190194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.192448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.203963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:45.252683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.253570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.253735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.254013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.254937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.257194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.288345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b61aa-129c-45fa-a50a-ccf10e9b24d6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.293364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 954/1917] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:45 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:45.293580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.294264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.294669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.294952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.295059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.295693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.297318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.297571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.309817 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 964/1918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:45.310685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.312404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.325787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e7227-318f-4986-864d-7d3bb5899188 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.398638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:45.401869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288946e-0f10-480d-9193-7acb04f1b29d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.407885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.408419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.408778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.409300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.410850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] PATH_INFO: `/v3/users/371af22921644f34a83cb16a2f3f119f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.410850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=371af22921644f34a83cb16a2f3f119f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.413554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.423883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.425494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.425948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] PATH_INFO: `/v3/users/77b31aa7cd0047aa8f2ce31eb5e64f15` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.427877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b31aa7cd0047aa8f2ce31eb5e64f15)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.436771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.497595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371af22921644f34a83cb16a2f3f119f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.498635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371af22921644f34a83cb16a2f3f119f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.509684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b31aa7cd0047aa8f2ce31eb5e64f15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.510370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b31aa7cd0047aa8f2ce31eb5e64f15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.523668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371af22921644f34a83cb16a2f3f119f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.525358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b31aa7cd0047aa8f2ce31eb5e64f15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.525674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371af22921644f34a83cb16a2f3f119f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.526218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b31aa7cd0047aa8f2ce31eb5e64f15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.534701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b31aa7cd0047aa8f2ce31eb5e64f15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.553973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371af22921644f34a83cb16a2f3f119f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:45.562025 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 965/1919] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:45 2022] DELETE /identity/v3/users/77b31aa7cd0047aa8f2ce31eb5e64f15 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:45.563103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.565194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.584952 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 955/1920] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:45 2022] DELETE /identity/v3/users/371af22921644f34a83cb16a2f3f119f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:45.584952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.589608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.640703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:45.698143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6c562-1e19-48b8-89e2-11280b9e32f6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.746715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5a300-d8b4-46e8-8ee3-dd63cee928ef admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.770961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.773191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.773740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.774279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] PATH_INFO: `/v3/projects/3e8c3c5a83424f58b83500e5e0199225/users/a6e61ae521dc42ec887e2a3cd6e52068/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.791502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.792838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.793557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.793946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8c3c5a83424f58b83500e5e0199225, user_id=a6e61ae521dc42ec887e2a3cd6e52068, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.794654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.797060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.797416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.805631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.817025 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 956/1921] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:45 2022] PUT /identity/v3/projects/3e8c3c5a83424f58b83500e5e0199225/users/a6e61ae521dc42ec887e2a3cd6e52068/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:45.819399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.825665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:45.861471 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 966/1922] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:45 2022] POST /identity/v3/users => generated 296 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:45.866634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.880268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ad5a4-e848-4a17-b90d-b430002757be admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.894735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:45.937496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4cd98-1fee-4e86-9060-1c192977afa2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.945630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.946569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.947092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.947412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.948422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.950382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:45.965277 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 957/1923] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:45.968217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:45.980689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02644f5-8dc7-4ab8-a603-4981e247447f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:45.986955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc720cb7-c315-44a3-930f-0a45567ada81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:45.987878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720cb7-c315-44a3-930f-0a45567ada81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:45.988161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720cb7-c315-44a3-930f-0a45567ada81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:45.988440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc720cb7-c315-44a3-930f-0a45567ada81 admin admin] PATH_INFO: `/v3/projects/3e8c3c5a83424f58b83500e5e0199225/users/a6e61ae521dc42ec887e2a3cd6e52068/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:45.991258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc720cb7-c315-44a3-930f-0a45567ada81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8c3c5a83424f58b83500e5e0199225, user_id=a6e61ae521dc42ec887e2a3cd6e52068, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:45.995818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc720cb7-c315-44a3-930f-0a45567ada81 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.009280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.010232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.010409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.010639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.021624 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 958/1924] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:45 2022] PUT /identity/v3/projects/3e8c3c5a83424f58b83500e5e0199225/users/a6e61ae521dc42ec887e2a3cd6e52068/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:01:46.021935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.021935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.023166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.023461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.023744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.044016 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 967/1925] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:01:46.046491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:46.069308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb00441-0fc2-4559-a3dc-5425bbdbd244 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:46.092033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] MFA Rules not processed for user `a6e61ae521dc42ec887e2a3cd6e52068`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:46.093566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.167055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.167843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.168157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.168468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.170093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.171938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.193435 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 968/1926] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:46.194750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:46.216974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815829-5196-4340-895a-afcac5cd4a93 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:46.223104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.224022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.224306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.224785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] PATH_INFO: `/v3/projects/b967e1c14fa24cb68ccc8af4afd35146/users/984077a564034acaa9b5219a26ca1031/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.244458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b967e1c14fa24cb68ccc8af4afd35146, user_id=984077a564034acaa9b5219a26ca1031, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.247603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.268587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 959/1927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:46.268587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:46.274039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.279133 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 969/1928] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:46 2022] PUT /identity/v3/projects/b967e1c14fa24cb68ccc8af4afd35146/users/984077a564034acaa9b5219a26ca1031/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:46.280958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:46.283064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.308132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4829cb-6a17-4c0b-86f6-3295e2b14aee None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:46.353426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:46.415346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810a11-41b2-4ff1-a4b0-7cc379c33bf8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:46.425463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bc3a1-470f-4356-80c9-30689a8f37e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.440383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.440383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.440383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.440383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] PATH_INFO: `/v3/projects/1eaef672917e400b8359d0e28fd5e2aa` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.440818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc3a1-470f-4356-80c9-30689a8f37e5 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.440818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc3a1-470f-4356-80c9-30689a8f37e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.440818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc3a1-470f-4356-80c9-30689a8f37e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.442069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaef672917e400b8359d0e28fd5e2aa)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.444594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.459456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:46.536711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaef672917e400b8359d0e28fd5e2aa', 'request_id': 'req-34378710-9565-4090-be53-403d7d8e2445'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.544971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaef672917e400b8359d0e28fd5e2aa', 'request_id': 'req-34378710-9565-4090-be53-403d7d8e2445'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.557964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bc3a1-470f-4356-80c9-30689a8f37e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.560170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bc3a1-470f-4356-80c9-30689a8f37e5 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.563564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaef672917e400b8359d0e28fd5e2aa', 'request_id': 'req-34378710-9565-4090-be53-403d7d8e2445'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.575022 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 970/1929] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:46.575022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971187a-3e5a-45da-8dfe-ca166e8236e6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.575022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971187a-3e5a-45da-8dfe-ca166e8236e6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.575022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971187a-3e5a-45da-8dfe-ca166e8236e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.581123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] The token cache is being invalidate because project 1eaef672917e400b8359d0e28fd5e2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:46.581123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.581123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.581720 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 960/1930] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:46 2022] DELETE /identity/v3/projects/1eaef672917e400b8359d0e28fd5e2aa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:46.582406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:46.583722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.610227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e971187a-3e5a-45da-8dfe-ca166e8236e6 None None] MFA Rules not processed for user `984077a564034acaa9b5219a26ca1031`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:46.611684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e971187a-3e5a-45da-8dfe-ca166e8236e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.669235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34378710-9565-4090-be53-403d7d8e2445 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:46.676628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.677778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.678447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.678879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] PATH_INFO: `/v3/projects/faf7f84a989a4297bd2286ce76be94ac` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.680493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf7f84a989a4297bd2286ce76be94ac)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.682684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.702438 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 971/1931] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:46.704342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.704531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.704811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.727218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:46.728505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.738157 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 972/1932] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:46.739039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:46.740618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.769556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf7f84a989a4297bd2286ce76be94ac', 'request_id': 'req-cb190331-5924-46ae-a4a7-73f75a531da1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.770718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94569f-067d-499c-90a2-0bbf7ebb1c9d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:46.771404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:46.781053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf7f84a989a4297bd2286ce76be94ac', 'request_id': 'req-cb190331-5924-46ae-a4a7-73f75a531da1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.793866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf7f84a989a4297bd2286ce76be94ac', 'request_id': 'req-cb190331-5924-46ae-a4a7-73f75a531da1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.807744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] The token cache is being invalidate because project faf7f84a989a4297bd2286ce76be94ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:46.808030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.808702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.812854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 961/1933] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:46 2022] DELETE /identity/v3/projects/faf7f84a989a4297bd2286ce76be94ac => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:46.813952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:46.815796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:46.870848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.871758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.872042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.872317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] PATH_INFO: `/v3/users/65775c0439914096ad0ac53dd291ae96` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.873902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65775c0439914096ad0ac53dd291ae96)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.875955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.922170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb190331-5924-46ae-a4a7-73f75a531da1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:46.927235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdf351-3005-4e11-b168-2353e003c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:46.927903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf351-3005-4e11-b168-2353e003c8ad admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.928185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf351-3005-4e11-b168-2353e003c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.928457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf351-3005-4e11-b168-2353e003c8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.928728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:46.929208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf351-3005-4e11-b168-2353e003c8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:46.931179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf351-3005-4e11-b168-2353e003c8ad admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:46.940032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65775c0439914096ad0ac53dd291ae96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.940835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65775c0439914096ad0ac53dd291ae96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.960464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65775c0439914096ad0ac53dd291ae96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.961232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65775c0439914096ad0ac53dd291ae96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.967862 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 962/1934] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:46 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:46.967862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.967862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.967862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.968164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5dee461c-00b5-472e-abc3-f6961874215a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65775c0439914096ad0ac53dd291ae96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:46.983121 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 973/1935] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:46 2022] DELETE /identity/v3/users/65775c0439914096ad0ac53dd291ae96 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:46.985114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cfe2b-fee3-4d04-99ae-89b09d9828c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:46.985464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cfe2b-fee3-4d04-99ae-89b09d9828c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:46.985799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cfe2b-fee3-4d04-99ae-89b09d9828c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:46.991451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:46.992716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:47.007928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bd5cfe2b-fee3-4d04-99ae-89b09d9828c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:47.009153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bd5cfe2b-fee3-4d04-99ae-89b09d9828c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:47.077840 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 963/1936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:47.080309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.081906 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 974/1937] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:47.083401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e08784-9272-404c-9295-363783890e88 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.083947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e08784-9272-404c-9295-363783890e88 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.084376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e08784-9272-404c-9295-363783890e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.085525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:47.098341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01329d-fba3-453e-9bbd-fc21940e0017 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.103278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276970-d65a-4661-a2be-f619ac6ad4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.103961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276970-d65a-4661-a2be-f619ac6ad4cf admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.104244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276970-d65a-4661-a2be-f619ac6ad4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.104517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276970-d65a-4661-a2be-f619ac6ad4cf admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.105389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276970-d65a-4661-a2be-f619ac6ad4cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.107318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276970-d65a-4661-a2be-f619ac6ad4cf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.110322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d5e08784-9272-404c-9295-363783890e88 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:47.111508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d5e08784-9272-404c-9295-363783890e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:47.123768 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 975/1938] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:47.124739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e08784-9272-404c-9295-363783890e88 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.135577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e08784-9272-404c-9295-363783890e88 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.140458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.141472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.141755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.142030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.142881 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 964/1939] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:47 2022] POST /identity/v3/users => generated 302 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:47.142998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:47.143247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.144347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e2789-8cec-423a-91a4-228f2bb17c1e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.144699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e2789-8cec-423a-91a4-228f2bb17c1e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.144872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.144972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e2789-8cec-423a-91a4-228f2bb17c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.157529 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 976/1940] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:47.158378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.162444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:47.169909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1a4e2789-8cec-423a-91a4-228f2bb17c1e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:47.171129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1a4e2789-8cec-423a-91a4-228f2bb17c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:47.184166 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 965/1941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:47.193359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e2789-8cec-423a-91a4-228f2bb17c1e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.197730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e2789-8cec-423a-91a4-228f2bb17c1e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.203739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.204417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.204696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.204969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.205789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.207511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.218344 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 966/1942] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:47.222195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.236296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b7b6a-9403-45db-be1b-bd76e3d90888 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.241385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4550-b338-4f2f-807f-87acbee6a693 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.241551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.242216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.242497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.242900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.243590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.245518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.246554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.247515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.247741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.248019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.260430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.263031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.278767 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 977/1944] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:47.278960 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 967/1944] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:47 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:47.279717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.279991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.298010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:47.312339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13914d0-660f-401f-b64e-97d40d0b7767 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.358066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:47.412038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbea83-b5f8-46a9-ae4a-eb64a8d8d1ea admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.416297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.417577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.417983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.418273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.419152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:47.419476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.420188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.421996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.422107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.422600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.423054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] PATH_INFO: `/v3/projects/11b839b7299c44399bf0478baee4abce/users/cb93d8314d1541668c9f6ab3b07f8405/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.440638 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 978/1945] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:47.442087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.450676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b839b7299c44399bf0478baee4abce, user_id=cb93d8314d1541668c9f6ab3b07f8405, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.453668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.476159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7942d0-a009-4c62-933e-8ec603ccfc2d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.480059 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 968/1946] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:47 2022] PUT /identity/v3/projects/11b839b7299c44399bf0478baee4abce/users/cb93d8314d1541668c9f6ab3b07f8405/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:47.483640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.570621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.571552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.572286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.572575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.573941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.577383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.603004 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 979/1947] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:47 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:47.604208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.604323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c8768-b1ca-4b87-8752-f11f642ecbbd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.610424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.610622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.610834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.611070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.611770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.613730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.616178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19e37a-31ab-4e4c-826a-00cffb0c218e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.621528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.622398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.622678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.623060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.623715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.626094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.642569 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 980/1948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:47.642569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.676006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337e47-5ac8-411e-a2e0-9c1b30865e54 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.682740 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 969/1949] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:47 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:47.684772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.778892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.779648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.779900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.780177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.781814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.783717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.800911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 981/1950] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:47.800911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.802755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a1e60-12e2-4577-a2de-e951ed37dc5e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.810093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.811833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71caf-52bb-486f-a7a3-50d268177181 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.812033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.812638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.813089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] PATH_INFO: `/v3/projects/11b839b7299c44399bf0478baee4abce/users/cb93d8314d1541668c9f6ab3b07f8405/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.817101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b839b7299c44399bf0478baee4abce, user_id=cb93d8314d1541668c9f6ab3b07f8405, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.818825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.819515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.819796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.820068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.821069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.821852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.823004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:47.853319 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 970/1951] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:47 2022] PUT /identity/v3/projects/11b839b7299c44399bf0478baee4abce/users/cb93d8314d1541668c9f6ab3b07f8405/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:47.854223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.864361 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 982/1952] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:47 2022] POST /identity/v3/users => generated 292 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:47.867297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:47.870570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:47.875330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:47.915421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:47.977824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352df0e-2016-460a-8609-d072c87084a3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.981473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea557-abf1-4d98-930e-fdfeb891aaed admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:47.985687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b078d-0999-4cfa-a8ac-4301cc61b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:47.986802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b078d-0999-4cfa-a8ac-4301cc61b870 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:47.986802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b078d-0999-4cfa-a8ac-4301cc61b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:47.987044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b078d-0999-4cfa-a8ac-4301cc61b870 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:47.988008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b078d-0999-4cfa-a8ac-4301cc61b870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:47.989547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b078d-0999-4cfa-a8ac-4301cc61b870 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.003364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 971/1953] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:48.003364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9654b-d7be-44d2-ae96-2fb1a27779e1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.003364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9654b-d7be-44d2-ae96-2fb1a27779e1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.003364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9654b-d7be-44d2-ae96-2fb1a27779e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.039832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-85e9654b-d7be-44d2-ae96-2fb1a27779e1 None None] MFA Rules not processed for user `cb93d8314d1541668c9f6ab3b07f8405`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:48.041093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85e9654b-d7be-44d2-ae96-2fb1a27779e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.090285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.091084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.091429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.091770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.093735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.117864 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 972/1954] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:48.118924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9654b-d7be-44d2-ae96-2fb1a27779e1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.131460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9654b-d7be-44d2-ae96-2fb1a27779e1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.136779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.137505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.137785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.138061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.138911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.140401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.151090 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 973/1955] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:48.151946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.153624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.165731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.166917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f0703-1c46-46f6-8cb6-6fbce576e9ca admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.167362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.171825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.172742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.173016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.173427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] PATH_INFO: `/v3/projects/25a0af8dee334c1daf0a086760e05589` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.178305 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 983/1956] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:48.178709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a0af8dee334c1daf0a086760e05589)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.178967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.183157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.193724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22c88-1c56-48af-b926-7225a01e2e3c service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.200482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.201436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.201963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.202243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] PATH_INFO: `/v3/projects/e83fa6c281d14bf686fc93aaaa2c636b/users/2e3b36b6855f473fb45a9e07a135a252/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.222979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83fa6c281d14bf686fc93aaaa2c636b, user_id=2e3b36b6855f473fb45a9e07a135a252, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.225748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.243650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a0af8dee334c1daf0a086760e05589', 'request_id': 'req-e6308ad5-d617-47d8-b952-864aa9a31ef1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.246383 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 984/1957] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:48 2022] PUT /identity/v3/projects/e83fa6c281d14bf686fc93aaaa2c636b/users/2e3b36b6855f473fb45a9e07a135a252/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:48.246817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.248914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.264446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a0af8dee334c1daf0a086760e05589', 'request_id': 'req-e6308ad5-d617-47d8-b952-864aa9a31ef1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.274596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a0af8dee334c1daf0a086760e05589', 'request_id': 'req-e6308ad5-d617-47d8-b952-864aa9a31ef1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.286943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] The token cache is being invalidate because project 25a0af8dee334c1daf0a086760e05589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:48.287787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.287992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.292869 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 974/1958] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:48 2022] DELETE /identity/v3/projects/25a0af8dee334c1daf0a086760e05589 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:48.294141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.295564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.300791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:48.302174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:48.359830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad18f8-4da6-464d-8e2a-52b7a4dc2a37 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.366578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.367410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.367880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.368152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.373875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.385358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6308ad5-d617-47d8-b952-864aa9a31ef1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.474367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bdf4a-23a7-4530-a254-12f508c15690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.475076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bdf4a-23a7-4530-a254-12f508c15690 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.475372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bdf4a-23a7-4530-a254-12f508c15690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.475697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bdf4a-23a7-4530-a254-12f508c15690 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.477082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bdf4a-23a7-4530-a254-12f508c15690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.481388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9bdf4a-23a7-4530-a254-12f508c15690 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.487738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.489824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.495625 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 975/1959] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:48.495625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb580a2-7299-4aed-a2aa-5b4cd390e051 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.495625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb580a2-7299-4aed-a2aa-5b4cd390e051 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.495625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb580a2-7299-4aed-a2aa-5b4cd390e051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.502718 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 985/1960] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:48.503799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.505315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.525561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8462877-4c0f-4a3b-8637-898ff6a7a68c service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.537609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-adb580a2-7299-4aed-a2aa-5b4cd390e051 None None] MFA Rules not processed for user `2e3b36b6855f473fb45a9e07a135a252`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:48.540120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-adb580a2-7299-4aed-a2aa-5b4cd390e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.543552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.544661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.544943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.545687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] PATH_INFO: `/v3/users/a6e61ae521dc42ec887e2a3cd6e52068` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.548477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e61ae521dc42ec887e2a3cd6e52068)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.551136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.619048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e61ae521dc42ec887e2a3cd6e52068'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.620006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e61ae521dc42ec887e2a3cd6e52068'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.641333 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 976/1961] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:48.642648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb580a2-7299-4aed-a2aa-5b4cd390e051 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.647081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e61ae521dc42ec887e2a3cd6e52068'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.647793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e61ae521dc42ec887e2a3cd6e52068'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.657717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb580a2-7299-4aed-a2aa-5b4cd390e051 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.658182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e61ae521dc42ec887e2a3cd6e52068'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:48.664266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd91ea-f7ff-4d21-8be8-49967e4547e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.665526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd91ea-f7ff-4d21-8be8-49967e4547e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.665923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd91ea-f7ff-4d21-8be8-49967e4547e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.666340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd91ea-f7ff-4d21-8be8-49967e4547e6 admin admin] PATH_INFO: `/v3/projects/503cdd964cc143e4990fba18313ea818/users/ac1f751c3ba64e29bd0b66e758ede8a3/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.675817 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 986/1962] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:48 2022] DELETE /identity/v3/users/a6e61ae521dc42ec887e2a3cd6e52068 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:48.677110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.678637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.683222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd91ea-f7ff-4d21-8be8-49967e4547e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503cdd964cc143e4990fba18313ea818, user_id=ac1f751c3ba64e29bd0b66e758ede8a3, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.686243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd91ea-f7ff-4d21-8be8-49967e4547e6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.707700 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 977/1963] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:48 2022] PUT /identity/v3/projects/503cdd964cc143e4990fba18313ea818/users/ac1f751c3ba64e29bd0b66e758ede8a3/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:48.717935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.718469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.718763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.742152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:48.761399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] MFA Rules not processed for user `ac1f751c3ba64e29bd0b66e758ede8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:48.763074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.786864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:48.825351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1291b-110a-472b-810b-17d6cc32fcee admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.887099 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 978/1964] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:48.894861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.897147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:48.905271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.907280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.908830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.909098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.911027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.915734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.923102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc910ee-f4ac-45f4-8773-c1e7d0c79b4f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:48.929455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275490-723d-4228-8a67-291824329990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:48.930278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275490-723d-4228-8a67-291824329990 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:48.930652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275490-723d-4228-8a67-291824329990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:48.931039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275490-723d-4228-8a67-291824329990 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:48.931831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f275490-723d-4228-8a67-291824329990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:48.934625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f275490-723d-4228-8a67-291824329990 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:48.971026 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 987/1965] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:48 2022] POST /identity/v3/projects => generated 375 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:48.973752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:48.981476 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 979/1966] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:48 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:48.985200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275490-723d-4228-8a67-291824329990 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.083193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465aee5-3986-4166-bf8e-1b4081a3bb43 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.120875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275490-723d-4228-8a67-291824329990 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.135474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.136352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.136755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.137585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.138419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.141092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.173132 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 980/1967] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:48 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:01:49.174096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.174518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.175217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.175501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.175863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.176578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.178767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.181147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:49.197382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f025cd-5c77-4aad-9603-d2a6993423f4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.202455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.203190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.203470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.203769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] PATH_INFO: `/v3/projects/3e8c3c5a83424f58b83500e5e0199225` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.203952 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 988/1968] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:48 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:49.204987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8c3c5a83424f58b83500e5e0199225)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.205124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.207011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.227212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099760a3-a2f8-4d94-964c-f759905afc6b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.232554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.233251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.233611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.233857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.234729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.236612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.243367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:49.254723 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 989/1969] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:49.255848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.274964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899e583-971d-4e08-b63b-d9d020e651e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.275852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8c3c5a83424f58b83500e5e0199225', 'request_id': 'req-1ca86461-803b-4a98-bdca-199abd16bbcf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:49.283684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8c3c5a83424f58b83500e5e0199225', 'request_id': 'req-1ca86461-803b-4a98-bdca-199abd16bbcf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:49.296211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8c3c5a83424f58b83500e5e0199225', 'request_id': 'req-1ca86461-803b-4a98-bdca-199abd16bbcf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:49.300680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:49.322375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] The token cache is being invalidate because project 3e8c3c5a83424f58b83500e5e0199225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:49.322671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:49.323363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:49.324981 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 981/1970] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:49 2022] DELETE /identity/v3/projects/3e8c3c5a83424f58b83500e5e0199225 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:49.325763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.327162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:49.382770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.383508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.383790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.384452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.385273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.386918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.399577 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 990/1971] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:49.399577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.402654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:49.406880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca86461-803b-4a98-bdca-199abd16bbcf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.411735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c6d6-7440-4085-a993-becb02b63780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.412631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c6d6-7440-4085-a993-becb02b63780 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.412906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c6d6-7440-4085-a993-becb02b63780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.416685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c6d6-7440-4085-a993-becb02b63780 admin admin] PATH_INFO: `/v3/projects/118da77b66654cfd8df2a932442e16f8/users/dbfe21975dc04864a8fb8cf787372b48/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.433157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c6d6-7440-4085-a993-becb02b63780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118da77b66654cfd8df2a932442e16f8, user_id=dbfe21975dc04864a8fb8cf787372b48, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.435837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c6d6-7440-4085-a993-becb02b63780 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.450082 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 982/1972] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:49 2022] PUT /identity/v3/projects/118da77b66654cfd8df2a932442e16f8/users/dbfe21975dc04864a8fb8cf787372b48/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:49.452767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.452767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.452767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.483606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:49.485160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:49.501774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee443-cf6d-4363-894d-2b7108262d14 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.570325 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 983/1973] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:49.571496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.573264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:49.578380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7a062-8e35-46a0-9d4c-164d162dddda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.579075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a062-8e35-46a0-9d4c-164d162dddda service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.579353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a062-8e35-46a0-9d4c-164d162dddda service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.579622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a062-8e35-46a0-9d4c-164d162dddda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.582542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14d7a062-8e35-46a0-9d4c-164d162dddda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:49.586133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e6f3-d01e-46d5-b205-d1e5361212d3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.606681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.607786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.608067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.608337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] PATH_INFO: `/v3/projects/0f08e1929913474c84ec87315d8a064b/users/609dcdf9d5c94261b22fed35f1bb913a/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.619043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:49.631257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f08e1929913474c84ec87315d8a064b, user_id=609dcdf9d5c94261b22fed35f1bb913a, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.634114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.654486 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 984/1974] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:49 2022] PUT /identity/v3/projects/0f08e1929913474c84ec87315d8a064b/users/609dcdf9d5c94261b22fed35f1bb913a/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:49.655846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.676821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7a062-8e35-46a0-9d4c-164d162dddda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.678779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7a062-8e35-46a0-9d4c-164d162dddda service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.692557 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 991/1975] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:49.694654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042569a-2fc2-4050-baec-c8275195dfe4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.695187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042569a-2fc2-4050-baec-c8275195dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.695735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042569a-2fc2-4050-baec-c8275195dfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.722574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2042569a-2fc2-4050-baec-c8275195dfe4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:49.723866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2042569a-2fc2-4050-baec-c8275195dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:49.729474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:49.742770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51fc6a-e84a-4472-adac-e54af80331da admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.749864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.753008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.753447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.753749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.754694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.756806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.770378 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 985/1976] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:49.771723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.785985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20497-b638-4651-b8db-8e060df96405 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.791019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.791711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.791990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.792348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.793093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.794741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.807448 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 992/1977] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:49.808526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042569a-2fc2-4050-baec-c8275195dfe4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.822072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042569a-2fc2-4050-baec-c8275195dfe4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.826978 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 986/1978] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:49.828021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.829769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.831083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.831458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.831829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] PATH_INFO: `/v3/projects/118da77b66654cfd8df2a932442e16f8/users/dbfe21975dc04864a8fb8cf787372b48/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.834177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118da77b66654cfd8df2a932442e16f8, user_id=dbfe21975dc04864a8fb8cf787372b48, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.837211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.840459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b733-3fcb-4e48-a873-961830c57d82 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:49.847369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5605cd-e32a-4747-9e9d-a385baa5a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:49.848057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5605cd-e32a-4747-9e9d-a385baa5a4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.848340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5605cd-e32a-4747-9e9d-a385baa5a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.848616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5605cd-e32a-4747-9e9d-a385baa5a4f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.849446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5605cd-e32a-4747-9e9d-a385baa5a4f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:49.849756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5605cd-e32a-4747-9e9d-a385baa5a4f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:49.861517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 993/1979] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:49 2022] PUT /identity/v3/projects/118da77b66654cfd8df2a932442e16f8/users/dbfe21975dc04864a8fb8cf787372b48/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:49.861762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5605cd-e32a-4747-9e9d-a385baa5a4f1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:49.861861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:49.883016 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 987/1980] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:49.883016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973bce-f4ad-4d1f-8993-8a32c548fe0d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:49.883016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973bce-f4ad-4d1f-8993-8a32c548fe0d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:49.883016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973bce-f4ad-4d1f-8993-8a32c548fe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:49.959011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1e973bce-f4ad-4d1f-8993-8a32c548fe0d None None] MFA Rules not processed for user `dbfe21975dc04864a8fb8cf787372b48`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:49.960727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1e973bce-f4ad-4d1f-8993-8a32c548fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:50.020005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee0c30-20f2-4a68-befa-6c4cc3e8b681 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.033630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.033630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.033630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.033630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] PATH_INFO: `/v3/projects/0f08e1929913474c84ec87315d8a064b/users/609dcdf9d5c94261b22fed35f1bb913a/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.040488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f08e1929913474c84ec87315d8a064b, user_id=609dcdf9d5c94261b22fed35f1bb913a, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.043472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.071671 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 994/1981] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:49 2022] PUT /identity/v3/projects/0f08e1929913474c84ec87315d8a064b/users/609dcdf9d5c94261b22fed35f1bb913a/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:50.072891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.083320 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 988/1982] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:50.085010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40adad3-823d-4914-b499-e8705cf8cc74 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.085800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40adad3-823d-4914-b499-e8705cf8cc74 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.085800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40adad3-823d-4914-b499-e8705cf8cc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.127223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c40adad3-823d-4914-b499-e8705cf8cc74 None None] MFA Rules not processed for user `609dcdf9d5c94261b22fed35f1bb913a`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:50.128708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c40adad3-823d-4914-b499-e8705cf8cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:50.147160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:50.179050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874052d-bd2e-4bbb-847c-788d420fa2a9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.184396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.185547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.185547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.185692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.186301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.188364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.237214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 995/1983] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:50 2022] POST /identity/v3/projects => generated 399 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:50.239872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.241920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:50.278745 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 989/1984] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:50.283342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40adad3-823d-4914-b499-e8705cf8cc74 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.299705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40adad3-823d-4914-b499-e8705cf8cc74 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.351436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:50.384826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c356c-e8f7-4f77-853f-4cf43f9846da admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.398334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.401947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.401947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.401947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.407065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.407794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.408069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.408398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.409290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.412856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.451950 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 990/1985] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:50 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:50.454398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.490743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef3f50-ee34-4ed9-9fc8-fd5a7c13f624 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.495478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.496170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.496448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.496720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.497634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.499884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.509777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.511557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.512312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 991/1986] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:01:50.513407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.538829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6142b-eb11-4e87-a433-8bd41eefa528 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.545420 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 996/1987] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:50.545558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525cdc1-bfaa-4842-808e-9f68c7683dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.546234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525cdc1-bfaa-4842-808e-9f68c7683dca service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.546514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525cdc1-bfaa-4842-808e-9f68c7683dca service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.546790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525cdc1-bfaa-4842-808e-9f68c7683dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.546896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.566924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14fb00-18f6-4bcf-a0e1-5ea7d85b40c2 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.572570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.573830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.574116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.574390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.575416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.577083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.592967 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 997/1988] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:50.596216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.609640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32813-0014-4b28-99db-ff392e6069f0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.618174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.619374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.620052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.620336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] PATH_INFO: `/v3/projects/f83f58887253437e8a2f9157e23244d4/users/6ea800942817425794e2f4b8b5aa9288/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.651282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525cdc1-bfaa-4842-808e-9f68c7683dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.654612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525cdc1-bfaa-4842-808e-9f68c7683dca service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.656009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83f58887253437e8a2f9157e23244d4, user_id=6ea800942817425794e2f4b8b5aa9288, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.659162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:50.676859 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 992/1989] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:50.683065 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 998/1990] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:50 2022] PUT /identity/v3/projects/f83f58887253437e8a2f9157e23244d4/users/6ea800942817425794e2f4b8b5aa9288/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:50.694149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ac40e-17de-42a4-9f4b-55c3aed48983 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.694583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ac40e-17de-42a4-9f4b-55c3aed48983 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.694756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ac40e-17de-42a4-9f4b-55c3aed48983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.738227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-660ac40e-17de-42a4-9f4b-55c3aed48983 None None] MFA Rules not processed for user `6ea800942817425794e2f4b8b5aa9288`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:50.741251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-660ac40e-17de-42a4-9f4b-55c3aed48983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:50.867560 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 993/1991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:50.868712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:50.906363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:50.957804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76954e3-aefb-43f0-af7c-840bab9b9f64 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:50.963462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:50.964396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:50.964671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:50.964951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:50.965750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:50.967918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:51.000919 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 999/1992] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:50 2022] POST /identity/v3/projects => generated 397 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:01:51.004875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ac40e-17de-42a4-9f4b-55c3aed48983 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:51.018174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ac40e-17de-42a4-9f4b-55c3aed48983 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:51.084971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:51.138330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:51.139254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:51.139623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:51.139972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:51.140839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:51.143857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:51.188331 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 994/1993] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:51 2022] POST /identity/v3/users => generated 305 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:51.192565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:51.199989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:51.212596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505e1f-7acd-4283-9c4c-864d105047ff admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:51.219637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:51.220338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:51.220625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:51.220899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:51.221742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:51.224142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:51.251089 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1000/1994] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:51.254919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:51.267440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179161d-1538-4cdf-9452-6663d69e7694 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:51.273549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:51.274955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:51.275320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:51.275668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] PATH_INFO: `/v3/projects/785513ceec0f48f99e27d8d7e7bc5aca/users/0803acbbfac946d19f661e007b4fbda4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:51.303577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=785513ceec0f48f99e27d8d7e7bc5aca, user_id=0803acbbfac946d19f661e007b4fbda4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:51.306509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:51.332090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1001/1995] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:51 2022] PUT /identity/v3/projects/785513ceec0f48f99e27d8d7e7bc5aca/users/0803acbbfac946d19f661e007b4fbda4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:51.333021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:51.333669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4020055-0a2c-4385-ba72-0f0b3fac52fd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:51.419621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04400a-ef74-4151-a91a-a8ffbbb793ef admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:51.420510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42e8cc-58b3-4099-bed6-e18376ba13f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:51.421863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e8cc-58b3-4099-bed6-e18376ba13f7 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:51.422285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e8cc-58b3-4099-bed6-e18376ba13f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:51.422858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42e8cc-58b3-4099-bed6-e18376ba13f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:51.424517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:51.425216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8c42e8cc-58b3-4099-bed6-e18376ba13f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:51.425330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:51.425607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:51.425886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:51.426638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:51.428258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:51.440111 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1002/1996] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:51.444843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:51.456092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59805c8-4205-4cf3-b624-722429532a60 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:51.461439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b098b-b618-4349-83bb-4bd234d98a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:51.462532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b098b-b618-4349-83bb-4bd234d98a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:51.462825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b098b-b618-4349-83bb-4bd234d98a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:51.463098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b098b-b618-4349-83bb-4bd234d98a16 admin admin] PATH_INFO: `/v3/projects/785513ceec0f48f99e27d8d7e7bc5aca/users/0803acbbfac946d19f661e007b4fbda4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:51.465367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b098b-b618-4349-83bb-4bd234d98a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785513ceec0f48f99e27d8d7e7bc5aca, user_id=0803acbbfac946d19f661e007b4fbda4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:51.476605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b098b-b618-4349-83bb-4bd234d98a16 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:51.491617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1003/1997] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:51 2022] PUT /identity/v3/projects/785513ceec0f48f99e27d8d7e7bc5aca/users/0803acbbfac946d19f661e007b4fbda4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:01:51.503518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086ad6-fd46-42a4-b01e-17bff86831c4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:51.503832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086ad6-fd46-42a4-b01e-17bff86831c4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:51.504080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b086ad6-fd46-42a4-b01e-17bff86831c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:51.512330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42e8cc-58b3-4099-bed6-e18376ba13f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:51.521734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42e8cc-58b3-4099-bed6-e18376ba13f7 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:51.527466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:51.540112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4b086ad6-fd46-42a4-b01e-17bff86831c4 None None] MFA Rules not processed for user `0803acbbfac946d19f661e007b4fbda4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:51.541240 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 995/1998] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:51.542191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b086ad6-fd46-42a4-b01e-17bff86831c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:51.609856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:51.639985 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1004/1999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:52.093261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438315b-75b0-4cd2-bdca-1e02fb530340 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:52.093460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438315b-75b0-4cd2-bdca-1e02fb530340 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:52.093749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438315b-75b0-4cd2-bdca-1e02fb530340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:52.119996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e438315b-75b0-4cd2-bdca-1e02fb530340 None None] MFA Rules not processed for user `c9ae6d217f7344408eed23388dd337b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:52.121281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e438315b-75b0-4cd2-bdca-1e02fb530340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:52.132896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b086ad6-fd46-42a4-b01e-17bff86831c4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:52.188317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 996/2000] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:52.230650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b086ad6-fd46-42a4-b01e-17bff86831c4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:52.236400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:52.237125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:52.237411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:52.237686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:52.299337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:52.301025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:52.312148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1005/2001] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:53.178641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438315b-75b0-4cd2-bdca-1e02fb530340 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:53.197079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438315b-75b0-4cd2-bdca-1e02fb530340 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:53.206048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:53.206974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:53.207605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:53.207956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:53.222431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:53.224219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:53.236210 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 997/2002] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:53.358135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:53.449166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3252c3-4151-4c7f-88d3-416619686879 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:53.462798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:53.464163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:53.464441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:53.464711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] PATH_INFO: `/v3/users/2e3b36b6855f473fb45a9e07a135a252` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:53.466449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3b36b6855f473fb45a9e07a135a252)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:53.468808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:53.526568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:53.528245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:53.554701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4998dc7-e32f-4fba-8da9-708a9cc5b514 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:53.562216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:53.563887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:53.564758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:53.565312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] PATH_INFO: `/v3/users/ac1f751c3ba64e29bd0b66e758ede8a3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:53.568724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1f751c3ba64e29bd0b66e758ede8a3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:53.572431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:53.574252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3b36b6855f473fb45a9e07a135a252'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.575357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3b36b6855f473fb45a9e07a135a252'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.607224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3b36b6855f473fb45a9e07a135a252'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.608002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3b36b6855f473fb45a9e07a135a252'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.624446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dd45b1f0-2958-402a-9fef-aec77050a871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3b36b6855f473fb45a9e07a135a252'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.670170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1f751c3ba64e29bd0b66e758ede8a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.670807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1f751c3ba64e29bd0b66e758ede8a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.697935 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1006/2003] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:53 2022] DELETE /identity/v3/users/2e3b36b6855f473fb45a9e07a135a252 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:53.704242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1f751c3ba64e29bd0b66e758ede8a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.704704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163cd19-1375-448a-9d03-3d4777e5b17d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:53.704999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163cd19-1375-448a-9d03-3d4777e5b17d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:53.705300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163cd19-1375-448a-9d03-3d4777e5b17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:53.705401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1f751c3ba64e29bd0b66e758ede8a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.726771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1f751c3ba64e29bd0b66e758ede8a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.746755 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 998/2004] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:53 2022] DELETE /identity/v3/users/ac1f751c3ba64e29bd0b66e758ede8a3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:53.747832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:53.749592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:53.754116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8163cd19-1375-448a-9d03-3d4777e5b17d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:53.755618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8163cd19-1375-448a-9d03-3d4777e5b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:53.842430 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1007/2005] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:53.844877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:53.845197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:53.845539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:53.868100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:53.869392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:53.873003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681b09f-54be-425f-8fed-a15d74c035d9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:53.878321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:53.879623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:53.880029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:53.880417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] PATH_INFO: `/v3/users/6ea800942817425794e2f4b8b5aa9288` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:53.882234 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1008/2006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:53.882565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea800942817425794e2f4b8b5aa9288)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:53.885512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:53.891658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:53.917658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:53.926831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:53.982109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea800942817425794e2f4b8b5aa9288'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:53.983580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea800942817425794e2f4b8b5aa9288'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.002919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea800942817425794e2f4b8b5aa9288'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.004500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea800942817425794e2f4b8b5aa9288'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.005925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a97be-2526-48ac-b499-a93b9fcbde0a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:54.009941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:54.010644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:54.010940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:54.011424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:54.013434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:54.031862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:54.033464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:54.038385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a14f3360-c1c4-48e8-a22e-8581b23b51ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea800942817425794e2f4b8b5aa9288'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.048848 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1009/2007] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:54.076056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:54.077504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:54.079977 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 999/2008] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:53 2022] DELETE /identity/v3/users/6ea800942817425794e2f4b8b5aa9288 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:54.084570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dffbb-ba45-4a6d-b4d0-f56f96c29dc0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:54.086541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dffbb-ba45-4a6d-b4d0-f56f96c29dc0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:54.087332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dffbb-ba45-4a6d-b4d0-f56f96c29dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:54.097263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94594a7-f0e0-4467-a03e-6c9a2e8dc06b service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:54.126695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2d6dffbb-ba45-4a6d-b4d0-f56f96c29dc0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:54.128324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2d6dffbb-ba45-4a6d-b4d0-f56f96c29dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:54.195231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:54.208416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:54.209472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:54.210505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:54.211153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:54.214553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:54.217584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1000/2009] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:54.229153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:54.230911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:54.242229 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1010/2010] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:01:54.249794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dffbb-ba45-4a6d-b4d0-f56f96c29dc0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:54.263616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dffbb-ba45-4a6d-b4d0-f56f96c29dc0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:54.268628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53098687-6c3c-4117-97bf-0153c88a8102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:54.269338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53098687-6c3c-4117-97bf-0153c88a8102 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:54.270011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53098687-6c3c-4117-97bf-0153c88a8102 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:54.270011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53098687-6c3c-4117-97bf-0153c88a8102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:54.282827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53098687-6c3c-4117-97bf-0153c88a8102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:54.284402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53098687-6c3c-4117-97bf-0153c88a8102 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:54.296450 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1001/2011] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:54.377511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:54.379258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:54.404647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84963a-1f31-4625-b48c-6324776989d2 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:54.411333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:54.413857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:54.414230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:54.414588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] PATH_INFO: `/v3/users/984077a564034acaa9b5219a26ca1031` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:54.416418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984077a564034acaa9b5219a26ca1031)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:54.418668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:54.496543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984077a564034acaa9b5219a26ca1031'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.500122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984077a564034acaa9b5219a26ca1031'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.536334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984077a564034acaa9b5219a26ca1031'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.537119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984077a564034acaa9b5219a26ca1031'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.546522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984077a564034acaa9b5219a26ca1031'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:54.565481 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1011/2012] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:54 2022] DELETE /identity/v3/users/984077a564034acaa9b5219a26ca1031 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:54.570986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:54.571402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:54.571788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:54.589640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:54.590935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:54.658283 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1002/2013] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:54.665587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:54.667255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:54.734365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fd665-b1c3-42a3-abc3-0179f536f8d5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:54.739084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:54.739935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:54.740044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:54.740319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:54.752582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:54.754940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:54.767989 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1012/2014] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:55.060130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:55.063010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:55.081998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ecd9-51d3-4182-8595-141eaf5e6699 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:55.090532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:55.091756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:55.092042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:55.092797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] PATH_INFO: `/v3/projects/b967e1c14fa24cb68ccc8af4afd35146` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:55.094844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b967e1c14fa24cb68ccc8af4afd35146)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:55.098606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:55.117499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:55.243808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:55.245651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:55.249937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b967e1c14fa24cb68ccc8af4afd35146', 'request_id': 'req-a6de420a-8abc-4bbb-a483-df3f3bce4d77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.266993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01f89e-88ee-4c88-ad57-d60b13807a37 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:55.269117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b967e1c14fa24cb68ccc8af4afd35146', 'request_id': 'req-a6de420a-8abc-4bbb-a483-df3f3bce4d77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.283169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b967e1c14fa24cb68ccc8af4afd35146', 'request_id': 'req-a6de420a-8abc-4bbb-a483-df3f3bce4d77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.303069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] The token cache is being invalidate because project b967e1c14fa24cb68ccc8af4afd35146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:55.303069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.303920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.308927 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1003/2015] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:55 2022] DELETE /identity/v3/projects/b967e1c14fa24cb68ccc8af4afd35146 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:55.310018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:55.311621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:55.394602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:55.395745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:55.396089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:55.396458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] PATH_INFO: `/v3/projects/e83fa6c281d14bf686fc93aaaa2c636b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:55.397802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83fa6c281d14bf686fc93aaaa2c636b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:55.400136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:55.402024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:55.462473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de420a-8abc-4bbb-a483-df3f3bce4d77 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:55.472414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:55.473424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:55.473705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:55.473977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] PATH_INFO: `/v3/projects/f83f58887253437e8a2f9157e23244d4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:55.475450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83f58887253437e8a2f9157e23244d4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:55.477553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:55.509410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83fa6c281d14bf686fc93aaaa2c636b', 'request_id': 'req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.523516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83fa6c281d14bf686fc93aaaa2c636b', 'request_id': 'req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.535395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83fa6c281d14bf686fc93aaaa2c636b', 'request_id': 'req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.555033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] The token cache is being invalidate because project e83fa6c281d14bf686fc93aaaa2c636b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:55.555570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.557645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.560956 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1013/2016] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:55 2022] DELETE /identity/v3/projects/e83fa6c281d14bf686fc93aaaa2c636b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:01:55.565853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:55.568875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:55.597619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83f58887253437e8a2f9157e23244d4', 'request_id': 'req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.605180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83f58887253437e8a2f9157e23244d4', 'request_id': 'req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.617587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83f58887253437e8a2f9157e23244d4', 'request_id': 'req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.655351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] The token cache is being invalidate because project f83f58887253437e8a2f9157e23244d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:55.655773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.657598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.660869 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1004/2017] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:55 2022] DELETE /identity/v3/projects/f83f58887253437e8a2f9157e23244d4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:55.665433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:55.667395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:55.690863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61429de-896c-4b1e-9ba6-0c987eeb7b0d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:55.721569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:55.767189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a282a0d-b4b5-4268-a45f-a12e92ec9e49 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:55.772056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:55.773091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:55.773461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:55.773745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] PATH_INFO: `/v3/projects/503cdd964cc143e4990fba18313ea818` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:55.774513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:55.774970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503cdd964cc143e4990fba18313ea818)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:55.775816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:55.776233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:55.776679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] PATH_INFO: `/v3/users/cb93d8314d1541668c9f6ab3b07f8405` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:55.776915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:55.778284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb93d8314d1541668c9f6ab3b07f8405)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:55.780602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:55.835015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:55.845924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503cdd964cc143e4990fba18313ea818', 'request_id': 'req-29ebc829-11e1-4b24-8bc5-c83876cedf24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.846041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb93d8314d1541668c9f6ab3b07f8405'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.847060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb93d8314d1541668c9f6ab3b07f8405'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.857376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503cdd964cc143e4990fba18313ea818', 'request_id': 'req-29ebc829-11e1-4b24-8bc5-c83876cedf24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.862201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb93d8314d1541668c9f6ab3b07f8405'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.863099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb93d8314d1541668c9f6ab3b07f8405'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.869782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503cdd964cc143e4990fba18313ea818', 'request_id': 'req-29ebc829-11e1-4b24-8bc5-c83876cedf24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.872293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb93d8314d1541668c9f6ab3b07f8405'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.885537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] The token cache is being invalidate because project 503cdd964cc143e4990fba18313ea818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:55.885813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.886572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:55.889789 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1014/2018] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:55 2022] DELETE /identity/v3/projects/503cdd964cc143e4990fba18313ea818 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:55.891636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:55.895075 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1005/2019] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:55 2022] DELETE /identity/v3/users/cb93d8314d1541668c9f6ab3b07f8405 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:55.897390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:55.899598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:55.904952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:56.007716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebc829-11e1-4b24-8bc5-c83876cedf24 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:56.013165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2845d-4824-4125-9ce7-d827b7258e56 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:56.016239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:56.017351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:56.017639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:56.018010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] PATH_INFO: `/v3/users/609dcdf9d5c94261b22fed35f1bb913a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:56.019375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=609dcdf9d5c94261b22fed35f1bb913a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:56.019499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:56.020336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:56.020620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:56.020894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] PATH_INFO: `/v3/users/0803acbbfac946d19f661e007b4fbda4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:56.021379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:56.022128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0803acbbfac946d19f661e007b4fbda4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:56.024661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:56.094622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:56.096947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0803acbbfac946d19f661e007b4fbda4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.097811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0803acbbfac946d19f661e007b4fbda4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.116121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609dcdf9d5c94261b22fed35f1bb913a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.116874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609dcdf9d5c94261b22fed35f1bb913a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.141228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609dcdf9d5c94261b22fed35f1bb913a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.142330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609dcdf9d5c94261b22fed35f1bb913a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.152953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609dcdf9d5c94261b22fed35f1bb913a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.153393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0803acbbfac946d19f661e007b4fbda4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.154583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0803acbbfac946d19f661e007b4fbda4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.174157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4eec31b1-f400-48e0-9792-84369f426823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0803acbbfac946d19f661e007b4fbda4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.181149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1015/2020] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:55 2022] DELETE /identity/v3/users/609dcdf9d5c94261b22fed35f1bb913a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:56.182335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:56.184563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:56.195968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1006/2021] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:55 2022] DELETE /identity/v3/users/0803acbbfac946d19f661e007b4fbda4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:56.306872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:56.346796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462bc1a-79de-4553-b258-d25b21a66fda admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:56.461657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:56.462259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:56.462259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:56.472964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:56.473946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:56.474202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:56.474730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] PATH_INFO: `/v3/users/dbfe21975dc04864a8fb8cf787372b48` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:56.477065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbfe21975dc04864a8fb8cf787372b48)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:56.479888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:56.495771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:56.499185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:56.610393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbfe21975dc04864a8fb8cf787372b48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.611781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbfe21975dc04864a8fb8cf787372b48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.630153 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1007/2022] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Jun 18 22:01:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:56.639610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbfe21975dc04864a8fb8cf787372b48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.640540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbfe21975dc04864a8fb8cf787372b48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.655447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbfe21975dc04864a8fb8cf787372b48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.662250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:56.664267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:56.683477 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1016/2023] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:56 2022] DELETE /identity/v3/users/dbfe21975dc04864a8fb8cf787372b48 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:56.685849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef12e-3fde-4597-a987-d037aea4c467 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:56.695304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:56.697316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:56.833902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fe303-26f4-44df-9686-0ddd539b5cef admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:56.842144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:56.843160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:56.843680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:56.844657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:56.853606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:56.856329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:56.856650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:56.864647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:56.865268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] PATH_INFO: `/v3/projects/11b839b7299c44399bf0478baee4abce` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:56.867242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b839b7299c44399bf0478baee4abce)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:56.868175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:56.869508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:56.888087 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1017/2024] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:01:56.900380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:56.903299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:56.934354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98345c4-b7db-4c6f-aa65-5c2cbb6193bc service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:56.942463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:56.943542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:56.944625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:56.945189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] PATH_INFO: `/v3/projects/0f08e1929913474c84ec87315d8a064b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:56.947829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f08e1929913474c84ec87315d8a064b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:56.951467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:56.955919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b839b7299c44399bf0478baee4abce', 'request_id': 'req-0c8fb835-5c09-430b-88a5-01a530a411dd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.964217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b839b7299c44399bf0478baee4abce', 'request_id': 'req-0c8fb835-5c09-430b-88a5-01a530a411dd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:56.969434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:56.989283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b839b7299c44399bf0478baee4abce', 'request_id': 'req-0c8fb835-5c09-430b-88a5-01a530a411dd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.042335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] The token cache is being invalidate because project 11b839b7299c44399bf0478baee4abce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:57.044094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.046338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c8fb835-5c09-430b-88a5-01a530a411dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.054221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1008/2025] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:56 2022] DELETE /identity/v3/projects/11b839b7299c44399bf0478baee4abce => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:57.058606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0825-8763-45fe-98ec-b6e01c8d1faf None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.061234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0825-8763-45fe-98ec-b6e01c8d1faf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.062472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0825-8763-45fe-98ec-b6e01c8d1faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.082905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:57.117806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-00ec0825-8763-45fe-98ec-b6e01c8d1faf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:57.119407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-00ec0825-8763-45fe-98ec-b6e01c8d1faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:57.122645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f08e1929913474c84ec87315d8a064b', 'request_id': 'req-28ccbe4a-a759-4b37-966a-3000fd4b3c36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.131605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f08e1929913474c84ec87315d8a064b', 'request_id': 'req-28ccbe4a-a759-4b37-966a-3000fd4b3c36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.146854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f08e1929913474c84ec87315d8a064b', 'request_id': 'req-28ccbe4a-a759-4b37-966a-3000fd4b3c36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.188579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] The token cache is being invalidate because project 0f08e1929913474c84ec87315d8a064b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:57.188879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.192642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-28ccbe4a-a759-4b37-966a-3000fd4b3c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:57.197948 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1018/2026] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:56 2022] DELETE /identity/v3/projects/0f08e1929913474c84ec87315d8a064b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:57.203829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf36af-fcb3-4df2-b120-176811d8033d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.204119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf36af-fcb3-4df2-b120-176811d8033d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.204401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf36af-fcb3-4df2-b120-176811d8033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.232415 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1009/2027] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:57.238936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095884-a1ba-4bf3-9785-c99f7e1652a3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.240409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095884-a1ba-4bf3-9785-c99f7e1652a3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.240753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095884-a1ba-4bf3-9785-c99f7e1652a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.254005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bdaf36af-fcb3-4df2-b120-176811d8033d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:57.255474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bdaf36af-fcb3-4df2-b120-176811d8033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:57.277254 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1019/2028] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:57.283603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a9095884-a1ba-4bf3-9785-c99f7e1652a3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:57.285230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a9095884-a1ba-4bf3-9785-c99f7e1652a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:57.285964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ccc43-ebd9-4b36-97cc-7362782a95fc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.286259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ccc43-ebd9-4b36-97cc-7362782a95fc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.286655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ccc43-ebd9-4b36-97cc-7362782a95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.301660 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1010/2029] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:01:57.305933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095884-a1ba-4bf3-9785-c99f7e1652a3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.319295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095884-a1ba-4bf3-9785-c99f7e1652a3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.326322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.327512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.327874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.328242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.337405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:57.337942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.339789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.346905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e25ccc43-ebd9-4b36-97cc-7362782a95fc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:57.351638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e25ccc43-ebd9-4b36-97cc-7362782a95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:57.355857 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1011/2030] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:01:57.361263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.380596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1020/2031] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:57.385198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ccc43-ebd9-4b36-97cc-7362782a95fc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.386339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c81fe-7b7a-4795-a1df-fbe07ff98b6f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.395312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ccc43-ebd9-4b36-97cc-7362782a95fc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.403161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.403989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.404358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.404701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.405516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.408899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.411084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.412204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.412643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.412920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.413785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:57.414009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.415963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.437100 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1021/2032] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:57.442022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.456570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21cc95-2b8a-4c95-a111-b2ccb020e11f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.462849 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1012/2033] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:57.464823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.550631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.551468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.551755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.552630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.553452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.556314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.602806 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1022/2034] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:57.606774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.610748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214b146-1469-4280-95de-c3a86ff64b87 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.720587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:57.730041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02298676-c7ec-4149-ab9e-e8e72d735b34 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.747706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.747706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.747706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.747706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.748081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.748081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.773797 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1023/2035] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:57.778051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.792620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df1e36-b28b-4443-84d6-2c9a653bc44b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.798949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.799655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.799931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.800199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.800901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.802012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.802870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.811719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.812641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.813078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.814605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.817664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.834360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1024/2036] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:01:57.837911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:57.840188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.844841 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1013/2037] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:57 2022] POST /identity/v3/users => generated 299 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:57.850722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.861337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e28e82-c621-451c-8bf7-1cd75ea56b8b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.872088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee9ed3-5d96-4334-908e-46c06e032ef1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.878414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.879440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.879440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.879753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.880357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.882162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.892834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.894161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.897119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.898242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.901156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.905843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.919734 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1025/2038] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:57.921516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.933329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1002532-51e2-4927-839e-ac8815a09213 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.939008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.940293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.941005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.941426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] PATH_INFO: `/v3/projects/e294453c68674ed8baea6d79c6a87e78/users/1d04016fb35f4b49a3fdd38c84bd9f77/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.944706 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1014/2039] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:01:57.948453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:57.960973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e294453c68674ed8baea6d79c6a87e78, user_id=1d04016fb35f4b49a3fdd38c84bd9f77, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.963337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ea2d9-a45f-40a7-925b-408b1aa23a7f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:57.972453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:57.979282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d8167-dfb4-4a52-b390-1c01af364929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:57.981483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8167-dfb4-4a52-b390-1c01af364929 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:57.984167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8167-dfb4-4a52-b390-1c01af364929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:57.985245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d8167-dfb4-4a52-b390-1c01af364929 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:57.986223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d8167-dfb4-4a52-b390-1c01af364929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:57.988699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d8167-dfb4-4a52-b390-1c01af364929 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:58.002168 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1026/2040] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:57 2022] PUT /identity/v3/projects/e294453c68674ed8baea6d79c6a87e78/users/1d04016fb35f4b49a3fdd38c84bd9f77/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:01:58.003240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:58.012515 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1015/2041] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:58.013898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:58.014212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d14f1-9be1-45d0-ab40-d77ec3557ae8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:58.014571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d14f1-9be1-45d0-ab40-d77ec3557ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:58.014923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d14f1-9be1-45d0-ab40-d77ec3557ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:58.049809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-de8d14f1-9be1-45d0-ab40-d77ec3557ae8 None None] MFA Rules not processed for user `1d04016fb35f4b49a3fdd38c84bd9f77`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:58.051134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-de8d14f1-9be1-45d0-ab40-d77ec3557ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:58.147058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4b7e6-8a26-46ea-9022-09dcae70e319 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:58.152095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:58.152980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:58.153297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:58.153576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] PATH_INFO: `/v3/projects/118da77b66654cfd8df2a932442e16f8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:58.154813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118da77b66654cfd8df2a932442e16f8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:58.157370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:58.224102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118da77b66654cfd8df2a932442e16f8', 'request_id': 'req-f31acebf-d8cb-4fef-b432-7ebbe9d23011'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.238949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118da77b66654cfd8df2a932442e16f8', 'request_id': 'req-f31acebf-d8cb-4fef-b432-7ebbe9d23011'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.251803 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1016/2042] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:58.251803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d14f1-9be1-45d0-ab40-d77ec3557ae8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:58.267882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118da77b66654cfd8df2a932442e16f8', 'request_id': 'req-f31acebf-d8cb-4fef-b432-7ebbe9d23011'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.287859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] The token cache is being invalidate because project 118da77b66654cfd8df2a932442e16f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:58.288298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.291811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d14f1-9be1-45d0-ab40-d77ec3557ae8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:58.295791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.302483 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1027/2043] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:58 2022] DELETE /identity/v3/projects/118da77b66654cfd8df2a932442e16f8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:58.302483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:58.302483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:58.421018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:58.535357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:58.538099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:58.539018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:58.542220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] PATH_INFO: `/v3/projects/7b63c52467494445b437e444a52e075e/users/58c3911cbbdf4e35ae8df9eb8b23f22d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:58.546335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acebf-d8cb-4fef-b432-7ebbe9d23011 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:58.565267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:58.566183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:58.566455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:58.566787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] PATH_INFO: `/v3/projects/785513ceec0f48f99e27d8d7e7bc5aca` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:58.569533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785513ceec0f48f99e27d8d7e7bc5aca)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:58.571563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:58.605245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b63c52467494445b437e444a52e075e, user_id=58c3911cbbdf4e35ae8df9eb8b23f22d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:58.611995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:58.639175 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1017/2044] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:58 2022] PUT /identity/v3/projects/7b63c52467494445b437e444a52e075e/users/58c3911cbbdf4e35ae8df9eb8b23f22d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:58.639958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:58.646751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:58.703649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785513ceec0f48f99e27d8d7e7bc5aca', 'request_id': 'req-4e09416d-71bb-4986-bc99-b37ecc28ecb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.719342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785513ceec0f48f99e27d8d7e7bc5aca', 'request_id': 'req-4e09416d-71bb-4986-bc99-b37ecc28ecb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.744552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785513ceec0f48f99e27d8d7e7bc5aca', 'request_id': 'req-4e09416d-71bb-4986-bc99-b37ecc28ecb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.768417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:58.770272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] The token cache is being invalidate because project 785513ceec0f48f99e27d8d7e7bc5aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:01:58.770652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.773205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4e09416d-71bb-4986-bc99-b37ecc28ecb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:58.778464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1028/2045] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:01:58 2022] DELETE /identity/v3/projects/785513ceec0f48f99e27d8d7e7bc5aca => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:58.778464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171f87-32ae-44ee-931b-683c2507c7f6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:58.778464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171f87-32ae-44ee-931b-683c2507c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:58.778464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171f87-32ae-44ee-931b-683c2507c7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:58.792520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58e4a1-0162-4110-b502-0e2d6c538de6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:58.816482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f9171f87-32ae-44ee-931b-683c2507c7f6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:58.817910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f9171f87-32ae-44ee-931b-683c2507c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:58.923925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e325-7be3-4cfa-98a3-af5fb35edb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:58.924667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e325-7be3-4cfa-98a3-af5fb35edb72 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:58.925276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e325-7be3-4cfa-98a3-af5fb35edb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:58.925590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e325-7be3-4cfa-98a3-af5fb35edb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:58.926299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285e325-7be3-4cfa-98a3-af5fb35edb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:58.937398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285e325-7be3-4cfa-98a3-af5fb35edb72 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.009456 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1018/2046] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:58 2022] POST /identity/v3/projects => generated 389 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:59.011083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.013527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.014022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.039227 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1029/2047] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:59.040607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf5a4-fa8b-4a2e-ad35-8e2032ff0285 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.043361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf5a4-fa8b-4a2e-ad35-8e2032ff0285 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.043660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bf5a4-fa8b-4a2e-ad35-8e2032ff0285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.057768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:59.060551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.091732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-491bf5a4-fa8b-4a2e-ad35-8e2032ff0285 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:59.095238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-491bf5a4-fa8b-4a2e-ad35-8e2032ff0285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.228617 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1019/2048] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:59.231726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.235910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.257827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3623-7eac-4f5e-8322-5d59267c18db None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.260997 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1030/2049] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:59.267878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.267878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.267878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.268130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb223-e435-498c-90d5-2a66b1ae6346 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.272268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.272918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.275890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.279097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb223-e435-498c-90d5-2a66b1ae6346 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.279495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbb223-e435-498c-90d5-2a66b1ae6346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.297061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:59.317742 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1020/2050] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:59.319422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.322486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-abbbb223-e435-498c-90d5-2a66b1ae6346 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:59.323021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-abbbb223-e435-498c-90d5-2a66b1ae6346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.324724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.356295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1031/2051] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:59.357933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7e20c-2a96-44ed-9c00-2cf3f523c501 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.358052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7e20c-2a96-44ed-9c00-2cf3f523c501 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.358320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7e20c-2a96-44ed-9c00-2cf3f523c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.387396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7cb7e20c-2a96-44ed-9c00-2cf3f523c501 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:59.387396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7cb7e20c-2a96-44ed-9c00-2cf3f523c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.405647 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1032/2052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:01:59.406677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7e20c-2a96-44ed-9c00-2cf3f523c501 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.425726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7e20c-2a96-44ed-9c00-2cf3f523c501 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.441251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.441966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.442242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.442556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.450251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.452012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.496601 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1033/2053] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:01:59.498826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.500507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b241c2-fb97-47d6-987f-a74d11720baa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.509961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.510633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.510897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.511166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.517601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57720e6b-0a98-4c80-9445-21b12e43026a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.528551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.529618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.537992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.539769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.540850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.541889 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1021/2054] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:59.542419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.543990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.547780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:59.548702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.558037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.569239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22f4fc-f8ee-4311-bb2c-7e975f97bd89 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.578041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.579481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.579769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.580074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.580808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:01:59.583281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.585679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.587923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:59.597785 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1034/2055] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:59.600752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.602611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.618028 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1022/2056] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:01:59.618028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.626288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b3e13-ebe3-4695-b803-da2455a0b771 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.632271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.632904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1590f8-dd69-4986-9df9-696b3f683842 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.633235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.633514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.633788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] PATH_INFO: `/v3/projects/60f4811f948c4076b467dc4690b0c9d4/users/d5fa624dbbeb4cf1b887b57be41a0a6d/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.653733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.654249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f4811f948c4076b467dc4690b0c9d4, user_id=d5fa624dbbeb4cf1b887b57be41a0a6d, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.655591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.656075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.656855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] PATH_INFO: `/v3/users/d7864d63d66e4397a2b2602f25d925f4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.657267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.664302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7864d63d66e4397a2b2602f25d925f4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.668410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.718030 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1023/2057] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:01:59 2022] PUT /identity/v3/projects/60f4811f948c4076b467dc4690b0c9d4/users/d5fa624dbbeb4cf1b887b57be41a0a6d/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:59.719209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.752990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7864d63d66e4397a2b2602f25d925f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:59.754135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7864d63d66e4397a2b2602f25d925f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:59.777377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7864d63d66e4397a2b2602f25d925f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:59.779010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7864d63d66e4397a2b2602f25d925f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:59.790677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7864d63d66e4397a2b2602f25d925f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:01:59.811402 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1035/2058] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:01:59 2022] DELETE /identity/v3/users/d7864d63d66e4397a2b2602f25d925f4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:01:59.813414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.816477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.818453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f48ece-cc23-44e1-9e63-f8e1dc74b933 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.897628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc349-1da9-45c2-a4f5-caf74cd922f2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:01:59.903472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.904144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.904427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.904731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.905549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.907091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ec8c-beaa-4ab3-a784-346f05675d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:01:59.907866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.908223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ec8c-beaa-4ab3-a784-346f05675d40 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.909438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ec8c-beaa-4ab3-a784-346f05675d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.909987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ec8c-beaa-4ab3-a784-346f05675d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.911109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ec8c-beaa-4ab3-a784-346f05675d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:01:59.913909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ec8c-beaa-4ab3-a784-346f05675d40 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:01:59.941944 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1036/2059] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:59.942610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:01:59.946732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:01:59.966830 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1024/2060] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:01:59.966830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb29b45-b378-4945-80ff-ac592fd4387f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:01:59.966830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb29b45-b378-4945-80ff-ac592fd4387f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:01:59.967554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb29b45-b378-4945-80ff-ac592fd4387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:01:59.976478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:59.995962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9bb29b45-b378-4945-80ff-ac592fd4387f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:01:59.997213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9bb29b45-b378-4945-80ff-ac592fd4387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.065761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5287622-25a6-4511-8860-972c8795da7c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.103067 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1025/2061] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:00.103936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb29b45-b378-4945-80ff-ac592fd4387f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.122718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:00.132783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb29b45-b378-4945-80ff-ac592fd4387f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.160409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.163728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.164168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.164515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.164780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.164891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.165314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.165777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.167147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.167780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.169932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.173845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.189764 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1037/2062] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:00.191077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.194391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.202051 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1026/2063] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:00 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:00.203287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.206480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.211857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c34092-3287-42c4-9796-c7e675e8190e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.219356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.219978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.220257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.220529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.226283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.226283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.262226 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1038/2064] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:00 2022] POST /identity/v3/users => generated 287 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:00.263546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.279796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46a243-090b-4dcb-9b6e-5700ce9bba59 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.285295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.286865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.287300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.287952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] PATH_INFO: `/v3/projects/60f4811f948c4076b467dc4690b0c9d4/users/d5fa624dbbeb4cf1b887b57be41a0a6d/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.290194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f4811f948c4076b467dc4690b0c9d4, user_id=d5fa624dbbeb4cf1b887b57be41a0a6d, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.293430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.309825 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1039/2065] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:00 2022] PUT /identity/v3/projects/60f4811f948c4076b467dc4690b0c9d4/users/d5fa624dbbeb4cf1b887b57be41a0a6d/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:00.313969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.382274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb817f98-7a66-4d83-a766-8d8598d01ad4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.470696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dada5d4-934b-4da6-b3aa-5f0b9251480e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.476205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.476457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c543ad3-a982-48ec-ba79-eabfd0da2cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.476946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.477268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.477544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.477651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543ad3-a982-48ec-ba79-eabfd0da2cee service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.478293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.478704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543ad3-a982-48ec-ba79-eabfd0da2cee service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.479038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c543ad3-a982-48ec-ba79-eabfd0da2cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.480037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.495150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c543ad3-a982-48ec-ba79-eabfd0da2cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.499418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c543ad3-a982-48ec-ba79-eabfd0da2cee service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.500831 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1040/2066] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:00.500921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.514215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d189ad4-7326-409b-8100-3ea3cecbaebf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.514428 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1027/2067] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:00.516047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4ceb-df75-4d5e-8c1d-11c90ba901e0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.516404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4ceb-df75-4d5e-8c1d-11c90ba901e0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.516785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4ceb-df75-4d5e-8c1d-11c90ba901e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.522522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.523333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.523622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.523900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.525271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.527287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.540360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1041/2068] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:00.541265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.547803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-541b4ceb-df75-4d5e-8c1d-11c90ba901e0 None None] MFA Rules not processed for user `d5fa624dbbeb4cf1b887b57be41a0a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:00.549474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-541b4ceb-df75-4d5e-8c1d-11c90ba901e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.555855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706260-f6e7-4ae4-8813-5d26e2705464 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.561292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.562191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.562637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.562974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.563835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.565982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.580896 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1042/2069] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:00.580896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.592141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1e6ef-c22f-4ef1-bb25-199f0ef2d061 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.600846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.601902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.602590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.602590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.603474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.605312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.608497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:00.618833 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1043/2070] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:00.619877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.623133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.636832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a4e15-c3a5-4413-b778-1a50567de52d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.640365 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1028/2071] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:00.641343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b4ceb-df75-4d5e-8c1d-11c90ba901e0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.642093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.643150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.643526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.643900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] PATH_INFO: `/v3/users/75df001919794fd7a2e79cdfbd87cfd6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.645299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75df001919794fd7a2e79cdfbd87cfd6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.647834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.652171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b4ceb-df75-4d5e-8c1d-11c90ba901e0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.658624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.660001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.660283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.660559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] PATH_INFO: `/v3/projects/7607bd86bd254abf96cba580431bd744/users/0f622a1911d44c699caf61401cce34b2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.678838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7607bd86bd254abf96cba580431bd744, user_id=0f622a1911d44c699caf61401cce34b2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.681897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.707223 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1029/2072] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:00 2022] PUT /identity/v3/projects/7607bd86bd254abf96cba580431bd744/users/0f622a1911d44c699caf61401cce34b2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:00.707223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.712034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75df001919794fd7a2e79cdfbd87cfd6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:00.713085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75df001919794fd7a2e79cdfbd87cfd6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:00.713719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:00.732635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75df001919794fd7a2e79cdfbd87cfd6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:00.733438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75df001919794fd7a2e79cdfbd87cfd6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:00.743678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75df001919794fd7a2e79cdfbd87cfd6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:00.775178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1044/2073] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:00 2022] DELETE /identity/v3/users/75df001919794fd7a2e79cdfbd87cfd6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:00.775178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:00.776860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.785986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bcee7-2fdc-442b-886c-d7ccb8a9eccb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.855655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b4ac6-94a2-452a-981b-c81558f51d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.856725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b4ac6-94a2-452a-981b-c81558f51d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.857129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b4ac6-94a2-452a-981b-c81558f51d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.857501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b4ac6-94a2-452a-981b-c81558f51d31 admin admin] PATH_INFO: `/v3/projects/da4bbfa66a0d404fb3c0d050146787b0/users/f6248920fd4b4c76ab42cd5f3978a740/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.875214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a42c4-9504-4301-9269-53746bc971b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:00.876103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b4ac6-94a2-452a-981b-c81558f51d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4bbfa66a0d404fb3c0d050146787b0, user_id=f6248920fd4b4c76ab42cd5f3978a740, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.879742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b4ac6-94a2-452a-981b-c81558f51d31 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.881555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e6fe1-43e3-4cfa-96e1-858f40d3ce95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:00.882306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6fe1-43e3-4cfa-96e1-858f40d3ce95 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.882655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6fe1-43e3-4cfa-96e1-858f40d3ce95 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.883001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e6fe1-43e3-4cfa-96e1-858f40d3ce95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.885449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c15e6fe1-43e3-4cfa-96e1-858f40d3ce95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.897185 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1030/2074] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:00 2022] PUT /identity/v3/projects/da4bbfa66a0d404fb3c0d050146787b0/users/f6248920fd4b4c76ab42cd5f3978a740/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:00.898724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a968a-22e6-4111-9a04-913420f8bd03 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:00.899193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a968a-22e6-4111-9a04-913420f8bd03 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:00.899476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a968a-22e6-4111-9a04-913420f8bd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:00.944490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-460a968a-22e6-4111-9a04-913420f8bd03 None None] MFA Rules not processed for user `0f622a1911d44c699caf61401cce34b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:00.945771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-460a968a-22e6-4111-9a04-913420f8bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:00.973683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6fe1-43e3-4cfa-96e1-858f40d3ce95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:00.975825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e6fe1-43e3-4cfa-96e1-858f40d3ce95 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:00.988633 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1045/2075] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:01.000901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.001274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.002215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.015066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:01.055217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:01.057853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.115044 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1031/2076] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:01.116735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.117223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.118276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.160139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] MFA Rules not processed for user `f6248920fd4b4c76ab42cd5f3978a740`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:01.161745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.181810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:01.210658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1046/2077] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:01.218502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:01.223548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.252671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dab-909d-4fcd-a4d9-eff96ce9a647 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:01.268292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:01.270180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.270570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.271113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.273093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:01.277932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:01.300813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1032/2078] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:01.300813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:01.300813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.342376 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1047/2079] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:01 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:01.343693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:01.347887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.435030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48fe9-d204-44ec-8a97-87c6cb7c2088 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:01.495171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894d494-9f53-4f64-86c3-f9bf151b74dd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:01.504037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:01.504897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.506368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.506664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.507546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:01.515675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:01.562698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:01.563565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.563948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.564628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.583517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1048/2080] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:01 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:01.584777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:01.585024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:01.587180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:01.617936 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1033/2081] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:01.619103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:01.668924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65bd7f-4d39-4a18-80ac-dc56cc6f1cbf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:01.676000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:01.677063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.677325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.678648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.679465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:01.682462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:01.699798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:01.719576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1049/2082] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:01 2022] POST /identity/v3/users => generated 311 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:01.720737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:01.726166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.740235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79223c5-f9c4-4ec9-bf0d-d24366e4f099 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:01.746026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:01.747062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.747513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.747840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] PATH_INFO: `/v3/projects/d6edcd41af0a4da89239e77e489b7791` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.749139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6edcd41af0a4da89239e77e489b7791)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:01.751336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:01.773680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf6d9-c754-44a9-91f2-8d03bef68c7e service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:01.791826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:01.812055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6edcd41af0a4da89239e77e489b7791', 'request_id': 'req-66bd98cc-1104-41f6-b31d-3a528b5e896a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:01.820876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6edcd41af0a4da89239e77e489b7791', 'request_id': 'req-66bd98cc-1104-41f6-b31d-3a528b5e896a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:01.833398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6edcd41af0a4da89239e77e489b7791', 'request_id': 'req-66bd98cc-1104-41f6-b31d-3a528b5e896a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:01.855114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] The token cache is being invalidate because project d6edcd41af0a4da89239e77e489b7791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:01.855693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:01.856991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:01.859517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1050/2083] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:01 2022] DELETE /identity/v3/projects/d6edcd41af0a4da89239e77e489b7791 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:01.860448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:01.862677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.902701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:01.903730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.904204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.904749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.906989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:01.965451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd98cc-1104-41f6-b31d-3a528b5e896a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:01.972518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:01.973403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:01.973885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:01.974253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:01.975075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:01.977224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:01.984006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:01.986091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:01.998051 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1034/2084] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:02.006735 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1051/2085] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:01 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:02.011445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.013224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.019351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.021826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.034871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bfd66-bf37-4ab3-94ff-0f93078d9dc6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:02.043214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:02.058818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:02.060417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:02.061413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:02.063805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:02.066801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:02.072803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52fec9-8166-49aa-a4c4-360167c36c24 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:02.084770 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1052/2086] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:02.085911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.090222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:02.090222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:02.093058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:02.093058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] PATH_INFO: `/v3/users/dc33955b63f643559995c4fb23fadcff` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:02.094202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc33955b63f643559995c4fb23fadcff)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:02.095783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.097969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:02.136317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cf37c-0340-4af4-bafa-8db287435334 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:02.146195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:02.154022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:02.154508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:02.155480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] PATH_INFO: `/v3/projects/454d2ab18dd84eaf8bbd1e2808159df7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:02.158084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454d2ab18dd84eaf8bbd1e2808159df7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:02.161527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:02.214403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc33955b63f643559995c4fb23fadcff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.214403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc33955b63f643559995c4fb23fadcff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.267011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc33955b63f643559995c4fb23fadcff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.267011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc33955b63f643559995c4fb23fadcff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.284580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454d2ab18dd84eaf8bbd1e2808159df7', 'request_id': 'req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.291904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:02.297437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc33955b63f643559995c4fb23fadcff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.317547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454d2ab18dd84eaf8bbd1e2808159df7', 'request_id': 'req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.353823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454d2ab18dd84eaf8bbd1e2808159df7', 'request_id': 'req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.359085 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1035/2087] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:02 2022] DELETE /identity/v3/users/dc33955b63f643559995c4fb23fadcff => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:02.362050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.370044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.381251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] The token cache is being invalidate because project 454d2ab18dd84eaf8bbd1e2808159df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:02.381998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.382778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.385704 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1053/2088] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:02 2022] DELETE /identity/v3/projects/454d2ab18dd84eaf8bbd1e2808159df7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:02.386572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.392410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.478364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:02.570611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a49fe-9edb-4cbe-a291-5c8c68ed76b6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:02.610367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec226b-14f6-4282-b255-fccf8a9f8128 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:02.626669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:02.627462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:02.627750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:02.628026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:02.628780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:02.635817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:02.658528 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1036/2089] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:02.660735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.663748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.681137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6243e-35ab-489c-8b48-3f61ccbf1855 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:02.685071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:02.686972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:02.687239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:02.688063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] PATH_INFO: `/v3/projects/697cf498c2734046b0108e023378f6d5/users/a456055974af48a794d0ffddd9837e83/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:02.688888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:02.691929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:02.692486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:02.693106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] PATH_INFO: `/v3/users/273d597843e74bf9a174ff58f2d27647` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:02.695287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=273d597843e74bf9a174ff58f2d27647)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:02.698127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:02.710391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=697cf498c2734046b0108e023378f6d5, user_id=a456055974af48a794d0ffddd9837e83, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:02.713584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:02.748205 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1054/2090] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:02 2022] PUT /identity/v3/projects/697cf498c2734046b0108e023378f6d5/users/a456055974af48a794d0ffddd9837e83/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:02.749179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.750966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.838426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273d597843e74bf9a174ff58f2d27647'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.844606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273d597843e74bf9a174ff58f2d27647'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.880517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273d597843e74bf9a174ff58f2d27647'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.881579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273d597843e74bf9a174ff58f2d27647'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.891050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273d597843e74bf9a174ff58f2d27647'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:02.918209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1037/2091] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:02 2022] DELETE /identity/v3/users/273d597843e74bf9a174ff58f2d27647 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:02.920487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:02.930556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:02.933768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c0f8-dbfc-474f-943d-7b0884824dae admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:02.968081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:03.083996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.085912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.086973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.086973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] PATH_INFO: `/v3/users/1d04016fb35f4b49a3fdd38c84bd9f77` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.088153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d04016fb35f4b49a3fdd38c84bd9f77)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.090393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.100383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1444e6-e363-489e-8030-029359e288f5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:03.109914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.111003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.111354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.111637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] PATH_INFO: `/v3/projects/feb72abb04804f2692d5a1e1e97b82ae/users/96f9002e77784084bf81cb68e72b5c4c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.143992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb72abb04804f2692d5a1e1e97b82ae, user_id=96f9002e77784084bf81cb68e72b5c4c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.148835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.176135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1038/2092] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:02 2022] PUT /identity/v3/projects/feb72abb04804f2692d5a1e1e97b82ae/users/96f9002e77784084bf81cb68e72b5c4c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:03.176135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:03.177316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.184696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d04016fb35f4b49a3fdd38c84bd9f77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.185674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d04016fb35f4b49a3fdd38c84bd9f77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.214122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d04016fb35f4b49a3fdd38c84bd9f77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.220056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d04016fb35f4b49a3fdd38c84bd9f77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.220353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:03.235821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d04016fb35f4b49a3fdd38c84bd9f77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.262048 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1055/2093] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:02 2022] DELETE /identity/v3/users/1d04016fb35f4b49a3fdd38c84bd9f77 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:03.263038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:03.268717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.315544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8af46-23d3-4156-9cf0-fb74794aa900 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:03.377818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710c877-8429-429f-857e-b7fd813acf62 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:03.385753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.388454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.388728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.389313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] PATH_INFO: `/v3/projects/a3e286d322464409a8ce89af7041777d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.390650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e286d322464409a8ce89af7041777d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.392623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.410045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.411418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.412063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.413610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.415035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.416976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.430776 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1039/2094] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:03.431773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:03.433690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.445385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:03.452330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641ef2-ff0e-4fe3-90f9-50dbac9e78ba admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:03.456785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e286d322464409a8ce89af7041777d', 'request_id': 'req-6f0ac69a-4566-4a30-ba05-00483ee11a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.465888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e286d322464409a8ce89af7041777d', 'request_id': 'req-6f0ac69a-4566-4a30-ba05-00483ee11a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.478955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e286d322464409a8ce89af7041777d', 'request_id': 'req-6f0ac69a-4566-4a30-ba05-00483ee11a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.495229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] The token cache is being invalidate because project a3e286d322464409a8ce89af7041777d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:03.495775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.496986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f0ac69a-4566-4a30-ba05-00483ee11a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.502643 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1056/2095] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:03 2022] DELETE /identity/v3/projects/a3e286d322464409a8ce89af7041777d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:03.502643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd830-94a6-4614-b357-329906df31df None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.502643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd830-94a6-4614-b357-329906df31df None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.502643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dd830-94a6-4614-b357-329906df31df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.525996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.527302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.527602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.527882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.528814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.531792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.546991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-560dd830-94a6-4614-b357-329906df31df None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:03.548702 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1040/2096] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:03.549700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-560dd830-94a6-4614-b357-329906df31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.549815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:03.551546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.565867 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1057/2097] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:03.567319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd830-94a6-4614-b357-329906df31df None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:03.581703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-560dd830-94a6-4614-b357-329906df31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.581907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ba9c6-41c2-46a7-9196-d90666c01ba7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:03.587236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.588958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.589225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.589506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] PATH_INFO: `/v3/projects/144bae0b8f7a4d6ba5d1b6e4b41742a5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.593126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=144bae0b8f7a4d6ba5d1b6e4b41742a5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.595184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.595298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dd830-94a6-4614-b357-329906df31df None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:03.600278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd82a2-3e4e-46c2-967a-c883ee99bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.601300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd82a2-3e4e-46c2-967a-c883ee99bec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.601645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd82a2-3e4e-46c2-967a-c883ee99bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.601986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd82a2-3e4e-46c2-967a-c883ee99bec7 admin admin] PATH_INFO: `/v3/projects/697cf498c2734046b0108e023378f6d5/users/a456055974af48a794d0ffddd9837e83/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.604093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd82a2-3e4e-46c2-967a-c883ee99bec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697cf498c2734046b0108e023378f6d5, user_id=a456055974af48a794d0ffddd9837e83, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.606903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd82a2-3e4e-46c2-967a-c883ee99bec7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.627672 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1058/2098] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:03 2022] PUT /identity/v3/projects/697cf498c2734046b0108e023378f6d5/users/a456055974af48a794d0ffddd9837e83/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:03.627672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.627672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.627672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.640645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:03.642063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.681245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:03.688259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144bae0b8f7a4d6ba5d1b6e4b41742a5', 'request_id': 'req-e39ed989-29c4-4ac7-af4e-b2b8840d2375'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.699307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144bae0b8f7a4d6ba5d1b6e4b41742a5', 'request_id': 'req-e39ed989-29c4-4ac7-af4e-b2b8840d2375'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.710045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144bae0b8f7a4d6ba5d1b6e4b41742a5', 'request_id': 'req-e39ed989-29c4-4ac7-af4e-b2b8840d2375'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.729401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] The token cache is being invalidate because project 144bae0b8f7a4d6ba5d1b6e4b41742a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:03.729698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.730384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:03.735547 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1041/2099] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:03 2022] DELETE /identity/v3/projects/144bae0b8f7a4d6ba5d1b6e4b41742a5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:03.735547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:03.735547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.786957 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1059/2100] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:03.788342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:03.790737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.818613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ed989-29c4-4ac7-af4e-b2b8840d2375 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:03.824030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667db59-21e5-484d-a0bf-af0254b43c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:03.824954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667db59-21e5-484d-a0bf-af0254b43c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.825884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667db59-21e5-484d-a0bf-af0254b43c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.826172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667db59-21e5-484d-a0bf-af0254b43c8b admin admin] PATH_INFO: `/v3/projects/feb72abb04804f2692d5a1e1e97b82ae/users/96f9002e77784084bf81cb68e72b5c4c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.828860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667db59-21e5-484d-a0bf-af0254b43c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb72abb04804f2692d5a1e1e97b82ae, user_id=96f9002e77784084bf81cb68e72b5c4c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:03.834365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667db59-21e5-484d-a0bf-af0254b43c8b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:03.855270 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1042/2101] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:03 2022] PUT /identity/v3/projects/feb72abb04804f2692d5a1e1e97b82ae/users/96f9002e77784084bf81cb68e72b5c4c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:03.864573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a20477-4fd6-4491-846b-9195a060a498 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:03.864573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a20477-4fd6-4491-846b-9195a060a498 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:03.864573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a20477-4fd6-4491-846b-9195a060a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:03.891147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d0a20477-4fd6-4491-846b-9195a060a498 None None] MFA Rules not processed for user `a456055974af48a794d0ffddd9837e83`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:03.892384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d0a20477-4fd6-4491-846b-9195a060a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:03.893397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d5692-1fbc-4db9-96d8-8bc06059f566 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.000820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45db03-5c34-4a2e-bea8-dae76a474711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.001703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45db03-5c34-4a2e-bea8-dae76a474711 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.001989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45db03-5c34-4a2e-bea8-dae76a474711 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.002307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45db03-5c34-4a2e-bea8-dae76a474711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.006862 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1043/2102] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:04.010032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e45db03-5c34-4a2e-bea8-dae76a474711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:04.011165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9de8a-294a-48b7-b5b8-4bf8d5118a24 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.011458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9de8a-294a-48b7-b5b8-4bf8d5118a24 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.011911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9de8a-294a-48b7-b5b8-4bf8d5118a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.050049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:04.053641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-03c9de8a-294a-48b7-b5b8-4bf8d5118a24 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:04.056431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-03c9de8a-294a-48b7-b5b8-4bf8d5118a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:04.135895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:04.158268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45db03-5c34-4a2e-bea8-dae76a474711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:04.159746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45db03-5c34-4a2e-bea8-dae76a474711 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:04.164740 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1044/2103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:04.166277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.168408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.169987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.199596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1060/2104] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:04.203501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e720e-03cc-424a-a73d-fb6137802159 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.203791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e720e-03cc-424a-a73d-fb6137802159 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.204077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e720e-03cc-424a-a73d-fb6137802159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.206662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:04.219138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:04.232994 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1045/2105] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:04.234016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:04.235514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:04.251916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dd9e720e-03cc-424a-a73d-fb6137802159 None None] MFA Rules not processed for user `96f9002e77784084bf81cb68e72b5c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:04.253479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dd9e720e-03cc-424a-a73d-fb6137802159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:04.385318 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1061/2106] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:04.388484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e532-fa95-4803-b9be-de18901c8870 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.388921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e532-fa95-4803-b9be-de18901c8870 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.391831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9e532-fa95-4803-b9be-de18901c8870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.398751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05126e-9a3a-469f-bbe9-d59ade855338 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.415402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.416382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.416766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.417516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.437487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-aea9e532-fa95-4803-b9be-de18901c8870 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:04.439529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aea9e532-fa95-4803-b9be-de18901c8870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:04.439810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:04.441712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:04.461087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1046/2107] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:04 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:04.465406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:04.467536 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1062/2108] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:04.468587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e532-fa95-4803-b9be-de18901c8870 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:04.486587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d91c-d1ff-4083-9578-2d50fff1e4dc service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.499025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9e532-fa95-4803-b9be-de18901c8870 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.499658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.500996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.500996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.501551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.502541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:04.503072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:04.504843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:04.526129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.527077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.527375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.527664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.528423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:04.528742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:04.536621 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1047/2109] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:04.539773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:04.540173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:04.569281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546b3d4-15b7-4bf4-be84-ef4661fe4451 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.591841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.592648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.593053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.593510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.594362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:04.596829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:04.601769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:04.609164 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1063/2110] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:04.610766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:04.628807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cf45b-ce86-4d6f-8983-3ebe3edb5082 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.640465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.641788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.643754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.644202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.645699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:04.652047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:04.660686 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1048/2111] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:04.661773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:04.706624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9193bb-a8c4-4648-a3d1-9af0b62c6f47 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.721763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1064/2112] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:04 2022] POST /identity/v3/projects => generated 411 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:04.722749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:04.905240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:04.913942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.915218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f387ec-ef3c-45a8-a387-97b7b21179e9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:04.915536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.915811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.916084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.920482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:04.927345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:04.928034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:04.928315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:04.928589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:04.929327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:04.932152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:04.997738 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1065/2113] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:04 2022] POST /identity/v3/projects => generated 369 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:04.999770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.030604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:05.071516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.075101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.097448 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1049/2114] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:05.100427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.168924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684045bc-e994-41e0-ab39-4bf6b9825ddb tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:05.178236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:05.180016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:05.180937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:05.181266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:05.181967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.185432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.260742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d874-ab8f-48e3-a71a-0dcc16606f9b service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:05.262004 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1066/2115] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:04 2022] POST /identity/v3/projects => generated 397 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:05.263481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.361827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa8339-8abd-4240-bbfc-5914682a27c8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:05.372445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:05.373157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:05.373442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:05.373711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:05.374411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.379153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.381867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:05.382675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:05.383836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:05.384237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:05.387673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:05.387849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.395847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.423275 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1067/2116] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:05.424277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.426844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:05.429768 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1050/2117] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:05 2022] POST /identity/v3/users => generated 306 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:05.431891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.446939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7d5c-f8e3-4b85-8f62-9d32be235b68 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:05.458214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:05.459973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:05.460651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:05.461069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] PATH_INFO: `/v3/projects/e294453c68674ed8baea6d79c6a87e78` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:05.462522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e294453c68674ed8baea6d79c6a87e78)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.465652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.467311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd99335-950e-4e67-96ad-d82fe071c7e1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:05.498079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:05.498795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:05.500756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:05.501193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:05.502102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.506319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.547317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1051/2118] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:05 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:05.548201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.552629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:05.579378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184a0b9-c23b-4140-a250-823ad7b16f4e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:05.591370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e294453c68674ed8baea6d79c6a87e78', 'request_id': 'req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.605138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e294453c68674ed8baea6d79c6a87e78', 'request_id': 'req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.610616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:05.625205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e294453c68674ed8baea6d79c6a87e78', 'request_id': 'req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.643430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] The token cache is being invalidate because project e294453c68674ed8baea6d79c6a87e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:05.644022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.644897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.647285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1068/2119] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:05 2022] DELETE /identity/v3/projects/e294453c68674ed8baea6d79c6a87e78 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:05.648513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.650064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:05.703679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:05.704849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:05.714957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:05.715642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] PATH_INFO: `/v3/users/0f622a1911d44c699caf61401cce34b2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:05.717371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f622a1911d44c699caf61401cce34b2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.719240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.722122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:05.770624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a7947-401a-4d0b-8f88-3f9bea8f0479 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:05.778866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:05.779849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:05.780281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:05.780658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:05.782570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:05.787114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:05.803560 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1069/2120] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:05.804744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.807198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:05.819907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f622a1911d44c699caf61401cce34b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.821800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f622a1911d44c699caf61401cce34b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.853903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f622a1911d44c699caf61401cce34b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.855721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f622a1911d44c699caf61401cce34b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.875245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f622a1911d44c699caf61401cce34b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:05.905015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1052/2121] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:05 2022] DELETE /identity/v3/users/0f622a1911d44c699caf61401cce34b2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:05.907216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:05.911167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.003166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fcb29-92dd-4cb0-ad4f-b5308eda72e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:06.065536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e572bf-8613-4eaa-98fe-f7d9b042a468 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:06.077977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:06.087561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.088125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.089232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.090185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:06.094029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:06.110467 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1053/2122] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:06.111677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:06.114993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.160846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:06.162505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.162505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.164958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1581-158b-467f-980f-0f8c5263686a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:06.169658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.179413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.185072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:06.185895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.186180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.189311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] PATH_INFO: `/v3/users/d5fa624dbbeb4cf1b887b57be41a0a6d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.190964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fa624dbbeb4cf1b887b57be41a0a6d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:06.193154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:06.203730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:06.281679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fa624dbbeb4cf1b887b57be41a0a6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:06.282394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fa624dbbeb4cf1b887b57be41a0a6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:06.303189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:06.304828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:06.305109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fa624dbbeb4cf1b887b57be41a0a6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:06.306033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fa624dbbeb4cf1b887b57be41a0a6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:06.316321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:06.333394 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1070/2123] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:06.334612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:06.338054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38d518cb-b6ce-4d52-b5de-66d82fa0bfa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fa624dbbeb4cf1b887b57be41a0a6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:06.341082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.357903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a19e8-83d8-458a-83f2-91652a98bf5c service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:06.364162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1054/2124] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:06 2022] DELETE /identity/v3/users/d5fa624dbbeb4cf1b887b57be41a0a6d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:06.365400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc62f-2f09-48fd-8e86-5c9add2d2651 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.365692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc62f-2f09-48fd-8e86-5c9add2d2651 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.365971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc62f-2f09-48fd-8e86-5c9add2d2651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.376172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:06.380292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.381656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.382113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.383106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:06.384718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9facc62f-2f09-48fd-8e86-5c9add2d2651 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:06.385971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9facc62f-2f09-48fd-8e86-5c9add2d2651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.389054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:06.415753 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1071/2125] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:06.417749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:06.422967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.453802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de5c5d-42d5-40b0-bf8c-7ac64ce34c6b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:06.596593 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1055/2126] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:06.599190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b971-62e5-4742-a1e1-24b2d11edd63 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.599565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b971-62e5-4742-a1e1-24b2d11edd63 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.599915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b971-62e5-4742-a1e1-24b2d11edd63 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.602685 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1056/2127] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:02:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:02:06.604232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b971-62e5-4742-a1e1-24b2d11edd63 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:06.609564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3d6b971-62e5-4742-a1e1-24b2d11edd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.628795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:06.629847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.630330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.630788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.631737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:06.633622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:06.635938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b971-62e5-4742-a1e1-24b2d11edd63 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:06.641828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:06.644117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.644482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.644850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] PATH_INFO: `/v3/projects/a9917e8c21314e5eb0a3fe51d198fb5d/users/dfa9abf56586438ba2855e3b7e494213/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.664243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1072/2128] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:06.665344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9917e8c21314e5eb0a3fe51d198fb5d, user_id=dfa9abf56586438ba2855e3b7e494213, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:06.665702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:02:06.667953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.669612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:06.704722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1057/2129] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:06 2022] PUT /identity/v3/projects/a9917e8c21314e5eb0a3fe51d198fb5d/users/dfa9abf56586438ba2855e3b7e494213/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:06.705858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:06.707644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.862700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:06.864490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:06.917150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe38216-7900-4419-86a2-f21d4a52a0e7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:06.921712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:06.922390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:06.922674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:06.923132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:06.945801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:07.019690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52f46-a46c-4a79-9d7d-ecd11f26379b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:07.037388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:07.041490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:07.059151 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1058/2130] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:07.060453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:07.114166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2a192-7472-4677-bd98-ad7df50d2640 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:07.122015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:07.123495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.123495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.123785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] PATH_INFO: `/v3/projects/8d5bb60da6c748069709e3c9e5bacbff/users/631f8b600f144677ae9831f5772407ec/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.171083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:07.185476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5bb60da6c748069709e3c9e5bacbff, user_id=631f8b600f144677ae9831f5772407ec, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:07.192647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:07.208376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac804d-1bfc-4404-9978-b3b0d13b0e62 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:07.210002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac804d-1bfc-4404-9978-b3b0d13b0e62 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.210290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac804d-1bfc-4404-9978-b3b0d13b0e62 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.210571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac804d-1bfc-4404-9978-b3b0d13b0e62 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.211877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac804d-1bfc-4404-9978-b3b0d13b0e62 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:get_project(project_id=dff3bf4d1e2544be9d0d68dcdc0a4393)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:07.214942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac804d-1bfc-4404-9978-b3b0d13b0e62 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:07.217114 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1073/2131] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:02:06 2022] GET /identity/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393 => generated 369 bytes in 552 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:07.219641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c385d-8a60-4160-8708-d004f009c9f6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.219932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c385d-8a60-4160-8708-d004f009c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.220227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c385d-8a60-4160-8708-d004f009c9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.231146 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1059/2132] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:07 2022] PUT /identity/v3/projects/8d5bb60da6c748069709e3c9e5bacbff/users/631f8b600f144677ae9831f5772407ec/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:07.242205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:07.244096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:07.334844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fb8c385d-8a60-4160-8708-d004f009c9f6 None None] MFA Rules not processed for user `dfa9abf56586438ba2855e3b7e494213`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:07.335098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479b57f-d1a4-475c-ad0d-63d2239f31d7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:07.336310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fb8c385d-8a60-4160-8708-d004f009c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:07.340668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:07.341726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.341945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.342164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] PATH_INFO: `/v3/projects/60f4811f948c4076b467dc4690b0c9d4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.344094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f4811f948c4076b467dc4690b0c9d4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:07.345934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:07.439685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f4811f948c4076b467dc4690b0c9d4', 'request_id': 'req-7cc55109-af3d-468e-97c3-1e4dca054741'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:07.461622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f4811f948c4076b467dc4690b0c9d4', 'request_id': 'req-7cc55109-af3d-468e-97c3-1e4dca054741'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:07.489735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f4811f948c4076b467dc4690b0c9d4', 'request_id': 'req-7cc55109-af3d-468e-97c3-1e4dca054741'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:07.516771 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1074/2133] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:07.517400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] The token cache is being invalidate because project 60f4811f948c4076b467dc4690b0c9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:07.517667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:07.519094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74826fc-7704-46b0-826e-cf3276850dc0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.519398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74826fc-7704-46b0-826e-cf3276850dc0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.519597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7cc55109-af3d-468e-97c3-1e4dca054741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:07.519710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74826fc-7704-46b0-826e-cf3276850dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.522916 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1060/2134] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:07 2022] DELETE /identity/v3/projects/60f4811f948c4076b467dc4690b0c9d4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:07.526315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040da21-a094-410d-ba2a-b5551744ee85 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.526916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040da21-a094-410d-ba2a-b5551744ee85 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.527112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040da21-a094-410d-ba2a-b5551744ee85 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.529206 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1061/2135] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:02:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:02:07.529977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040da21-a094-410d-ba2a-b5551744ee85 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:07.532399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0040da21-a094-410d-ba2a-b5551744ee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:07.593120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c74826fc-7704-46b0-826e-cf3276850dc0 None None] MFA Rules not processed for user `631f8b600f144677ae9831f5772407ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:07.595265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c74826fc-7704-46b0-826e-cf3276850dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:07.650811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040da21-a094-410d-ba2a-b5551744ee85 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:07.687767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013584-f325-4d62-875a-81029bfb38d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:07.689565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013584-f325-4d62-875a-81029bfb38d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.690180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013584-f325-4d62-875a-81029bfb38d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.691714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013584-f325-4d62-875a-81029bfb38d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.692779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013584-f325-4d62-875a-81029bfb38d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:07.705973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013584-f325-4d62-875a-81029bfb38d5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:07.709238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:07.719743 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1075/2136] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:07.722104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.722567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.723505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.754914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:07.756393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:07.765364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1076/2137] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:07.766599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:02:07.767856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:07.805905 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1062/2138] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:07 2022] POST /identity/v3/projects => generated 409 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:07.811292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:07.811577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:07.811857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:07.827932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:07.858087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] MFA Rules not processed for user `58c3911cbbdf4e35ae8df9eb8b23f22d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:07.861253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:07.887434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:07.890146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.000665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d17f7d-8056-4d13-86e0-320600e84854 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.019536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1063/2139] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:08.020952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.031670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.123249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8963d7-b94c-4582-acab-1a976873e90a tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.124688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8963d7-b94c-4582-acab-1a976873e90a tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.125072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8963d7-b94c-4582-acab-1a976873e90a tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.125669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8963d7-b94c-4582-acab-1a976873e90a tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.126870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8963d7-b94c-4582-acab-1a976873e90a tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:get_project(project_id=dff3bf4d1e2544be9d0d68dcdc0a4393)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.128092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5fa1-20e5-4ee1-b693-403ab28a1024 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.129080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8963d7-b94c-4582-acab-1a976873e90a tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.131021 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1077/2140] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:02:07 2022] GET /identity/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393 => generated 369 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:08.132096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11450-cde5-4780-8821-c20d3aaab09a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.132380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11450-cde5-4780-8821-c20d3aaab09a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.132649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11450-cde5-4780-8821-c20d3aaab09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.133423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.134421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.134781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.135138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.136315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.139021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.151297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bfe11450-cde5-4780-8821-c20d3aaab09a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:08.152606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bfe11450-cde5-4780-8821-c20d3aaab09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.166027 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1078/2141] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:08.167065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe11450-cde5-4780-8821-c20d3aaab09a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.178606 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1064/2142] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:08 2022] POST /identity/v3/projects => generated 399 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:08.178606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.179757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.188385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe11450-cde5-4780-8821-c20d3aaab09a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.239050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:08.269103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5464c-6fd0-41e8-a688-c2874282261f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.275763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.276892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.277351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.277788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] PATH_INFO: `/v3/projects/7607bd86bd254abf96cba580431bd744` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.280178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7607bd86bd254abf96cba580431bd744)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.281167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff068781-1e74-4dea-979c-3302f106f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.281987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068781-1e74-4dea-979c-3302f106f3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.282271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068781-1e74-4dea-979c-3302f106f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.282573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068781-1e74-4dea-979c-3302f106f3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.283490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.283671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff068781-1e74-4dea-979c-3302f106f3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.285852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff068781-1e74-4dea-979c-3302f106f3d3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.318815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:08.328365 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1079/2143] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:08 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:08.331631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.332053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.332300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.350075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7607bd86bd254abf96cba580431bd744', 'request_id': 'req-3eac711e-0775-4168-8ef4-7da1ed0eab5a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.350843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] MFA Rules not processed for user `58c3911cbbdf4e35ae8df9eb8b23f22d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:08.352069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.357902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7607bd86bd254abf96cba580431bd744', 'request_id': 'req-3eac711e-0775-4168-8ef4-7da1ed0eab5a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.367683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7607bd86bd254abf96cba580431bd744', 'request_id': 'req-3eac711e-0775-4168-8ef4-7da1ed0eab5a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.383987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] The token cache is being invalidate because project 7607bd86bd254abf96cba580431bd744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:08.384280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.384959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.390333 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1065/2144] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:08 2022] DELETE /identity/v3/projects/7607bd86bd254abf96cba580431bd744 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:08.390333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.390333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.419315 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1080/2145] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:08.419315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.419315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.478193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac711e-0775-4168-8ef4-7da1ed0eab5a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.483132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.483817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.484274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.484567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.485364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:08.485684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.488544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.506567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1066/2146] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:08.506567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.507081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.532311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f5eef-37e9-4453-86f7-e2efa84a22d7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.537316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.538228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.538497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.538772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.539464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.541480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.572896 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1081/2147] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:08 2022] POST /identity/v3/users => generated 306 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:08.573826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.575909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.594069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31883834-a5f8-4a93-a255-d17040e58226 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.596585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa1ec7-f6b6-4932-80fa-95463bd28577 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.599768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.600429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.600718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.601001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.601800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:08.602120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.603395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.603752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.605371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.605371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.605371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.606576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.609119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.618295 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1067/2148] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:08.619305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.621224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.625755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1082/2149] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:08.626793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.628660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.643421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f9979-dfef-4a30-9fde-52277069dbe4 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.650575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.651501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.651781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.652062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] PATH_INFO: `/v3/users/a456055974af48a794d0ffddd9837e83` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.653325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a456055974af48a794d0ffddd9837e83)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.655780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.702926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:08.720089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:08.733432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a456055974af48a794d0ffddd9837e83'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.734709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a456055974af48a794d0ffddd9837e83'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.750731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a456055974af48a794d0ffddd9837e83'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.751923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a456055974af48a794d0ffddd9837e83'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.758674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cbf9-1965-4e4d-b13e-fc81bf5d48c5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.762905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a456055974af48a794d0ffddd9837e83'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:08.766826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.767605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.767970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.768478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.770632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.779152 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1068/2150] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:08 2022] DELETE /identity/v3/users/a456055974af48a794d0ffddd9837e83 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:08.779790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.781345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.791328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.793361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.806589 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1083/2151] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:08.807469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:08.809687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:08.841750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff00dc-cd43-42ef-874c-3a8bd6a3820b service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.915596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bad6-50ed-447f-b1ac-f3f0c47c997d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:08.924195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.925261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.925858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.926293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.927240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.930500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:08.991406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:08.993641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:08.994374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:08.994676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:08.995428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:08.999142 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1069/2152] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:08 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:09.000009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.003855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.008649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.019908 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1084/2153] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:09.019908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.019908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.047444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acff535-aa93-408d-90b4-9bcd6f633e76 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.158613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bfc39-8c63-440c-9ac0-0cc13fc3f97c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.163315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.164250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.164535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.164814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] PATH_INFO: `/v3/projects/67785e8d0d06450697c89092ece4dcc7/users/fd3ffd9bcd8c4569899332930691b953/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.171918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.173605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.173932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.174218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.177139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.189347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.193291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67785e8d0d06450697c89092ece4dcc7, user_id=fd3ffd9bcd8c4569899332930691b953, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.197167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.219585 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1085/2154] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:09 2022] PUT /identity/v3/projects/67785e8d0d06450697c89092ece4dcc7/users/fd3ffd9bcd8c4569899332930691b953/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:09.220823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.231873 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1070/2155] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:08 2022] POST /identity/v3/users => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:09.234388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.263499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b74a34-6e22-459e-aea0-8d8e76afe447 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.298465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:09.318430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33b34-afe4-4488-883f-026a64d8393a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.318716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:09.325859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.327914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.328569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.328855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.329600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.332989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.372254 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1086/2156] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:09 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:09.372624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.383040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0759e4a-2af1-44a3-a104-14f6dcd7d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.383950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759e4a-2af1-44a3-a104-14f6dcd7d4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.384306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759e4a-2af1-44a3-a104-14f6dcd7d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.384583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0759e4a-2af1-44a3-a104-14f6dcd7d4e8 admin admin] PATH_INFO: `/v3/projects/4bdd63e71f4849a6863acf098904960f/users/91afdba04a224a359e43f0a18defd2c3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.386844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4938c-2ef4-4894-a468-992a343e9da9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.392333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.393243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.393567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.393910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.395377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.396416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.413456 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1087/2157] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:09.413456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.413865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0759e4a-2af1-44a3-a104-14f6dcd7d4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bdd63e71f4849a6863acf098904960f, user_id=91afdba04a224a359e43f0a18defd2c3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.416049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0759e4a-2af1-44a3-a104-14f6dcd7d4e8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.440410 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1071/2158] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:09 2022] PUT /identity/v3/projects/4bdd63e71f4849a6863acf098904960f/users/91afdba04a224a359e43f0a18defd2c3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:09.445984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.446273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.446553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.492383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:09.493864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.522144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33491d-57e6-4b8d-ac66-d2eae08cd1bd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.555728 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1072/2159] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:09.556782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.558160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.615300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.616157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.616449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.616729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.617515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:09.618378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.619674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.633507 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1088/2160] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:09.634507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.647329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a293575-02cf-45db-a7b8-28f85451f932 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.650086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65984fea-0f2f-416a-9f63-678caea74342 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.652974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.653688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.653979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.654260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.655013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.655791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.656765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.656964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.657382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.657732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] PATH_INFO: `/v3/projects/697cf498c2734046b0108e023378f6d5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.659844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697cf498c2734046b0108e023378f6d5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.662213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.671307 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1089/2161] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:09.671307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.680559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daa8ff-f275-413a-830b-ac796a809e6a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.685825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.686780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.687169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.687450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] PATH_INFO: `/v3/projects/67785e8d0d06450697c89092ece4dcc7/users/fd3ffd9bcd8c4569899332930691b953/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.690775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67785e8d0d06450697c89092ece4dcc7, user_id=fd3ffd9bcd8c4569899332930691b953, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.693668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.716940 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1090/2162] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:09 2022] PUT /identity/v3/projects/67785e8d0d06450697c89092ece4dcc7/users/fd3ffd9bcd8c4569899332930691b953/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:09.718097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.725895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697cf498c2734046b0108e023378f6d5', 'request_id': 'req-f9b2aa84-7888-409c-99c6-bcdc707b5915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:09.736506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697cf498c2734046b0108e023378f6d5', 'request_id': 'req-f9b2aa84-7888-409c-99c6-bcdc707b5915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:09.746787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697cf498c2734046b0108e023378f6d5', 'request_id': 'req-f9b2aa84-7888-409c-99c6-bcdc707b5915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:09.748483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:09.766435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] The token cache is being invalidate because project 697cf498c2734046b0108e023378f6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:09.766832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:09.767637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:09.771291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1073/2163] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:09 2022] DELETE /identity/v3/projects/697cf498c2734046b0108e023378f6d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:09.772106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.777386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.793655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:09.819566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded1598-de7d-4573-986b-07f0065d8f05 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.852877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2aa84-7888-409c-99c6-bcdc707b5915 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.857760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.858309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.858593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.858903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.862380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.874278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.876844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.881945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcb177-651c-41a8-9f86-919652c657ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.882624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcb177-651c-41a8-9f86-919652c657ef admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.882906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcb177-651c-41a8-9f86-919652c657ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.883190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcb177-651c-41a8-9f86-919652c657ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.883930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcb177-651c-41a8-9f86-919652c657ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.885607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcb177-651c-41a8-9f86-919652c657ef admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.887970 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1074/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:09.889224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.890861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.903809 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1091/2165] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:09.905356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4791e5-f9fd-4b9c-a9e2-3074011545d5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.905705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4791e5-f9fd-4b9c-a9e2-3074011545d5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.905988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4791e5-f9fd-4b9c-a9e2-3074011545d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.908247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f8a75-a4fa-492c-b14f-6dadb335d4a4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:09.914197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7024d-bbd4-47a3-b0e5-31ad48da9f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:09.915361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7024d-bbd4-47a3-b0e5-31ad48da9f81 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.916057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7024d-bbd4-47a3-b0e5-31ad48da9f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.916557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7024d-bbd4-47a3-b0e5-31ad48da9f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.917539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7024d-bbd4-47a3-b0e5-31ad48da9f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:09.919383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7024d-bbd4-47a3-b0e5-31ad48da9f81 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:09.938335 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1075/2166] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:09.940174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae8db-06d4-4ab0-b9af-6ab7082744b0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.940480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae8db-06d4-4ab0-b9af-6ab7082744b0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.940873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ae8db-06d4-4ab0-b9af-6ab7082744b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.942897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1b4791e5-f9fd-4b9c-a9e2-3074011545d5 None None] MFA Rules not processed for user `fd3ffd9bcd8c4569899332930691b953`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:09.944125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1b4791e5-f9fd-4b9c-a9e2-3074011545d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.969105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ac8ae8db-06d4-4ab0-b9af-6ab7082744b0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:09.971508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ac8ae8db-06d4-4ab0-b9af-6ab7082744b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:09.982075 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1076/2167] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:09.984421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098b274-5ac0-4a62-b2aa-8c4022a53dff None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:09.985188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098b274-5ac0-4a62-b2aa-8c4022a53dff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:09.985662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098b274-5ac0-4a62-b2aa-8c4022a53dff None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:09.988612 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1077/2168] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:02:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:02:09.989591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098b274-5ac0-4a62-b2aa-8c4022a53dff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:09.991514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d098b274-5ac0-4a62-b2aa-8c4022a53dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:10.012148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098b274-5ac0-4a62-b2aa-8c4022a53dff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:10.019206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:10.020386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.020853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.021335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] PATH_INFO: `/v3/projects/4bdd63e71f4849a6863acf098904960f/users/91afdba04a224a359e43f0a18defd2c3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.024168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bdd63e71f4849a6863acf098904960f, user_id=91afdba04a224a359e43f0a18defd2c3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:10.028081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:10.047665 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1078/2169] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:09 2022] PUT /identity/v3/projects/4bdd63e71f4849a6863acf098904960f/users/91afdba04a224a359e43f0a18defd2c3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:10.053200 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1092/2170] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:10.053295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:10.053384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.053384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.053384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.089069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:10.091936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:10.142843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0f23-bfad-40cf-8a94-44b3d0e8643c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:10.148576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a13592-145f-492b-ba4f-0fb096eb5451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:10.149289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a13592-145f-492b-ba4f-0fb096eb5451 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.149575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a13592-145f-492b-ba4f-0fb096eb5451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.149854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a13592-145f-492b-ba4f-0fb096eb5451 admin admin] PATH_INFO: `/v3/projects/5c35ef36a81442b69cd93edc50ecb5bf/users/681cfb0e560145b4abef98dbd417f3e0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.171947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a13592-145f-492b-ba4f-0fb096eb5451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c35ef36a81442b69cd93edc50ecb5bf, user_id=681cfb0e560145b4abef98dbd417f3e0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:10.175084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a13592-145f-492b-ba4f-0fb096eb5451 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:10.189263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1093/2171] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:10.190744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:02:10.191975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:10.199800 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1079/2172] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:10 2022] PUT /identity/v3/projects/5c35ef36a81442b69cd93edc50ecb5bf/users/681cfb0e560145b4abef98dbd417f3e0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:10.202661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea8158-3957-414c-ae09-ee58ee7f44cc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.203141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea8158-3957-414c-ae09-ee58ee7f44cc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.203479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea8158-3957-414c-ae09-ee58ee7f44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.221541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:10.271141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ccea8158-3957-414c-ae09-ee58ee7f44cc None None] MFA Rules not processed for user `91afdba04a224a359e43f0a18defd2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:10.272978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ccea8158-3957-414c-ae09-ee58ee7f44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:10.299548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:10.301169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:10.322000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:10.434979 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1080/2173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:10.434979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea8158-3957-414c-ae09-ee58ee7f44cc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:10.472968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf4d63-6aa1-42eb-95b5-00dc0958b917 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:10.598903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca1f16-d49b-451e-91c1-8df5db9cfff2 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:10.600034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1f16-d49b-451e-91c1-8df5db9cfff2 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.601429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1f16-d49b-451e-91c1-8df5db9cfff2 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.601813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1f16-d49b-451e-91c1-8df5db9cfff2 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.603819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca1f16-d49b-451e-91c1-8df5db9cfff2 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:get_project(project_id=dff3bf4d1e2544be9d0d68dcdc0a4393)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:10.607851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca1f16-d49b-451e-91c1-8df5db9cfff2 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:10.610272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1094/2174] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:02:10 2022] GET /identity/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393 => generated 369 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:10.626608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.628398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.629351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.637736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea8158-3957-414c-ae09-ee58ee7f44cc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:10.651227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:10.652831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.655956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.657009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.658023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:10.659403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:10.663192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:10.677732 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1081/2175] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:10.677912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:10.679271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:10.681822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:10.696528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f254-bfe8-400a-8d0d-a3e506a29c83 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:10.702844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:10.703594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.703949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.704326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.705132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:10.707708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:10.720268 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1095/2176] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:10.732457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:10.735364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:10.766243 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1082/2177] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:10 2022] POST /identity/v3/projects => generated 397 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:02:10.782695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:10.834347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b836ac-a4f2-46bf-b2d3-00cacda96056 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:10.840355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:10.976898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b8856-b01d-420d-ba0e-fda4fc03299f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:10.992375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:10.993317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.993598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.993805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:10.994650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:10.995949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:10.996756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:10.997085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:10.997417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:10.997893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.012337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.015154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.053606 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1083/2178] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:10 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:11.055260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.061109 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1096/2179] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:11.061961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.081719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e4104-9ca0-4a4d-b342-1ed2d84d3675 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.098102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.098955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.099243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.099515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.100275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.101895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.112791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:11.117403 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1097/2180] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:11.122804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.147559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbfc8d-c29e-44b6-b2c3-b6a53ad95f6d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.156553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.157864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.158329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.158914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.160090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.163024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.180512 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1098/2181] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:11.184829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.201864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3987318-4c51-4bff-96b3-01ec9124fa7f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.212285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf542a6-c7c8-4cc2-a91b-57ba41950978 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.227322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7bb68-353b-485c-aca4-e3bb56fd6291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.228012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7bb68-353b-485c-aca4-e3bb56fd6291 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.228306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7bb68-353b-485c-aca4-e3bb56fd6291 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.228586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7bb68-353b-485c-aca4-e3bb56fd6291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.234283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.235200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.235486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.235762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] PATH_INFO: `/v3/projects/9f0a0c26a5b846f0a657fa8810da9d71/users/76897f7be7494bb589de747493240449/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.269066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0a0c26a5b846f0a657fa8810da9d71, user_id=76897f7be7494bb589de747493240449, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.273508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.304085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1099/2182] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:11 2022] PUT /identity/v3/projects/9f0a0c26a5b846f0a657fa8810da9d71/users/76897f7be7494bb589de747493240449/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:11.305803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.309016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:11.326386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7bb68-353b-485c-aca4-e3bb56fd6291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.328134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7bb68-353b-485c-aca4-e3bb56fd6291 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.346606 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1084/2183] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:11.348107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5770b0-3b3d-4ff0-9c06-ce69c83408c9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.348457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5770b0-3b3d-4ff0-9c06-ce69c83408c9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.349286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5770b0-3b3d-4ff0-9c06-ce69c83408c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.372067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3a5770b0-3b3d-4ff0-9c06-ce69c83408c9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:11.372555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3a5770b0-3b3d-4ff0-9c06-ce69c83408c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:11.429324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ca53c-27e4-46e0-9f54-a6a82ac11f77 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.437780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.438554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.439306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.439729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.541680 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1085/2184] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:11.543506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a311d-b618-42ff-8098-7b562616f423 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.543889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a311d-b618-42ff-8098-7b562616f423 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.544437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a311d-b618-42ff-8098-7b562616f423 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.546228 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1086/2185] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:02:11.558246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a311d-b618-42ff-8098-7b562616f423 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.560460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:11.569580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.573122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.599837 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1100/2186] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:11.629074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:02:11.679156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.761607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a311d-b618-42ff-8098-7b562616f423 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.774024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.774809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.775192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.775484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.793744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.795481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.808521 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1087/2187] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:11.851116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397d0db-d6f7-4bcd-b643-fad20e8be72b service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.859693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.861169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.861878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.862549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.865402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:get_project(project_id=dff3bf4d1e2544be9d0d68dcdc0a4393)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.868173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:11.871151 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1101/2188] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:02:11 2022] GET /identity/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393 => generated 369 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:11.911104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.927400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:11.936876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b5b2-c04f-4c13-a454-075fa92ee686 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.942882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.944615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.945165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.945690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/users/f482897e21254e588949fd62ac5d146f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.948661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:11.952442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291d6a6-65b7-4161-935b-51e367b23816 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:11.960578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:11.962458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:11.963625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:11.963930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:11.966264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:11.967317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f482897e21254e588949fd62ac5d146f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:11.970071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:12.080063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f482897e21254e588949fd62ac5d146f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.080664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:12.081464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f482897e21254e588949fd62ac5d146f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.084429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:12.102454 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1102/2189] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:12.111624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f482897e21254e588949fd62ac5d146f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.112813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f482897e21254e588949fd62ac5d146f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.131885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f482897e21254e588949fd62ac5d146f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.155568 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1088/2190] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:11 2022] DELETE /identity/v3/users/f482897e21254e588949fd62ac5d146f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:12.159689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:12.187720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3cff-a9e8-4821-8913-561f2f332ee6 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:12.270158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f9002e77784084bf81cb68e72b5c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb72abb04804f2692d5a1e1e97b82ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:12.271174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:12.271522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:12.271863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] PATH_INFO: `/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:12.273552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dff3bf4d1e2544be9d0d68dcdc0a4393)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:12.276607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:12.346173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:12.362689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff3bf4d1e2544be9d0d68dcdc0a4393', 'request_id': 'req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.370510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff3bf4d1e2544be9d0d68dcdc0a4393', 'request_id': 'req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.391925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff3bf4d1e2544be9d0d68dcdc0a4393', 'request_id': 'req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.397159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] The token cache is being invalidate because project dff3bf4d1e2544be9d0d68dcdc0a4393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:12.397455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.398164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.400078 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1103/2191] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:12 2022] DELETE /identity/v3/projects/dff3bf4d1e2544be9d0d68dcdc0a4393 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:12.407089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:12.411146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:12.568689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8458a-88c8-4fd7-9a16-03dbd3146362 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:12.671303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:12.671303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:12.671602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:12.674250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] PATH_INFO: `/v3/users/f6248920fd4b4c76ab42cd5f3978a740` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:12.678004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6248920fd4b4c76ab42cd5f3978a740)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:12.685862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:12.688094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:12.699240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:12.709015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3fde-7c13-4560-82eb-1bc8fb6cf458 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:12.723418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:12.724351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:12.724910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:12.724910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] PATH_INFO: `/v3/users/dfa9abf56586438ba2855e3b7e494213` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:12.726155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa9abf56586438ba2855e3b7e494213)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:12.728137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:12.741288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:12.812343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6248920fd4b4c76ab42cd5f3978a740'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.814056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6248920fd4b4c76ab42cd5f3978a740'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.849845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa9abf56586438ba2855e3b7e494213'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.851671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6248920fd4b4c76ab42cd5f3978a740'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.851799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa9abf56586438ba2855e3b7e494213'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.853048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6248920fd4b4c76ab42cd5f3978a740'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.873367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3fdd1602-6524-4fe5-b18b-1aa4b64cb8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6248920fd4b4c76ab42cd5f3978a740'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.881499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa9abf56586438ba2855e3b7e494213'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.883596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa9abf56586438ba2855e3b7e494213'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.902520 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1089/2192] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:12 2022] DELETE /identity/v3/users/f6248920fd4b4c76ab42cd5f3978a740 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:12.907629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:12.907953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df408263-021c-49c6-9bb5-68e719087ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa9abf56586438ba2855e3b7e494213'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:12.908224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:12.908593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:12.930134 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1104/2193] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:12 2022] DELETE /identity/v3/users/dfa9abf56586438ba2855e3b7e494213 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:12.931626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:12.932354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:12.932629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:12.952182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:12.955641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:12.956971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:12.960150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:13.150504 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1105/2194] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:13.154468 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1090/2195] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:13.174875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:13.184068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:13.201399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:13.203161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:13.350851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:13.362393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6140-202a-4738-9f51-dd2e17ce0145 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:13.386922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:13.403138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:13.403523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:13.404712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:13.419345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebc891-9344-481f-a8af-0a9c45602b46 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:13.433005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:13.434005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:13.434948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:13.435549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:13.451363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:13.460446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:13.465521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:13.467229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:13.497768 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1106/2196] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:13.499226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:13.507542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:13.537757 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1091/2197] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:13.669187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ce8f7-2ff4-4854-bd91-d3d664d926a4 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:13.675997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:13.676744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:13.677341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:13.677686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:13.680827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:13.784718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:13.786727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:13.811260 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1107/2198] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:16.245800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:16.247548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:16.272653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd87a33-a22e-4fa8-a2ec-b5d09405462e service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:16.291261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:16.291261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:16.291261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:16.291261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] PATH_INFO: `/v3/projects/a9917e8c21314e5eb0a3fe51d198fb5d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:16.296309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9917e8c21314e5eb0a3fe51d198fb5d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:16.296309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:16.319188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:16.322379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:16.382282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:16.406955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9917e8c21314e5eb0a3fe51d198fb5d', 'request_id': 'req-4d567129-ecae-4017-b583-0cf0739a84fe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.423350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b5e47-b288-433b-96ad-249fc9b5d191 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:16.424674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9917e8c21314e5eb0a3fe51d198fb5d', 'request_id': 'req-4d567129-ecae-4017-b583-0cf0739a84fe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.446089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9917e8c21314e5eb0a3fe51d198fb5d', 'request_id': 'req-4d567129-ecae-4017-b583-0cf0739a84fe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.471881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] The token cache is being invalidate because project a9917e8c21314e5eb0a3fe51d198fb5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:16.473137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.476913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.481093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1092/2199] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:16 2022] DELETE /identity/v3/projects/a9917e8c21314e5eb0a3fe51d198fb5d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:16.481093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:16.484517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:16.595908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:16.596808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:16.597153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:16.597438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] PATH_INFO: `/v3/projects/da4bbfa66a0d404fb3c0d050146787b0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:16.599888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4bbfa66a0d404fb3c0d050146787b0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:16.604139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:16.660532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567129-ecae-4017-b583-0cf0739a84fe admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:16.675499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:16.679260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:16.680490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:16.681253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:16.681253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] PATH_INFO: `/v3/users/631f8b600f144677ae9831f5772407ec` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:16.685839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631f8b600f144677ae9831f5772407ec)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:16.687896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:16.741439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4bbfa66a0d404fb3c0d050146787b0', 'request_id': 'req-1af1a3af-85d4-476b-b21b-134c05cee38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.750041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4bbfa66a0d404fb3c0d050146787b0', 'request_id': 'req-1af1a3af-85d4-476b-b21b-134c05cee38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.763158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4bbfa66a0d404fb3c0d050146787b0', 'request_id': 'req-1af1a3af-85d4-476b-b21b-134c05cee38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.794222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] The token cache is being invalidate because project da4bbfa66a0d404fb3c0d050146787b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:16.794519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.797973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.801303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631f8b600f144677ae9831f5772407ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.803129 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1108/2200] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:16 2022] DELETE /identity/v3/projects/da4bbfa66a0d404fb3c0d050146787b0 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:16.803952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:16.804767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631f8b600f144677ae9831f5772407ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.815043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:16.849472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631f8b600f144677ae9831f5772407ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.853679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631f8b600f144677ae9831f5772407ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.879762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631f8b600f144677ae9831f5772407ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:16.909971 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1093/2201] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:16 2022] DELETE /identity/v3/users/631f8b600f144677ae9831f5772407ec => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:16.911104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:16.914522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:16.987356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:16.994930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1a3af-85d4-476b-b21b-134c05cee38e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:17.026322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c529d-e683-4986-8691-acb782a36ea5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:17.035316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:17.036790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:17.037264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:17.037726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] PATH_INFO: `/v3/users/96f9002e77784084bf81cb68e72b5c4c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:17.039186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f9002e77784084bf81cb68e72b5c4c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:17.043104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:17.125928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f9002e77784084bf81cb68e72b5c4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.127100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f9002e77784084bf81cb68e72b5c4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.161615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:17.162492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:17.162773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:17.163453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] PATH_INFO: `/v3/users/fd3ffd9bcd8c4569899332930691b953` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:17.170631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3ffd9bcd8c4569899332930691b953)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:17.172182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f9002e77784084bf81cb68e72b5c4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.173006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:17.173473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f9002e77784084bf81cb68e72b5c4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.202762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ceb767d-f3b2-4d14-8525-6b343b4bfa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f9002e77784084bf81cb68e72b5c4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.231608 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1094/2202] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:16 2022] DELETE /identity/v3/users/96f9002e77784084bf81cb68e72b5c4c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:17.233548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:17.234015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:17.238905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:17.268743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3ffd9bcd8c4569899332930691b953'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.269858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3ffd9bcd8c4569899332930691b953'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.281150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:17.284212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:17.289897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:17.291510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3ffd9bcd8c4569899332930691b953'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.292974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3ffd9bcd8c4569899332930691b953'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.306527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3ffd9bcd8c4569899332930691b953'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:17.328701 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1109/2203] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:16 2022] DELETE /identity/v3/users/fd3ffd9bcd8c4569899332930691b953 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:17.425356 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1095/2204] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:17.448574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:17.450451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:17.622285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b9734-0a09-44e7-a555-613ee54a148c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:17.638642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef37170-21a1-4d5d-9ca4-ed50627f6e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:17.639516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef37170-21a1-4d5d-9ca4-ed50627f6e67 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:17.639994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef37170-21a1-4d5d-9ca4-ed50627f6e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:17.640464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef37170-21a1-4d5d-9ca4-ed50627f6e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:17.777589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:17.779826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:17.808916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6885a0c-21ac-4da4-a102-805ff250535b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:17.874250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef37170-21a1-4d5d-9ca4-ed50627f6e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:17.876021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef37170-21a1-4d5d-9ca4-ed50627f6e67 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:17.911378 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1110/2205] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:17.976749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:17.977951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:17.978341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:17.978721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] PATH_INFO: `/v3/users/c9ae6d217f7344408eed23388dd337b7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:17.980257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ae6d217f7344408eed23388dd337b7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:17.982415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:17.984511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:18.084753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ae6d217f7344408eed23388dd337b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:18.086900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ae6d217f7344408eed23388dd337b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:18.117329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ae6d217f7344408eed23388dd337b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:18.118405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ae6d217f7344408eed23388dd337b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:18.133565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ae6d217f7344408eed23388dd337b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:18.153722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1096/2206] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:17 2022] DELETE /identity/v3/users/c9ae6d217f7344408eed23388dd337b7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:18.158267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:18.158861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:18.159345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:18.198159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:18.199658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:18.347903 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1111/2207] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:18.495052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:18.496678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:18.679231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbbf5f-a45e-4b88-be68-3b1e3b772c66 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:18.688301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:18.689487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:18.689776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:18.690047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:18.718519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:18.720075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:18.740483 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1097/2208] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:19.164010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:19.166834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:19.189523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce03b46-634a-4a5e-b666-fc64c74fb2e0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:19.213219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:19.214296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:19.214575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:19.215576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] PATH_INFO: `/v3/projects/feb72abb04804f2692d5a1e1e97b82ae` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:19.217625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb72abb04804f2692d5a1e1e97b82ae)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:19.222506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:19.254041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:19.330333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb72abb04804f2692d5a1e1e97b82ae', 'request_id': 'req-7ed69ca5-891d-4375-a705-769d3bf44724'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.344928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb72abb04804f2692d5a1e1e97b82ae', 'request_id': 'req-7ed69ca5-891d-4375-a705-769d3bf44724'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.366052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb72abb04804f2692d5a1e1e97b82ae', 'request_id': 'req-7ed69ca5-891d-4375-a705-769d3bf44724'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.386373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] The token cache is being invalidate because project feb72abb04804f2692d5a1e1e97b82ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:19.387021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.388301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ed69ca5-891d-4375-a705-769d3bf44724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.390059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:19.390766 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1112/2209] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:19 2022] DELETE /identity/v3/projects/feb72abb04804f2692d5a1e1e97b82ae => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:19.396021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:19.400147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69b25-c789-42e9-81d3-9168c1e8b794 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:19.400641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69b25-c789-42e9-81d3-9168c1e8b794 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:19.401266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69b25-c789-42e9-81d3-9168c1e8b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:19.407450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0c8f4-993e-4012-ae90-daaa36b5ed5f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:19.431773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3fb69b25-c789-42e9-81d3-9168c1e8b794 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:19.434675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3fb69b25-c789-42e9-81d3-9168c1e8b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:19.486274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:19.487266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:19.487608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:19.487946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] PATH_INFO: `/v3/projects/8d5bb60da6c748069709e3c9e5bacbff` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:19.497447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5bb60da6c748069709e3c9e5bacbff)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:19.517814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:19.575940 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1113/2210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:19.582449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:19.593632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222101d0-946c-420a-8a71-c7204982a190 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:19.593984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222101d0-946c-420a-8a71-c7204982a190 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:19.594272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222101d0-946c-420a-8a71-c7204982a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:19.624564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-222101d0-946c-420a-8a71-c7204982a190 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:19.625788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-222101d0-946c-420a-8a71-c7204982a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:19.636477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5bb60da6c748069709e3c9e5bacbff', 'request_id': 'req-2f06cd28-0fd6-4472-ac9a-846083afc99f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.649117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5bb60da6c748069709e3c9e5bacbff', 'request_id': 'req-2f06cd28-0fd6-4472-ac9a-846083afc99f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.673183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5bb60da6c748069709e3c9e5bacbff', 'request_id': 'req-2f06cd28-0fd6-4472-ac9a-846083afc99f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.687243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] The token cache is being invalidate because project 8d5bb60da6c748069709e3c9e5bacbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:19.687806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.688924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:19.696180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1098/2211] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:19 2022] DELETE /identity/v3/projects/8d5bb60da6c748069709e3c9e5bacbff => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:19.699067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:19.701348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:19.791224 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1114/2212] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:19.792835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222101d0-946c-420a-8a71-c7204982a190 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:19.794850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-222101d0-946c-420a-8a71-c7204982a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:19.827866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222101d0-946c-420a-8a71-c7204982a190 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:19.878733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06cd28-0fd6-4472-ac9a-846083afc99f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:19.885948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:19.887209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:19.887209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:19.887417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] PATH_INFO: `/v3/users/91afdba04a224a359e43f0a18defd2c3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:19.892746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:19.895787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91afdba04a224a359e43f0a18defd2c3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:19.895956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:19.895956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:19.895956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] PATH_INFO: `/v3/projects/d9f244c1df9c4ca19ec5fa57b7d94bc6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:19.897884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:19.906097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f244c1df9c4ca19ec5fa57b7d94bc6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:19.908083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:20.053195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'request_id': 'req-ba29f67d-54b2-4b0c-a73a-52c62be2148c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.058220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:20.075381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91afdba04a224a359e43f0a18defd2c3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.076372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'request_id': 'req-ba29f67d-54b2-4b0c-a73a-52c62be2148c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.078484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91afdba04a224a359e43f0a18defd2c3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.105812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'request_id': 'req-ba29f67d-54b2-4b0c-a73a-52c62be2148c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.122607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91afdba04a224a359e43f0a18defd2c3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.123435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91afdba04a224a359e43f0a18defd2c3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.128549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] The token cache is being invalidate because project d9f244c1df9c4ca19ec5fa57b7d94bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:20.128850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.130607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.133319 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1099/2213] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:19 2022] DELETE /identity/v3/projects/d9f244c1df9c4ca19ec5fa57b7d94bc6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:20.134230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:20.136610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:20.145436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91afdba04a224a359e43f0a18defd2c3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.167899 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1115/2214] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:19 2022] DELETE /identity/v3/users/91afdba04a224a359e43f0a18defd2c3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:20.168522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:20.172342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:20.207421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:20.243716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29f67d-54b2-4b0c-a73a-52c62be2148c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:20.326676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:20.327838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:20.328125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:20.328446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] PATH_INFO: `/v3/projects/67785e8d0d06450697c89092ece4dcc7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:20.329670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67785e8d0d06450697c89092ece4dcc7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:20.330124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d714d34-22a7-46c3-8549-fd242b978cd8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:20.331629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:20.346895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:20.348062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:20.348525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:20.348953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:20.349896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:20.350359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:20.352295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:20.390725 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1116/2215] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:20.391744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:20.401818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:20.429302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67785e8d0d06450697c89092ece4dcc7', 'request_id': 'req-e2e54dca-612c-4d32-b687-6a09cc84642c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.441699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea9cff-1e18-43a4-ab14-3fa398a7402f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:20.451259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67785e8d0d06450697c89092ece4dcc7', 'request_id': 'req-e2e54dca-612c-4d32-b687-6a09cc84642c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.476181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67785e8d0d06450697c89092ece4dcc7', 'request_id': 'req-e2e54dca-612c-4d32-b687-6a09cc84642c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.500540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] The token cache is being invalidate because project 67785e8d0d06450697c89092ece4dcc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:20.503064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.505238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.511883 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1100/2216] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:20 2022] DELETE /identity/v3/projects/67785e8d0d06450697c89092ece4dcc7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:20.511883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:20.515189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:20.593409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:20.596640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:20.598144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:20.598451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] PATH_INFO: `/v3/users/b1324392f6a94f0189bed37ed3548fb3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:20.602598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1324392f6a94f0189bed37ed3548fb3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:20.608439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:20.727888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1324392f6a94f0189bed37ed3548fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.729224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1324392f6a94f0189bed37ed3548fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.743109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:20.755103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54dca-612c-4d32-b687-6a09cc84642c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:20.761766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1324392f6a94f0189bed37ed3548fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.762651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1324392f6a94f0189bed37ed3548fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.780486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b266c17-f5cf-4be2-93df-a58da40176d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1324392f6a94f0189bed37ed3548fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:20.783031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:20.783719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:20.783998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:20.784269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:20.785714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:20.786932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:20.806214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1117/2217] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:20 2022] DELETE /identity/v3/users/b1324392f6a94f0189bed37ed3548fb3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:20.808791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ad75-8209-4226-b0a7-d67eb17407dd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:20.809099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ad75-8209-4226-b0a7-d67eb17407dd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:20.809377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ad75-8209-4226-b0a7-d67eb17407dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:20.865228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3248ad75-8209-4226-b0a7-d67eb17407dd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:20.868131 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1101/2218] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:20 2022] POST /identity/v3/projects => generated 393 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:20.869132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:20.869350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3248ad75-8209-4226-b0a7-d67eb17407dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:20.871048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:20.888209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:21.018185 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1118/2219] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:21.021713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b73e-67bd-4b54-973e-c3b1e9be88c7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.021999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b73e-67bd-4b54-973e-c3b1e9be88c7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.022274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b73e-67bd-4b54-973e-c3b1e9be88c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.041554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0aab-b955-4023-b3ce-20e409a3fe87 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.057851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.058564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.058902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.059107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.060016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.061994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.071220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-de19b73e-67bd-4b54-973e-c3b1e9be88c7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:21.072465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-de19b73e-67bd-4b54-973e-c3b1e9be88c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:21.097097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1119/2220] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:21.103852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19b73e-67bd-4b54-973e-c3b1e9be88c7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.123584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19b73e-67bd-4b54-973e-c3b1e9be88c7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.130942 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1102/2221] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:20 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:21.135182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.136103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.137062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.137266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.137555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.138418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:21.138668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.140779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.169670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1120/2222] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:21.170813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681c80e-3125-4bde-aba6-bdd035ba3b72 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.174561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.187044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.187953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.188884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.189317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.190207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.195493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.206257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f36d96-d82e-4c1b-b9b2-36f39cffc2eb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.211886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.212458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.212810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.213606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.214459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.216403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.225350 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1103/2223] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:02:21.230088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.244625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff83ec9-bf1c-4cfb-a0ea-c7c643960a4b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.250026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.251343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.251650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.252008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.253677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.255636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.273114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1104/2224] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:21.276475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.295399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1121/2225] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:02:21.298044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.300110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48f55a-c82c-4701-8f25-8730765ea6f2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.430692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da156ce9-da47-43b4-8a78-a242dd783b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.431608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156ce9-da47-43b4-8a78-a242dd783b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.431884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156ce9-da47-43b4-8a78-a242dd783b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.432168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da156ce9-da47-43b4-8a78-a242dd783b4d admin admin] PATH_INFO: `/v3/projects/83b48069cb8e4096b3832bcb6418e322/users/46a9ee6642b4477d9f96934e9d91cc47/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.448185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0c23-b73a-4494-b1f8-586d388b28aa admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.454958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.455648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.455924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.456192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.456937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.459738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.465572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156ce9-da47-43b4-8a78-a242dd783b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b48069cb8e4096b3832bcb6418e322, user_id=46a9ee6642b4477d9f96934e9d91cc47, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.468460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da156ce9-da47-43b4-8a78-a242dd783b4d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.494258 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1122/2227] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:21.499671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.503268 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1105/2227] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:21 2022] PUT /identity/v3/projects/83b48069cb8e4096b3832bcb6418e322/users/46a9ee6642b4477d9f96934e9d91cc47/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:21.504887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ee83-68c9-4775-a6df-00cbc99cd636 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.505548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ee83-68c9-4775-a6df-00cbc99cd636 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.505676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ee83-68c9-4775-a6df-00cbc99cd636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.512832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6b580-8280-42bf-a078-291b254c56a3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.541072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:21.551105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5027ee83-68c9-4775-a6df-00cbc99cd636 None None] MFA Rules not processed for user `46a9ee6642b4477d9f96934e9d91cc47`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:21.552603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5027ee83-68c9-4775-a6df-00cbc99cd636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:21.590697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.591598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.592022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.592938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.593398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.598089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.612242 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1123/2228] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:21.621320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.625287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:21.652353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fc9c8-5578-45c0-9c4b-98a62cf14082 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.657096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1106/2229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:21.665097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.665921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.666278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.666629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.667589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.669639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.671941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027ee83-68c9-4775-a6df-00cbc99cd636 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.682068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1124/2230] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:21.689229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.698557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027ee83-68c9-4775-a6df-00cbc99cd636 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.710724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.714000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4e896-5e27-4f35-9089-bfac9b60ebb9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.715319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.715657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.715992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.716776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.719085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.720667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685409f-90c9-4eac-97f8-377018ba075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:21.721993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685409f-90c9-4eac-97f8-377018ba075d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.722475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685409f-90c9-4eac-97f8-377018ba075d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.722960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685409f-90c9-4eac-97f8-377018ba075d admin admin] PATH_INFO: `/v3/projects/8a610355b4324f8f8bac4b1673685d44/users/02a8362ef1d14be9b41ba2e6c904807f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.750956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685409f-90c9-4eac-97f8-377018ba075d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a610355b4324f8f8bac4b1673685d44, user_id=02a8362ef1d14be9b41ba2e6c904807f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:21.755756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685409f-90c9-4eac-97f8-377018ba075d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:21.761140 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1107/2231] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:21.765517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:21.777702 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1125/2232] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:21 2022] PUT /identity/v3/projects/8a610355b4324f8f8bac4b1673685d44/users/02a8362ef1d14be9b41ba2e6c904807f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:21.790195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acae78-d8ee-4b1f-bbd7-0396b8e71877 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:21.791118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acae78-d8ee-4b1f-bbd7-0396b8e71877 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:21.792391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acae78-d8ee-4b1f-bbd7-0396b8e71877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:21.843867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b2acae78-d8ee-4b1f-bbd7-0396b8e71877 None None] MFA Rules not processed for user `02a8362ef1d14be9b41ba2e6c904807f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:21.845553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2acae78-d8ee-4b1f-bbd7-0396b8e71877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:21.905193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb276e-c0c5-4f1e-9a05-ea10cf7b300a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:21.968070 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1126/2233] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:21.970974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acae78-d8ee-4b1f-bbd7-0396b8e71877 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.038436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.041826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.042185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.042499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.046002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.051358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.071802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acae78-d8ee-4b1f-bbd7-0396b8e71877 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.080483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.081875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.082615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.083067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.083985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.086249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.098023 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1108/2234] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/users => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:22.111466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.113608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:22.134149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1127/2235] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:21 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:22.138039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.146119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513835b-be63-46cc-bf13-2646ff14232f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.248321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e5070-82dd-4618-ab1c-52479cb7fcae admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.256675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.257957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.258469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.258952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.260380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.263176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.301867 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1128/2236] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:22 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:22.305468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.317926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.318882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79508b-81f4-41ac-87c5-983bd07ee7f7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.321513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.322106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.323868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.324809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.324925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.325899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.326721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.327290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.328188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.329847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.330154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.340706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:22.352242 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1129/2237] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:02:22.359659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.370154 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1109/2238] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:22.374356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.391972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e122-9b50-4932-b4cd-4beb90034a12 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.398406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.399931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.400461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.400850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372ee1-731f-4f94-952f-dde0a017b321 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.401241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] PATH_INFO: `/v3/projects/5faaae9647da4088a0abfba5c48320b2/users/d23a12015c6e436786b575431bc643d2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.409900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.410834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.411116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.411399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] PATH_INFO: `/v3/projects/e33f3ce9021643ac99ea26b034d319d0/users/9350658ba89742da93fe72a8795fd8e9/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.423813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faaae9647da4088a0abfba5c48320b2, user_id=d23a12015c6e436786b575431bc643d2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.428018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.432410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33f3ce9021643ac99ea26b034d319d0, user_id=9350658ba89742da93fe72a8795fd8e9, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.436042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.457393 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1130/2239] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:22 2022] PUT /identity/v3/projects/5faaae9647da4088a0abfba5c48320b2/users/d23a12015c6e436786b575431bc643d2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:22.462740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.464039 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1110/2240] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:22 2022] PUT /identity/v3/projects/e33f3ce9021643ac99ea26b034d319d0/users/9350658ba89742da93fe72a8795fd8e9/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:22.468143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.638357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe81d7-c738-486d-99c8-dc39a49ec855 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.648367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856e3a2-1cfe-4560-b317-0a7294a7be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.649063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e3a2-1cfe-4560-b317-0a7294a7be7a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.652948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e3a2-1cfe-4560-b317-0a7294a7be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.654007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e3a2-1cfe-4560-b317-0a7294a7be7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.654827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856e3a2-1cfe-4560-b317-0a7294a7be7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.659264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856e3a2-1cfe-4560-b317-0a7294a7be7a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.660202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6bb23-2f9e-4f44-ac33-1348458c42ce admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.670254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.671387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.671387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.671657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.672571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.674481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.684368 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1131/2241] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:22.689230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40c56e-3547-41e9-be75-0ff340fb8067 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.689879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40c56e-3547-41e9-be75-0ff340fb8067 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.689879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40c56e-3547-41e9-be75-0ff340fb8067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.703159 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1111/2242] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:22.704176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.730863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe280-ce0f-4438-bd2b-fd37ec975408 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.737811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:22.738731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:22.739017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:22.739364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] PATH_INFO: `/v3/projects/5faaae9647da4088a0abfba5c48320b2/users/d23a12015c6e436786b575431bc643d2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:22.756867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faaae9647da4088a0abfba5c48320b2, user_id=d23a12015c6e436786b575431bc643d2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:22.759669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:22.763010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7f40c56e-3547-41e9-be75-0ff340fb8067 None None] MFA Rules not processed for user `681cfb0e560145b4abef98dbd417f3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:22.765489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7f40c56e-3547-41e9-be75-0ff340fb8067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:22.789298 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1112/2243] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:22 2022] PUT /identity/v3/projects/5faaae9647da4088a0abfba5c48320b2/users/d23a12015c6e436786b575431bc643d2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:22.790940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:22.885303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:22.968756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51448828-1455-47df-a8dc-7bd1851a2ffa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:22.999875 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1132/2244] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:23.016867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:23.018087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.018419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.019773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.020065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.020467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.029063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] PATH_INFO: `/v3/projects/e33f3ce9021643ac99ea26b034d319d0/users/9350658ba89742da93fe72a8795fd8e9/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.045376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33f3ce9021643ac99ea26b034d319d0, user_id=9350658ba89742da93fe72a8795fd8e9, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:23.063057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:23.110162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1113/2245] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:22 2022] PUT /identity/v3/projects/e33f3ce9021643ac99ea26b034d319d0/users/9350658ba89742da93fe72a8795fd8e9/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:23.123805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:23.138800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.160679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] MFA Rules not processed for user `d23a12015c6e436786b575431bc643d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:23.162575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.266538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:23.323606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e68c7-ce87-45e4-a664-979f86f57a1a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:23.335836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:23.337207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.337690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.338110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] PATH_INFO: `/v3/projects/4bdd63e71f4849a6863acf098904960f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.342821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bdd63e71f4849a6863acf098904960f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:23.362467 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1133/2246] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:23.362887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:23.362996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:23.362996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.378763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc00388-1554-444c-9546-44c67b87cd34 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:23.386126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38bd9f-d0da-4c8c-a7ad-8b7eb1dd005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:23.387200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bd9f-d0da-4c8c-a7ad-8b7eb1dd005e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.387840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bd9f-d0da-4c8c-a7ad-8b7eb1dd005e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.388124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38bd9f-d0da-4c8c-a7ad-8b7eb1dd005e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.388844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38bd9f-d0da-4c8c-a7ad-8b7eb1dd005e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:23.391065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38bd9f-d0da-4c8c-a7ad-8b7eb1dd005e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:23.429235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bdd63e71f4849a6863acf098904960f', 'request_id': 'req-2c11db65-992e-475e-87ab-ce0708952ea9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.431994 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1134/2247] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:23 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:23.433845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.434135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.434502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.449139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bdd63e71f4849a6863acf098904960f', 'request_id': 'req-2c11db65-992e-475e-87ab-ce0708952ea9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.463643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bdd63e71f4849a6863acf098904960f', 'request_id': 'req-2c11db65-992e-475e-87ab-ce0708952ea9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.467533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] MFA Rules not processed for user `9350658ba89742da93fe72a8795fd8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:23.469125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.492835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] The token cache is being invalidate because project 4bdd63e71f4849a6863acf098904960f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:23.493933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.496207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c11db65-992e-475e-87ab-ce0708952ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.500496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1114/2248] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:23 2022] DELETE /identity/v3/projects/4bdd63e71f4849a6863acf098904960f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:23.501917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.502205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.502485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.544999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] MFA Rules not processed for user `02a8362ef1d14be9b41ba2e6c904807f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:23.546631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.555936 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1135/2249] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:23.561289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:23.561289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.600891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:23.649023 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1115/2250] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:23.649892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:23.651211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.662896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c756e64-0cf4-4f1c-bd78-c84f4243bfd2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:23.667517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde926a-8169-4fb1-a5fc-ab45774effe4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:23.669425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4717f-a6c8-4b1c-a8f1-b91a2a9db1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:23.670126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4717f-a6c8-4b1c-a8f1-b91a2a9db1de admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.670468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4717f-a6c8-4b1c-a8f1-b91a2a9db1de admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.670754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4717f-a6c8-4b1c-a8f1-b91a2a9db1de admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.671454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4717f-a6c8-4b1c-a8f1-b91a2a9db1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:23.672632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:23.673923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.674018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.674217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4717f-a6c8-4b1c-a8f1-b91a2a9db1de admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:23.674316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] PATH_INFO: `/v3/projects/b82f16206d8d4cd8b71a90ead54464c1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.679219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82f16206d8d4cd8b71a90ead54464c1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:23.681575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:23.710762 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1136/2251] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:23 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:23.713704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.713989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.714353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.747806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:23.749447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.764764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82f16206d8d4cd8b71a90ead54464c1', 'request_id': 'req-096a9b7a-f24e-48e9-8166-4dca32a5f757'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.774276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82f16206d8d4cd8b71a90ead54464c1', 'request_id': 'req-096a9b7a-f24e-48e9-8166-4dca32a5f757'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.789960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82f16206d8d4cd8b71a90ead54464c1', 'request_id': 'req-096a9b7a-f24e-48e9-8166-4dca32a5f757'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.806412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] The token cache is being invalidate because project b82f16206d8d4cd8b71a90ead54464c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:23.806709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.807697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:23.810316 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1116/2252] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:23 2022] DELETE /identity/v3/projects/b82f16206d8d4cd8b71a90ead54464c1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:23.812106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:23.814981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.833119 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1137/2253] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:23.841535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:23.842859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:23.845330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:23.944357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9b7a-f24e-48e9-8166-4dca32a5f757 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:23.951393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:23.952767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:23.953635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:23.953635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:23.957005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:24.014132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf898d6-db6f-4646-ba09-9c48f5f0aed9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.022285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a5a41-9240-4c0c-991d-91578911a4d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.023311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5a41-9240-4c0c-991d-91578911a4d4 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.024038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5a41-9240-4c0c-991d-91578911a4d4 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.024484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5a41-9240-4c0c-991d-91578911a4d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.028926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-661a5a41-9240-4c0c-991d-91578911a4d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:24.084127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.086834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.109474 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1117/2254] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:24.110444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.127046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:24.141525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:24.157554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f85f8-624c-4e11-aab8-35b8f5a85c3b service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.166852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5a41-9240-4c0c-991d-91578911a4d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.169366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5a41-9240-4c0c-991d-91578911a4d4 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.172054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d6fae-4684-4735-92b5-45fd77f67d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.172763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6fae-4684-4735-92b5-45fd77f67d0f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.173060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6fae-4684-4735-92b5-45fd77f67d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.173354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d6fae-4684-4735-92b5-45fd77f67d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.174094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6fae-4684-4735-92b5-45fd77f67d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.175726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d6fae-4684-4735-92b5-45fd77f67d0f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.191852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1118/2255] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:24.195669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263777cd-f871-4eeb-82d4-d5209f9e236a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.195987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263777cd-f871-4eeb-82d4-d5209f9e236a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.197418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263777cd-f871-4eeb-82d4-d5209f9e236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.198596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1138/2256] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:24.202912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16173d80-83d7-4996-950c-32343345edc5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.204676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16173d80-83d7-4996-950c-32343345edc5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.205486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16173d80-83d7-4996-950c-32343345edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.237567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-263777cd-f871-4eeb-82d4-d5209f9e236a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:24.239144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-263777cd-f871-4eeb-82d4-d5209f9e236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:24.250279 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1119/2257] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:24.251178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263777cd-f871-4eeb-82d4-d5209f9e236a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.263143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-16173d80-83d7-4996-950c-32343345edc5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:24.263794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263777cd-f871-4eeb-82d4-d5209f9e236a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.266464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-16173d80-83d7-4996-950c-32343345edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:24.271855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.275574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.275574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.275574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] PATH_INFO: `/v3/projects/e553785e5aaa4badba8b6ed9cd24a215/users/cab13553622243d7a8892a30cd85aa9a/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.289666 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1139/2258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:24.294424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751d0b-2c9f-4f09-bd6b-de2080dee21c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.294719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751d0b-2c9f-4f09-bd6b-de2080dee21c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.295275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e751d0b-2c9f-4f09-bd6b-de2080dee21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.320413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e553785e5aaa4badba8b6ed9cd24a215, user_id=cab13553622243d7a8892a30cd85aa9a, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.327144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.341327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9e751d0b-2c9f-4f09-bd6b-de2080dee21c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:24.343385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9e751d0b-2c9f-4f09-bd6b-de2080dee21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:24.358789 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1120/2259] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:24 2022] PUT /identity/v3/projects/e553785e5aaa4badba8b6ed9cd24a215/users/cab13553622243d7a8892a30cd85aa9a/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:24.360230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.448580 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1140/2260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:24.449956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751d0b-2c9f-4f09-bd6b-de2080dee21c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.452913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:24.458036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1043-74c5-48b6-aaf8-15c4043b27f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.465748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.466554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.466937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.467059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e751d0b-2c9f-4f09-bd6b-de2080dee21c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.467555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.468478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:24.468975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.470952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.494083 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1121/2261] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:24.495142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.495616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.497587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.499177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.499605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.502965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.507511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.515216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038703f-0c79-4838-a49c-8dd1111eeaa7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.532520 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1141/2262] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:24.535354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.548366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.549433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.551095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.551385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.552171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:24.553181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.554605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.556112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14345a-a204-4680-b765-24590d317a2d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.565253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.566247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.566719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.567137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.568140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.571162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.577682 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1122/2263] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:24.578180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.596435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af6efd-4324-46a1-a811-7201bf56e40e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.603255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.604770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.605109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.605398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] PATH_INFO: `/v3/projects/e553785e5aaa4badba8b6ed9cd24a215/users/cab13553622243d7a8892a30cd85aa9a/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.608989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e553785e5aaa4badba8b6ed9cd24a215, user_id=cab13553622243d7a8892a30cd85aa9a, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.615746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.647792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1123/2264] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:24 2022] PUT /identity/v3/projects/e553785e5aaa4badba8b6ed9cd24a215/users/cab13553622243d7a8892a30cd85aa9a/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:24.648724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.651867 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1142/2265] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:24 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:24.653920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.808066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f173d-a651-4799-82b8-f9fa10a0b3cd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.815839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.816802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.817312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.817661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.818232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58db63f-bdb5-40ca-91d2-cff45604f40e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:24.819448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:24.822825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:24.915146 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1143/2266] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:24 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:24.915845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:24.966699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:24.967539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:24.967894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:24.968479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:24.972251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:24.974816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:25.018992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b5f3b-e767-4b14-8093-2f27f1be0b9b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.025848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.027675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.027958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.028443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.029860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.031991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.068561 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1144/2267] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:24 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:25.068561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.084017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a8818-3d80-48d4-9e88-ec7a8c5b07ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.091371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.093145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.094743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.096688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.097744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.104321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.133846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.135567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.143406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:25.154927 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1145/2268] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:25 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:25.154927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.157976 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1124/2269] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:25.158420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.183090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e532447-587c-49d7-8bf8-42e07d0375b1 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.192004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9131a32-a990-4986-982b-e7006a3ab276 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.196232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.197670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.197937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.198186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.199017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.199404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.199512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.199850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.200174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.200804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.203183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.206978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.236889 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1146/2270] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:25.240145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.245217 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1125/2271] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:25.247752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:25.248126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.277920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309aec7-dc48-4c0d-ae0f-af57d4b55ca4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.280853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf3303-46ab-4bcf-aded-2bfa9eaa9be2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.285775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.288730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.289859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.290725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.291757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.295956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.296194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.297428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.297720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.298002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] PATH_INFO: `/v3/users/46a9ee6642b4477d9f96934e9d91cc47` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.301590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a9ee6642b4477d9f96934e9d91cc47)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.308228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.334243 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1126/2272] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:25.336419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.366969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b316f-a217-4607-8aff-ebdf22b297f2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.379886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.381682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.382852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.383805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.389351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.393316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.401272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a9ee6642b4477d9f96934e9d91cc47'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:25.402275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a9ee6642b4477d9f96934e9d91cc47'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:25.419248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a9ee6642b4477d9f96934e9d91cc47'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:25.420102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a9ee6642b4477d9f96934e9d91cc47'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:25.441706 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1127/2273] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:25.448839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.453379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a9ee6642b4477d9f96934e9d91cc47'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:25.453623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:25.477555 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1147/2274] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:25 2022] DELETE /identity/v3/users/46a9ee6642b4477d9f96934e9d91cc47 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:25.477555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:25.477555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:25.486556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e5ae-ed69-4812-91ed-5bdd40e152e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.601906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f395b0-9ef6-4954-9bd0-d43cfcb570a1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:25.609639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751029a-b099-45c1-ae32-c8437a4323e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.610821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751029a-b099-45c1-ae32-c8437a4323e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.611255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751029a-b099-45c1-ae32-c8437a4323e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.611717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751029a-b099-45c1-ae32-c8437a4323e0 admin admin] PATH_INFO: `/v3/projects/8cc95ba05ddf49d4b6b23b429e20665b/users/30a358199c944668ac9c17fe670ef47c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.630251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751029a-b099-45c1-ae32-c8437a4323e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc95ba05ddf49d4b6b23b429e20665b, user_id=30a358199c944668ac9c17fe670ef47c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.633502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751029a-b099-45c1-ae32-c8437a4323e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.636457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:25.663298 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1148/2275] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:25 2022] PUT /identity/v3/projects/8cc95ba05ddf49d4b6b23b429e20665b/users/30a358199c944668ac9c17fe670ef47c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:25.666952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6ff08-97c3-452b-afd1-e7c9baf398a1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.667408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6ff08-97c3-452b-afd1-e7c9baf398a1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.667847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6ff08-97c3-452b-afd1-e7c9baf398a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.700680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6b1d-62d3-4f44-b6b5-17c6871ac0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:25.711106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6b1d-62d3-4f44-b6b5-17c6871ac0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.711106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6b1d-62d3-4f44-b6b5-17c6871ac0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.711106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6b1d-62d3-4f44-b6b5-17c6871ac0bb admin admin] PATH_INFO: `/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2/users/de5439d59d6245039cbdbdf8a3dd4694/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.717236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cad6ff08-97c3-452b-afd1-e7c9baf398a1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:25.718556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cad6ff08-97c3-452b-afd1-e7c9baf398a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:25.751081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b6b1d-62d3-4f44-b6b5-17c6871ac0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73f88f132ef42e791a97ee1e21ca4e2, user_id=de5439d59d6245039cbdbdf8a3dd4694, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:25.755317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b6b1d-62d3-4f44-b6b5-17c6871ac0bb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:25.785310 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1128/2276] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:25 2022] PUT /identity/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2/users/de5439d59d6245039cbdbdf8a3dd4694/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:25.794091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c103b-b7a1-40e9-b2a9-b5c9656c0b9f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.794717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c103b-b7a1-40e9-b2a9-b5c9656c0b9f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.795235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c103b-b7a1-40e9-b2a9-b5c9656c0b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.868005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b06c103b-b7a1-40e9-b2a9-b5c9656c0b9f None None] MFA Rules not processed for user `30a358199c944668ac9c17fe670ef47c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:25.869570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b06c103b-b7a1-40e9-b2a9-b5c9656c0b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:25.899755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1149/2277] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:25.901700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:25.902108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:25.902498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:25.938495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] MFA Rules not processed for user `de5439d59d6245039cbdbdf8a3dd4694`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:25.941655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:26.152352 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1150/2278] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:26.153516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:26.155760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:26.163891 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1129/2279] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:26.167205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c103b-b7a1-40e9-b2a9-b5c9656c0b9f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:26.363317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:26.406552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981063b8-d658-438e-81a6-5c73ce460054 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:26.409105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c103b-b7a1-40e9-b2a9-b5c9656c0b9f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:26.414888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:26.415588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:26.415872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:26.416148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:26.422908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:26.423869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:26.425575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:26.425860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:26.428651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:26.432264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:26.459124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:26.462234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:26.482502 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1151/2280] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:26.483734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:26.496253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc2226-24d1-4c27-869d-38ca528ca529 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:26.501424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:26.502247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:26.502405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:26.502693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:26.503391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:26.505567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:26.545500 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1152/2281] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:26 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:26.548131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:26.559776 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1130/2282] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:26 2022] POST /identity/v3/projects => generated 379 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:26.560824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:26.562703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:26.721637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94179-4ed0-491c-b1b3-591967e5a2fb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:26.790689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe4a5-b7c0-4f10-b644-f8b22df2b567 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:26.809652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:26.810376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:26.810661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:26.811034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:26.811768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:26.822881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:26.896948 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1131/2283] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:26 2022] POST /identity/v3/users => generated 296 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:26.899807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:26.947416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:26.948118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:26.948415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:26.948831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:26.950393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:26.952966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42f2a0-950d-4408-9050-62502c2ed061 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:26.954573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:26.981645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:26.982395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:26.982739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:26.986252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:26.996176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:26.998977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.000076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1153/2284] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:26 2022] POST /identity/v3/users => generated 293 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:27.001264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:27.033835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7200c17-9c1a-47b7-a2eb-2476e32ffa80 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:27.043717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:27.044414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.044697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.044971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.046243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:27.047462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.061089 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1132/2285] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:27.062911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:27.074999 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1154/2286] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:27.080484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:27.094620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66875c-5de3-443a-87ad-56209a696819 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:27.108873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:27.109923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.110232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.110527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] PATH_INFO: `/v3/projects/300537e1bb1542a892dfe167c76c50ec/users/60461777ecfa4d338521c22e25a29d55/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.113662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c5f3-6ef7-41ec-b6df-af0629d5ba35 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:27.126362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:27.127315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.127541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.127813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] PATH_INFO: `/v3/projects/f103ab40f02d4cc4add41a9900f0e70e/users/6159e4b7f68f412f84e86de95d67dc67/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.152374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=300537e1bb1542a892dfe167c76c50ec, user_id=60461777ecfa4d338521c22e25a29d55, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:27.160152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.183915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f103ab40f02d4cc4add41a9900f0e70e, user_id=6159e4b7f68f412f84e86de95d67dc67, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:27.191638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.196724 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1133/2287] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:27 2022] PUT /identity/v3/projects/300537e1bb1542a892dfe167c76c50ec/users/60461777ecfa4d338521c22e25a29d55/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:27.200479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:27.293578 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1155/2288] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:27 2022] PUT /identity/v3/projects/f103ab40f02d4cc4add41a9900f0e70e/users/6159e4b7f68f412f84e86de95d67dc67/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:27.295096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:27.381145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cdc73-90e5-446f-84a7-84d11f38bc5c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:27.497098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:27.563585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3507f06-85f5-4e70-acf6-3543581cbe82 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:27.573940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:27.574809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.575103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.575386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.577485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:27.580863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.615700 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1156/2289] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:27.616768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:27.632715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:27.634476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:27.635277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.639408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.639882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.640947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:27.642696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.651917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9ace-1cdb-422b-a58b-56af064646a2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:27.675977 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1134/2290] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:02:27.676958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:27.677095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2a865-001b-47bb-a643-1cfd8337045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:27.678057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a865-001b-47bb-a643-1cfd8337045a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.678369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a865-001b-47bb-a643-1cfd8337045a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.678682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a865-001b-47bb-a643-1cfd8337045a admin admin] PATH_INFO: `/v3/projects/f103ab40f02d4cc4add41a9900f0e70e/users/6159e4b7f68f412f84e86de95d67dc67/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.690407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2a865-001b-47bb-a643-1cfd8337045a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f103ab40f02d4cc4add41a9900f0e70e, user_id=6159e4b7f68f412f84e86de95d67dc67, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:27.695012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2a865-001b-47bb-a643-1cfd8337045a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.706115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7739-04a3-4cba-b7f2-c5fe65f058e5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:27.719648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69517299-0d40-4982-8252-6740fdeb02df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:27.720600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69517299-0d40-4982-8252-6740fdeb02df admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.720880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69517299-0d40-4982-8252-6740fdeb02df admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.721210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69517299-0d40-4982-8252-6740fdeb02df admin admin] PATH_INFO: `/v3/projects/300537e1bb1542a892dfe167c76c50ec/users/60461777ecfa4d338521c22e25a29d55/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.723328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69517299-0d40-4982-8252-6740fdeb02df admin admin] RBAC: Authorizing `identity:create_grant(project_id=300537e1bb1542a892dfe167c76c50ec, user_id=60461777ecfa4d338521c22e25a29d55, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:27.726375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69517299-0d40-4982-8252-6740fdeb02df admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:27.747253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1157/2291] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:27 2022] PUT /identity/v3/projects/f103ab40f02d4cc4add41a9900f0e70e/users/6159e4b7f68f412f84e86de95d67dc67/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:27.749960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.749960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.750240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.762219 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1135/2292] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:27 2022] PUT /identity/v3/projects/300537e1bb1542a892dfe167c76c50ec/users/60461777ecfa4d338521c22e25a29d55/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:27.773549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:27.773886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:27.774097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:27.808978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] MFA Rules not processed for user `6159e4b7f68f412f84e86de95d67dc67`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:27.812729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:27.835643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] MFA Rules not processed for user `60461777ecfa4d338521c22e25a29d55`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:27.840198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:28.005334 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1158/2293] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:28.014740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:28.028187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:28.048196 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1136/2294] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:28.076389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:28.078064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:28.272820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09fa97-77f0-43d6-bf68-3be87aab638d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:28.295552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:28.295552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:28.295552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:28.295947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:28.343654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2362c84-ff91-43fe-902a-07644c4f4233 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:28.352892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:28.357779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:28.368239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4589a2d-2396-4a88-a23e-16c74181eed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:28.369000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4589a2d-2396-4a88-a23e-16c74181eed4 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:28.371028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4589a2d-2396-4a88-a23e-16c74181eed4 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:28.371171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4589a2d-2396-4a88-a23e-16c74181eed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:28.384074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4589a2d-2396-4a88-a23e-16c74181eed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:28.386190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4589a2d-2396-4a88-a23e-16c74181eed4 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:28.433004 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1159/2295] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:02:28.444826 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1137/2296] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:28.561829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:28.587085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f1d64-7c96-403c-8650-acec2e4eb9aa service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:28.612124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:28.614561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:28.614561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:28.614561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:28.757922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfbac2-7770-4462-8667-1118ab669ab7 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:28.758284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfbac2-7770-4462-8667-1118ab669ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:28.758563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfbac2-7770-4462-8667-1118ab669ab7 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:28.760012 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1138/2297] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:02:28.766873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfbac2-7770-4462-8667-1118ab669ab7 None None] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:02:28.770303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:28.772103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:28.776312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:28.787328 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1160/2298] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:28.795153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfbac2-7770-4462-8667-1118ab669ab7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:28.831075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:28.832981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:28.841087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfbac2-7770-4462-8667-1118ab669ab7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:28.854235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60461777ecfa4d338521c22e25a29d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '300537e1bb1542a892dfe167c76c50ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:28.859882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:28.860195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:28.861583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] PATH_INFO: `/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:28.864808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] RBAC: Authorizing `identity:get_project(project_id=a73f88f132ef42e791a97ee1e21ca4e2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:28.872566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:28.886876 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1139/2299] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:02:28 2022] GET /identity/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2 => generated 379 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:02:28.930213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:28.977183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952019ea-386d-4765-ba36-4a08f3ebd875 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:28.987461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385d171-8cc4-4dfc-9d07-42b97ee98675 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:28.994427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:28.995990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:28.996766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:28.997420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] PATH_INFO: `/v3/projects/83b48069cb8e4096b3832bcb6418e322` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:28.999009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b48069cb8e4096b3832bcb6418e322)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:29.002242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:29.017476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc2783-1e46-44bf-9c54-653ffdd48391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:29.018485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2783-1e46-44bf-9c54-653ffdd48391 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:29.018485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2783-1e46-44bf-9c54-653ffdd48391 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:29.018803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2783-1e46-44bf-9c54-653ffdd48391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:29.048862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:29.145307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b48069cb8e4096b3832bcb6418e322', 'request_id': 'req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.172690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b48069cb8e4096b3832bcb6418e322', 'request_id': 'req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.190129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b48069cb8e4096b3832bcb6418e322', 'request_id': 'req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.198849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2783-1e46-44bf-9c54-653ffdd48391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:29.200812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2783-1e46-44bf-9c54-653ffdd48391 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:29.214118 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1140/2300] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:29.216323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de437d2-57df-4426-959d-013d935b9d71 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:29.216655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de437d2-57df-4426-959d-013d935b9d71 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:29.216947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de437d2-57df-4426-959d-013d935b9d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:29.227440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] The token cache is being invalidate because project 83b48069cb8e4096b3832bcb6418e322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:29.227959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.228935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.231372 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1161/2301] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:28 2022] DELETE /identity/v3/projects/83b48069cb8e4096b3832bcb6418e322 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:29.235790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:29.239305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:29.297016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4de437d2-57df-4426-959d-013d935b9d71 None None] MFA Rules not processed for user `76897f7be7494bb589de747493240449`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:29.298552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4de437d2-57df-4426-959d-013d935b9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:29.425218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19c05c-ac7c-4369-b3a4-06631b64c4f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:29.429732 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1141/2302] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:29.431626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099ea9-ea17-4d9a-9cb4-2de9f35c919e None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:29.431813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:29.431935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099ea9-ea17-4d9a-9cb4-2de9f35c919e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:29.432248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87099ea9-ea17-4d9a-9cb4-2de9f35c919e None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:29.433000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:29.433665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:29.434144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1142/2303] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:02:29.434331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] PATH_INFO: `/v3/users/9350658ba89742da93fe72a8795fd8e9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:29.434962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099ea9-ea17-4d9a-9cb4-2de9f35c919e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:29.437261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-87099ea9-ea17-4d9a-9cb4-2de9f35c919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:29.441991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9350658ba89742da93fe72a8795fd8e9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:29.446322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:29.462576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87099ea9-ea17-4d9a-9cb4-2de9f35c919e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:29.474989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:29.475711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:29.475987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:29.476262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:29.476973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:29.479168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:29.507801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:29.522796 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1143/2304] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:29 2022] POST /identity/v3/projects => generated 397 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:29.527069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:02:29.537242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:29.537844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9350658ba89742da93fe72a8795fd8e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.539326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9350658ba89742da93fe72a8795fd8e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.561425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9350658ba89742da93fe72a8795fd8e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.562201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9350658ba89742da93fe72a8795fd8e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.578785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9350658ba89742da93fe72a8795fd8e9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.624776 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1162/2305] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:29 2022] DELETE /identity/v3/users/9350658ba89742da93fe72a8795fd8e9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:29.627796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:29.633205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:29.723760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:29.725291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:29.756224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:29.804864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7e47a-b5fe-468a-8f1c-755427984884 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:29.811988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:29.813951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:29.813951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:29.815121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] PATH_INFO: `/v3/users/30a358199c944668ac9c17fe670ef47c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:29.817479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a358199c944668ac9c17fe670ef47c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:29.820155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:29.894046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852ac3c-7e90-4ab8-b5fb-b0a884981ebc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:29.922267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a358199c944668ac9c17fe670ef47c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.924096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a358199c944668ac9c17fe670ef47c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.968087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a358199c944668ac9c17fe670ef47c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.969271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a358199c944668ac9c17fe670ef47c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:29.979057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a358199c944668ac9c17fe670ef47c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:30.004978 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1163/2306] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:29 2022] DELETE /identity/v3/users/30a358199c944668ac9c17fe670ef47c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:30.006246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:30.009350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:30.063846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:30.078508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc488-b57d-433b-9bd5-1bfd3d3d6bb3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60461777ecfa4d338521c22e25a29d55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '300537e1bb1542a892dfe167c76c50ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.079449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc488-b57d-433b-9bd5-1bfd3d3d6bb3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.079741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc488-b57d-433b-9bd5-1bfd3d3d6bb3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.080020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc488-b57d-433b-9bd5-1bfd3d3d6bb3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] PATH_INFO: `/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.085931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dc488-b57d-433b-9bd5-1bfd3d3d6bb3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] RBAC: Authorizing `identity:get_project(project_id=a73f88f132ef42e791a97ee1e21ca4e2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.089993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dc488-b57d-433b-9bd5-1bfd3d3d6bb3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:30.107660 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1144/2307] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:02:29 2022] GET /identity/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2 => generated 379 bytes in 584 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:30.120507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.120961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.121364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.123412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e8b0-b8d0-4810-9ee2-13bb73df3e21 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:30.138572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.141325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.141615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.143745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.144547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.151429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:30.176379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:30.178261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:30.199588 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1145/2308] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:30.212874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:30.215389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:30.221083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1164/2309] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:30 2022] POST /identity/v3/users => generated 305 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:30.222339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:30.235817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8130f4-00ca-480d-8c0f-d039c8681d89 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:30.242230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.252498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.252498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.252498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.252498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.252498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:30.268694 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1165/2310] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:30.273741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:30.298433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbeec-d3b5-405b-8267-43a09d4c932b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:30.316543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.317853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.318452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.321879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] PATH_INFO: `/v3/projects/1f4879f8999a4d71a4a30f3741f57dbd/users/94e008869afc498fa83c783b4c08a8eb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.342486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d9b6-38b1-4df9-9872-8c44083b46c1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:30.356830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.363975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.371807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.372330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.398604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4879f8999a4d71a4a30f3741f57dbd, user_id=94e008869afc498fa83c783b4c08a8eb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.403603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:30.439176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.443224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:30.451610 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1166/2311] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:30 2022] PUT /identity/v3/projects/1f4879f8999a4d71a4a30f3741f57dbd/users/94e008869afc498fa83c783b4c08a8eb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:30.456422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:30.482359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1146/2312] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:30.598813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a912666-f687-48cc-a090-e6a2846786cf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:30.612930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.613727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.614013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.614279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.615052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.618531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:30.642618 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1167/2313] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:30.644459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:30.665362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7190b88-e11a-43b6-92f1-092ce8d61600 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:30.684878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc70c5d-21e9-4f63-9128-a7385cdf859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.686105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc70c5d-21e9-4f63-9128-a7385cdf859a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.686312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc70c5d-21e9-4f63-9128-a7385cdf859a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.686592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc70c5d-21e9-4f63-9128-a7385cdf859a admin admin] PATH_INFO: `/v3/projects/1f4879f8999a4d71a4a30f3741f57dbd/users/94e008869afc498fa83c783b4c08a8eb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.691303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc70c5d-21e9-4f63-9128-a7385cdf859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4879f8999a4d71a4a30f3741f57dbd, user_id=94e008869afc498fa83c783b4c08a8eb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.709296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc70c5d-21e9-4f63-9128-a7385cdf859a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:30.743997 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1147/2314] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:30 2022] PUT /identity/v3/projects/1f4879f8999a4d71a4a30f3741f57dbd/users/94e008869afc498fa83c783b4c08a8eb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:30.748442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:30.751459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:30.793109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a27b-832f-4420-b07c-368d7a134d6e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:30.953330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:30.954279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:30.954561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:30.954837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] PATH_INFO: `/v3/users/de5439d59d6245039cbdbdf8a3dd4694` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:30.956171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5439d59d6245039cbdbdf8a3dd4694)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:30.958241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:31.021819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:31.092160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5439d59d6245039cbdbdf8a3dd4694'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.093108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5439d59d6245039cbdbdf8a3dd4694'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.114996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5439d59d6245039cbdbdf8a3dd4694'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.116982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5439d59d6245039cbdbdf8a3dd4694'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.137357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5439d59d6245039cbdbdf8a3dd4694'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.162320 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1168/2315] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:30 2022] DELETE /identity/v3/users/de5439d59d6245039cbdbdf8a3dd4694 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:31.164109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:31.164572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:31.164761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:31.198966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:31.200269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:31.228609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:31.231583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:31.285310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:31.317702 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1148/2316] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:31.326261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:31.327874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:31.388567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce722-7d1a-4b23-a78b-7c6bbca0b77e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:31.397192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:31.398489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:31.398988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:31.399522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] PATH_INFO: `/v3/projects/e33f3ce9021643ac99ea26b034d319d0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:31.401462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33f3ce9021643ac99ea26b034d319d0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:31.401578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e2675-6023-46c8-95fc-3e66e6e93f00 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:31.405999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:31.430172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6f24-3415-4790-80d9-aadfd9979ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:31.430889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6f24-3415-4790-80d9-aadfd9979ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:31.431169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6f24-3415-4790-80d9-aadfd9979ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:31.431436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6f24-3415-4790-80d9-aadfd9979ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:31.450779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc6f24-3415-4790-80d9-aadfd9979ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:31.452389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc6f24-3415-4790-80d9-aadfd9979ae4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:31.488922 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1149/2317] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:31.517857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33f3ce9021643ac99ea26b034d319d0', 'request_id': 'req-14158e96-eb41-421a-8d6f-b9b608dadd6f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.529638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33f3ce9021643ac99ea26b034d319d0', 'request_id': 'req-14158e96-eb41-421a-8d6f-b9b608dadd6f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.553491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33f3ce9021643ac99ea26b034d319d0', 'request_id': 'req-14158e96-eb41-421a-8d6f-b9b608dadd6f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.579840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] The token cache is being invalidate because project e33f3ce9021643ac99ea26b034d319d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:31.580510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.581527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14158e96-eb41-421a-8d6f-b9b608dadd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:31.590027 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1169/2318] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:31 2022] DELETE /identity/v3/projects/e33f3ce9021643ac99ea26b034d319d0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:31.590879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f27797-3a4c-4def-9969-241dec05eb9a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:31.591169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f27797-3a4c-4def-9969-241dec05eb9a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:31.591442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f27797-3a4c-4def-9969-241dec05eb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:31.642281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b2f27797-3a4c-4def-9969-241dec05eb9a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:31.648763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b2f27797-3a4c-4def-9969-241dec05eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:31.816528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5719-3ae0-4d8b-aa97-0069f0cb3702 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:31.822129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5719-3ae0-4d8b-aa97-0069f0cb3702 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:31.823422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5719-3ae0-4d8b-aa97-0069f0cb3702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:31.840261 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1150/2319] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:31.873132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-debd5719-3ae0-4d8b-aa97-0069f0cb3702 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:31.876525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-debd5719-3ae0-4d8b-aa97-0069f0cb3702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:31.894941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f27797-3a4c-4def-9969-241dec05eb9a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:31.901386 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1170/2320] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:31.916974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f27797-3a4c-4def-9969-241dec05eb9a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:31.929372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:31.931054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:31.931524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:31.932741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:31.934292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:31.937460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:31.939902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:31.962184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1151/2321] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:31.963089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd5719-3ae0-4d8b-aa97-0069f0cb3702 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:31.975171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd5719-3ae0-4d8b-aa97-0069f0cb3702 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:31.996129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:31.996838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:31.997150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:31.997434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:31.999036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:32.000431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:32.060158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:32.064245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:32.095901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6097fe-4aac-4a76-9de5-e71237143039 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:32.099358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:32.123433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:32.125572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:32.125833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:32.127932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] PATH_INFO: `/v3/projects/8cc95ba05ddf49d4b6b23b429e20665b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:32.128466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1171/2322] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:31 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:02:32.129651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:32.130969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc95ba05ddf49d4b6b23b429e20665b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:32.131979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:32.136038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:32.198884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc95ba05ddf49d4b6b23b429e20665b', 'request_id': 'req-41f04722-3dca-4ce5-8d05-c47dd0c85591'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.207484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc95ba05ddf49d4b6b23b429e20665b', 'request_id': 'req-41f04722-3dca-4ce5-8d05-c47dd0c85591'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.217541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc95ba05ddf49d4b6b23b429e20665b', 'request_id': 'req-41f04722-3dca-4ce5-8d05-c47dd0c85591'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.226495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:32.234719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] The token cache is being invalidate because project 8cc95ba05ddf49d4b6b23b429e20665b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:32.235790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.236739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.237969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3d2fb-f8fe-4cf9-b3b9-05a7623381ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:32.239552 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1152/2323] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:32 2022] DELETE /identity/v3/projects/8cc95ba05ddf49d4b6b23b429e20665b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:32.243438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:32.245347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:32.358084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:32.359146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:32.359431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:32.359593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f04722-3dca-4ce5-8d05-c47dd0c85591 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:32.359724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] PATH_INFO: `/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:32.361338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73f88f132ef42e791a97ee1e21ca4e2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:32.365158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:32.366356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:32.367187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:32.367561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:32.368600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:32.369390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:32.372075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:32.422470 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1153/2324] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:32 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:32.426489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:32.433279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:32.475199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe5da7-adc2-4f70-b854-99e1899dca86 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:32.491279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73f88f132ef42e791a97ee1e21ca4e2', 'request_id': 'req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.515714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73f88f132ef42e791a97ee1e21ca4e2', 'request_id': 'req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.541417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73f88f132ef42e791a97ee1e21ca4e2', 'request_id': 'req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.559315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] The token cache is being invalidate because project a73f88f132ef42e791a97ee1e21ca4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:32.559647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.560369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.590341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1172/2325] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:32 2022] DELETE /identity/v3/projects/a73f88f132ef42e791a97ee1e21ca4e2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:32.591529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:32.593304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:32.647730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:32.648848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:32.649284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:32.649659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] PATH_INFO: `/v3/users/6159e4b7f68f412f84e86de95d67dc67` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:32.651315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6159e4b7f68f412f84e86de95d67dc67)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:32.656369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:32.682030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:32.755274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6159e4b7f68f412f84e86de95d67dc67'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.755274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6159e4b7f68f412f84e86de95d67dc67'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.755555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6da9b-4d27-4b93-9ed1-c381fc30bc48 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:32.763448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:32.766222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:32.767598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:32.768001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:32.769735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6159e4b7f68f412f84e86de95d67dc67'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.769864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:32.770535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6159e4b7f68f412f84e86de95d67dc67'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.772537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:32.785627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6159e4b7f68f412f84e86de95d67dc67'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:32.792396 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1173/2326] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:32.794438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:32.798713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:32.815318 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1154/2327] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:32 2022] DELETE /identity/v3/users/6159e4b7f68f412f84e86de95d67dc67 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:32.819759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:32.821518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:32.823268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4760fe-1f26-4d34-8282-69aaa0c7790c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:32.838450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:32.929677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:32.931694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:32.931981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:32.932260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] PATH_INFO: `/v3/users/60461777ecfa4d338521c22e25a29d55` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:32.933851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60461777ecfa4d338521c22e25a29d55)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:32.936658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:32.979913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e0263-3ddb-4315-bee2-41f5f153f9fa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:32.999268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:32.999985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:33.000297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:33.000576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:33.001567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:33.003155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:33.024369 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1155/2328] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:33.033712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:33.049124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b3ad-981e-4349-bddb-f87b899c6b84 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:33.055138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60461777ecfa4d338521c22e25a29d55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:33.057517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60461777ecfa4d338521c22e25a29d55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:33.070572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc11663-b454-4046-b889-586abf07999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:33.071001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11663-b454-4046-b889-586abf07999c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:33.071244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11663-b454-4046-b889-586abf07999c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:33.071507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc11663-b454-4046-b889-586abf07999c admin admin] PATH_INFO: `/v3/projects/c980b8607bd240b29a63759634333154/users/0895b43c4cbd40eab2dde002397519b3/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:33.097352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60461777ecfa4d338521c22e25a29d55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:33.102497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11663-b454-4046-b889-586abf07999c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c980b8607bd240b29a63759634333154, user_id=0895b43c4cbd40eab2dde002397519b3, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:33.105437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc11663-b454-4046-b889-586abf07999c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:33.109390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60461777ecfa4d338521c22e25a29d55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:33.128005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60461777ecfa4d338521c22e25a29d55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:33.143564 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1156/2329] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:33 2022] PUT /identity/v3/projects/c980b8607bd240b29a63759634333154/users/0895b43c4cbd40eab2dde002397519b3/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:33.145461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2993-a35a-4337-b984-1dc439510523 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:33.145745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2993-a35a-4337-b984-1dc439510523 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:33.146026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2993-a35a-4337-b984-1dc439510523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:33.167652 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1174/2330] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:32 2022] DELETE /identity/v3/users/60461777ecfa4d338521c22e25a29d55 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:33.214126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-feda2993-a35a-4337-b984-1dc439510523 None None] MFA Rules not processed for user `0895b43c4cbd40eab2dde002397519b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:33.215485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-feda2993-a35a-4337-b984-1dc439510523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:33.368079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1157/2331] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:33.382773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:33.384525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:33.519380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:33.596795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf6478-6228-4de8-8ad1-d84785894be7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:33.602345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:33.603286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:33.603608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:33.603989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:33.625534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:33.628013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:33.661783 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1175/2332] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:33.835192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:33.835479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:33.835757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:33.972229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:33.973807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:34.066104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:34.074376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:34.075392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:34.135367 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1158/2333] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:02:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:34.220760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:34.223359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:34.277541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85045bf-6f92-4705-8a7a-34102d67be9a service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:34.283878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:34.284923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:34.285320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:34.286824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] PATH_INFO: `/v3/projects/f103ab40f02d4cc4add41a9900f0e70e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:34.288316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f103ab40f02d4cc4add41a9900f0e70e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:34.290496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:34.379403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f103ab40f02d4cc4add41a9900f0e70e', 'request_id': 'req-30cf31ed-6e57-43e7-bef6-c5c641300f8d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:34.392771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f103ab40f02d4cc4add41a9900f0e70e', 'request_id': 'req-30cf31ed-6e57-43e7-bef6-c5c641300f8d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:34.407879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f103ab40f02d4cc4add41a9900f0e70e', 'request_id': 'req-30cf31ed-6e57-43e7-bef6-c5c641300f8d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:34.426583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] The token cache is being invalidate because project f103ab40f02d4cc4add41a9900f0e70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:34.427522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:34.428460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30cf31ed-6e57-43e7-bef6-c5c641300f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:34.431160 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1176/2334] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:34 2022] DELETE /identity/v3/projects/f103ab40f02d4cc4add41a9900f0e70e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:34.440572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58d74-4c74-424c-a0c8-cfa2a450f383 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:34.440951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58d74-4c74-424c-a0c8-cfa2a450f383 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:34.441319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58d74-4c74-424c-a0c8-cfa2a450f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:34.475289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79d3d7-8ac6-44b3-8e86-a323ca258e53 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:34.486606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-14d58d74-4c74-424c-a0c8-cfa2a450f383 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:34.487902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14d58d74-4c74-424c-a0c8-cfa2a450f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:34.669599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:34.673718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:34.674059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:34.674356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:34.675240 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1177/2335] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:34.684759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:34.686971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997153af-b162-4f5e-9a41-0b82849ba874 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:34.687653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997153af-b162-4f5e-9a41-0b82849ba874 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:34.688342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997153af-b162-4f5e-9a41-0b82849ba874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:34.706895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:34.737073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-997153af-b162-4f5e-9a41-0b82849ba874 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:34.741148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-997153af-b162-4f5e-9a41-0b82849ba874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:34.764285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1178/2336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:34.768676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997153af-b162-4f5e-9a41-0b82849ba874 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:34.800793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997153af-b162-4f5e-9a41-0b82849ba874 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:34.816773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:34.817290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:34.817575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:34.817909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:34.818622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:34.818929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:34.822148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:34.841336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:34.843379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:34.867916 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1179/2337] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:02:34.872888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:34.887897 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1159/2338] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:02:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:34.906155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc2cad-127f-438a-ac49-beeb3d127084 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:34.914349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:34.915398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:34.915398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:34.915598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:34.916285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:34.920411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:34.978355 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1180/2339] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:34 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:34.979773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:35.005372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:35.014550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106bc5f-0544-428a-a137-fdb476c490d2 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:35.161524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:35.162232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:35.162512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:35.162785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:35.165115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:35.166970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:35.203794 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1160/2340] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:34 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:35.205550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:35.221614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088dda-4b7f-41c1-b38f-284ddfc4373e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:35.239513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:35.240264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:35.240545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:35.240822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:35.242194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:35.244945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:35.287897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:35.302169 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1181/2341] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:35.302377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdd13c-e46b-4a32-b4c9-bf29c29df317 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:35.312179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f203e-1ea6-4efb-81fc-780b91fa6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:35.314242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f203e-1ea6-4efb-81fc-780b91fa6bcc admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:35.315009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f203e-1ea6-4efb-81fc-780b91fa6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:35.315421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f203e-1ea6-4efb-81fc-780b91fa6bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:35.317526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f203e-1ea6-4efb-81fc-780b91fa6bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:35.320243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f203e-1ea6-4efb-81fc-780b91fa6bcc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:35.341840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:35.351562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1161/2342] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:35.357322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c772e-f2d2-46c0-bdbe-c0e4ce5c60f1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:35.363780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:35.365298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:35.365594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:35.365944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] PATH_INFO: `/v3/projects/c5ee47070e2e4d1da7f730e525068554/users/dcba179f9ae842e0a47dbe13e661f042/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:35.397140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ee47070e2e4d1da7f730e525068554, user_id=dcba179f9ae842e0a47dbe13e661f042, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:35.405373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:35.442972 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1182/2343] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:35 2022] PUT /identity/v3/projects/c5ee47070e2e4d1da7f730e525068554/users/dcba179f9ae842e0a47dbe13e661f042/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:35.456664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237bfa-da20-49f8-ac51-45f84f2efb11 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:35.459727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237bfa-da20-49f8-ac51-45f84f2efb11 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:35.460053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237bfa-da20-49f8-ac51-45f84f2efb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:35.563232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c6237bfa-da20-49f8-ac51-45f84f2efb11 None None] MFA Rules not processed for user `dcba179f9ae842e0a47dbe13e661f042`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:35.564435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6237bfa-da20-49f8-ac51-45f84f2efb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:35.691774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:35.701020 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1162/2344] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:35.836716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8252-6225-442e-9386-f47c959f5278 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:35.850359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:35.851719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:35.852455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:35.852455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:35.853252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:35.859026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:35.995565 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1183/2345] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:35 2022] POST /identity/v3/projects => generated 395 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:36.004207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6237bfa-da20-49f8-ac51-45f84f2efb11 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:36.028281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6237bfa-da20-49f8-ac51-45f84f2efb11 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:36.153515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:36.161760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.163950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.163950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.165053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:36.170945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:36.182384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:36.184747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:36.213623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29471b-b6b9-4f1a-a8a7-87f0d81a8851 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:36.217447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1163/2346] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:35 2022] POST /identity/v3/users => generated 304 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:36.222029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:36.224351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:36.226239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.226715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.227381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:36.227696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] PATH_INFO: `/v3/projects/300537e1bb1542a892dfe167c76c50ec` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.229225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300537e1bb1542a892dfe167c76c50ec)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:36.233096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:36.242754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f4348-ff73-4ef7-b268-41108807da96 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:36.256391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:36.257158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.257436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.257711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.258466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:36.260160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:36.279089 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1164/2347] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:02:36.283707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:36.303427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e37554-9742-4b6b-a8b2-a3bf6f0d8b8d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:36.320045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:36.321158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.321440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.321715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] PATH_INFO: `/v3/projects/53c131621b4740d9aa9c16e86c857cb0/users/bea411e354384718a9e4fe7af8ebbda0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.358315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c131621b4740d9aa9c16e86c857cb0, user_id=bea411e354384718a9e4fe7af8ebbda0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:36.364628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:36.408722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1165/2348] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:36 2022] PUT /identity/v3/projects/53c131621b4740d9aa9c16e86c857cb0/users/bea411e354384718a9e4fe7af8ebbda0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:36.410534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300537e1bb1542a892dfe167c76c50ec', 'request_id': 'req-2da50543-197c-4f6e-8ba3-677e38942d77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:36.412470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:36.439075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300537e1bb1542a892dfe167c76c50ec', 'request_id': 'req-2da50543-197c-4f6e-8ba3-677e38942d77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:36.455223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300537e1bb1542a892dfe167c76c50ec', 'request_id': 'req-2da50543-197c-4f6e-8ba3-677e38942d77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:36.463237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:36.478490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] The token cache is being invalidate because project 300537e1bb1542a892dfe167c76c50ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:36.478792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:36.481437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2da50543-197c-4f6e-8ba3-677e38942d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:36.484882 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1184/2349] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:36 2022] DELETE /identity/v3/projects/300537e1bb1542a892dfe167c76c50ec => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:36.492569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807973d9-756b-4829-87db-897fb3718af6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.492569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807973d9-756b-4829-87db-897fb3718af6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.492569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807973d9-756b-4829-87db-897fb3718af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.527943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-807973d9-756b-4829-87db-897fb3718af6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:36.529252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-807973d9-756b-4829-87db-897fb3718af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:36.581756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e00508-d654-4abf-a5fc-d5fff0ec9a82 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:36.590847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:36.591610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.591923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.592267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.593401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:36.596090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:36.630445 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1166/2350] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:36.634715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:36.637275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:36.659212 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1185/2351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:36.663187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d549-d0ff-430d-a037-af626fe31b12 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.665300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d549-d0ff-430d-a037-af626fe31b12 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.665814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100d549-d0ff-430d-a037-af626fe31b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.674946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc9390-94b2-4bc6-b464-009d4b45c986 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:36.691099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d472a85-b0fd-4f46-be6d-c7d1db7402c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:36.692147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472a85-b0fd-4f46-be6d-c7d1db7402c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.692744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472a85-b0fd-4f46-be6d-c7d1db7402c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.693105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472a85-b0fd-4f46-be6d-c7d1db7402c8 admin admin] PATH_INFO: `/v3/projects/53c131621b4740d9aa9c16e86c857cb0/users/bea411e354384718a9e4fe7af8ebbda0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.696831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f100d549-d0ff-430d-a037-af626fe31b12 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:36.699796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d472a85-b0fd-4f46-be6d-c7d1db7402c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c131621b4740d9aa9c16e86c857cb0, user_id=bea411e354384718a9e4fe7af8ebbda0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:36.701278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f100d549-d0ff-430d-a037-af626fe31b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:36.703122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d472a85-b0fd-4f46-be6d-c7d1db7402c8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:36.723370 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1186/2352] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:36.727299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100d549-d0ff-430d-a037-af626fe31b12 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:36.732642 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1167/2353] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:36 2022] PUT /identity/v3/projects/53c131621b4740d9aa9c16e86c857cb0/users/bea411e354384718a9e4fe7af8ebbda0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:36.745940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c8f1-17c7-4d5c-bb94-28f4dcb9f891 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.746333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c8f1-17c7-4d5c-bb94-28f4dcb9f891 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.746584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c8f1-17c7-4d5c-bb94-28f4dcb9f891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.782019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100d549-d0ff-430d-a037-af626fe31b12 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:36.809167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8067c8f1-17c7-4d5c-bb94-28f4dcb9f891 None None] MFA Rules not processed for user `bea411e354384718a9e4fe7af8ebbda0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:36.810611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8067c8f1-17c7-4d5c-bb94-28f4dcb9f891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:36.941628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:36.942337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:36.942632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:36.942904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:36.947144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:36.947470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:36.949481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:37.002420 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1187/2354] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:37.004315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:37.033712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7333d3-c3bd-4586-8b2b-9ca558615c21 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:37.034690 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1168/2355] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:37.041134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2e996-d197-4739-b3f1-a26822afa9f2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:37.041434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2e996-d197-4739-b3f1-a26822afa9f2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:37.041722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2e996-d197-4739-b3f1-a26822afa9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:37.048751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:37.050430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:37.052175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:37.056570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:37.059783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:37.071142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:37.082392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f4f2e996-d197-4739-b3f1-a26822afa9f2 None None] MFA Rules not processed for user `dcba179f9ae842e0a47dbe13e661f042`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:37.083801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f4f2e996-d197-4739-b3f1-a26822afa9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:37.148692 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1188/2356] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:37 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:37.151716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:37.207867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:37.290173 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1169/2357] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:37.323639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048f98c-257b-4dfa-9e97-badda4298eec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:37.329812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:37.332517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:37.332844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:37.333176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:37.333911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:37.336079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:37.352244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:37.376484 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1189/2358] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:37 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:37.380471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2e996-d197-4739-b3f1-a26822afa9f2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:37.392746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2e996-d197-4739-b3f1-a26822afa9f2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:37.401463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:37.403877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:37.407142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:37.407556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:37.408818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:37.415506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:37.434345 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1170/2359] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:37.438819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:37.458280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103fb53-e361-47db-8aea-946856f3960c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:37.516396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fb95b-4673-4bba-bae0-984acf5382e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:37.517293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb95b-4673-4bba-bae0-984acf5382e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:37.517575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb95b-4673-4bba-bae0-984acf5382e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:37.518370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fb95b-4673-4bba-bae0-984acf5382e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:37.518964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fb95b-4673-4bba-bae0-984acf5382e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:37.520612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fb95b-4673-4bba-bae0-984acf5382e2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:37.551285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1190/2360] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:37.557052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:37.580619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a57054-2a3b-413a-bb10-0ade43448b75 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:37.594247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:37.599296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:37.599725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:37.600834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] PATH_INFO: `/v3/projects/38321cae8f734f338ae310afefd10288/users/bb4ef8e8d4f1411987870a89632cf57d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:37.626759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38321cae8f734f338ae310afefd10288, user_id=bb4ef8e8d4f1411987870a89632cf57d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:37.630382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:37.648667 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1171/2361] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:37 2022] PUT /identity/v3/projects/38321cae8f734f338ae310afefd10288/users/bb4ef8e8d4f1411987870a89632cf57d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:37.663002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:37.664895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:37.665316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:37.724777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] MFA Rules not processed for user `bb4ef8e8d4f1411987870a89632cf57d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:37.727496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:37.845832 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1191/2362] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:37.847342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:37.948991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:37.950648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:37.989232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e361d2-c048-4584-b723-0905758c1560 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:38.000631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:38.004518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.004943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.005366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.006212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:38.012525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:38.086907 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1172/2363] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:37 2022] POST /identity/v3/projects => generated 393 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:38.091173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:38.145346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09988861-90ef-4130-83d3-d38c17f32c74 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:38.191753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fe28d-bc33-4c62-ac6f-f5df9574f067 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:38.197682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:38.198724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.199035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.199413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.200526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:38.202479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:38.252672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1173/2364] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:38 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:38.264704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:38.283284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:38.284731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.286841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e2ca-ae81-4451-95d4-9dbb57345502 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:38.287284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.287731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.291499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:38.299981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:38.301446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:38.302247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.302534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.302887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.303597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:38.305418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:38.334698 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1174/2365] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:38.339174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:38.367394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e212e68-8f82-4536-8b9f-7f981ad39c1b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:38.373012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:38.374547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.374846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.375126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] PATH_INFO: `/v3/projects/ae11f4a987ba4f3a8c59daffb0b1daf3/users/027f9a6dc5a44c3b9aa5be4adc5202aa/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.382537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:38.410692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae11f4a987ba4f3a8c59daffb0b1daf3, user_id=027f9a6dc5a44c3b9aa5be4adc5202aa, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:38.413769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:38.440985 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1175/2366] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:38 2022] PUT /identity/v3/projects/ae11f4a987ba4f3a8c59daffb0b1daf3/users/027f9a6dc5a44c3b9aa5be4adc5202aa/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:38.444945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:38.501071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:38.503053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:38.522558 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1192/2367] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:38.551278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61588e-b229-4cfc-a761-39f8e935688d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:38.570189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38799157-9296-4aad-aa97-84bf1a46113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:38.571216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38799157-9296-4aad-aa97-84bf1a46113a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.571691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38799157-9296-4aad-aa97-84bf1a46113a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.572145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38799157-9296-4aad-aa97-84bf1a46113a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.573134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38799157-9296-4aad-aa97-84bf1a46113a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:38.574968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38799157-9296-4aad-aa97-84bf1a46113a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:38.595812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:38.602711 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1176/2368] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:02:38.622434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b19b8-6779-4c1b-804d-4e57de6a2cd5 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:38.655987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:38.656995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.657324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.657603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] PATH_INFO: `/v3/projects/ae11f4a987ba4f3a8c59daffb0b1daf3/users/027f9a6dc5a44c3b9aa5be4adc5202aa/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.659904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae11f4a987ba4f3a8c59daffb0b1daf3, user_id=027f9a6dc5a44c3b9aa5be4adc5202aa, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:38.672633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:38.695851 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1193/2369] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:38 2022] PUT /identity/v3/projects/ae11f4a987ba4f3a8c59daffb0b1daf3/users/027f9a6dc5a44c3b9aa5be4adc5202aa/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:38.707313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15984640-be76-48a8-b16f-11e99db27c37 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:38.707601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15984640-be76-48a8-b16f-11e99db27c37 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:38.707879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15984640-be76-48a8-b16f-11e99db27c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:38.748335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-15984640-be76-48a8-b16f-11e99db27c37 None None] MFA Rules not processed for user `027f9a6dc5a44c3b9aa5be4adc5202aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:38.753312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15984640-be76-48a8-b16f-11e99db27c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:38.881824 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1177/2370] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:40.547082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:40.689233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39f002-df7f-4daf-9285-e19a714d6d9d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:40.701956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:40.703443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:40.703974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:40.704259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] PATH_INFO: `/v3/users/bb4ef8e8d4f1411987870a89632cf57d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:40.715539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4ef8e8d4f1411987870a89632cf57d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:40.717933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:40.829339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4ef8e8d4f1411987870a89632cf57d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:40.831326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4ef8e8d4f1411987870a89632cf57d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:40.852700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4ef8e8d4f1411987870a89632cf57d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:40.853809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4ef8e8d4f1411987870a89632cf57d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:40.864251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4ef8e8d4f1411987870a89632cf57d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:40.887824 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1194/2371] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:40 2022] DELETE /identity/v3/users/bb4ef8e8d4f1411987870a89632cf57d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:40.889661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab411-1e92-4ebc-ac92-59194d38bf75 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:40.890139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab411-1e92-4ebc-ac92-59194d38bf75 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:40.890217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab411-1e92-4ebc-ac92-59194d38bf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:40.929535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7e8ab411-1e92-4ebc-ac92-59194d38bf75 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:40.930877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7e8ab411-1e92-4ebc-ac92-59194d38bf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:41.093352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1178/2372] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:41.114004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:41.115733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:41.159193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:41.254425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d29f-7486-4b68-87c2-307442aff34c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:41.262168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c3f8e-8beb-4d33-9aa1-9822491c1239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:41.262931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c3f8e-8beb-4d33-9aa1-9822491c1239 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:41.263255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c3f8e-8beb-4d33-9aa1-9822491c1239 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:41.263536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c3f8e-8beb-4d33-9aa1-9822491c1239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:41.296411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c3f8e-8beb-4d33-9aa1-9822491c1239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:41.300272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c3f8e-8beb-4d33-9aa1-9822491c1239 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:41.331080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1195/2373] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:41.978099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d61f5-e540-474d-bd78-c4987ca733fb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:41.978566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d61f5-e540-474d-bd78-c4987ca733fb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:41.978702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d61f5-e540-474d-bd78-c4987ca733fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:42.004659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:42.023650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:42.024849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:42.025358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:42.048640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ba4d61f5-e540-474d-bd78-c4987ca733fb None None] MFA Rules not processed for user `cab13553622243d7a8892a30cd85aa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:42.050152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ba4d61f5-e540-474d-bd78-c4987ca733fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:42.090528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] MFA Rules not processed for user `58c3911cbbdf4e35ae8df9eb8b23f22d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:42.097103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:42.238331 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1179/2374] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:42.251325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:42.252000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:42.252552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:42.256915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1196/2375] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:42.301151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] MFA Rules not processed for user `681cfb0e560145b4abef98dbd417f3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:42.303833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:42.416068 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1180/2376] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:42.711683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:42.714126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:42.866597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c34860-ae21-437c-a450-3b77f2b55562 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:42.874415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:42.875134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:42.875419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:42.875698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:42.878642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:42.894751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:42.896493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:42.912720 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1197/2377] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:43.536212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:43.537425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:43.582978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3894996-3faa-4cf9-be6b-8c05676f8576 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:43.603582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:43.606130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:43.606464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:43.606868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] PATH_INFO: `/v3/projects/38321cae8f734f338ae310afefd10288` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:43.609954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38321cae8f734f338ae310afefd10288)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:43.617256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:43.811900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38321cae8f734f338ae310afefd10288', 'request_id': 'req-36031de3-e583-48ac-a5d8-4955e3cc3f51'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:43.838027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38321cae8f734f338ae310afefd10288', 'request_id': 'req-36031de3-e583-48ac-a5d8-4955e3cc3f51'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:43.862179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38321cae8f734f338ae310afefd10288', 'request_id': 'req-36031de3-e583-48ac-a5d8-4955e3cc3f51'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:43.903925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] The token cache is being invalidate because project 38321cae8f734f338ae310afefd10288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:43.904697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:43.906942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:43.925937 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1181/2378] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:43 2022] DELETE /identity/v3/projects/38321cae8f734f338ae310afefd10288 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:43.929567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:43.960524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d29a-9610-43c3-959a-5ba84ce14d11 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:44.071225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:44.112311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:44.114370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:44.115664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:44.116057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] PATH_INFO: `/v3/users/027f9a6dc5a44c3b9aa5be4adc5202aa` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:44.119608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027f9a6dc5a44c3b9aa5be4adc5202aa)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:44.127858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:44.255603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027f9a6dc5a44c3b9aa5be4adc5202aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:44.257322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027f9a6dc5a44c3b9aa5be4adc5202aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:44.308221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027f9a6dc5a44c3b9aa5be4adc5202aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:44.312030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027f9a6dc5a44c3b9aa5be4adc5202aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:44.336970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17d62229-938f-49b6-89b8-ce7fb53044e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027f9a6dc5a44c3b9aa5be4adc5202aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:44.366039 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1198/2379] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:43 2022] DELETE /identity/v3/users/027f9a6dc5a44c3b9aa5be4adc5202aa => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:45.777060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:45.779280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:45.848015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36031de3-e583-48ac-a5d8-4955e3cc3f51 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:45.893644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:46.071202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:46.072144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:46.072430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:46.072711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] PATH_INFO: `/v3/projects/ae11f4a987ba4f3a8c59daffb0b1daf3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:46.081457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae11f4a987ba4f3a8c59daffb0b1daf3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:46.083707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:46.214049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae11f4a987ba4f3a8c59daffb0b1daf3', 'request_id': 'req-43123dbd-e777-4996-b25e-2666c1b73e64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:46.224619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae11f4a987ba4f3a8c59daffb0b1daf3', 'request_id': 'req-43123dbd-e777-4996-b25e-2666c1b73e64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:46.239019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae11f4a987ba4f3a8c59daffb0b1daf3', 'request_id': 'req-43123dbd-e777-4996-b25e-2666c1b73e64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:46.254248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] The token cache is being invalidate because project ae11f4a987ba4f3a8c59daffb0b1daf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:46.254959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:46.256103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-43123dbd-e777-4996-b25e-2666c1b73e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:46.258533 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1182/2380] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:45 2022] DELETE /identity/v3/projects/ae11f4a987ba4f3a8c59daffb0b1daf3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:46.264406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f509-9ae5-49ed-81f3-6e764797a2e4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:46.264937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f509-9ae5-49ed-81f3-6e764797a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:46.265334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8f509-9ae5-49ed-81f3-6e764797a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:46.295232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b4b8f509-9ae5-49ed-81f3-6e764797a2e4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:46.297866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4b8f509-9ae5-49ed-81f3-6e764797a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:46.429520 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1199/2381] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:46.436067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f924-4eeb-4b37-b7ef-3c71391fe241 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:46.436714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f924-4eeb-4b37-b7ef-3c71391fe241 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:46.437288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f924-4eeb-4b37-b7ef-3c71391fe241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:46.464883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3506f924-4eeb-4b37-b7ef-3c71391fe241 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:46.466716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3506f924-4eeb-4b37-b7ef-3c71391fe241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:46.480672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1183/2382] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:46.484939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f509-9ae5-49ed-81f3-6e764797a2e4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:46.514653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8f509-9ae5-49ed-81f3-6e764797a2e4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:46.525572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:46.526972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:46.528204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:46.528628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:46.529493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:46.529902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:46.531802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:46.567277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1200/2383] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:46.571474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f924-4eeb-4b37-b7ef-3c71391fe241 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:46.583188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f924-4eeb-4b37-b7ef-3c71391fe241 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:46.602439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:46.603472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:46.603751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:46.604031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:46.605415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:46.607419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:46.669753 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1184/2384] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:46 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:46.674724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:46.696020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98faee-719b-491a-9eb0-5f3375749738 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:46.839193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:46.901801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:46.902900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:46.903434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:46.905928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:46.906879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:46.911192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:46.957853 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1201/2385] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:46 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:46.962071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:46.993055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660387fa-bc60-4d33-90c8-359245e899cb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:47.011411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:47.015405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.015976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.016449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.017692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:47.026006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:47.046529 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1185/2386] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:47.050601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:47.067221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24275fcb-6c2c-4a0a-a5ff-fd4bf9a05522 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:47.080240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad26ba-1827-4409-a4fd-2369bd73e9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:47.080938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad26ba-1827-4409-a4fd-2369bd73e9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.081265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad26ba-1827-4409-a4fd-2369bd73e9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.081802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad26ba-1827-4409-a4fd-2369bd73e9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.082551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad26ba-1827-4409-a4fd-2369bd73e9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:47.084182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad26ba-1827-4409-a4fd-2369bd73e9f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:47.100733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:47.116828 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1202/2387] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:47.117209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bee57-f5a8-49ed-a8dd-ef3014b49827 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:47.129748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e09ca1-117c-4dfa-9719-445b5bea8268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:47.130955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09ca1-117c-4dfa-9719-445b5bea8268 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.131417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09ca1-117c-4dfa-9719-445b5bea8268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.131833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09ca1-117c-4dfa-9719-445b5bea8268 admin admin] PATH_INFO: `/v3/projects/8e0bf3dc007548bb87da22fac0d67403/users/f9ed28305e484ef285a3a1b6d532134c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.165686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e09ca1-117c-4dfa-9719-445b5bea8268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0bf3dc007548bb87da22fac0d67403, user_id=f9ed28305e484ef285a3a1b6d532134c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:47.169954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e09ca1-117c-4dfa-9719-445b5bea8268 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:47.208271 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1186/2388] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:47 2022] PUT /identity/v3/projects/8e0bf3dc007548bb87da22fac0d67403/users/f9ed28305e484ef285a3a1b6d532134c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:47.221745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eae56-553d-4e2d-9374-d222ed5fca65 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.222028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eae56-553d-4e2d-9374-d222ed5fca65 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.222309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eae56-553d-4e2d-9374-d222ed5fca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.300942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d68eae56-553d-4e2d-9374-d222ed5fca65 None None] MFA Rules not processed for user `f9ed28305e484ef285a3a1b6d532134c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:47.302494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d68eae56-553d-4e2d-9374-d222ed5fca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:47.344444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d6af-a2d5-4642-84d9-46ca67e10cc7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.345699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d6af-a2d5-4642-84d9-46ca67e10cc7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.346164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d6af-a2d5-4642-84d9-46ca67e10cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.418598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fc65d6af-a2d5-4642-84d9-46ca67e10cc7 None None] MFA Rules not processed for user `94e008869afc498fa83c783b4c08a8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:47.419985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fc65d6af-a2d5-4642-84d9-46ca67e10cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:47.457604 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1203/2389] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:47.462662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eae56-553d-4e2d-9374-d222ed5fca65 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:47.509792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:47.601652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1187/2390] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:47.608558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5cb8-0fda-4ef9-bb47-bf9219709bc0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.609076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5cb8-0fda-4ef9-bb47-bf9219709bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.610234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f5cb8-0fda-4ef9-bb47-bf9219709bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.622541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eae56-553d-4e2d-9374-d222ed5fca65 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:47.633071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:47.633461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a92f5cb8-0fda-4ef9-bb47-bf9219709bc0 None None] MFA Rules not processed for user `76897f7be7494bb589de747493240449`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:47.634477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.635349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a92f5cb8-0fda-4ef9-bb47-bf9219709bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:47.635750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.636889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.639446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:47.643334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:47.705922 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1204/2391] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:47 2022] POST /identity/v3/projects => generated 391 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:47.707198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:47.823037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:47.823590 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1188/2392] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:47.888442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be2e7-2b8e-4855-b2a6-c317874e4663 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:47.894802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:47.895817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.896303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.896754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.897992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:47.900236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:47.943415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1205/2393] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:47 2022] POST /identity/v3/users => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:47.947837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f5cb8-0fda-4ef9-bb47-bf9219709bc0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:47.962440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f5cb8-0fda-4ef9-bb47-bf9219709bc0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:47.978318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:47.979371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:47.979759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:47.980129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:47.981126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:47.984614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:48.023246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:48.023889 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1189/2394] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:48.035037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:48.038422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4947e01-8f7f-4e8e-8598-e23b8a43936f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:48.039820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:48.044907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:48.046175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:48.046613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:48.047839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] PATH_INFO: `/v3/projects/7b68de35c7314e449433ee47802a7851/users/5b763071f9b8464bbb7a5dc91bb36b1b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:48.087165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b68de35c7314e449433ee47802a7851, user_id=5b763071f9b8464bbb7a5dc91bb36b1b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:48.089855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:48.117488 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1206/2395] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:48 2022] PUT /identity/v3/projects/7b68de35c7314e449433ee47802a7851/users/5b763071f9b8464bbb7a5dc91bb36b1b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:48.119402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:48.155984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c233a40-8cb8-434a-9e2c-a5ac5d41a607 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:48.218772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66566af-dbb8-4656-a14f-0c605f4d9f17 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:48.225769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:48.227071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:48.227071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:48.227275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:48.228039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:48.230862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:48.245595 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1207/2396] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:48.250423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:48.256547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:48.266292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6a2be-45fe-4221-a2cb-353be3260bec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:48.271659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:48.272436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:48.272709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d308-131d-40ab-a0a9-d22d3658b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:48.272840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:48.272985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:48.273772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d308-131d-40ab-a0a9-d22d3658b5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:48.274117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d308-131d-40ab-a0a9-d22d3658b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:48.274491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d308-131d-40ab-a0a9-d22d3658b5e3 admin admin] PATH_INFO: `/v3/projects/7b68de35c7314e449433ee47802a7851/users/5b763071f9b8464bbb7a5dc91bb36b1b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:48.276617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d308-131d-40ab-a0a9-d22d3658b5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b68de35c7314e449433ee47802a7851, user_id=5b763071f9b8464bbb7a5dc91bb36b1b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:48.276792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:48.280513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d308-131d-40ab-a0a9-d22d3658b5e3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:48.296386 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1208/2397] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:48 2022] PUT /identity/v3/projects/7b68de35c7314e449433ee47802a7851/users/5b763071f9b8464bbb7a5dc91bb36b1b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:48.308352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c11c-5d2a-4a35-bb5b-06156683f329 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:48.309585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c11c-5d2a-4a35-bb5b-06156683f329 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:48.310051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c11c-5d2a-4a35-bb5b-06156683f329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:48.378134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b535c11c-5d2a-4a35-bb5b-06156683f329 None None] MFA Rules not processed for user `5b763071f9b8464bbb7a5dc91bb36b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:48.380314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b535c11c-5d2a-4a35-bb5b-06156683f329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:48.403442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:48.405446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:48.431307 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1190/2398] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:02:48.481289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:48.483257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:48.501465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc8d6-fc8b-4434-b5c0-2557fd61cd1e service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:48.526540 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1209/2399] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:48.603535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40209c7-f2da-458b-9825-3afd2f036032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:48.605346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40209c7-f2da-458b-9825-3afd2f036032 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:48.605641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40209c7-f2da-458b-9825-3afd2f036032 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:48.605955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40209c7-f2da-458b-9825-3afd2f036032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:48.610114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f40209c7-f2da-458b-9825-3afd2f036032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:48.703964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40209c7-f2da-458b-9825-3afd2f036032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:48.705899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40209c7-f2da-458b-9825-3afd2f036032 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:48.739384 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1191/2400] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:49.831696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c11c-5d2a-4a35-bb5b-06156683f329 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:49.854100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c11c-5d2a-4a35-bb5b-06156683f329 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:49.872274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a3049-6653-46ed-a75d-5eda43af259c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:49.873158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3049-6653-46ed-a75d-5eda43af259c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:49.873438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3049-6653-46ed-a75d-5eda43af259c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:49.873751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3049-6653-46ed-a75d-5eda43af259c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:49.893762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a3049-6653-46ed-a75d-5eda43af259c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:49.895487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a3049-6653-46ed-a75d-5eda43af259c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:49.908791 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1210/2401] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:50.352146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:50.352146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:50.352648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:50.395171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] MFA Rules not processed for user `02a8362ef1d14be9b41ba2e6c904807f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:50.396488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:50.480498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:50.545058 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1192/2402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:50.762699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f07778-c894-4bf8-a471-8d1b456f97d4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:50.762865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f07778-c894-4bf8-a471-8d1b456f97d4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:50.763140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f07778-c894-4bf8-a471-8d1b456f97d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:50.779275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:50.818817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e8f07778-c894-4bf8-a471-8d1b456f97d4 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:50.820393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e8f07778-c894-4bf8-a471-8d1b456f97d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:50.994543 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1211/2403] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:02:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:51.013009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:51.014599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:51.053595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f07778-c894-4bf8-a471-8d1b456f97d4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:51.227055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ffcac-2848-43ab-8597-312a9a23b073 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:51.237876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e530fba-3006-40e9-8133-477f2485e173 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:51.238893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e530fba-3006-40e9-8133-477f2485e173 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:51.239393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e530fba-3006-40e9-8133-477f2485e173 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:51.239986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e530fba-3006-40e9-8133-477f2485e173 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:51.251258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e530fba-3006-40e9-8133-477f2485e173 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:51.253351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e530fba-3006-40e9-8133-477f2485e173 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:51.253746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f07778-c894-4bf8-a471-8d1b456f97d4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:51.264311 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1193/2404] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:51.281254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:51.286660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:51.286985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:51.287240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] PATH_INFO: `/v3/users/f9ed28305e484ef285a3a1b6d532134c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:51.289292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ed28305e484ef285a3a1b6d532134c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:51.297409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:51.450294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ed28305e484ef285a3a1b6d532134c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:51.451332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ed28305e484ef285a3a1b6d532134c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:51.471372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ed28305e484ef285a3a1b6d532134c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:51.472286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ed28305e484ef285a3a1b6d532134c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:51.482848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ed28305e484ef285a3a1b6d532134c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:51.538333 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1212/2405] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:51 2022] DELETE /identity/v3/users/f9ed28305e484ef285a3a1b6d532134c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:51.541406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:51.541934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:51.542637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:51.582622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:51.586931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:51.694893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:51.696434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:51.758934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:51.761000 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1194/2406] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:51.780585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:51.782298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:51.875896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c222c6e-95ae-41f9-b3c2-a67a1eed86b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:51.892167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:51.893412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:51.893735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:51.893997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] PATH_INFO: `/v3/users/0895b43c4cbd40eab2dde002397519b3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:51.902827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0895b43c4cbd40eab2dde002397519b3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:51.905013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:51.954711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4341489-6b37-42de-8c35-7bbcd26fed6d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:51.971532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82709949-ffad-4b6d-97a8-77bcd7ff5b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:51.975968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82709949-ffad-4b6d-97a8-77bcd7ff5b18 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:51.977411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82709949-ffad-4b6d-97a8-77bcd7ff5b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:51.977949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82709949-ffad-4b6d-97a8-77bcd7ff5b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:52.007768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82709949-ffad-4b6d-97a8-77bcd7ff5b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:52.010044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0895b43c4cbd40eab2dde002397519b3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:52.011208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82709949-ffad-4b6d-97a8-77bcd7ff5b18 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:52.012022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0895b43c4cbd40eab2dde002397519b3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:52.040249 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1195/2407] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:52.046093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0895b43c4cbd40eab2dde002397519b3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:52.047064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0895b43c4cbd40eab2dde002397519b3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:52.067421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0895b43c4cbd40eab2dde002397519b3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:52.092227 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1213/2408] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:51 2022] DELETE /identity/v3/users/0895b43c4cbd40eab2dde002397519b3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:52.096991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:52.097585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:52.097834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:52.138611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:52.140270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:52.147701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:52.241107 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1196/2409] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:52.315608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:52.317120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:52.543207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad7ee1-4213-4818-ac5c-cf72beca4a85 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:52.553073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:52.553871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:52.554051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:52.554332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:52.574749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:52.576287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:52.605920 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1214/2410] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:53.025716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:53.030504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:53.068229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694846d-bfb5-423d-abb6-918f5ae7cef7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:53.081953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:53.086210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:53.087808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:53.089278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] PATH_INFO: `/v3/projects/8e0bf3dc007548bb87da22fac0d67403` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:53.093920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0bf3dc007548bb87da22fac0d67403)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:53.100468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:53.277472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0bf3dc007548bb87da22fac0d67403', 'request_id': 'req-5546197f-e58a-4643-ba23-50e6ddf688e1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.285904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0bf3dc007548bb87da22fac0d67403', 'request_id': 'req-5546197f-e58a-4643-ba23-50e6ddf688e1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.303577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0bf3dc007548bb87da22fac0d67403', 'request_id': 'req-5546197f-e58a-4643-ba23-50e6ddf688e1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.331293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] The token cache is being invalidate because project 8e0bf3dc007548bb87da22fac0d67403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:53.331967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.334524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.338892 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1197/2411] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:53 2022] DELETE /identity/v3/projects/8e0bf3dc007548bb87da22fac0d67403 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:53.343088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:53.357883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb972fb-993d-49ad-ac35-8e050f931cc7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:53.477463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:53.495448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:53.496853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:53.497338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:53.497889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] PATH_INFO: `/v3/users/5b763071f9b8464bbb7a5dc91bb36b1b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:53.501021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b763071f9b8464bbb7a5dc91bb36b1b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:53.503643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:53.600762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b763071f9b8464bbb7a5dc91bb36b1b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.604093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b763071f9b8464bbb7a5dc91bb36b1b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.623770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b763071f9b8464bbb7a5dc91bb36b1b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.624704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b763071f9b8464bbb7a5dc91bb36b1b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.640023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b763071f9b8464bbb7a5dc91bb36b1b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:53.652982 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1215/2412] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:53 2022] DELETE /identity/v3/users/5b763071f9b8464bbb7a5dc91bb36b1b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:54.708534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:54.709205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:54.713878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:54.714481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:54.752078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546197f-e58a-4643-ba23-50e6ddf688e1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:54.863721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:54.865265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:54.865547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:54.865817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] PATH_INFO: `/v3/projects/c980b8607bd240b29a63759634333154` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:54.868495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c980b8607bd240b29a63759634333154)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:54.870079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e4bc-be2f-49c9-bd31-53aa4d12e26c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:54.872342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:54.882224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:54.883235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:54.883531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:54.883804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] PATH_INFO: `/v3/projects/7b68de35c7314e449433ee47802a7851` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:54.886983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b68de35c7314e449433ee47802a7851)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:54.889876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:54.937634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:54.955036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c980b8607bd240b29a63759634333154', 'request_id': 'req-d8f85d4f-3e9d-4959-8204-b47ed653157c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:54.967261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c980b8607bd240b29a63759634333154', 'request_id': 'req-d8f85d4f-3e9d-4959-8204-b47ed653157c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:54.977190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c980b8607bd240b29a63759634333154', 'request_id': 'req-d8f85d4f-3e9d-4959-8204-b47ed653157c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:54.991939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] The token cache is being invalidate because project c980b8607bd240b29a63759634333154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:54.992761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:54.994038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8f85d4f-3e9d-4959-8204-b47ed653157c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:54.995956 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1198/2413] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:54 2022] DELETE /identity/v3/projects/c980b8607bd240b29a63759634333154 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:55.001872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f5e2c-f0ea-4308-be2a-3b907d233a1b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.002630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f5e2c-f0ea-4308-be2a-3b907d233a1b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.003444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f5e2c-f0ea-4308-be2a-3b907d233a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.005313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b68de35c7314e449433ee47802a7851', 'request_id': 'req-b1de7e21-d974-4ef0-9906-4cb0372a1a92'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:55.016721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b68de35c7314e449433ee47802a7851', 'request_id': 'req-b1de7e21-d974-4ef0-9906-4cb0372a1a92'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:55.045812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8d0f5e2c-f0ea-4308-be2a-3b907d233a1b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:55.047175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8d0f5e2c-f0ea-4308-be2a-3b907d233a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:55.067655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b68de35c7314e449433ee47802a7851', 'request_id': 'req-b1de7e21-d974-4ef0-9906-4cb0372a1a92'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:55.099628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:55.109487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] The token cache is being invalidate because project 7b68de35c7314e449433ee47802a7851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:02:55.114464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:55.117102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b1de7e21-d974-4ef0-9906-4cb0372a1a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:55.119693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1216/2414] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:54 2022] DELETE /identity/v3/projects/7b68de35c7314e449433ee47802a7851 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:55.127305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292d29b-5912-4f93-850f-66257bdcc6cb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.136403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292d29b-5912-4f93-850f-66257bdcc6cb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.137435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292d29b-5912-4f93-850f-66257bdcc6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.187346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6292d29b-5912-4f93-850f-66257bdcc6cb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:55.193527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6292d29b-5912-4f93-850f-66257bdcc6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:55.210389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1199/2415] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:55.217954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e5b6-bdb8-482c-b0ba-e851004ffb93 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.218243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e5b6-bdb8-482c-b0ba-e851004ffb93 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.218527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e5b6-bdb8-482c-b0ba-e851004ffb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.223905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1217/2416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:55.232516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a79668-cb15-4647-94c1-b60b3c16f025 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.232812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a79668-cb15-4647-94c1-b60b3c16f025 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.233124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a79668-cb15-4647-94c1-b60b3c16f025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.239079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6a97e5b6-bdb8-482c-b0ba-e851004ffb93 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:55.240608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6a97e5b6-bdb8-482c-b0ba-e851004ffb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:55.256173 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1200/2417] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:55.260893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97e5b6-bdb8-482c-b0ba-e851004ffb93 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.276205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-71a79668-cb15-4647-94c1-b60b3c16f025 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:55.278004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71a79668-cb15-4647-94c1-b60b3c16f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:55.284447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97e5b6-bdb8-482c-b0ba-e851004ffb93 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.301697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.303264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.303721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.304372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.305415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1218/2418] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:55.307434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:55.308118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a79668-cb15-4647-94c1-b60b3c16f025 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.308611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.310514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.329969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a79668-cb15-4647-94c1-b60b3c16f025 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.343295 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1201/2419] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:55.344316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.351453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.352144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.352418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.352687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.353460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:02:55.353762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.355538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.369346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e16f-f7d7-4f40-83cb-a68c3cd222e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.385513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.385513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.385513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.385513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.386125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.386217 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1219/2420] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:02:55.387009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.389181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.408958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391172a-1647-49b5-bd8a-9d6972c8d598 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.420026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.420365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.421128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.421412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.422121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.424100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.447586 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1202/2421] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:55.448106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.489553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1220/2422] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:55.490622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.583219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00dd3dc-3e9a-402d-819d-c9b8c4155292 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.632616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b821d47-d9df-4742-b1d7-3684f14496b3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.648610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.649965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.650501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.650985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.651877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.654936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:55.656407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.697539 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1221/2423] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:02:55.704234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.729545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.730604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41aa7d6-2b9a-4211-ae87-e95e1261c516 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.731402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.731847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.732327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.734045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.736756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.742495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.743370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.744137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.745062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.747439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.751055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.778572 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1222/2424] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:02:55.784535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.799001 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1203/2425] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:55 2022] POST /identity/v3/users => generated 282 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:55.800619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.821149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4493d9-8ac1-4fb6-9913-29a88af92a28 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.823442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b31a-cc82-486a-ac16-576845ec524c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.827792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.828764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.828918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.829246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.830976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.834006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.836580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.839097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.839455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.840292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.841856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.846977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.848186 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1204/2426] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:55.853254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.870467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953071d7-f1fa-40de-93be-47f4009bef3f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.879113 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1223/2427] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:55.879356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.879356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.879552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.880753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.880753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.881395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.882846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.903805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19de91-b30b-45b8-8a9f-0cc6272c8b22 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.905327 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1205/2428] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:55.909528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:55.923643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e13730-17a4-45c4-b82d-e29b8f460448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.926582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13730-17a4-45c4-b82d-e29b8f460448 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.928008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13730-17a4-45c4-b82d-e29b8f460448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.928298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13730-17a4-45c4-b82d-e29b8f460448 admin admin] PATH_INFO: `/v3/projects/46299d1307ab4bf8a82541458fbcb344/users/4be96a3ed7744627a601e785726060e6/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.929863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687d83b-d1d0-4835-93ac-b9f942a65a26 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:55.936778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ff548-9107-4e9c-8847-e7d182c39c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:55.938928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff548-9107-4e9c-8847-e7d182c39c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:55.939459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff548-9107-4e9c-8847-e7d182c39c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:55.939839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ff548-9107-4e9c-8847-e7d182c39c0b admin admin] PATH_INFO: `/v3/projects/df7809024c414efd8534cefdecd980cf/users/4eef98c56e744064b2b5f131c3766c0c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:55.969005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13730-17a4-45c4-b82d-e29b8f460448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46299d1307ab4bf8a82541458fbcb344, user_id=4be96a3ed7744627a601e785726060e6, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.973211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ff548-9107-4e9c-8847-e7d182c39c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7809024c414efd8534cefdecd980cf, user_id=4eef98c56e744064b2b5f131c3766c0c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:55.974702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13730-17a4-45c4-b82d-e29b8f460448 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:55.977923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ff548-9107-4e9c-8847-e7d182c39c0b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.002139 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1206/2429] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:55 2022] PUT /identity/v3/projects/df7809024c414efd8534cefdecd980cf/users/4eef98c56e744064b2b5f131c3766c0c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:56.004921 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1224/2430] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:55 2022] PUT /identity/v3/projects/46299d1307ab4bf8a82541458fbcb344/users/4be96a3ed7744627a601e785726060e6/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:56.017697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.018331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f987c-51cc-4bac-8129-aaba297190bb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.018535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f987c-51cc-4bac-8129-aaba297190bb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.019523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f987c-51cc-4bac-8129-aaba297190bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.020044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.020914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.077781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:56.083213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:56.084079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-677f987c-51cc-4bac-8129-aaba297190bb None None] MFA Rules not processed for user `4be96a3ed7744627a601e785726060e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:56.086166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-677f987c-51cc-4bac-8129-aaba297190bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:56.167525 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1207/2431] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:56.171968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f987c-51cc-4bac-8129-aaba297190bb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:56.217213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:56.252414 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1225/2432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:56.292322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:56.293929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:56.311185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f987c-51cc-4bac-8129-aaba297190bb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:56.319893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:56.320880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.321348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.322114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.322394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:56.325736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.338190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:56.365003 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1208/2433] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:02:56 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:56.375896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:56.441085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604462b0-3e4f-4e12-8563-bc666d0aa9a1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:56.501066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4364-c7e8-436d-acae-14a628798ca6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:56.507797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:56.508719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.509077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.509366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.510665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:56.514371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.529562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:56.530512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.530983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.531378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.546183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:56.546750 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1209/2434] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:02:56 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:02:56.548163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:56.548725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.560626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb90f-8ead-4e2c-b4a4-00cf8f6d6c9e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:56.564755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1226/2435] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:02:56.568976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:56.570173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.570602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.571040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.571946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:56.582946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.595596 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1210/2436] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:56.596236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:56.611849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d07a3b-d6ed-47be-ac72-ceda45038841 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:56.621601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:56.623049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.623481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.625533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] PATH_INFO: `/v3/projects/52dc6ed45a7749f388d4fa48535ccceb/users/c2b440cd916f4e6f99200f1e19957c61/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.650930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dc6ed45a7749f388d4fa48535ccceb, user_id=c2b440cd916f4e6f99200f1e19957c61, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:56.654406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.693149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1227/2437] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:56 2022] PUT /identity/v3/projects/52dc6ed45a7749f388d4fa48535ccceb/users/c2b440cd916f4e6f99200f1e19957c61/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:02:56.693323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:56.715561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37e51a-5bb2-478d-aa3e-3f8f90b22253 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:56.805020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4d53-a83c-4140-aacb-ca9b556c8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:56.806092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4d53-a83c-4140-aacb-ca9b556c8c1f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.806436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4d53-a83c-4140-aacb-ca9b556c8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.806866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4d53-a83c-4140-aacb-ca9b556c8c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.807678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df4d53-a83c-4140-aacb-ca9b556c8c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:56.809674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df4d53-a83c-4140-aacb-ca9b556c8c1f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.822908 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1211/2438] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:02:56.827180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:56.840374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71c0c-74a2-41fd-a067-1a70303c4e38 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:56.844460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:56.845560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.845931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.846299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] PATH_INFO: `/v3/projects/52dc6ed45a7749f388d4fa48535ccceb/users/c2b440cd916f4e6f99200f1e19957c61/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.848795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52dc6ed45a7749f388d4fa48535ccceb, user_id=c2b440cd916f4e6f99200f1e19957c61, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:56.851628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:56.864961 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1228/2439] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:02:56 2022] PUT /identity/v3/projects/52dc6ed45a7749f388d4fa48535ccceb/users/c2b440cd916f4e6f99200f1e19957c61/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:56.876615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c286-cce1-4e2a-a7b8-56298723e162 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:56.876928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c286-cce1-4e2a-a7b8-56298723e162 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:56.877203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c286-cce1-4e2a-a7b8-56298723e162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:56.912238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6244c286-cce1-4e2a-a7b8-56298723e162 None None] MFA Rules not processed for user `c2b440cd916f4e6f99200f1e19957c61`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:56.915653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6244c286-cce1-4e2a-a7b8-56298723e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:56.991384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:57.037259 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1212/2440] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:02:57.353545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:57.355328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:57.443065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5f790-5636-4c71-ad3e-b84075390286 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:57.452614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd855c-ef26-45d1-83b2-dcb9b8143339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:57.453476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd855c-ef26-45d1-83b2-dcb9b8143339 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:57.453817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd855c-ef26-45d1-83b2-dcb9b8143339 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:57.454229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd855c-ef26-45d1-83b2-dcb9b8143339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:57.472242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd855c-ef26-45d1-83b2-dcb9b8143339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:57.474239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd855c-ef26-45d1-83b2-dcb9b8143339 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:57.485871 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1229/2441] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:58.516145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a196-275e-4a82-87d9-172f09872c9c None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:58.516145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a196-275e-4a82-87d9-172f09872c9c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:58.516811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24a196-275e-4a82-87d9-172f09872c9c None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:58.517924 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1213/2442] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:02:58.548935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be3a43-6b45-4687-9ae8-2cd4fa354f79 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:58.549988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be3a43-6b45-4687-9ae8-2cd4fa354f79 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:58.551198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be3a43-6b45-4687-9ae8-2cd4fa354f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:58.561408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:58.584504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d1be3a43-6b45-4687-9ae8-2cd4fa354f79 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:58.587557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1be3a43-6b45-4687-9ae8-2cd4fa354f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:58.603533 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1230/2443] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:59.056221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24a196-275e-4a82-87d9-172f09872c9c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:59.093222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24a196-275e-4a82-87d9-172f09872c9c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:59.104108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165e8c1-ea23-449f-9a82-28af632ec3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:59.104965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e8c1-ea23-449f-9a82-28af632ec3ee service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:59.105383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e8c1-ea23-449f-9a82-28af632ec3ee service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:59.105912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165e8c1-ea23-449f-9a82-28af632ec3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:59.116321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e8c1-ea23-449f-9a82-28af632ec3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:59.118327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165e8c1-ea23-449f-9a82-28af632ec3ee service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:59.129694 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1214/2444] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:59.275568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be3a43-6b45-4687-9ae8-2cd4fa354f79 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:59.386250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be3a43-6b45-4687-9ae8-2cd4fa354f79 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:59.395365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:59.396213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:59.396329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:59.396554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] PATH_INFO: `/v3/users/4be96a3ed7744627a601e785726060e6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:59.397843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be96a3ed7744627a601e785726060e6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:59.399792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:59.479607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be96a3ed7744627a601e785726060e6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:59.480679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be96a3ed7744627a601e785726060e6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:59.500491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be96a3ed7744627a601e785726060e6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:59.502646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be96a3ed7744627a601e785726060e6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:59.512472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be96a3ed7744627a601e785726060e6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:02:59.529164 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1231/2445] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:59 2022] DELETE /identity/v3/users/4be96a3ed7744627a601e785726060e6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:02:59.533905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:59.534390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:59.534494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:59.555935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:02:59.557518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:59.641919 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1215/2446] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:02:59.651596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:02:59.653805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:02:59.749617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a485fc-7e55-4253-8572-26f0f59f18d5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:02:59.753665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:02:59.754336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:02:59.754616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:02:59.755049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:02:59.770696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:02:59.772184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:02:59.786674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1232/2447] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:00.503359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:00.508591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:00.529006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b08f84-c174-4b0f-bc62-4a884ddb4600 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:00.536911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:00.538484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:00.538967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:00.539391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] PATH_INFO: `/v3/projects/46299d1307ab4bf8a82541458fbcb344` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:00.540805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=46299d1307ab4bf8a82541458fbcb344)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:00.543119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:00.616742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46299d1307ab4bf8a82541458fbcb344', 'request_id': 'req-68333181-0f46-48be-9df7-816771e9cf7b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.630166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46299d1307ab4bf8a82541458fbcb344', 'request_id': 'req-68333181-0f46-48be-9df7-816771e9cf7b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.649255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46299d1307ab4bf8a82541458fbcb344', 'request_id': 'req-68333181-0f46-48be-9df7-816771e9cf7b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.669230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] The token cache is being invalidate because project 46299d1307ab4bf8a82541458fbcb344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:00.669871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.670758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.672891 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1216/2448] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:00 2022] DELETE /identity/v3/projects/46299d1307ab4bf8a82541458fbcb344 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:00.676792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:00.687635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fe505-2c76-4742-9379-d122b6a0473d service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:00.702600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:00.756660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:00.757875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:00.758154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:00.758464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] PATH_INFO: `/v3/users/c2b440cd916f4e6f99200f1e19957c61` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:00.760016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b440cd916f4e6f99200f1e19957c61)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:00.762474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:00.865094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b440cd916f4e6f99200f1e19957c61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.866114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b440cd916f4e6f99200f1e19957c61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.885409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b440cd916f4e6f99200f1e19957c61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.886581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b440cd916f4e6f99200f1e19957c61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.896981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-079443a7-8ff7-46ad-8f90-83743ef488c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b440cd916f4e6f99200f1e19957c61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:00.958695 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1233/2449] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:00 2022] DELETE /identity/v3/users/c2b440cd916f4e6f99200f1e19957c61 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:02.600368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:02.602632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:02.651093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333181-0f46-48be-9df7-816771e9cf7b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:02.829777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:02.830677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:02.831011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:02.831291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] PATH_INFO: `/v3/projects/52dc6ed45a7749f388d4fa48535ccceb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:02.832626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52dc6ed45a7749f388d4fa48535ccceb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:02.839825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:02.843448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:02.962182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52dc6ed45a7749f388d4fa48535ccceb', 'request_id': 'req-fb184112-c42b-4ab7-a4b4-515d92ca2d05'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:02.978078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52dc6ed45a7749f388d4fa48535ccceb', 'request_id': 'req-fb184112-c42b-4ab7-a4b4-515d92ca2d05'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:02.996355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52dc6ed45a7749f388d4fa48535ccceb', 'request_id': 'req-fb184112-c42b-4ab7-a4b4-515d92ca2d05'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:03.022325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] The token cache is being invalidate because project 52dc6ed45a7749f388d4fa48535ccceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:03.023484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:03.026020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fb184112-c42b-4ab7-a4b4-515d92ca2d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:03.029164 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1217/2450] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:02 2022] DELETE /identity/v3/projects/52dc6ed45a7749f388d4fa48535ccceb => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:03.048132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbadfa1-7f3b-40a0-a0f1-90bcb1f57dd4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.048631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbadfa1-7f3b-40a0-a0f1-90bcb1f57dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.052003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbadfa1-7f3b-40a0-a0f1-90bcb1f57dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.095200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0bbadfa1-7f3b-40a0-a0f1-90bcb1f57dd4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:03.097277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0bbadfa1-7f3b-40a0-a0f1-90bcb1f57dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:03.190131 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1234/2451] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:03.198066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d173b57-ce83-44d9-89f5-30e3ef6fb929 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.198066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d173b57-ce83-44d9-89f5-30e3ef6fb929 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.199853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d173b57-ce83-44d9-89f5-30e3ef6fb929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.229721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2d173b57-ce83-44d9-89f5-30e3ef6fb929 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:03.231108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2d173b57-ce83-44d9-89f5-30e3ef6fb929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:03.246655 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1218/2452] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:03.250877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbadfa1-7f3b-40a0-a0f1-90bcb1f57dd4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:03.266429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbadfa1-7f3b-40a0-a0f1-90bcb1f57dd4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:03.273719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:03.274708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.275134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.275832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.277014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:03.277569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:03.279506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:03.296251 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1235/2453] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:03.300771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d173b57-ce83-44d9-89f5-30e3ef6fb929 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:03.312202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d173b57-ce83-44d9-89f5-30e3ef6fb929 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:03.320037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:03.321464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.321900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.322351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.323361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:03.326145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:03.381560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:03.394101 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1219/2454] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:03 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:03.404820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646dcc8-3d2d-4d26-8ccf-12bee3e7a4ca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:03.467958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:03.555113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:03.555813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.556088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.556355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.557077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:03.559172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:03.592051 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1236/2455] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:03 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:03.593622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:03.649577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a8947-4f6e-4ddc-a0f5-73c03029b2a5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:03.661116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:03.662070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.662499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.662944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.663830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:03.665687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:03.682860 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1220/2456] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:03.687511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:03.706144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aec7ef-3020-41a0-9d25-ac19b08be7b9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:03.723270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:03.724319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.724764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.725440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.727016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:03.739292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:03.763983 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1237/2457] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:03.768931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:03.785110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88501c6-94e8-43d0-bc84-f446e58404af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:03.791950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55145af0-5469-4d10-b8e7-fa316dec9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:03.793207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145af0-5469-4d10-b8e7-fa316dec9a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.794396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145af0-5469-4d10-b8e7-fa316dec9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.794839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145af0-5469-4d10-b8e7-fa316dec9a40 admin admin] PATH_INFO: `/v3/projects/7a4f5163a259436ea88ff2f11c347e52/users/e3d077125c08422ba5b838f5695a6860/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.798627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:03.801694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:03.853861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55145af0-5469-4d10-b8e7-fa316dec9a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4f5163a259436ea88ff2f11c347e52, user_id=e3d077125c08422ba5b838f5695a6860, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:03.880185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55145af0-5469-4d10-b8e7-fa316dec9a40 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:03.925640 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1221/2458] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:03 2022] PUT /identity/v3/projects/7a4f5163a259436ea88ff2f11c347e52/users/e3d077125c08422ba5b838f5695a6860/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:03:03.929092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fac54-720e-43e5-80e7-b7accae470d3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:03.930151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fac54-720e-43e5-80e7-b7accae470d3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:03.930151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fac54-720e-43e5-80e7-b7accae470d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:03.992396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5c2fac54-720e-43e5-80e7-b7accae470d3 None None] MFA Rules not processed for user `e3d077125c08422ba5b838f5695a6860`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:03.993650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5c2fac54-720e-43e5-80e7-b7accae470d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:04.021102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0e4e4-5184-40fb-bb83-bce5570f80e5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:04.155888 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1222/2459] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:04.160349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fac54-720e-43e5-80e7-b7accae470d3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:04.174369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:04.175233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.175576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.175927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.178021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:04.213696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:04.231910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:04.278920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:04.282046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:04.296667 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1238/2460] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:04.300039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fac54-720e-43e5-80e7-b7accae470d3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:04.305815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:04.306498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.306777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.307225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.307929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:04.310366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:04.360433 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1223/2461] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:04 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:04.366025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:04.379109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f70096-31c2-49aa-ab61-f72162a4ee72 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:04.488075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:04.489666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.490038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.490516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.491491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:04.494315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:04.529847 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1239/2462] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:04 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:04.532707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:04.545595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba186a6-5cc3-43ba-ad27-a78b44ea61a6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:04.556565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:04.557300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.557648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.558072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.558954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:04.560532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:04.577177 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1224/2463] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:04.579193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:04.592512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41722cd0-d965-4ca1-83a3-970651a08f05 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:04.606516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d941aa1-efc1-4bc9-8114-0c3a5481cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:04.637998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941aa1-efc1-4bc9-8114-0c3a5481cd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.641921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941aa1-efc1-4bc9-8114-0c3a5481cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.642242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d941aa1-efc1-4bc9-8114-0c3a5481cd06 admin admin] PATH_INFO: `/v3/projects/e3de274473d74817a6017d4a1df40052/users/bee7bb44f0f644498468b37adfafceee/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.686073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d941aa1-efc1-4bc9-8114-0c3a5481cd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3de274473d74817a6017d4a1df40052, user_id=bee7bb44f0f644498468b37adfafceee, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:04.689293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d941aa1-efc1-4bc9-8114-0c3a5481cd06 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:04.729253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1240/2464] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:04 2022] PUT /identity/v3/projects/e3de274473d74817a6017d4a1df40052/users/bee7bb44f0f644498468b37adfafceee/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:04.730995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:04.744545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16f266-25a5-4dc8-80c9-ee46b3103ba3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:04.833219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968793-f77a-4599-a8fe-62f75d4edfcd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.833219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968793-f77a-4599-a8fe-62f75d4edfcd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.833219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03968793-f77a-4599-a8fe-62f75d4edfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.868915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:04.872520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.873107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.873644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.874854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:04.879641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:04.881349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-03968793-f77a-4599-a8fe-62f75d4edfcd None None] MFA Rules not processed for user `4eef98c56e744064b2b5f131c3766c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:04.883451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-03968793-f77a-4599-a8fe-62f75d4edfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:04.895721 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1225/2465] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:03:04.899743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:04.919912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821d669-9242-428e-8b5e-d9a1dfb29abb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:04.928428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb9925-63a9-4ad5-9eb7-f9e52b52ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:04.929381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9925-63a9-4ad5-9eb7-f9e52b52ba0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.929678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9925-63a9-4ad5-9eb7-f9e52b52ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.930001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb9925-63a9-4ad5-9eb7-f9e52b52ba0e admin admin] PATH_INFO: `/v3/projects/e3de274473d74817a6017d4a1df40052/users/bee7bb44f0f644498468b37adfafceee/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:04.932562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb9925-63a9-4ad5-9eb7-f9e52b52ba0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3de274473d74817a6017d4a1df40052, user_id=bee7bb44f0f644498468b37adfafceee, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:04.935411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb9925-63a9-4ad5-9eb7-f9e52b52ba0e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:04.949071 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1226/2466] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:04 2022] PUT /identity/v3/projects/e3de274473d74817a6017d4a1df40052/users/bee7bb44f0f644498468b37adfafceee/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:04.960158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:04.960631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:04.961101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.000223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] MFA Rules not processed for user `bee7bb44f0f644498468b37adfafceee`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:05.001909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:05.002628 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1241/2467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:05.015234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685bd42-9edc-4b7d-bc1c-09a19ab859b4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:05.015844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685bd42-9edc-4b7d-bc1c-09a19ab859b4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:05.016634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685bd42-9edc-4b7d-bc1c-09a19ab859b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.071405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5685bd42-9edc-4b7d-bc1c-09a19ab859b4 None None] MFA Rules not processed for user `4eef98c56e744064b2b5f131c3766c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:05.073170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5685bd42-9edc-4b7d-bc1c-09a19ab859b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:05.105599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:05.128831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:05.143704 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1227/2468] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:05.159864 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1242/2469] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:05.390484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:05.394714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:05.490325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef489ba-9020-45c3-86cb-5c44609107e3 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:05.490873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef489ba-9020-45c3-86cb-5c44609107e3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:05.490873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef489ba-9020-45c3-86cb-5c44609107e3 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.492252 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1243/2470] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:03:05.498067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d8ba-2dae-4bbf-b306-15fb023df9b8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:05.498290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d8ba-2dae-4bbf-b306-15fb023df9b8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:05.498564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967d8ba-2dae-4bbf-b306-15fb023df9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.503188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbbba6-bd6e-4d87-a05d-cdb8ddb4bd37 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:05.510417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:05.512684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:05.512684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:05.512684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.522062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3967d8ba-2dae-4bbf-b306-15fb023df9b8 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:05.522270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:05.523305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3967d8ba-2dae-4bbf-b306-15fb023df9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:05.523698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:05.536280 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1228/2471] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:05.565167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:05.577481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809185ae-9a07-4da6-8164-e19f38516b41 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:05.584072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:05.584826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:05.585080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:05.585394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.594875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:05.597360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:05.607689 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1229/2472] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:03:05.615158 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1244/2473] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:03:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:05.631755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:05.633367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:05.650974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50b6f-8eb7-428a-9c4a-69c280daa4e5 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:05.656700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ada0d2-10e2-4109-be5d-c9ee2f44c066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:05.657708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada0d2-10e2-4109-be5d-c9ee2f44c066 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:05.657708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada0d2-10e2-4109-be5d-c9ee2f44c066 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:05.657996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada0d2-10e2-4109-be5d-c9ee2f44c066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.668948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ada0d2-10e2-4109-be5d-c9ee2f44c066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:05.670664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ada0d2-10e2-4109-be5d-c9ee2f44c066 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:05.682764 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1230/2474] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:05.894757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967d8ba-2dae-4bbf-b306-15fb023df9b8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:05.908439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967d8ba-2dae-4bbf-b306-15fb023df9b8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:05.917350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af10ab-01a8-4560-82c1-e634f5f5648e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:05.918720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af10ab-01a8-4560-82c1-e634f5f5648e service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:05.919278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af10ab-01a8-4560-82c1-e634f5f5648e service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:05.919948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af10ab-01a8-4560-82c1-e634f5f5648e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:05.922451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4af10ab-01a8-4560-82c1-e634f5f5648e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:05.940479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af10ab-01a8-4560-82c1-e634f5f5648e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:05.942692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af10ab-01a8-4560-82c1-e634f5f5648e service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:05.959531 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1245/2475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:06.767500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4d84-1cb5-43df-b365-2a50879bf1c8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:06.768009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4d84-1cb5-43df-b365-2a50879bf1c8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:06.768100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f4d84-1cb5-43df-b365-2a50879bf1c8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:06.769687 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1231/2476] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:06.778541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46f52b-5beb-4ece-9297-f49d4e916ef5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:06.779625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46f52b-5beb-4ece-9297-f49d4e916ef5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:06.780231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46f52b-5beb-4ece-9297-f49d4e916ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:06.815225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ec46f52b-5beb-4ece-9297-f49d4e916ef5 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:06.819329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ec46f52b-5beb-4ece-9297-f49d4e916ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:06.848609 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1246/2477] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:03:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:06.865481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f4d84-1cb5-43df-b365-2a50879bf1c8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:06.868329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e71f4d84-1cb5-43df-b365-2a50879bf1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:07.035982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f4d84-1cb5-43df-b365-2a50879bf1c8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:07.045102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:07.045807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:07.046094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:07.046374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:07.076566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:07.078248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:07.105143 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1232/2478] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:07.174248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:07.174895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:07.175582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:07.219017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:07.221561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:07.235586 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1247/2479] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:07.304963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:07.322090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9d46-0eb0-4f56-8c10-4f824faf4465 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:07.334191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2881-f7b7-4b16-ad2a-f55538b89901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:07.334930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2881-f7b7-4b16-ad2a-f55538b89901 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:07.335216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2881-f7b7-4b16-ad2a-f55538b89901 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:07.336628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2881-f7b7-4b16-ad2a-f55538b89901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:07.363406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec2881-f7b7-4b16-ad2a-f55538b89901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:07.365185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec2881-f7b7-4b16-ad2a-f55538b89901 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:07.375579 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1233/2480] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:11.008549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:11.012361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:11.141422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb0836-e144-44d1-aa5c-4f6b145c5ce5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:11.153188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:11.154230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:11.154370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:11.154659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] PATH_INFO: `/v3/users/dcba179f9ae842e0a47dbe13e661f042` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:11.157425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcba179f9ae842e0a47dbe13e661f042)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:11.159372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:11.257202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:11.274892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcba179f9ae842e0a47dbe13e661f042'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.275607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcba179f9ae842e0a47dbe13e661f042'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.306471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcba179f9ae842e0a47dbe13e661f042'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.307377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcba179f9ae842e0a47dbe13e661f042'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.317067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcba179f9ae842e0a47dbe13e661f042'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.338781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:11.339863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:11.340967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:11.343073 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1248/2481] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:11 2022] DELETE /identity/v3/users/dcba179f9ae842e0a47dbe13e661f042 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:11.369301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:11.371156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:11.443529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:11.469545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1234/2482] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:11.592646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:11.594780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:11.685784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:11.687890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:11.697268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a467957-c3c9-4e08-9446-7fd8fa0cf874 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:11.703722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681838c-d733-4973-8bff-090f5e42f18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:11.705455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681838c-d733-4973-8bff-090f5e42f18c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:11.706323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681838c-d733-4973-8bff-090f5e42f18c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:11.706323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681838c-d733-4973-8bff-090f5e42f18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:11.716228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5708-aa93-4787-8e19-1a92c5f5fe81 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:11.719473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681838c-d733-4973-8bff-090f5e42f18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:11.723046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681838c-d733-4973-8bff-090f5e42f18c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:11.729138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:11.733587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:11.734322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:11.737435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] PATH_INFO: `/v3/users/e3d077125c08422ba5b838f5695a6860` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:11.739480 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1249/2483] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:11.740724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d077125c08422ba5b838f5695a6860)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:11.744443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:11.819758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d077125c08422ba5b838f5695a6860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.821136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d077125c08422ba5b838f5695a6860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.841752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d077125c08422ba5b838f5695a6860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.842535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d077125c08422ba5b838f5695a6860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.852211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d077125c08422ba5b838f5695a6860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:11.875748 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1235/2484] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:11 2022] DELETE /identity/v3/users/e3d077125c08422ba5b838f5695a6860 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:11.880454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:11.880961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:11.881535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:11.904595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:11.906151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:11.974531 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1250/2485] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:12.003022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:12.004916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:12.090535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ee96-fbaf-49d2-a999-f2e28516b86c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:12.096588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:12.097499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:12.097963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:12.098400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:12.109808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:12.111601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:12.128205 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1236/2486] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:12.378899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:12.380620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:12.436758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25ad8-3cd3-451f-b629-6aec1addf425 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:12.458598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:12.459507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:12.459785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:12.460048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] PATH_INFO: `/v3/projects/c5ee47070e2e4d1da7f730e525068554` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:12.463963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ee47070e2e4d1da7f730e525068554)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:12.466737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:12.591903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ee47070e2e4d1da7f730e525068554', 'request_id': 'req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.623821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ee47070e2e4d1da7f730e525068554', 'request_id': 'req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.642565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ee47070e2e4d1da7f730e525068554', 'request_id': 'req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.646220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:12.665587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] The token cache is being invalidate because project c5ee47070e2e4d1da7f730e525068554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:12.666101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.670755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.674001 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1251/2487] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:12 2022] DELETE /identity/v3/projects/c5ee47070e2e4d1da7f730e525068554 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:12.678015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:12.692952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9176de-443e-4e1c-876d-5efa6d6b8a2b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:12.824821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:12.829207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:12.829527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:12.832190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] PATH_INFO: `/v3/users/bea411e354384718a9e4fe7af8ebbda0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:12.835448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea411e354384718a9e4fe7af8ebbda0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:12.839567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:12.845896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:12.941298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea411e354384718a9e4fe7af8ebbda0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.942100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea411e354384718a9e4fe7af8ebbda0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.970751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea411e354384718a9e4fe7af8ebbda0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.972108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea411e354384718a9e4fe7af8ebbda0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:12.982359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea411e354384718a9e4fe7af8ebbda0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.012130 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1237/2488] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:12 2022] DELETE /identity/v3/users/bea411e354384718a9e4fe7af8ebbda0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:13.352636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:13.354615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:13.370355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba012e-9e2d-4ef5-a3f6-d23a97ee7fb0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:13.459513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:13.460795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:13.461107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:13.461429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] PATH_INFO: `/v3/projects/7a4f5163a259436ea88ff2f11c347e52` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:13.462711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4f5163a259436ea88ff2f11c347e52)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:13.465546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:13.556978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4f5163a259436ea88ff2f11c347e52', 'request_id': 'req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.566118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4f5163a259436ea88ff2f11c347e52', 'request_id': 'req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.576917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4f5163a259436ea88ff2f11c347e52', 'request_id': 'req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.598006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] The token cache is being invalidate because project 7a4f5163a259436ea88ff2f11c347e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:13.598573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.599323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.604482 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1252/2489] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:13 2022] DELETE /identity/v3/projects/7a4f5163a259436ea88ff2f11c347e52 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:13.605642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:13.614833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:13.639826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30a5f-142f-4e51-9f52-eb934dd649bf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:13.685106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:13.686965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:13.734476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:13.738821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:13.739672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:13.739672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] PATH_INFO: `/v3/users/bee7bb44f0f644498468b37adfafceee` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:13.741978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee7bb44f0f644498468b37adfafceee)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:13.743970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:13.808845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21681fe9-eef2-4d63-87a5-9c3e5c5892d7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:13.820936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:13.821994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:13.822913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:13.822913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] PATH_INFO: `/v3/projects/53c131621b4740d9aa9c16e86c857cb0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:13.824021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c131621b4740d9aa9c16e86c857cb0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:13.826157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:13.852485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:13.861974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee7bb44f0f644498468b37adfafceee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.862844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee7bb44f0f644498468b37adfafceee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.901440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee7bb44f0f644498468b37adfafceee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.902655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee7bb44f0f644498468b37adfafceee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.904165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c131621b4740d9aa9c16e86c857cb0', 'request_id': 'req-a0494a87-aee0-4a57-be74-9308faa3762c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.919205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c131621b4740d9aa9c16e86c857cb0', 'request_id': 'req-a0494a87-aee0-4a57-be74-9308faa3762c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.919844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee7bb44f0f644498468b37adfafceee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.948935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c131621b4740d9aa9c16e86c857cb0', 'request_id': 'req-a0494a87-aee0-4a57-be74-9308faa3762c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.961216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:13.967074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] The token cache is being invalidate because project 53c131621b4740d9aa9c16e86c857cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:13.967372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.970828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0494a87-aee0-4a57-be74-9308faa3762c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:13.971040 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1238/2490] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:13 2022] DELETE /identity/v3/users/bee7bb44f0f644498468b37adfafceee => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:13.977840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1253/2491] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:13 2022] DELETE /identity/v3/projects/53c131621b4740d9aa9c16e86c857cb0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:03:13.983275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810651d-883e-4200-b688-e0124077d9a7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:13.983561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810651d-883e-4200-b688-e0124077d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:13.983841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810651d-883e-4200-b688-e0124077d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:13.985641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:13.990806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:14.018537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3810651d-883e-4200-b688-e0124077d9a7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:14.019976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3810651d-883e-4200-b688-e0124077d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:14.102882 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1254/2492] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:14.104395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d800e8-4d8d-44d0-9a3d-4c998f772570 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.104684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d800e8-4d8d-44d0-9a3d-4c998f772570 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.105020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d800e8-4d8d-44d0-9a3d-4c998f772570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.127810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f1d800e8-4d8d-44d0-9a3d-4c998f772570 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:14.129227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f1d800e8-4d8d-44d0-9a3d-4c998f772570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:14.139291 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1255/2493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:14.144773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d800e8-4d8d-44d0-9a3d-4c998f772570 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:14.158240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d800e8-4d8d-44d0-9a3d-4c998f772570 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.163476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.164424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.165078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.165735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.166580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:14.166918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.170466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.185025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f9ea-c864-4230-be02-c5082cf50af3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.188488 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1256/2494] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:14.192339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:14.203957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.204638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.204969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.205301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.208808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b172827-c771-4fde-828d-0b86ca731d10 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.209697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:14.223551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.224923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.225597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.226135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.227046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.229327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.276709 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1257/2495] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:14 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:14.282718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:14.348572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.350218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.368016 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1239/2496] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:14.396078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b24991-2fa7-4686-9f85-c77275cf5520 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.420583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.421327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.421610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.421884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.422586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.433679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.483350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:14.496109 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1258/2497] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:14 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:14.496787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:14.512511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51571e29-4458-4e5c-83d0-8eadd8ca4fe3 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.527886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.528688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.528976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.529331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.530096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.531836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.565982 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1240/2498] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:03:14.568319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:14.582368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69998df9-0538-4a9b-8725-6825c8dff7f2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.598711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.599664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.600327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.600802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.601877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.605455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.652892 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1259/2499] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:14.654284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:14.669358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986d32c-c12e-40d9-a300-453e8408a461 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.681142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:14.683973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65196a-be9f-4346-8256-569f6a17e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.685016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65196a-be9f-4346-8256-569f6a17e493 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.685330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65196a-be9f-4346-8256-569f6a17e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.685609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65196a-be9f-4346-8256-569f6a17e493 admin admin] PATH_INFO: `/v3/projects/c5285b07988c4c8581f047981271fee1/users/545b6c16175f418587d6c8649b3ba8b0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.688598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:14.717766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b82ab5-c38e-4625-8997-03f37be0cf4d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:14.722997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:14.723986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.724350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.724700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] PATH_INFO: `/v3/projects/e3de274473d74817a6017d4a1df40052` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.727240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65196a-be9f-4346-8256-569f6a17e493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5285b07988c4c8581f047981271fee1, user_id=545b6c16175f418587d6c8649b3ba8b0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.732012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3de274473d74817a6017d4a1df40052)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:14.734345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65196a-be9f-4346-8256-569f6a17e493 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.736040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:14.762764 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1241/2500] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:14 2022] PUT /identity/v3/projects/c5285b07988c4c8581f047981271fee1/users/545b6c16175f418587d6c8649b3ba8b0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:14.774617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.774909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.775188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.833662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] MFA Rules not processed for user `545b6c16175f418587d6c8649b3ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:14.835971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:14.841232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3de274473d74817a6017d4a1df40052', 'request_id': 'req-0cc8dcc6-1025-416b-9434-96eb75891fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:14.852122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3de274473d74817a6017d4a1df40052', 'request_id': 'req-0cc8dcc6-1025-416b-9434-96eb75891fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:14.870131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3de274473d74817a6017d4a1df40052', 'request_id': 'req-0cc8dcc6-1025-416b-9434-96eb75891fb3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:14.906591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] The token cache is being invalidate because project e3de274473d74817a6017d4a1df40052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:14.906937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:14.914409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0cc8dcc6-1025-416b-9434-96eb75891fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:14.922749 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1260/2501] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:14 2022] DELETE /identity/v3/projects/e3de274473d74817a6017d4a1df40052 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:14.927653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddea3-f064-4854-b4be-ade1ea2faad0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:14.927977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddea3-f064-4854-b4be-ade1ea2faad0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:14.928256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ddea3-f064-4854-b4be-ade1ea2faad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:14.970837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-661ddea3-f064-4854-b4be-ade1ea2faad0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:14.972078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-661ddea3-f064-4854-b4be-ade1ea2faad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:14.976144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:15.029217 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1242/2502] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:15.030416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.034072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:15.118606 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1261/2503] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:15.126806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd626-cfe8-4fb6-9dec-91cffca4e104 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.127201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd626-cfe8-4fb6-9dec-91cffca4e104 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.127571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd626-cfe8-4fb6-9dec-91cffca4e104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.149847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7c45-5f84-4dc0-986c-7605e2b160c0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.156476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.157404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.158021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.158369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.162297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e35fd626-cfe8-4fb6-9dec-91cffca4e104 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:15.164526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e35fd626-cfe8-4fb6-9dec-91cffca4e104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:15.175039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.178017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.196097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1262/2504] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:15.197550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fd626-cfe8-4fb6-9dec-91cffca4e104 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.221197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fd626-cfe8-4fb6-9dec-91cffca4e104 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.232755 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1243/2505] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:15 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:15.235739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.237354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.239894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.239986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.240269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.242776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:15.243102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.245650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.261997 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1263/2506] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:03:15.266031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.293441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6869-7765-4874-b4e4-a7d18154fca0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.348257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56c1f7-408c-49f7-8b40-1208648f2398 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.366634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.366634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.369432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.369868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.370836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.376810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.378328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:15.404073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.406684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.406684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.409711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.411255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.424454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.431318 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1244/2507] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:15 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:15.434866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.458643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5b09-4f54-4837-b66a-941e7fc23cb4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.483553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.484291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.484551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.489180 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1264/2508] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:15 2022] POST /identity/v3/projects => generated 413 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:15.493685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.496532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.497533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.499185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.539337 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1245/2509] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:15.541163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.568263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5d281-386d-4575-8894-ccb11671c6d9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.576821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f87689-31da-4fa2-aee1-53f27b3b8fb9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.579560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.579910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.580192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.580472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] PATH_INFO: `/v3/projects/988e1078e63647239bfe684b17aba6c7/users/7c9c0427e9ba4117993b96d033cb767c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.584510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.584510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.584510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.584510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.585492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.588050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.626329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988e1078e63647239bfe684b17aba6c7, user_id=7c9c0427e9ba4117993b96d033cb767c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.628994 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1265/2510] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:15 2022] POST /identity/v3/users => generated 307 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:15.630293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.632798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.656603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a741e2-b031-488d-8f34-f4b42803c282 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.675020 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1246/2511] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:15 2022] PUT /identity/v3/projects/988e1078e63647239bfe684b17aba6c7/users/7c9c0427e9ba4117993b96d033cb767c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:15.676467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.719936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:15.790932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.791627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.791906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.792179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.792959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.794813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.810614 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1266/2512] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:15.821481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.821879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f26fc-c80e-4500-9149-6d9ef6c6c856 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.833759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.834461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.834743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.834852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbef889-d486-4346-ac8d-e17d06d8f298 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.835016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.836385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.839163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.841306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.842708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.844030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.844232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.845162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.846721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.864387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1267/2513] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:15.868670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.883985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b23285-36e5-41fc-9002-383d62b88307 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.884341 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1247/2514] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:15.888915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:15.912652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bccab-d0e8-42a2-b2a4-2c45ec7a97f2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:15.912871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9abbf0-a172-4e16-a74a-b13824790818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.914046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abbf0-a172-4e16-a74a-b13824790818 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.915378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abbf0-a172-4e16-a74a-b13824790818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.917416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9abbf0-a172-4e16-a74a-b13824790818 admin admin] PATH_INFO: `/v3/projects/c5893b4b7c9c49bf87729b506675446e/users/db0ce8caf601458c94d03b85b37e4371/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.921263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc3df2-1d02-406d-92f3-596418d1b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:15.922567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc3df2-1d02-406d-92f3-596418d1b333 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.922934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc3df2-1d02-406d-92f3-596418d1b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.923240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc3df2-1d02-406d-92f3-596418d1b333 admin admin] PATH_INFO: `/v3/projects/988e1078e63647239bfe684b17aba6c7/users/7c9c0427e9ba4117993b96d033cb767c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.926650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc3df2-1d02-406d-92f3-596418d1b333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988e1078e63647239bfe684b17aba6c7, user_id=7c9c0427e9ba4117993b96d033cb767c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.930296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc3df2-1d02-406d-92f3-596418d1b333 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.940909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9abbf0-a172-4e16-a74a-b13824790818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5893b4b7c9c49bf87729b506675446e, user_id=db0ce8caf601458c94d03b85b37e4371, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:15.945357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9abbf0-a172-4e16-a74a-b13824790818 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:15.945539 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1248/2515] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:15 2022] PUT /identity/v3/projects/988e1078e63647239bfe684b17aba6c7/users/7c9c0427e9ba4117993b96d033cb767c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:15.956472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383b835-db11-498a-8739-38d9a1863a8a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.956893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383b835-db11-498a-8739-38d9a1863a8a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.957250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383b835-db11-498a-8739-38d9a1863a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:15.965791 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1268/2516] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:15 2022] PUT /identity/v3/projects/c5893b4b7c9c49bf87729b506675446e/users/db0ce8caf601458c94d03b85b37e4371/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:15.970818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:15.971340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:15.971852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:16.005606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:16.007192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:16.049266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:16.051779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5383b835-db11-498a-8739-38d9a1863a8a None None] MFA Rules not processed for user `7c9c0427e9ba4117993b96d033cb767c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:16.053267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5383b835-db11-498a-8739-38d9a1863a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:16.143803 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1269/2517] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:16.186051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:16.187797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:16.200285 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1249/2518] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:16.212023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:16.212388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:16.212601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:16.251072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] MFA Rules not processed for user `545b6c16175f418587d6c8649b3ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:16.252315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:16.316384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b384a-5e70-4cd9-b034-eb819a1612fc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:16.328861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a597042-201f-4060-94d9-52a20f26c75b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:16.332069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597042-201f-4060-94d9-52a20f26c75b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:16.339321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597042-201f-4060-94d9-52a20f26c75b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:16.340303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a597042-201f-4060-94d9-52a20f26c75b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:16.368476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597042-201f-4060-94d9-52a20f26c75b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:16.380563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a597042-201f-4060-94d9-52a20f26c75b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:16.393502 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1250/2519] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:16.425528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1270/2520] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:03:16.837855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:16.839770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:16.906304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:16.954137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487cecf-6aee-402f-9f0e-3071435c49ff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:16.961674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefe763-0afa-49df-b5ac-b4eb7b9e7652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:16.962536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefe763-0afa-49df-b5ac-b4eb7b9e7652 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:16.962941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefe763-0afa-49df-b5ac-b4eb7b9e7652 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:16.963309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefe763-0afa-49df-b5ac-b4eb7b9e7652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:16.974283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefe763-0afa-49df-b5ac-b4eb7b9e7652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:16.976683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefe763-0afa-49df-b5ac-b4eb7b9e7652 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:17.002739 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1251/2521] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:17.285800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ce83b-165e-42ec-8409-47f101d2183c None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:17.286356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ce83b-165e-42ec-8409-47f101d2183c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:17.286356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ce83b-165e-42ec-8409-47f101d2183c None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:17.289192 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1271/2522] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:17.295465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0ea92-0bb7-42ab-97e6-67720ff11b49 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:17.295750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0ea92-0bb7-42ab-97e6-67720ff11b49 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:17.296026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0ea92-0bb7-42ab-97e6-67720ff11b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:17.323269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-85d0ea92-0bb7-42ab-97e6-67720ff11b49 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:17.324576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85d0ea92-0bb7-42ab-97e6-67720ff11b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:17.435346 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1252/2523] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:03:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:17.445645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ce83b-165e-42ec-8409-47f101d2183c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:17.447897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a21ce83b-165e-42ec-8409-47f101d2183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:17.472391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ce83b-165e-42ec-8409-47f101d2183c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:17.479604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b2082-c8c3-4121-9583-ba4c4f028cea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:17.480552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b2082-c8c3-4121-9583-ba4c4f028cea service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:17.480917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b2082-c8c3-4121-9583-ba4c4f028cea service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:17.481354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b2082-c8c3-4121-9583-ba4c4f028cea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:17.492910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b2082-c8c3-4121-9583-ba4c4f028cea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:17.495034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b2082-c8c3-4121-9583-ba4c4f028cea service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:17.508176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1272/2524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:25.055025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6e73-f6df-4524-9f9f-9dc34f4e4f38 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:25.055662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6e73-f6df-4524-9f9f-9dc34f4e4f38 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:25.055662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6e73-f6df-4524-9f9f-9dc34f4e4f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:25.095871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-780f6e73-f6df-4524-9f9f-9dc34f4e4f38 None None] MFA Rules not processed for user `79c12f29545c40ec955650696bb91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:25.097165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-780f6e73-f6df-4524-9f9f-9dc34f4e4f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:25.214520 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1253/2525] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:26.630373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683294-1326-41cc-ab26-10340533a35a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:26.630847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683294-1326-41cc-ab26-10340533a35a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:26.630847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683294-1326-41cc-ab26-10340533a35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:26.689013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b2683294-1326-41cc-ab26-10340533a35a None None] MFA Rules not processed for user `db0ce8caf601458c94d03b85b37e4371`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:26.690380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2683294-1326-41cc-ab26-10340533a35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:26.867418 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1273/2526] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:26.877633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:26.878333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:26.878766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:26.910121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] MFA Rules not processed for user `db0ce8caf601458c94d03b85b37e4371`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:26.913001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:26.934316 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1254/2527] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:28.461302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:28.461913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:28.461913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:28.519564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:28.520912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:28.672191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:28.712280 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1274/2528] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:03:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:28.728080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:28.729880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:28.893293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:28.912758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7fd6a-e916-4d73-ba33-bdb8e8b14e03 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:28.924389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc8126-ae8a-4430-9950-f1a55dab232a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:28.925100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8126-ae8a-4430-9950-f1a55dab232a service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:28.925407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8126-ae8a-4430-9950-f1a55dab232a service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:28.927896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8126-ae8a-4430-9950-f1a55dab232a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:28.952612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc8126-ae8a-4430-9950-f1a55dab232a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:28.954348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc8126-ae8a-4430-9950-f1a55dab232a service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:28.982560 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1255/2529] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:29.211834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:29.214177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:29.293513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced54fbb-4c40-4398-9faa-971ec13d2ff1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:29.325306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:29.326948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:29.327411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:29.327842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:29.341007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:29.346293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:29.406260 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1275/2530] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:29 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:32.374546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7235b3-93c0-4786-86c0-d6d1f0f72587 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:32.375083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7235b3-93c0-4786-86c0-d6d1f0f72587 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:32.375083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7235b3-93c0-4786-86c0-d6d1f0f72587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:32.425000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-de7235b3-93c0-4786-86c0-d6d1f0f72587 None None] MFA Rules not processed for user `681cfb0e560145b4abef98dbd417f3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:32.428844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-de7235b3-93c0-4786-86c0-d6d1f0f72587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:32.512973 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1256/2531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:39.353858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:42.503854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=30 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:43.940398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:43.941916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:43.986558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab490a3e-070c-4625-86f5-21ff093ecc56 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:44.001801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:44.002944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:44.003434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:44.003868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] PATH_INFO: `/v3/users/02a8362ef1d14be9b41ba2e6c904807f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:44.005714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a8362ef1d14be9b41ba2e6c904807f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:44.008119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:44.116445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a8362ef1d14be9b41ba2e6c904807f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.129706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a8362ef1d14be9b41ba2e6c904807f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.152395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a8362ef1d14be9b41ba2e6c904807f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.155150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a8362ef1d14be9b41ba2e6c904807f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.194847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a8362ef1d14be9b41ba2e6c904807f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.236791 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1276/2532] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:43 2022] DELETE /identity/v3/users/02a8362ef1d14be9b41ba2e6c904807f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:44.238466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:44.239002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:44.239100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:44.282518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:44.283777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:44.395969 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1257/2533] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:44.404505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:44.407977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:44.496215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889668f1-1208-427a-84cf-699bbc474a0e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:44.500609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:44.502389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:44.503214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:44.504380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:44.533251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:44.535334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:44.567785 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1277/2534] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:44.783193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:44.785231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:44.801228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0b63d-98c9-4c8d-82b6-bd23bd50b260 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:44.808035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:44.812607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:44.812818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:44.813304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] PATH_INFO: `/v3/projects/8a610355b4324f8f8bac4b1673685d44` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:44.815199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a610355b4324f8f8bac4b1673685d44)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:44.818214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:44.954439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a610355b4324f8f8bac4b1673685d44', 'request_id': 'req-58dd13ff-74c6-437a-b5bd-f1d752b14190'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.963612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a610355b4324f8f8bac4b1673685d44', 'request_id': 'req-58dd13ff-74c6-437a-b5bd-f1d752b14190'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.976953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a610355b4324f8f8bac4b1673685d44', 'request_id': 'req-58dd13ff-74c6-437a-b5bd-f1d752b14190'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.995698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] The token cache is being invalidate because project 8a610355b4324f8f8bac4b1673685d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:44.996054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:44.996853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:45.002394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1258/2535] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:44 2022] DELETE /identity/v3/projects/8a610355b4324f8f8bac4b1673685d44 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:45.003792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:45.017107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cfb50-c211-4218-bf78-d9eee379be73 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:45.170565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:45.171682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:45.171834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:45.172114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] PATH_INFO: `/v3/users/d23a12015c6e436786b575431bc643d2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:45.173790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23a12015c6e436786b575431bc643d2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:45.175751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:45.211568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:45.329872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23a12015c6e436786b575431bc643d2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:45.331131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23a12015c6e436786b575431bc643d2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:45.354652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23a12015c6e436786b575431bc643d2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:45.355428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23a12015c6e436786b575431bc643d2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:45.373930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23a12015c6e436786b575431bc643d2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:45.401522 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1278/2536] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:45 2022] DELETE /identity/v3/users/d23a12015c6e436786b575431bc643d2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:45.672075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:45.675997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:45.791752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd13ff-74c6-437a-b5bd-f1d752b14190 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:45.824165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:45.938016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbac83-4402-4d09-a8d9-d3a17c0ec6c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:45.939363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbac83-4402-4d09-a8d9-d3a17c0ec6c2 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:45.940400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbac83-4402-4d09-a8d9-d3a17c0ec6c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:45.941977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbac83-4402-4d09-a8d9-d3a17c0ec6c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:45.945641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-39dbac83-4402-4d09-a8d9-d3a17c0ec6c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:46.117726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbac83-4402-4d09-a8d9-d3a17c0ec6c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:46.121268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbac83-4402-4d09-a8d9-d3a17c0ec6c2 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:46.128429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:46.130804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:46.156124 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1259/2537] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:46.268159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddff86c-aa80-4d00-910b-3327778e3917 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:46.273289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:46.274196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:46.274477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:46.275009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] PATH_INFO: `/v3/projects/5faaae9647da4088a0abfba5c48320b2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:46.276285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faaae9647da4088a0abfba5c48320b2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:46.278355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:46.412946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faaae9647da4088a0abfba5c48320b2', 'request_id': 'req-5b12c163-91fa-4335-a86b-76eecc91e400'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:46.421853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faaae9647da4088a0abfba5c48320b2', 'request_id': 'req-5b12c163-91fa-4335-a86b-76eecc91e400'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:46.438005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faaae9647da4088a0abfba5c48320b2', 'request_id': 'req-5b12c163-91fa-4335-a86b-76eecc91e400'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:46.456752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] The token cache is being invalidate because project 5faaae9647da4088a0abfba5c48320b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:46.457365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:46.458383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b12c163-91fa-4335-a86b-76eecc91e400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:46.464160 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1279/2538] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:46 2022] DELETE /identity/v3/projects/5faaae9647da4088a0abfba5c48320b2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:46.466314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9b287-397f-4c6e-9568-466474f0964e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:46.467072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9b287-397f-4c6e-9568-466474f0964e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:46.467464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9b287-397f-4c6e-9568-466474f0964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:46.522301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c4b9b287-397f-4c6e-9568-466474f0964e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:46.523910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4b9b287-397f-4c6e-9568-466474f0964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:46.637153 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1260/2539] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:46.644715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a484ad9-7184-4a48-81c0-dbe5ff5c94a9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:46.645014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a484ad9-7184-4a48-81c0-dbe5ff5c94a9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:46.645338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a484ad9-7184-4a48-81c0-dbe5ff5c94a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:46.695905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9a484ad9-7184-4a48-81c0-dbe5ff5c94a9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:46.698290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9a484ad9-7184-4a48-81c0-dbe5ff5c94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:46.715734 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1280/2540] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:46.721471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9b287-397f-4c6e-9568-466474f0964e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:46.737563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9b287-397f-4c6e-9568-466474f0964e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:46.747544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:46.749373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:46.749890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:46.750544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:46.751907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:46.752448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:46.755906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:46.774680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a484ad9-7184-4a48-81c0-dbe5ff5c94a9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:46.775807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1261/2541] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:46.791950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a484ad9-7184-4a48-81c0-dbe5ff5c94a9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:46.803781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:46.805020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:46.805337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:46.806978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:46.809445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:46.822794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:46.861151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:46.888705 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1281/2542] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:46 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:03:46.889947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:46.910323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cc933-4fe6-49b0-9ca6-7dfb1bb132a0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:46.977334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:47.038014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:47.038799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:47.039308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:47.046402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:47.047331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:47.049592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:47.094507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1262/2543] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:46 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:47.095507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:47.123079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea604a2-0bf0-432c-8361-d9b23b0a8486 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:47.145932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:47.146744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:47.146920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:47.147199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:47.147953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:47.157373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:47.195360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1282/2544] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:03:47.199564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:47.222715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780c3ad-4dc7-4cff-a905-6303e53146a8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:47.232169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813770d1-95bc-4067-b98e-3ee2db7678de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:47.237554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813770d1-95bc-4067-b98e-3ee2db7678de admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:47.239131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813770d1-95bc-4067-b98e-3ee2db7678de admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:47.239510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813770d1-95bc-4067-b98e-3ee2db7678de admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:47.242430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813770d1-95bc-4067-b98e-3ee2db7678de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:47.244878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813770d1-95bc-4067-b98e-3ee2db7678de admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:47.265943 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1263/2545] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:47.270158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:47.285892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d272c10-b79a-4d13-b27e-3baa7c2c33af admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:47.297206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:47.298138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:47.298422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:47.298696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] PATH_INFO: `/v3/projects/18f2d50ee9b74209b100e2fb806ca813/users/d21544edc78a4b44904ac2c9a5caa791/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:47.335602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f2d50ee9b74209b100e2fb806ca813, user_id=d21544edc78a4b44904ac2c9a5caa791, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:47.347760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:47.387409 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1283/2546] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:47 2022] PUT /identity/v3/projects/18f2d50ee9b74209b100e2fb806ca813/users/d21544edc78a4b44904ac2c9a5caa791/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:47.398101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc8a5-a01b-4b11-909d-6544cd04c780 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:47.398438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc8a5-a01b-4b11-909d-6544cd04c780 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:47.398884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddc8a5-a01b-4b11-909d-6544cd04c780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:47.453400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-afddc8a5-a01b-4b11-909d-6544cd04c780 None None] MFA Rules not processed for user `d21544edc78a4b44904ac2c9a5caa791`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:47.460080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-afddc8a5-a01b-4b11-909d-6544cd04c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:47.638438 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1264/2547] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:47.642964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:47.804201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a632a0d-5972-455f-8740-e1fbb24226bb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:47.804701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a632a0d-5972-455f-8740-e1fbb24226bb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:47.804934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a632a0d-5972-455f-8740-e1fbb24226bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:47.837097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9a632a0d-5972-455f-8740-e1fbb24226bb None None] MFA Rules not processed for user `545b6c16175f418587d6c8649b3ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:47.838845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a632a0d-5972-455f-8740-e1fbb24226bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:47.980537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e68e9-b1e3-4e50-8b00-00738e28aabf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:48.003523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ae2ce-2233-4dc4-88b8-a0182ba22556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:48.003796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ae2ce-2233-4dc4-88b8-a0182ba22556 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.003937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ae2ce-2233-4dc4-88b8-a0182ba22556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.004183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ae2ce-2233-4dc4-88b8-a0182ba22556 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.004914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ae2ce-2233-4dc4-88b8-a0182ba22556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:48.019974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ae2ce-2233-4dc4-88b8-a0182ba22556 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:48.085980 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1284/2548] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:47 2022] POST /identity/v3/projects => generated 375 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:48.092839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63541c-a3f8-4bbd-ab09-0e7711156efd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.093226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63541c-a3f8-4bbd-ab09-0e7711156efd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.093504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63541c-a3f8-4bbd-ab09-0e7711156efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.102228 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1265/2549] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:48.106159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a632a0d-5972-455f-8740-e1fbb24226bb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:48.142274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ed63541c-a3f8-4bbd-ab09-0e7711156efd None None] MFA Rules not processed for user `76897f7be7494bb589de747493240449`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:48.143942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ed63541c-a3f8-4bbd-ab09-0e7711156efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:48.148754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a632a0d-5972-455f-8740-e1fbb24226bb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:48.305150 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1285/2550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:48.338902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:48.356652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:48.357691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.358170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.358550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.359506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:48.365448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:48.476199 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1266/2551] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:48 2022] POST /identity/v3/users => generated 294 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:48.480808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63541c-a3f8-4bbd-ab09-0e7711156efd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:48.504815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63541c-a3f8-4bbd-ab09-0e7711156efd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:48.511923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:48.512802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.513831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.514220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.515098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:48.516952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:48.536702 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1286/2552] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:48.541425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:48.555679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6a6f0-724b-43c1-bf20-d743768fc604 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:48.565774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:48.566723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.567010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.567282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] PATH_INFO: `/v3/projects/d2a5c75dce40456cb07a94832527b262/users/05667c4717684b13b60f93a6597965f3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.589559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a5c75dce40456cb07a94832527b262, user_id=05667c4717684b13b60f93a6597965f3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:48.592829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:48.628955 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1267/2553] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:48 2022] PUT /identity/v3/projects/d2a5c75dce40456cb07a94832527b262/users/05667c4717684b13b60f93a6597965f3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:48.633451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:48.650588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0407-084f-4461-a040-9030e9e971cf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:48.750764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:48.780060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcccea-b160-4115-8304-8e778f7b5f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:48.780629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcccea-b160-4115-8304-8e778f7b5f68 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.781042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcccea-b160-4115-8304-8e778f7b5f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.782670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcccea-b160-4115-8304-8e778f7b5f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.782670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcccea-b160-4115-8304-8e778f7b5f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:48.784054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcccea-b160-4115-8304-8e778f7b5f68 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:48.841278 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1287/2554] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:03:48.842893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:48.876672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488b30-b01d-42e3-8179-56a85ff6bc48 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:48.887751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:48.889023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.889510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.890528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] PATH_INFO: `/v3/projects/d2a5c75dce40456cb07a94832527b262/users/05667c4717684b13b60f93a6597965f3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.893396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a5c75dce40456cb07a94832527b262, user_id=05667c4717684b13b60f93a6597965f3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:48.896475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:48.931981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7aa76-f170-42d3-9912-a5ee99763e06 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:48.932340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7aa76-f170-42d3-9912-a5ee99763e06 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:48.932455 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1268/2555] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:03:48 2022] PUT /identity/v3/projects/d2a5c75dce40456cb07a94832527b262/users/05667c4717684b13b60f93a6597965f3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:48.932808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7aa76-f170-42d3-9912-a5ee99763e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:48.991410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dfd7aa76-f170-42d3-9912-a5ee99763e06 None None] MFA Rules not processed for user `05667c4717684b13b60f93a6597965f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:48.996151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dfd7aa76-f170-42d3-9912-a5ee99763e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:49.187336 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1288/2556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:49.194516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:49.218095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb0deb-fb3c-4fc2-ac9c-bac0ea3bccd6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:49.225407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:49.226090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:49.226975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:49.227257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:49.228662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:49.228970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:49.230612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:49.254565 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1269/2557] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:49.255082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7aa76-f170-42d3-9912-a5ee99763e06 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:49.266021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7aa76-f170-42d3-9912-a5ee99763e06 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:49.279716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:49.280698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:49.281165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:49.281618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:49.282504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:49.284584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:49.326734 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1289/2558] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:49 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:03:49.330865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:49.346621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958a20-433b-4251-a678-ad7d749a2830 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:49.458843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dd185-efff-404b-a20c-bead79e1d9bf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:49.459959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd185-efff-404b-a20c-bead79e1d9bf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:49.460342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd185-efff-404b-a20c-bead79e1d9bf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:49.460720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd185-efff-404b-a20c-bead79e1d9bf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:49.462540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dd185-efff-404b-a20c-bead79e1d9bf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:49.462961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dd185-efff-404b-a20c-bead79e1d9bf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:49.465238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dd185-efff-404b-a20c-bead79e1d9bf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:49.487929 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1270/2559] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:50.045220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:50.053048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:50.284365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b061fd-30d5-496e-9ec5-113fe36f5b82 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:50.291689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:50.292395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:50.292679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:50.292988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:50.304953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:50.307210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:50.321385 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1290/2560] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:50.338029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a2a1-9c0a-4eb2-896f-7ff9eb1672e8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:50.339043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a2a1-9c0a-4eb2-896f-7ff9eb1672e8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:50.339345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a2a1-9c0a-4eb2-896f-7ff9eb1672e8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:50.340955 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1271/2561] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:50.347384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:03:50.364951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:50.375597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944baca-903e-4960-919b-a0cc93fb2fda service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:50.381086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:50.382375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:50.382896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:50.383396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/5871c9523ae24283a0695e89fa639d7a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:50.385096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=5871c9523ae24283a0695e89fa639d7a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:50.387954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:50.390508 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1291/2562] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:03:50 2022] GET /identity/v3/projects/5871c9523ae24283a0695e89fa639d7a => generated 369 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:03:50.579163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e7e1-f04b-4f2d-982a-132f9c2f3f09 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:50.579585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e7e1-f04b-4f2d-982a-132f9c2f3f09 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:50.579980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e7e1-f04b-4f2d-982a-132f9c2f3f09 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:50.581756 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1272/2563] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:50.589550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:03:50.608490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:50.621815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e999f-1f52-4c59-8138-09c5e568c293 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:50.629052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:50.630043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:50.630324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:50.630614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/5871c9523ae24283a0695e89fa639d7a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:50.632338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=5871c9523ae24283a0695e89fa639d7a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:50.635265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:50.637964 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1292/2564] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:03:50 2022] GET /identity/v3/projects/5871c9523ae24283a0695e89fa639d7a => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:50.939435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f7335-a406-4c86-ad85-e135adbc852a None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:50.940074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f7335-a406-4c86-ad85-e135adbc852a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:50.940537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f7335-a406-4c86-ad85-e135adbc852a None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:50.942400 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1273/2565] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:50.947889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:03:50.954043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:50.954701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:50.955266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:50.974473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:50.982405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:50.984241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:50.985292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:51.000113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2be9d-9a37-4a4a-9608-50df17eea7d7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:51.012713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:51.014411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:51.014779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:51.018948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/5871c9523ae24283a0695e89fa639d7a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:51.021865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=5871c9523ae24283a0695e89fa639d7a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:51.027395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:51.029311 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1293/2566] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:03:50 2022] GET /identity/v3/projects/5871c9523ae24283a0695e89fa639d7a => generated 369 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:51.066336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:51.088163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd11e7a-af29-44b3-a12c-093e8850d814 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:51.095073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:51.096700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:51.096992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:51.097386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/5871c9523ae24283a0695e89fa639d7a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:51.099587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5871c9523ae24283a0695e89fa639d7a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:51.101745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:51.110056 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1274/2567] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:03:51.126487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:51.128171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:51.187469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:51.211030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5871c9523ae24283a0695e89fa639d7a', 'request_id': 'req-7b8f8c04-70fe-46bf-9418-ce25c531250c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:51.226738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5871c9523ae24283a0695e89fa639d7a', 'request_id': 'req-7b8f8c04-70fe-46bf-9418-ce25c531250c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:51.249463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5871c9523ae24283a0695e89fa639d7a', 'request_id': 'req-7b8f8c04-70fe-46bf-9418-ce25c531250c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:51.273453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] The token cache is being invalidate because project 5871c9523ae24283a0695e89fa639d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:03:51.274144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:51.275934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7b8f8c04-70fe-46bf-9418-ce25c531250c tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:51.283688 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1294/2568] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:51 2022] DELETE /identity/v3/projects/5871c9523ae24283a0695e89fa639d7a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:03:51.283892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51409c-29c4-4dec-8862-5a027e9a9f7f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:51.358973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:51.369806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:51.370293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:51.370762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:51.373424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:51.495923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:51.498549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:51.524975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1275/2569] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:03:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:51.975082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49a04d-34be-48e3-9185-0446506acc51 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:51.980530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49a04d-34be-48e3-9185-0446506acc51 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:51.981017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49a04d-34be-48e3-9185-0446506acc51 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:51.983452 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1295/2570] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:03:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:51.988453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:03:51.990072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:52.200437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:52.205655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:52.235384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:52.359150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1841cae-4a3e-46c0-b19b-059a9fbec8f3 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:52.365919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:52.367164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:52.367252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:52.367540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/18f2d50ee9b74209b100e2fb806ca813` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:52.376315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=18f2d50ee9b74209b100e2fb806ca813)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:52.378453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:52.393336 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1276/2571] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:03:51 2022] GET /identity/v3/projects/18f2d50ee9b74209b100e2fb806ca813 => generated 373 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:52.401875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49a04d-34be-48e3-9185-0446506acc51 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:52.423476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49a04d-34be-48e3-9185-0446506acc51 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:52.429300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:52.430517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:52.431182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:52.431709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:52.433166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:52.433727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:52.437646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:52.456607 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1296/2572] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:52.457424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:52.469490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4881fb6-3bbc-4995-992e-963a79ec4b52 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:52.475047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9517f-eccb-4db7-807d-1f3d0d0ccd88 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:52.476041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9517f-eccb-4db7-807d-1f3d0d0ccd88 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:52.476329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9517f-eccb-4db7-807d-1f3d0d0ccd88 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:52.476609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9517f-eccb-4db7-807d-1f3d0d0ccd88 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:52.477387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9517f-eccb-4db7-807d-1f3d0d0ccd88 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:52.479957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9517f-eccb-4db7-807d-1f3d0d0ccd88 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:52.517245 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1277/2573] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:03:52 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:52.521227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:52.532709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaae23-025d-4fbd-8f1b-689d0a6fb283 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:52.686773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af96112-9259-4681-b278-4f5db1829338 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:52.689120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96112-9259-4681-b278-4f5db1829338 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:52.691117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96112-9259-4681-b278-4f5db1829338 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:52.691565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96112-9259-4681-b278-4f5db1829338 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:52.692473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96112-9259-4681-b278-4f5db1829338 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:52.693919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96112-9259-4681-b278-4f5db1829338 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:52.702419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96112-9259-4681-b278-4f5db1829338 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:52.725915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1297/2574] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:52.853749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:52.854080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:52.854315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:52.884273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] MFA Rules not processed for user `4eef98c56e744064b2b5f131c3766c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:52.885870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:52.966071 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1278/2575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:03:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:53.328293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52b68-2195-4931-a45f-324052a75f44 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:53.329201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52b68-2195-4931-a45f-324052a75f44 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:53.330540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52b68-2195-4931-a45f-324052a75f44 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:53.332487 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1298/2576] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:03:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:53.340378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:03:53.502047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:53.534277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1545726-28c5-495c-b37c-51d5ebaa1cf5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:53.542761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:53.543800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:53.544082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:53.544364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/4ae82f501733415e89a0c98820b2e653` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:53.546925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=4ae82f501733415e89a0c98820b2e653)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:53.550362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:53.552899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1279/2577] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:03:53 2022] GET /identity/v3/projects/4ae82f501733415e89a0c98820b2e653 => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:57.699538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5905-a239-45e3-9a87-0df48fcf6c18 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:57.700544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5905-a239-45e3-9a87-0df48fcf6c18 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:57.701093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c5905-a239-45e3-9a87-0df48fcf6c18 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:57.704464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1299/2578] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:03:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:57.711704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:03:57.726032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:57.737266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e296a-7260-4762-b72f-5c7d85b67e71 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:57.747879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:57.751726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:57.752709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:57.752709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/4ae82f501733415e89a0c98820b2e653` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:57.754332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=4ae82f501733415e89a0c98820b2e653)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:57.759214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:57.767309 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1280/2579] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:03:57 2022] GET /identity/v3/projects/4ae82f501733415e89a0c98820b2e653 => generated 367 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:57.867003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c5905-a239-45e3-9a87-0df48fcf6c18 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:57.894155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c5905-a239-45e3-9a87-0df48fcf6c18 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:57.918064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:57.920600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:57.921155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:57.921869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:57.923460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:57.924262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:57.926549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:57.957306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:57.957525 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1300/2580] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:57.974840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030f5e8-0bc2-45d1-aa67-611fb90e4c58 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:57.982134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d9981-eea8-45f1-a197-74027328025d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:57.990242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d9981-eea8-45f1-a197-74027328025d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:57.991209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d9981-eea8-45f1-a197-74027328025d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:57.991738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d9981-eea8-45f1-a197-74027328025d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:57.992949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d9981-eea8-45f1-a197-74027328025d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:57.995947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d9981-eea8-45f1-a197-74027328025d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:58.022701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:58.044469 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1281/2581] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:03:57 2022] POST /identity/v3/users => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:03:58.048858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:58.084538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0f2f8-d950-4a13-a2c9-f5c0550261c7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:58.096738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a62da-63b2-4f55-9ba8-978a551c65cb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:58.099709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a62da-63b2-4f55-9ba8-978a551c65cb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:58.100052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a62da-63b2-4f55-9ba8-978a551c65cb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:58.102259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a62da-63b2-4f55-9ba8-978a551c65cb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:58.105870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a62da-63b2-4f55-9ba8-978a551c65cb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:03:58.106435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a62da-63b2-4f55-9ba8-978a551c65cb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:58.110601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a62da-63b2-4f55-9ba8-978a551c65cb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:58.171304 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1301/2582] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:58.714865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0275e9-83d8-4c32-8c2e-02408cafd0d5 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:58.715363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0275e9-83d8-4c32-8c2e-02408cafd0d5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:58.715486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0275e9-83d8-4c32-8c2e-02408cafd0d5 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:58.719672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1282/2583] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:03:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:03:58.738283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:58.740940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:58.741469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:58.780161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:03:58.782612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:58.837957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:58.926131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09aa1f-b8df-40be-9868-8fbc011d6b14 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:58.926439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09aa1f-b8df-40be-9868-8fbc011d6b14 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:58.926781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09aa1f-b8df-40be-9868-8fbc011d6b14 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:58.929092 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1283/2584] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:03:58.957868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09aa1f-b8df-40be-9868-8fbc011d6b14 None None] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:03:59.030840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09aa1f-b8df-40be-9868-8fbc011d6b14 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:59.063889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09aa1f-b8df-40be-9868-8fbc011d6b14 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:59.077960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:59.078875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:59.079340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:59.079779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/4ae82f501733415e89a0c98820b2e653` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:59.081278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=4ae82f501733415e89a0c98820b2e653)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:59.083531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:59.097539 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1284/2585] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:03:58 2022] GET /identity/v3/projects/4ae82f501733415e89a0c98820b2e653 => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:03:59.098798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:59.100793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:59.216192 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1302/2586] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:03:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:03:59.244004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95c02-4426-409c-8e2f-9d81823d9652 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:59.250493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:59.252670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:59.253202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:59.254375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] PATH_INFO: `/v3/users/58c3911cbbdf4e35ae8df9eb8b23f22d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:59.257930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c3911cbbdf4e35ae8df9eb8b23f22d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:59.260401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:59.274964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:59.276879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:59.319574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d9f8f-2ed5-494b-b9b9-f43f4fcd9e38 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:59.335832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:59.337669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:59.338059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:59.339495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:59.350394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c3911cbbdf4e35ae8df9eb8b23f22d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:59.351359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c3911cbbdf4e35ae8df9eb8b23f22d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:59.363289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:59.365182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:59.369703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c3911cbbdf4e35ae8df9eb8b23f22d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:59.371764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c3911cbbdf4e35ae8df9eb8b23f22d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:59.380902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1303/2587] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:03:59.381940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c3911cbbdf4e35ae8df9eb8b23f22d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:03:59.403214 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1285/2588] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:03:59 2022] DELETE /identity/v3/users/58c3911cbbdf4e35ae8df9eb8b23f22d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:03:59.411107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:59.413115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:59.432052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688a910-9211-4492-b0b7-9465db15d983 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:59.533082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756314ec-7605-4a91-b415-0ce799e56ddf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:59.533862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756314ec-7605-4a91-b415-0ce799e56ddf service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:59.534139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756314ec-7605-4a91-b415-0ce799e56ddf service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:59.534960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756314ec-7605-4a91-b415-0ce799e56ddf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:59.537207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-756314ec-7605-4a91-b415-0ce799e56ddf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:59.554281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756314ec-7605-4a91-b415-0ce799e56ddf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:59.556158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756314ec-7605-4a91-b415-0ce799e56ddf service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:59.572697 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1304/2589] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:03:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:03:59.784381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:03:59.789914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:03:59.927032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdeb96-0f1f-42ea-a453-366c019a1b09 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:03:59.934006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:03:59.935273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:03:59.936239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:03:59.936686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] PATH_INFO: `/v3/projects/7b63c52467494445b437e444a52e075e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:03:59.938494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b63c52467494445b437e444a52e075e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:03:59.941382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:03:59.956225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:00.045886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b63c52467494445b437e444a52e075e', 'request_id': 'req-5408eb32-675a-40bf-81a3-bcd231188923'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.053980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b63c52467494445b437e444a52e075e', 'request_id': 'req-5408eb32-675a-40bf-81a3-bcd231188923'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.071316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b63c52467494445b437e444a52e075e', 'request_id': 'req-5408eb32-675a-40bf-81a3-bcd231188923'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.088154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] The token cache is being invalidate because project 7b63c52467494445b437e444a52e075e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:04:00.088492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.089320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5408eb32-675a-40bf-81a3-bcd231188923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.091655 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1286/2590] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:59 2022] DELETE /identity/v3/projects/7b63c52467494445b437e444a52e075e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:00.097544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01decd48-4865-4386-92c5-03e3bcf1b141 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.098071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01decd48-4865-4386-92c5-03e3bcf1b141 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.098269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01decd48-4865-4386-92c5-03e3bcf1b141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.120825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-01decd48-4865-4386-92c5-03e3bcf1b141 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:00.122512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-01decd48-4865-4386-92c5-03e3bcf1b141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:00.214548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05be8c-0985-4063-929e-08e0315808a7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.215851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05be8c-0985-4063-929e-08e0315808a7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.217086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05be8c-0985-4063-929e-08e0315808a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.225627 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1305/2591] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:00.287992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3c05be8c-0985-4063-929e-08e0315808a7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:00.289427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3c05be8c-0985-4063-929e-08e0315808a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:00.297392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.297805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.298081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.302359 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1306/2592] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:04:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:00.307943 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1287/2593] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:04:00.309527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:04:00.312239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05be8c-0985-4063-929e-08e0315808a7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.317795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:00.324612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05be8c-0985-4063-929e-08e0315808a7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.332590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.333227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.333885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.334232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.335066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:04:00.335507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.338278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.358127 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1288/2594] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:04:00.362748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.378902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab89a41-cb27-4f69-9895-7faf52c3e306 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.384680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.385501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.385792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.386366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.387086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.389186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.390340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:00.429127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.431297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:00.436594 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1289/2595] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:04:00 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:00.436922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.551341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ae7b-d593-4851-bfbc-cd1d634bfad1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.557352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.558249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.558710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.559558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.560432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.563921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.574292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c2de2-f610-4478-93df-86cc59b8d51a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.596016 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1290/2596] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:04:00 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:00.600214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.629059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa807b-7d63-4b48-9b80-401d0350cd4d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.641351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.643326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.643518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.643779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.644672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.647021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.667925 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1291/2597] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:00.672197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.677694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.678975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.679260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.679528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/4ae82f501733415e89a0c98820b2e653` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.681871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=4ae82f501733415e89a0c98820b2e653)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.685760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.688400 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1307/2598] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:04:00 2022] GET /identity/v3/projects/4ae82f501733415e89a0c98820b2e653 => generated 367 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:04:00.688543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa221ee-620a-4afb-a13c-cca491e64e59 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.694101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.694906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.695271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.695645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.696502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.698414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.718018 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1292/2599] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:00.723363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.737051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:00.738605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdf03f-0364-4a66-a7e9-beb571a412bb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.756500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670553c-1a9a-4860-8051-968f8d6d8959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.757506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670553c-1a9a-4860-8051-968f8d6d8959 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.757782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670553c-1a9a-4860-8051-968f8d6d8959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.758056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670553c-1a9a-4860-8051-968f8d6d8959 admin admin] PATH_INFO: `/v3/projects/40e3c1170ca7453d94bd37157475dca2/users/c0b7f548b6bc46e1983a955e1c900fb9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.762668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655b0c-9621-4ebf-8260-7283b6146283 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:00.779064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:00.780165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.780461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.780738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/users/30f0b3c317bc49ef99dd5ba17975b197` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.781625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670553c-1a9a-4860-8051-968f8d6d8959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e3c1170ca7453d94bd37157475dca2, user_id=c0b7f548b6bc46e1983a955e1c900fb9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.784778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670553c-1a9a-4860-8051-968f8d6d8959 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.815498 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1308/2600] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:04:00 2022] PUT /identity/v3/projects/40e3c1170ca7453d94bd37157475dca2/users/c0b7f548b6bc46e1983a955e1c900fb9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:00.817027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:delete_user(user_id=30f0b3c317bc49ef99dd5ba17975b197)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:00.819565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:00.829144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:00.832749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:00.833241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:00.855169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:00.925743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] MFA Rules not processed for user `c0b7f548b6bc46e1983a955e1c900fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:00.926997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:00.937089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f0b3c317bc49ef99dd5ba17975b197'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.939611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f0b3c317bc49ef99dd5ba17975b197'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.967767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f0b3c317bc49ef99dd5ba17975b197'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.968630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f0b3c317bc49ef99dd5ba17975b197'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:00.980112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f0b3c317bc49ef99dd5ba17975b197'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:01.009930 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1293/2601] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:04:00 2022] DELETE /identity/v3/users/30f0b3c317bc49ef99dd5ba17975b197 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:01.011949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:01.014498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:01.022901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:01.049706 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1309/2602] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:01.152205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed2cdb-25f7-4173-8106-4f9980c83711 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:01.167304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:01.168397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:01.169137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:01.169480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/4ae82f501733415e89a0c98820b2e653` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:01.170914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ae82f501733415e89a0c98820b2e653)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:01.173415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:01.296863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae82f501733415e89a0c98820b2e653', 'request_id': 'req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:01.314699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae82f501733415e89a0c98820b2e653', 'request_id': 'req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:01.341484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae82f501733415e89a0c98820b2e653', 'request_id': 'req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:01.356521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] The token cache is being invalidate because project 4ae82f501733415e89a0c98820b2e653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:04:01.356852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:01.357630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4dc63fed-cb0b-4bbf-92f1-8c0bf2726965 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:01.365291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1294/2603] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:01 2022] DELETE /identity/v3/projects/4ae82f501733415e89a0c98820b2e653 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:04:02.323862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:02.325348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:02.423402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235acc-2e84-4010-956a-eb5f1f953509 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:02.508185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:02.509790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:02.509790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:02.510137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:02.512210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:02.573525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:02.575147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:02.584753 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1310/2604] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:02.637739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2e54-6731-4338-b2e6-0aa6f61e8669 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:02.638298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2e54-6731-4338-b2e6-0aa6f61e8669 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:02.638298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa2e54-6731-4338-b2e6-0aa6f61e8669 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:02.639715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1295/2605] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:02.645152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:04:02.646706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:02.661800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:02.663063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:02.702229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:02.736193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6644bb-449e-4ae1-8b30-7972c73e0ef4 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:02.741435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:02.742311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:02.742594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:02.742879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/18f2d50ee9b74209b100e2fb806ca813` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:02.744133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=18f2d50ee9b74209b100e2fb806ca813)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:02.746268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:02.748026 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1311/2606] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:04:02 2022] GET /identity/v3/projects/18f2d50ee9b74209b100e2fb806ca813 => generated 373 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:04:03.156264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa604b-ee48-4835-8911-adc6c3fb7495 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:03.156658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa604b-ee48-4835-8911-adc6c3fb7495 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:03.157016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa604b-ee48-4835-8911-adc6c3fb7495 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:03.158610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1296/2607] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:03.164110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:04:03.178791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:03.189007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092a86f-0b95-42a1-9f45-38578a0ca0c5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:03.195426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:03.196315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:03.196628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:03.196936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/18f2d50ee9b74209b100e2fb806ca813` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:03.198176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=18f2d50ee9b74209b100e2fb806ca813)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:03.200242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:03.206581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1312/2608] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:04:03 2022] GET /identity/v3/projects/18f2d50ee9b74209b100e2fb806ca813 => generated 373 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:04:03.986137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123965b0-5462-4aaa-b5f3-3361347949e9 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:03.986646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123965b0-5462-4aaa-b5f3-3361347949e9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:03.986646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123965b0-5462-4aaa-b5f3-3361347949e9 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:03.988055 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1297/2609] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:03.993777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:04:03.995689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:04.016058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:04.035230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d54a-ccd5-4444-be0b-e96f6dc3667a tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:04.041011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2db56-84a2-46eb-bfc9-b25a2227e3f5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05667c4717684b13b60f93a6597965f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2a5c75dce40456cb07a94832527b262', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:04.042020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2db56-84a2-46eb-bfc9-b25a2227e3f5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:04.042373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2db56-84a2-46eb-bfc9-b25a2227e3f5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:04.042713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2db56-84a2-46eb-bfc9-b25a2227e3f5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] PATH_INFO: `/v3/projects/18f2d50ee9b74209b100e2fb806ca813` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:04.044380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2db56-84a2-46eb-bfc9-b25a2227e3f5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorizing `identity:get_project(project_id=18f2d50ee9b74209b100e2fb806ca813)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:04.046717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2db56-84a2-46eb-bfc9-b25a2227e3f5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:04.049095 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1313/2610] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:04:03 2022] GET /identity/v3/projects/18f2d50ee9b74209b100e2fb806ca813 => generated 373 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:04:04.517518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123965b0-5462-4aaa-b5f3-3361347949e9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:04.519540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-123965b0-5462-4aaa-b5f3-3361347949e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:04.583528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:04.694292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123965b0-5462-4aaa-b5f3-3361347949e9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:04.700416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:04.701409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:04.701678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:04.701951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] PATH_INFO: `/v3/users/d21544edc78a4b44904ac2c9a5caa791` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:04.703183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21544edc78a4b44904ac2c9a5caa791)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:04.705293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:04.762685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21544edc78a4b44904ac2c9a5caa791'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:04.763378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21544edc78a4b44904ac2c9a5caa791'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:04.785917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21544edc78a4b44904ac2c9a5caa791'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:04.786930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21544edc78a4b44904ac2c9a5caa791'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:04.794646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21544edc78a4b44904ac2c9a5caa791'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:04.808427 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1298/2611] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:04:04 2022] DELETE /identity/v3/users/d21544edc78a4b44904ac2c9a5caa791 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:04.813631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:04.814007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:04.814354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:04.832923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:04.834186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:04.899629 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1314/2612] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:04:04.911344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:04.913845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.003417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:05.004491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.025075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7949df-b34a-4aba-adab-6a8e7336ef70 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:05.029755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85937ad2-2489-465d-bde5-cb7940536da9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:05.035428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:05.036741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.037209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.037566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] PATH_INFO: `/v3/users/c0b7f548b6bc46e1983a955e1c900fb9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.039596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8818fd-f97d-4945-a2e1-7ea88c56b25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:05.040274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8818fd-f97d-4945-a2e1-7ea88c56b25d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.040580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8818fd-f97d-4945-a2e1-7ea88c56b25d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.040907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8818fd-f97d-4945-a2e1-7ea88c56b25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.045329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b7f548b6bc46e1983a955e1c900fb9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:05.051117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8818fd-f97d-4945-a2e1-7ea88c56b25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:05.052910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:05.053131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8818fd-f97d-4945-a2e1-7ea88c56b25d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:05.068063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1299/2613] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:05.159823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b7f548b6bc46e1983a955e1c900fb9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.160939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b7f548b6bc46e1983a955e1c900fb9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.196181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b7f548b6bc46e1983a955e1c900fb9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.197706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b7f548b6bc46e1983a955e1c900fb9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.208017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b7f548b6bc46e1983a955e1c900fb9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.226979 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1315/2614] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:04:05 2022] DELETE /identity/v3/users/c0b7f548b6bc46e1983a955e1c900fb9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:05.235052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.235525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.236860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.265505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:05.267594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.312256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:05.351524 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1300/2615] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:04:05.363557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:05.365672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.401134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:05.447589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e571f5-2ba7-4e16-ba47-82b3aea13b40 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:05.452252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:05.453097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.453450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.453732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.470384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:05.471988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.477396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:05.479506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:05.490420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204fdb5-195d-495f-aea1-ec91e23920e9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:05.503276 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1316/2616] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:05.509568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:05.510735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.511226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.511709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] PATH_INFO: `/v3/projects/18f2d50ee9b74209b100e2fb806ca813` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.513327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f2d50ee9b74209b100e2fb806ca813)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:05.515781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:05.578105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f2d50ee9b74209b100e2fb806ca813', 'request_id': 'req-82c4966b-6907-413b-a1b2-0a6deca3fce0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.585439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f2d50ee9b74209b100e2fb806ca813', 'request_id': 'req-82c4966b-6907-413b-a1b2-0a6deca3fce0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.595045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f2d50ee9b74209b100e2fb806ca813', 'request_id': 'req-82c4966b-6907-413b-a1b2-0a6deca3fce0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.610299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] The token cache is being invalidate because project 18f2d50ee9b74209b100e2fb806ca813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:04:05.611489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.612246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-82c4966b-6907-413b-a1b2-0a6deca3fce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.618047 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1301/2617] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:05 2022] DELETE /identity/v3/projects/18f2d50ee9b74209b100e2fb806ca813 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:04:05.619969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:05.630932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa48b5-78c3-4b97-b015-11e2f5cbf2ac service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:05.728467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:05.729516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.729795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.730067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] PATH_INFO: `/v3/users/05667c4717684b13b60f93a6597965f3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.733702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05667c4717684b13b60f93a6597965f3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:05.738321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc7b0-cd70-4466-871f-466f9d99dcda None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.738509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:05.738729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc7b0-cd70-4466-871f-466f9d99dcda None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.738997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc7b0-cd70-4466-871f-466f9d99dcda None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.740402 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1302/2618] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:05.748857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:05.749997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:05.750296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:05.772960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:05.774466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.804691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05667c4717684b13b60f93a6597965f3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.806088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05667c4717684b13b60f93a6597965f3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.834801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05667c4717684b13b60f93a6597965f3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.836758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05667c4717684b13b60f93a6597965f3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.848486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05667c4717684b13b60f93a6597965f3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:05.856381 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1303/2619] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:04:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:04:05.880067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1317/2620] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:04:05 2022] DELETE /identity/v3/users/05667c4717684b13b60f93a6597965f3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:04:05.885479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:05.887566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.895029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:05.897191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:05.904774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e339-1cb6-431e-9f42-a0ff8e9f8f09 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:05.968769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:05.993014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8659a70-f371-49ef-b1f6-9dce511d9e3c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:05.999158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.000296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.000601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.000876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] PATH_INFO: `/v3/projects/40e3c1170ca7453d94bd37157475dca2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.002144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e3c1170ca7453d94bd37157475dca2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.004141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.072825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:06.075593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e3c1170ca7453d94bd37157475dca2', 'request_id': 'req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.083751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56599e-55e2-48ca-b49a-ea98ce89db72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.084939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56599e-55e2-48ca-b49a-ea98ce89db72 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.084939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56599e-55e2-48ca-b49a-ea98ce89db72 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.085786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56599e-55e2-48ca-b49a-ea98ce89db72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.093162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e3c1170ca7453d94bd37157475dca2', 'request_id': 'req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.104665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e3c1170ca7453d94bd37157475dca2', 'request_id': 'req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.106016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56599e-55e2-48ca-b49a-ea98ce89db72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.107738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56599e-55e2-48ca-b49a-ea98ce89db72 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.124335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] The token cache is being invalidate because project 40e3c1170ca7453d94bd37157475dca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:04:06.128596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.131652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b538bb7b-cdc5-410f-b7c7-ab6e1c6882e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.136422 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1304/2621] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:06.136915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1318/2622] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:05 2022] DELETE /identity/v3/projects/40e3c1170ca7453d94bd37157475dca2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:06.142311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.142813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.143252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.180840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:06.182635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:06.314455 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1319/2623] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:06.316305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87519f5b-2d8c-412e-b1dd-02022cce7fc0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.316689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87519f5b-2d8c-412e-b1dd-02022cce7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.316970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87519f5b-2d8c-412e-b1dd-02022cce7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.328746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.330485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:06.352291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8b377-0812-494a-bc40-cce6b642817f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.361463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.362651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.363691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.367292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-87519f5b-2d8c-412e-b1dd-02022cce7fc0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:06.371198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-87519f5b-2d8c-412e-b1dd-02022cce7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:06.371819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] PATH_INFO: `/v3/projects/d2a5c75dce40456cb07a94832527b262` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.373543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a5c75dce40456cb07a94832527b262)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.375803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.382673 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1305/2624] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:06.387253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87519f5b-2d8c-412e-b1dd-02022cce7fc0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.407034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87519f5b-2d8c-412e-b1dd-02022cce7fc0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.414606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350902-556d-4af8-9227-384344697274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.415593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350902-556d-4af8-9227-384344697274 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.416168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350902-556d-4af8-9227-384344697274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.416723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350902-556d-4af8-9227-384344697274 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.418287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c350902-556d-4af8-9227-384344697274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:04:06.419121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c350902-556d-4af8-9227-384344697274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.421209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c350902-556d-4af8-9227-384344697274 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.444128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1306/2625] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:04:06.450297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350902-556d-4af8-9227-384344697274 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.474974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350902-556d-4af8-9227-384344697274 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.488832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a5c75dce40456cb07a94832527b262', 'request_id': 'req-052a7d99-737c-4daa-af71-7f168e7514ae'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.498276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a5c75dce40456cb07a94832527b262', 'request_id': 'req-052a7d99-737c-4daa-af71-7f168e7514ae'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.510617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a5c75dce40456cb07a94832527b262', 'request_id': 'req-052a7d99-737c-4daa-af71-7f168e7514ae'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.528650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] The token cache is being invalidate because project d2a5c75dce40456cb07a94832527b262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:04:06.529178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.529862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-052a7d99-737c-4daa-af71-7f168e7514ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:06.533093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1320/2626] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:06 2022] DELETE /identity/v3/projects/d2a5c75dce40456cb07a94832527b262 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:04:06.539926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef488-2431-434d-bc20-c51c9e1c1473 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.540213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef488-2431-434d-bc20-c51c9e1c1473 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.540510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef488-2431-434d-bc20-c51c9e1c1473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.549845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:06.574064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9f3ef488-2431-434d-bc20-c51c9e1c1473 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:06.576559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9f3ef488-2431-434d-bc20-c51c9e1c1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:06.641784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.642491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.642786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.643063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.643779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.646477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.680521 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1307/2627] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:06.684063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.687726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:06.708669 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1321/2628] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:06.717375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd575c-0d86-4133-a7a0-85922507ccc3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.717663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd575c-0d86-4133-a7a0-85922507ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.717939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd575c-0d86-4133-a7a0-85922507ccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.737227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d6dd575c-0d86-4133-a7a0-85922507ccc3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:06.738434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d6dd575c-0d86-4133-a7a0-85922507ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:06.766593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c733c1-884f-471a-83bf-dcf4b500ea03 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.771348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.772038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.772314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.772626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.773382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.775471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.800589 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1308/2629] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:04:06.804724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.809729 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1322/2630] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:06.815631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd575c-0d86-4133-a7a0-85922507ccc3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.819207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d10d-69bf-49d9-8806-01189e1ff582 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.825700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd575c-0d86-4133-a7a0-85922507ccc3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.828243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.829182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.829446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.829728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.830473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.832080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.839165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.841290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.841290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.841290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.842191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:04:06.842502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.843829 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1309/2631] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:04:06.844156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.848785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.858743 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1323/2632] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:04:06.863878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.864388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb058d-0ed2-41d5-8eca-be8c925de24a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.870467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.871147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.871638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.871925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.872911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.874502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.884415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d5559-318a-41b5-8b7e-90be523f449e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.887040 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1310/2633] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:06.891412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.891896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.892384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.892671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.893219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.893920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.895828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.903476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c38142-95d7-40ef-8d6a-2ce59dd14138 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:06.908549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc0aef-1c01-423c-ab23-011a6a9d5456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:06.909650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0aef-1c01-423c-ab23-011a6a9d5456 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.910004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0aef-1c01-423c-ab23-011a6a9d5456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.910353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0aef-1c01-423c-ab23-011a6a9d5456 admin admin] PATH_INFO: `/v3/projects/1821f70f45ef4861bb8d49faaba64b20/users/1e85a218336047078ebb040193bd24a9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:06.932016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0aef-1c01-423c-ab23-011a6a9d5456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1821f70f45ef4861bb8d49faaba64b20, user_id=1e85a218336047078ebb040193bd24a9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:06.935000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0aef-1c01-423c-ab23-011a6a9d5456 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:06.943543 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1324/2634] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:06.945957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:06.952111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:06.961224 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1311/2635] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:04:06 2022] PUT /identity/v3/projects/1821f70f45ef4861bb8d49faaba64b20/users/1e85a218336047078ebb040193bd24a9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:06.967992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:06.969589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:06.970057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.001810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:07.003651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:07.095716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7773b-a070-48d6-82f9-879a4c37c504 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.117513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:07.206952 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1312/2636] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:07.234569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:07.236577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:07.249964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.252257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.253392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.254236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.257478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.261787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:07.307779 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1325/2637] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:04:06 2022] POST /identity/v3/users => generated 288 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:04:07.309213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:07.328143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91055b5-66a5-44ce-9230-a06641120cc8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.333458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.351916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.352233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.352492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.354906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.357852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:07.378144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1326/2638] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:07.379876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:07.391790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc80f44-a917-4b7b-ad37-86742a3b2967 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.395409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eaf6c-3df5-4055-87c4-715bc2387ff8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.397418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.398443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.398888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.399435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.400422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.400636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef8a77-6240-46c5-a41d-8775c8192d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.401461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef8a77-6240-46c5-a41d-8775c8192d58 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.401814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef8a77-6240-46c5-a41d-8775c8192d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.402228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef8a77-6240-46c5-a41d-8775c8192d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.403031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:07.418885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef8a77-6240-46c5-a41d-8775c8192d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.419673 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1327/2639] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:07.421479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:07.422054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef8a77-6240-46c5-a41d-8775c8192d58 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:07.438614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc17dc-49cf-421b-98cf-85f582d9cbf8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.439628 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1313/2640] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:07.446718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.447692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.450518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.450518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] PATH_INFO: `/v3/projects/24245a540466462bb9a908267f505f28/users/f8783e0de2414f20ade6604bd0089fab/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.470359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24245a540466462bb9a908267f505f28, user_id=f8783e0de2414f20ade6604bd0089fab, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.473520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:07.491209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1328/2641] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:04:07 2022] PUT /identity/v3/projects/24245a540466462bb9a908267f505f28/users/f8783e0de2414f20ade6604bd0089fab/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:07.504945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c2bd-4546-48ee-bd14-ee7165a6ebdd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.505984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c2bd-4546-48ee-bd14-ee7165a6ebdd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.506281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0c2bd-4546-48ee-bd14-ee7165a6ebdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.564735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8fc0c2bd-4546-48ee-bd14-ee7165a6ebdd None None] MFA Rules not processed for user `f8783e0de2414f20ade6604bd0089fab`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:07.567611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8fc0c2bd-4546-48ee-bd14-ee7165a6ebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:07.673545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1314/2642] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:04:07.678590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:07.759620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16714ef-6066-461c-b17b-3a69a253143f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.765517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.766199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.767155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.768188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.769375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.771892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:07.811966 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1329/2643] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:04:07 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:07.813252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0c2bd-4546-48ee-bd14-ee7165a6ebdd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:07.829508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0c2bd-4546-48ee-bd14-ee7165a6ebdd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.879451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:07.918918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.919752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.920098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.920438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.921381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.923953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:07.958384 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1315/2644] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:04:07 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:04:07.962038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:07.980546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b62570-2abe-4726-8623-cb84d2c02611 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:07.985918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:07.987042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:07.987491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:07.987862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:07.988766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:07.990833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:08.006812 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1330/2645] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:08.009617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:08.023568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2d5ce-708c-48e6-b0dd-decc8a6ed990 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:08.031532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:08.032466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:08.032752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:08.033047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] PATH_INFO: `/v3/projects/a6a5988d0538426288555ee3fc2bfec4/users/4fbe8bdaf5d54ddcac851d92ae9b1a7c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:08.050302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a5988d0538426288555ee3fc2bfec4, user_id=4fbe8bdaf5d54ddcac851d92ae9b1a7c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:08.053068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:08.078362 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1316/2646] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:04:08 2022] PUT /identity/v3/projects/a6a5988d0538426288555ee3fc2bfec4/users/4fbe8bdaf5d54ddcac851d92ae9b1a7c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:08.079994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:08.091091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7679bb-db38-48a3-83ba-89d04b9329c0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:08.127161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:08.157625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f843a8-dad5-4433-b75c-2524f2e441ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:08.158485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f843a8-dad5-4433-b75c-2524f2e441ca admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:08.158860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f843a8-dad5-4433-b75c-2524f2e441ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:08.159227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f843a8-dad5-4433-b75c-2524f2e441ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:08.160383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f843a8-dad5-4433-b75c-2524f2e441ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:08.162242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f843a8-dad5-4433-b75c-2524f2e441ca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:08.174012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1331/2647] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:08.178368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:08.196459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238b18-5da8-4619-86bd-2d1c20d612ad admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:08.204282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447745d5-8d8e-467a-8044-b39490a7899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:08.205670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447745d5-8d8e-467a-8044-b39490a7899d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:08.206156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447745d5-8d8e-467a-8044-b39490a7899d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:08.206661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447745d5-8d8e-467a-8044-b39490a7899d admin admin] PATH_INFO: `/v3/projects/a6a5988d0538426288555ee3fc2bfec4/users/4fbe8bdaf5d54ddcac851d92ae9b1a7c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:08.209627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447745d5-8d8e-467a-8044-b39490a7899d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a5988d0538426288555ee3fc2bfec4, user_id=4fbe8bdaf5d54ddcac851d92ae9b1a7c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:08.213791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447745d5-8d8e-467a-8044-b39490a7899d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:08.236165 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1317/2648] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:04:08 2022] PUT /identity/v3/projects/a6a5988d0538426288555ee3fc2bfec4/users/4fbe8bdaf5d54ddcac851d92ae9b1a7c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:08.238127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:08.238526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:08.238916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:08.276582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] MFA Rules not processed for user `4fbe8bdaf5d54ddcac851d92ae9b1a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:08.278176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:08.405857 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1332/2649] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:04:08.419709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:08.420085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:08.420376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:08.442122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] MFA Rules not processed for user `f8783e0de2414f20ade6604bd0089fab`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:08.446935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:08.535355 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1318/2650] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:09.484357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:09.487144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:09.670344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99c64-0764-4d3e-9910-a77e4dae8c06 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:09.683344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b89ba0-c2ef-4108-9157-99f5c9a2d8c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:09.685311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89ba0-c2ef-4108-9157-99f5c9a2d8c2 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:09.685931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89ba0-c2ef-4108-9157-99f5c9a2d8c2 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:09.687018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89ba0-c2ef-4108-9157-99f5c9a2d8c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:09.694093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-63b89ba0-c2ef-4108-9157-99f5c9a2d8c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:09.721917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b89ba0-c2ef-4108-9157-99f5c9a2d8c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:09.728637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b89ba0-c2ef-4108-9157-99f5c9a2d8c2 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:09.759163 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1333/2651] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:10.136783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:10.137423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:10.335585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64eaff-56eb-4862-ac5d-8d0f9a6af356 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:10.343599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29533572-46ce-4f8d-93f4-c1a1c86b178f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:10.344743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29533572-46ce-4f8d-93f4-c1a1c86b178f service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:10.345233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29533572-46ce-4f8d-93f4-c1a1c86b178f service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:10.345683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29533572-46ce-4f8d-93f4-c1a1c86b178f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:10.357435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29533572-46ce-4f8d-93f4-c1a1c86b178f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:10.359521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29533572-46ce-4f8d-93f4-c1a1c86b178f service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:10.392461 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1319/2652] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:11.550458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b4d5-bfa1-4a8e-8d6e-dc0a8423b8d8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:11.551068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b4d5-bfa1-4a8e-8d6e-dc0a8423b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:11.551068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768b4d5-bfa1-4a8e-8d6e-dc0a8423b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:11.618925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8768b4d5-bfa1-4a8e-8d6e-dc0a8423b8d8 None None] MFA Rules not processed for user `f8783e0de2414f20ade6604bd0089fab`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:11.622100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8768b4d5-bfa1-4a8e-8d6e-dc0a8423b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:11.669799 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1334/2653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:16.830552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408de5-d6d4-409c-b0ea-aa6032553de1 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:16.831062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408de5-d6d4-409c-b0ea-aa6032553de1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:16.831529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408de5-d6d4-409c-b0ea-aa6032553de1 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:16.834126 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1320/2654] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:04:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:16.847470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8c34-87c8-4c87-bb74-f6c457ad5e0a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:16.848336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8c34-87c8-4c87-bb74-f6c457ad5e0a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:16.848814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8c34-87c8-4c87-bb74-f6c457ad5e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:16.892006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-893a8c34-87c8-4c87-bb74-f6c457ad5e0a None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:16.896614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-893a8c34-87c8-4c87-bb74-f6c457ad5e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:16.922478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1335/2655] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:04:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:16.973297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408de5-d6d4-409c-b0ea-aa6032553de1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:16.990653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408de5-d6d4-409c-b0ea-aa6032553de1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:16.998476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5907c1-785c-463b-bb49-35be778a4520 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:16.999690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5907c1-785c-463b-bb49-35be778a4520 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:16.999989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5907c1-785c-463b-bb49-35be778a4520 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:17.000433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5907c1-785c-463b-bb49-35be778a4520 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:17.013219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5907c1-785c-463b-bb49-35be778a4520 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:17.014844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5907c1-785c-463b-bb49-35be778a4520 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:17.023023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:17.039711 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1321/2656] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:17.078417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7256-8373-49c2-b6f7-229a5c38a1d3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:17.078699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7256-8373-49c2-b6f7-229a5c38a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:17.078978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7256-8373-49c2-b6f7-229a5c38a1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:17.114606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-340d7256-8373-49c2-b6f7-229a5c38a1d3 None None] MFA Rules not processed for user `1e85a218336047078ebb040193bd24a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:17.115986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-340d7256-8373-49c2-b6f7-229a5c38a1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:17.145998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:17.278166 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1336/2657] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:17.293161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40c32a-43a8-428a-b219-def9c6018775 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:17.293437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40c32a-43a8-428a-b219-def9c6018775 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:17.293713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40c32a-43a8-428a-b219-def9c6018775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:17.337150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2d40c32a-43a8-428a-b219-def9c6018775 None None] MFA Rules not processed for user `1e85a218336047078ebb040193bd24a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:17.340266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2d40c32a-43a8-428a-b219-def9c6018775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:17.360513 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1322/2658] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:18.177412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa803eac-fb6f-454f-8b98-9cc74d5ba572 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:18.177910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa803eac-fb6f-454f-8b98-9cc74d5ba572 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:18.178194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa803eac-fb6f-454f-8b98-9cc74d5ba572 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:18.180198 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1337/2659] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:18.185760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:18.186299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:18.186299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:18.221658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:18.222939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:18.236617 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1323/2660] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:04:18.249412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa803eac-fb6f-454f-8b98-9cc74d5ba572 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:18.251539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fa803eac-fb6f-454f-8b98-9cc74d5ba572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:18.270663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa803eac-fb6f-454f-8b98-9cc74d5ba572 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:18.276888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39a8b5-d482-401f-9acd-6d3ed07e2af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:18.277968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a8b5-d482-401f-9acd-6d3ed07e2af8 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:18.278596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a8b5-d482-401f-9acd-6d3ed07e2af8 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:18.279125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a8b5-d482-401f-9acd-6d3ed07e2af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:18.290267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39a8b5-d482-401f-9acd-6d3ed07e2af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:18.292509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39a8b5-d482-401f-9acd-6d3ed07e2af8 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:18.304735 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1338/2661] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:18.314665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:18.316292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:18.454681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13453-c5f1-481a-82bd-15af3d8c7ac5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:18.459717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:18.460899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:18.461350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:18.461731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:18.474619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:18.476436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:18.491650 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1324/2662] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:18.815291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963809cf-f197-4528-b702-4639e26466a4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:18.815883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963809cf-f197-4528-b702-4639e26466a4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:18.817011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963809cf-f197-4528-b702-4639e26466a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:18.859040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-963809cf-f197-4528-b702-4639e26466a4 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:18.863469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-963809cf-f197-4528-b702-4639e26466a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:18.893553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1339/2663] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:04:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:18.922142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:18.938955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8638576-7513-4a08-9cd2-422751dd3df6 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:18.953985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ca307-fd7c-4b12-998b-585e70ea752d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:18.954399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ca307-fd7c-4b12-998b-585e70ea752d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:18.954601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ca307-fd7c-4b12-998b-585e70ea752d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:18.954882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ca307-fd7c-4b12-998b-585e70ea752d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:18.987953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ca307-fd7c-4b12-998b-585e70ea752d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:19.003288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ca307-fd7c-4b12-998b-585e70ea752d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:19.020577 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1325/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:23.078690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:23.079788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:23.080257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:23.121323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] MFA Rules not processed for user `545b6c16175f418587d6c8649b3ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:23.122992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:23.221112 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1340/2665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:27.598471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675e2d-d45e-46f6-b655-48fad1932fe6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:27.598932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675e2d-d45e-46f6-b655-48fad1932fe6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:27.599041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675e2d-d45e-46f6-b655-48fad1932fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:27.633858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b8675e2d-d45e-46f6-b655-48fad1932fe6 None None] MFA Rules not processed for user `681cfb0e560145b4abef98dbd417f3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:27.635100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b8675e2d-d45e-46f6-b655-48fad1932fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:27.772388 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1326/2666] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:31.935651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:31.937320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:32.078967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789c3d-da2a-4734-b1de-dc2cf7aecb3f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:32.083998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:32.085109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:32.085583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:32.086203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] PATH_INFO: `/v3/users/db0ce8caf601458c94d03b85b37e4371` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:32.087678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0ce8caf601458c94d03b85b37e4371)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:32.090012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:32.186328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0ce8caf601458c94d03b85b37e4371'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:32.187275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0ce8caf601458c94d03b85b37e4371'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:32.189301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:32.215068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0ce8caf601458c94d03b85b37e4371'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:32.216226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0ce8caf601458c94d03b85b37e4371'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:32.227865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87d794e6-00ea-4ed7-a744-0551b9be527e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0ce8caf601458c94d03b85b37e4371'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:32.251347 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1341/2667] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:04:31 2022] DELETE /identity/v3/users/db0ce8caf601458c94d03b85b37e4371 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:32.810271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675e2d-d45e-46f6-b655-48fad1932fe6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:32.824990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675e2d-d45e-46f6-b655-48fad1932fe6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:32.976496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:32.980912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:32.982028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:32.982661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] PATH_INFO: `/v3/projects/c5893b4b7c9c49bf87729b506675446e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:32.986057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5893b4b7c9c49bf87729b506675446e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:33.001404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:33.067607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:33.110156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5893b4b7c9c49bf87729b506675446e', 'request_id': 'req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:33.131726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5893b4b7c9c49bf87729b506675446e', 'request_id': 'req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:33.148108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5893b4b7c9c49bf87729b506675446e', 'request_id': 'req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:33.172678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] The token cache is being invalidate because project c5893b4b7c9c49bf87729b506675446e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:04:33.174128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:33.178043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a446452-bbc3-446f-8c0d-ba6ec2c5b144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:33.186302 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1327/2668] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:32 2022] DELETE /identity/v3/projects/c5893b4b7c9c49bf87729b506675446e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:33.188529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60eea-69dc-41ea-a81f-88f06de8d584 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.189070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60eea-69dc-41ea-a81f-88f06de8d584 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.189205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f60eea-69dc-41ea-a81f-88f06de8d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.223647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f4f60eea-69dc-41ea-a81f-88f06de8d584 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:33.224908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f4f60eea-69dc-41ea-a81f-88f06de8d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:33.319595 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1342/2669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:33.327291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2082ad-6d06-4cda-bac3-9ed404475662 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.327663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2082ad-6d06-4cda-bac3-9ed404475662 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.328021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2082ad-6d06-4cda-bac3-9ed404475662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.349509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3a2082ad-6d06-4cda-bac3-9ed404475662 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:33.353956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3a2082ad-6d06-4cda-bac3-9ed404475662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:33.366106 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1328/2670] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:33.370177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f60eea-69dc-41ea-a81f-88f06de8d584 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:33.388141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f60eea-69dc-41ea-a81f-88f06de8d584 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:33.397012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:33.398112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.398567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.399363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.400411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:04:33.401263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:33.403651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:33.426974 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1343/2671] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:04:33.428372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2082ad-6d06-4cda-bac3-9ed404475662 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:33.443251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2082ad-6d06-4cda-bac3-9ed404475662 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:33.451428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:33.452835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.453380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.453879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.455237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:33.458996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:33.531409 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1329/2672] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:04:33 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:04:33.535717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:33.547173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53210bb-2511-457c-94f4-2134b8fa8e26 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:33.650873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:33.653067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.653365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.653646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.654554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:33.656663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:33.689435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:33.690828 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1344/2673] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:04:33 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:33.704005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a14c-0051-438e-bff6-1284e8f3f40d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:33.709786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:33.711131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.711478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.711813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.712572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:33.714690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:33.733197 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1330/2674] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:04:33.734811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:33.747162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d2a2-faf9-4ba2-91c7-0035c954f018 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:33.752672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e7d3e-69c2-414c-9d9c-3841d923a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:33.753595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7d3e-69c2-414c-9d9c-3841d923a1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.753882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7d3e-69c2-414c-9d9c-3841d923a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.754159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7d3e-69c2-414c-9d9c-3841d923a1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.754978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7d3e-69c2-414c-9d9c-3841d923a1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:33.756794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7d3e-69c2-414c-9d9c-3841d923a1d8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:33.768179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1345/2675] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:33.772573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:33.784744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac14464-8236-4148-ac13-ebfe0b07a217 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:33.791642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:33.793692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.794236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.795059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] PATH_INFO: `/v3/projects/e0c1dd409b0646c0bfe6e4e59a3a4e6e/users/1b50d4456513401a9ef5a9e518f770ac/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.812207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c1dd409b0646c0bfe6e4e59a3a4e6e, user_id=1b50d4456513401a9ef5a9e518f770ac, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:33.815707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:33.844670 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1331/2676] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:04:33 2022] PUT /identity/v3/projects/e0c1dd409b0646c0bfe6e4e59a3a4e6e/users/1b50d4456513401a9ef5a9e518f770ac/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:04:33.850038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcf0d-f3e2-43e8-9e7d-adca1ed68c20 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:33.850399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcf0d-f3e2-43e8-9e7d-adca1ed68c20 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:33.850765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcf0d-f3e2-43e8-9e7d-adca1ed68c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:33.869605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-05cbcf0d-f3e2-43e8-9e7d-adca1ed68c20 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:33.871105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05cbcf0d-f3e2-43e8-9e7d-adca1ed68c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:33.909091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:33.972123 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1346/2677] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:33.986912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:33.988725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:34.144467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c496d-267a-4efb-ae5a-1333acbdac4e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:34.151877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e404-fbc3-4d4d-93a1-58325d5f6cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:34.152741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e404-fbc3-4d4d-93a1-58325d5f6cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:34.153199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e404-fbc3-4d4d-93a1-58325d5f6cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:34.153627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e404-fbc3-4d4d-93a1-58325d5f6cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:34.182143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e404-fbc3-4d4d-93a1-58325d5f6cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:34.183863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e404-fbc3-4d4d-93a1-58325d5f6cc9 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:34.197068 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1332/2678] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:36.096081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ccda-ef6e-45ce-8a3c-9b2f6389982a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:36.098557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ccda-ef6e-45ce-8a3c-9b2f6389982a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:36.099418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512ccda-ef6e-45ce-8a3c-9b2f6389982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:36.134111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d512ccda-ef6e-45ce-8a3c-9b2f6389982a None None] MFA Rules not processed for user `f8783e0de2414f20ade6604bd0089fab`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:36.136539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d512ccda-ef6e-45ce-8a3c-9b2f6389982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:36.217881 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1347/2679] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:44.190857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:46.207002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=38 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:46.649432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:46.651857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:46.652155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:46.684020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] MFA Rules not processed for user `545b6c16175f418587d6c8649b3ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:46.685287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:46.761149 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1333/2680] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:49.261160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d193e-3da0-4ef4-9085-8ca7ae355fae None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:49.261757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d193e-3da0-4ef4-9085-8ca7ae355fae None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:49.261757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d193e-3da0-4ef4-9085-8ca7ae355fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:49.312943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-828d193e-3da0-4ef4-9085-8ca7ae355fae None None] MFA Rules not processed for user `1b50d4456513401a9ef5a9e518f770ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:49.314701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-828d193e-3da0-4ef4-9085-8ca7ae355fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:49.452663 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1348/2681] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:49.460677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:49.462752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:49.606167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d8a4-5eb6-481f-8878-de1b450d2dfb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:49.617377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b982cb-4d8b-4b97-a475-861de60a80ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:49.618851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b982cb-4d8b-4b97-a475-861de60a80ec service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:49.619153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b982cb-4d8b-4b97-a475-861de60a80ec service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:49.619809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b982cb-4d8b-4b97-a475-861de60a80ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:49.639968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b982cb-4d8b-4b97-a475-861de60a80ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:49.641824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b982cb-4d8b-4b97-a475-861de60a80ec service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:49.664402 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1334/2682] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:49.827255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:49.827613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:49.827958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:49.853924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] MFA Rules not processed for user `76897f7be7494bb589de747493240449`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:49.855401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:49.980827 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1349/2683] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:57.105506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c93e-b35a-4c2c-b166-7af4c695ebb8 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:57.106553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c93e-b35a-4c2c-b166-7af4c695ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:57.107074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468c93e-b35a-4c2c-b166-7af4c695ebb8 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:57.109253 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1335/2684] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:04:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:04:57.164203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:57.168307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:57.197296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa35d8-b84e-48d6-99b8-150a11eba792 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:57.201862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:57.202396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:57.203141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:57.216215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:57.217590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:57.218419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:57.218913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:57.221416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:57.243202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:57.245382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:57.319892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:57.322167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:57.345082 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1350/2685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:57.374526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:57.376912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:57.392862 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1336/2686] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:04:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:57.406609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2f01a-01cb-474d-bada-1eeac6a33545 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:57.416177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:57.418976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:57.419321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:57.419707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] PATH_INFO: `/v3/users/1e85a218336047078ebb040193bd24a9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:57.421367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e85a218336047078ebb040193bd24a9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:57.423868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:57.434314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:57.435916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:57.458259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909200e-bb04-470b-8ec8-e9302e84ca53 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:57.462963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:57.467642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:57.469162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:57.469751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:57.470241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:57.518114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:57.524180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:57.534788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e85a218336047078ebb040193bd24a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:57.537612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e85a218336047078ebb040193bd24a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:57.554123 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1337/2687] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:04:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:04:57.587363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e85a218336047078ebb040193bd24a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:57.588515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e85a218336047078ebb040193bd24a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:57.606109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d887b43d-13f4-4ed7-a8ce-be866a162b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e85a218336047078ebb040193bd24a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:57.634176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1351/2688] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:04:57 2022] DELETE /identity/v3/users/1e85a218336047078ebb040193bd24a9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:04:58.896633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:58.924501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a5993-3fef-43df-b032-bb9a28f3beff service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:58.938587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:59.060857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:59.062752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.063230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.066903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] PATH_INFO: `/v3/projects/1821f70f45ef4861bb8d49faaba64b20` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.069524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1821f70f45ef4861bb8d49faaba64b20)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:59.072632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:59.134950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1821f70f45ef4861bb8d49faaba64b20', 'request_id': 'req-767aaf3c-e5c3-47b0-81fe-c530a07866e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:59.143362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1821f70f45ef4861bb8d49faaba64b20', 'request_id': 'req-767aaf3c-e5c3-47b0-81fe-c530a07866e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:59.153335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1821f70f45ef4861bb8d49faaba64b20', 'request_id': 'req-767aaf3c-e5c3-47b0-81fe-c530a07866e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:59.165629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] The token cache is being invalidate because project 1821f70f45ef4861bb8d49faaba64b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:04:59.165903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:59.166652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-767aaf3c-e5c3-47b0-81fe-c530a07866e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:04:59.168852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1338/2689] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:58 2022] DELETE /identity/v3/projects/1821f70f45ef4861bb8d49faaba64b20 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:59.173908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9bb48-ca8e-4723-851a-4658231edf48 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.174531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9bb48-ca8e-4723-851a-4658231edf48 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.174531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9bb48-ca8e-4723-851a-4658231edf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.196303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-38c9bb48-ca8e-4723-851a-4658231edf48 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:59.198140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-38c9bb48-ca8e-4723-851a-4658231edf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:59.348590 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1352/2690] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:59.361324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaef47-32ce-4343-97d5-e2fad8126d6a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.362359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaef47-32ce-4343-97d5-e2fad8126d6a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.365937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaef47-32ce-4343-97d5-e2fad8126d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.424098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e3eaef47-32ce-4343-97d5-e2fad8126d6a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:59.426028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3eaef47-32ce-4343-97d5-e2fad8126d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:04:59.444323 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1339/2691] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:04:59.447955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9bb48-ca8e-4723-851a-4658231edf48 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:59.461010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9bb48-ca8e-4723-851a-4658231edf48 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:59.470906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:59.471246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.472650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.472650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.475800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:04:59.475800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:59.476266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:59.491797 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1353/2692] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:04:59.496776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaef47-32ce-4343-97d5-e2fad8126d6a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:59.507654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaef47-32ce-4343-97d5-e2fad8126d6a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:59.517988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:59.521272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.522081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.522519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.524119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:59.526539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:59.573556 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1340/2693] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:04:59 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:59.575356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:59.588169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a4317-3dc5-42b9-882e-db33327d53e5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:59.660355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:59.661124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.661427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.661761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.662506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:59.664591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:59.693236 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1354/2694] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:04:59 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:04:59.695301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:59.707119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6db167-dc72-4c28-a7b2-2fdbe4e86c16 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:59.713429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:59.714278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.714413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.714739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.716299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:59.718153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:59.731007 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1341/2695] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:59.735446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:59.751883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c201a2-0e2e-4486-b413-f5a84772bf17 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:59.757877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb08f8-51a1-4dbd-bfde-021bdc2e0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:59.759222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb08f8-51a1-4dbd-bfde-021bdc2e0bba admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.759222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb08f8-51a1-4dbd-bfde-021bdc2e0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.759222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb08f8-51a1-4dbd-bfde-021bdc2e0bba admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.759870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb08f8-51a1-4dbd-bfde-021bdc2e0bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:59.761729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb08f8-51a1-4dbd-bfde-021bdc2e0bba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:59.777544 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1355/2696] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:04:59.778770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:04:59.791376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a99fe-277c-4f2b-a989-48369e635065 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:04:59.796956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:04:59.797954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.798231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.798675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] PATH_INFO: `/v3/projects/37df598baf854c16997629e2c8d8399a/users/1beb8610e39144788d17f96aaf21dec9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.816397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37df598baf854c16997629e2c8d8399a, user_id=1beb8610e39144788d17f96aaf21dec9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:04:59.819294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:04:59.839316 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1342/2697] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:04:59 2022] PUT /identity/v3/projects/37df598baf854c16997629e2c8d8399a/users/1beb8610e39144788d17f96aaf21dec9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:04:59.850650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be767-ee10-4f52-8dbe-320ad3871584 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:04:59.851321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be767-ee10-4f52-8dbe-320ad3871584 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:04:59.851842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be767-ee10-4f52-8dbe-320ad3871584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:04:59.898651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:59.953178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-992be767-ee10-4f52-8dbe-320ad3871584 None None] MFA Rules not processed for user `1beb8610e39144788d17f96aaf21dec9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:04:59.954428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-992be767-ee10-4f52-8dbe-320ad3871584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:00.133264 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1356/2698] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:04:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:05:00.351377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:00.356782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:00.514715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:00.591596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92571a-53f2-4ee8-ba10-af955442abb4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:00.614291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:00.614291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:00.615535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:00.616005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:00.628588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:00.631435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:00.655169 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1343/2699] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:00.877201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63dc4-34fa-4e6f-8c25-5aa9514282b0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:00.877967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63dc4-34fa-4e6f-8c25-5aa9514282b0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:00.877967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63dc4-34fa-4e6f-8c25-5aa9514282b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:00.933461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-20d63dc4-34fa-4e6f-8c25-5aa9514282b0 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:00.934875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-20d63dc4-34fa-4e6f-8c25-5aa9514282b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:01.096796 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1357/2700] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:05:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:05:01.181171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:01.183123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:01.417301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511318-3288-499a-89f1-39f34b30a75b service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:01.439731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:01.440444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:01.440722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:01.446191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:01.466825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:01.468848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:01.492468 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1344/2701] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:05:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:05:03.346754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63dc4-34fa-4e6f-8c25-5aa9514282b0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:03.380926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:03.382790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:03.557725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63dc4-34fa-4e6f-8c25-5aa9514282b0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:03.584052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:03.585236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:03.585516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:03.585789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] PATH_INFO: `/v3/users/1beb8610e39144788d17f96aaf21dec9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:03.591701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1beb8610e39144788d17f96aaf21dec9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:03.598694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:03.615885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5274-9a3a-4669-8315-a5f2e915a149 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:03.629670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:03.630824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:03.631282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:03.631892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] PATH_INFO: `/v3/users/1b50d4456513401a9ef5a9e518f770ac` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:03.633623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b50d4456513401a9ef5a9e518f770ac)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:03.635967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:03.728337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:03.732943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1beb8610e39144788d17f96aaf21dec9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.735812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1beb8610e39144788d17f96aaf21dec9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.779971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b50d4456513401a9ef5a9e518f770ac'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.781075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b50d4456513401a9ef5a9e518f770ac'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.782163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1beb8610e39144788d17f96aaf21dec9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.788983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1beb8610e39144788d17f96aaf21dec9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.799321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:03.815378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aabb0645-bd46-4a52-9843-c1618ef278b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1beb8610e39144788d17f96aaf21dec9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.816273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b50d4456513401a9ef5a9e518f770ac'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.818277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b50d4456513401a9ef5a9e518f770ac'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.851490 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1358/2702] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:03 2022] DELETE /identity/v3/users/1beb8610e39144788d17f96aaf21dec9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:03.853673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:03.857495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:03.857980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:03.866857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b50d4456513401a9ef5a9e518f770ac'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:03.896780 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1345/2703] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:03 2022] DELETE /identity/v3/users/1b50d4456513401a9ef5a9e518f770ac => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:03.899978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:03.901345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:04.055414 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1359/2704] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:04.076251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:04.078280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:04.229167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d36853-c05f-465b-99be-d18f2d74d077 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:04.239642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24812f8a-62a0-4d2e-93bc-3e90c35104dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:04.242307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812f8a-62a0-4d2e-93bc-3e90c35104dd service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:04.242307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812f8a-62a0-4d2e-93bc-3e90c35104dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:04.242797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24812f8a-62a0-4d2e-93bc-3e90c35104dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:04.267072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24812f8a-62a0-4d2e-93bc-3e90c35104dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:04.270465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24812f8a-62a0-4d2e-93bc-3e90c35104dd service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:04.323012 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1346/2705] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:04.712122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:04.713632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:04.736407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768154c-bd80-4a3a-b2ab-a4f80d1ad46b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:04.758374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:04.759482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:04.759927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:04.760356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] PATH_INFO: `/v3/projects/e0c1dd409b0646c0bfe6e4e59a3a4e6e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:04.763197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c1dd409b0646c0bfe6e4e59a3a4e6e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:04.769915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:04.913269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c1dd409b0646c0bfe6e4e59a3a4e6e', 'request_id': 'req-5e270bdb-3b42-4ba8-a639-651900c8bac4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:04.929756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c1dd409b0646c0bfe6e4e59a3a4e6e', 'request_id': 'req-5e270bdb-3b42-4ba8-a639-651900c8bac4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:04.950512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c1dd409b0646c0bfe6e4e59a3a4e6e', 'request_id': 'req-5e270bdb-3b42-4ba8-a639-651900c8bac4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:04.973797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] The token cache is being invalidate because project e0c1dd409b0646c0bfe6e4e59a3a4e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:04.974091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:04.976900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5e270bdb-3b42-4ba8-a639-651900c8bac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:04.980219 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1360/2706] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:04 2022] DELETE /identity/v3/projects/e0c1dd409b0646c0bfe6e4e59a3a4e6e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:04.985616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45caee-54d1-4cb7-ab32-de50923d0e9e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:04.986159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45caee-54d1-4cb7-ab32-de50923d0e9e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:04.986159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45caee-54d1-4cb7-ab32-de50923d0e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:05.061068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1d45caee-54d1-4cb7-ab32-de50923d0e9e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:05.062328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1d45caee-54d1-4cb7-ab32-de50923d0e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:05.191043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceeca9-0b19-4b4e-baf3-29f41fe153a9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:05.191588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceeca9-0b19-4b4e-baf3-29f41fe153a9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:05.192042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceeca9-0b19-4b4e-baf3-29f41fe153a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:05.230158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f3ceeca9-0b19-4b4e-baf3-29f41fe153a9 None None] MFA Rules not processed for user `545b6c16175f418587d6c8649b3ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:05.233830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f3ceeca9-0b19-4b4e-baf3-29f41fe153a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:05.360834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:05.386690 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1347/2707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:05.394942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1666d6-82ea-467d-8c67-15fcaf6ea3a8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:05.395230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1666d6-82ea-467d-8c67-15fcaf6ea3a8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:05.395511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1666d6-82ea-467d-8c67-15fcaf6ea3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:05.415210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1361/2708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:05:05.452866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ac1666d6-82ea-467d-8c67-15fcaf6ea3a8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:05.455500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ac1666d6-82ea-467d-8c67-15fcaf6ea3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:05.509586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceeca9-0b19-4b4e-baf3-29f41fe153a9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:05.510145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1348/2709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:05.531344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceeca9-0b19-4b4e-baf3-29f41fe153a9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:05.546492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:05.547574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:05.548045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:05.548535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:05.549521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:05:05.549907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:05.551576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:05.588444 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1362/2710] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:05:05.589426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1666d6-82ea-467d-8c67-15fcaf6ea3a8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:05.608271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1666d6-82ea-467d-8c67-15fcaf6ea3a8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:05.632601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:05.636261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:05.636261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:05.636261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:05.642232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:05.646461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:05.728706 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1349/2711] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:05 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:05.731375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:05.746542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfee200-0c5d-48f6-afaa-d607a9da1149 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:05.803840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:05.806091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:05.932546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:06.012819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352df189-8954-49a2-8dc7-d848f163d4b7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:06.031728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.039054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.046110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.048546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.049809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.050286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.053693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:06.062773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.063790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] PATH_INFO: `/v3/users/79c12f29545c40ec955650696bb91a65` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.065124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:06.068426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c12f29545c40ec955650696bb91a65)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:06.070558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:06.141184 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1363/2712] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:05 2022] POST /identity/v3/users => generated 290 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:06.142115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:06.148111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:06.190942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2416c-e2d1-42f2-8c99-322ed7375105 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:06.201742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c12f29545c40ec955650696bb91a65'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.203563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c12f29545c40ec955650696bb91a65'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.217875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.218784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.219069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.219347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] PATH_INFO: `/v3/projects/37df598baf854c16997629e2c8d8399a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.223953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37df598baf854c16997629e2c8d8399a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:06.226562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c12f29545c40ec955650696bb91a65'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.227695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c12f29545c40ec955650696bb91a65'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.228400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:06.240781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c12f29545c40ec955650696bb91a65'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.273620 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1350/2713] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:05 2022] DELETE /identity/v3/users/79c12f29545c40ec955650696bb91a65 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:05:06.276418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:06.279254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:06.413208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37df598baf854c16997629e2c8d8399a', 'request_id': 'req-e38acbe2-d02c-4525-b4c1-4c83b692eb20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.431602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37df598baf854c16997629e2c8d8399a', 'request_id': 'req-e38acbe2-d02c-4525-b4c1-4c83b692eb20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.472801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37df598baf854c16997629e2c8d8399a', 'request_id': 'req-e38acbe2-d02c-4525-b4c1-4c83b692eb20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.511596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] The token cache is being invalidate because project 37df598baf854c16997629e2c8d8399a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:06.512046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.521446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e38acbe2-d02c-4525-b4c1-4c83b692eb20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:06.523528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1364/2714] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:06 2022] DELETE /identity/v3/projects/37df598baf854c16997629e2c8d8399a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:06.530916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e6a2-deca-4af2-a7cf-ceef562dc447 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.531289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e6a2-deca-4af2-a7cf-ceef562dc447 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.531605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e6a2-deca-4af2-a7cf-ceef562dc447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.544654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68ad5-8c43-405a-9e5f-f77604ad525b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:06.588871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f354e6a2-deca-4af2-a7cf-ceef562dc447 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:06.592964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f354e6a2-deca-4af2-a7cf-ceef562dc447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:06.692597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.693655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.693901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.694169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.694939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:06.696631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:06.716672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:06.729658 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1351/2715] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:06.743512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:06.752635 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1365/2716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:06.760191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357af30-dd26-4708-a57b-26408642d41e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.760495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357af30-dd26-4708-a57b-26408642d41e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.760748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357af30-dd26-4708-a57b-26408642d41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.766275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:06.795472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2357af30-dd26-4708-a57b-26408642d41e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:06.797695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2357af30-dd26-4708-a57b-26408642d41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:06.802787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e037e9-ac10-41b6-805a-13b23fbd061b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:06.811666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.812530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.812838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.813130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.813893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:06.819767 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1366/2717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:05:06.823763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357af30-dd26-4708-a57b-26408642d41e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:06.824573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:06.835177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357af30-dd26-4708-a57b-26408642d41e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:06.858034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:06.860255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.860960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.861265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.861579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.862324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:05:06.863229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:06.866570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:06.885244 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1367/2718] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:05:06.890575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:06.900117 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1352/2719] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:06.901146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:06.914105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06d1e0-40e3-44e8-b229-0d7579476086 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:06.919917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.920801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.921429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.921710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.922609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:06.924733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:06.952520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bde004-3497-428b-9e44-e0c992473ddf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:06.968013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:06.969931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:06.970370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:06.970930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] PATH_INFO: `/v3/projects/1d3c1a33ed1449bdbec74fb4d3c0784f/users/035a5cccca15429e845012dd629d5038/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:06.979383 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1368/2720] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:06 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:05:06.983125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:06.988318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:07.022813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3c1a33ed1449bdbec74fb4d3c0784f, user_id=035a5cccca15429e845012dd629d5038, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.040736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:07.085394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1353/2721] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:06 2022] PUT /identity/v3/projects/1d3c1a33ed1449bdbec74fb4d3c0784f/users/035a5cccca15429e845012dd629d5038/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:07.087315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:07.182162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bf06b-3cfe-4083-88b0-27ad830f28e8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:07.311380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef6e9-4416-4d89-9169-39ca0a93349e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:07.323782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d1284-708f-45e2-9fe3-dd6f189d2777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:07.324536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1284-708f-45e2-9fe3-dd6f189d2777 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.324826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1284-708f-45e2-9fe3-dd6f189d2777 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.325129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1284-708f-45e2-9fe3-dd6f189d2777 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.325961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d1284-708f-45e2-9fe3-dd6f189d2777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.330146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d1284-708f-45e2-9fe3-dd6f189d2777 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:07.347553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:07.351158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.352457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.353545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] PATH_INFO: `/v3/projects/dad7b33b97ba48a6a4989ff35985a4ca` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.357968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad7b33b97ba48a6a4989ff35985a4ca)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.364053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:07.377412 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1354/2722] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:07 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:07.378996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f448-0050-4908-808c-9a1b31b96a43 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.379297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f448-0050-4908-808c-9a1b31b96a43 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.379587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f448-0050-4908-808c-9a1b31b96a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.418946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-64b9f448-0050-4908-808c-9a1b31b96a43 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:07.421653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64b9f448-0050-4908-808c-9a1b31b96a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:07.469319 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1355/2723] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:07.469319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f448-0050-4908-808c-9a1b31b96a43 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:07.491752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad7b33b97ba48a6a4989ff35985a4ca', 'request_id': 'req-3e1c4abc-d211-4093-8d59-90b083038f95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.492829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f448-0050-4908-808c-9a1b31b96a43 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:07.508348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad7b33b97ba48a6a4989ff35985a4ca', 'request_id': 'req-3e1c4abc-d211-4093-8d59-90b083038f95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.522814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:07.535001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad7b33b97ba48a6a4989ff35985a4ca', 'request_id': 'req-3e1c4abc-d211-4093-8d59-90b083038f95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.562828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] The token cache is being invalidate because project dad7b33b97ba48a6a4989ff35985a4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:07.563400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.566366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.570054 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1369/2724] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:06 2022] DELETE /identity/v3/projects/dad7b33b97ba48a6a4989ff35985a4ca => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:07.573232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:07.577913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:07.641115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:07.643453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.643751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.644039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.645427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.648866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:07.670899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1356/2725] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:07.670899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:07.679185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:07.713481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7a92b-5985-4f3e-8060-0a26248417a9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:07.735676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:07.736611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c4abc-d211-4093-8d59-90b083038f95 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:07.738755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.739713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.740915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] PATH_INFO: `/v3/users/f74a0bfbb8f1410da348911a11bd27f4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.743446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74a0bfbb8f1410da348911a11bd27f4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.747072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:07.750911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:07.751893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.752383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.752666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.755703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:07.786338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.788297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:07.829255 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1370/2726] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:07.830293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:07.838573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:07.859845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2c7cb-b963-4a56-bef6-5d67a84392d7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:07.865351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:07.866082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.866365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.866640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.867469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.869232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:07.872764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74a0bfbb8f1410da348911a11bd27f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.873574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74a0bfbb8f1410da348911a11bd27f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.881659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:07.889505 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1371/2727] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:07.897863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:07.903829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:07.917815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74a0bfbb8f1410da348911a11bd27f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.923845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74a0bfbb8f1410da348911a11bd27f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.933267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab8a4361-e50f-45e4-8aa4-5f04a8e20330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74a0bfbb8f1410da348911a11bd27f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:07.935515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95cc4-78e6-43d6-ac3d-e0c65a03a291 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:07.953157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:07.954386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:07.954864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:07.955557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] PATH_INFO: `/v3/projects/b9a85ed67a4b4908b724c49a9754d312/users/8ede0902f6cf47fc8bbcec812fd9615b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:07.955838 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1357/2728] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:07 2022] DELETE /identity/v3/users/f74a0bfbb8f1410da348911a11bd27f4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:07.995082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a85ed67a4b4908b724c49a9754d312, user_id=8ede0902f6cf47fc8bbcec812fd9615b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:07.998762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:08.024014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1372/2729] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:07 2022] PUT /identity/v3/projects/b9a85ed67a4b4908b724c49a9754d312/users/8ede0902f6cf47fc8bbcec812fd9615b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:08.025971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:08.026483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:08.026761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:08.092442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:08.097753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:08.274714 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1358/2730] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:08.287644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:08.290710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:08.475031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:08.478100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:08.547495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee6b8e-4171-45a5-ae41-5b76b586206f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:08.559110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ec02d-0dcb-4178-b6a1-6822e827eaa8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:08.573776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:08.576441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:08.577398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:08.577748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] PATH_INFO: `/v3/projects/51d45e4edfc14265b9464ae54cdfa434` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:08.578586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9565-3fd7-457e-8e6e-dcf3fa3c08f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:08.579465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9565-3fd7-457e-8e6e-dcf3fa3c08f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:08.579821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9565-3fd7-457e-8e6e-dcf3fa3c08f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:08.580157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9565-3fd7-457e-8e6e-dcf3fa3c08f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:08.580689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d45e4edfc14265b9464ae54cdfa434)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:08.587777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:08.618583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9565-3fd7-457e-8e6e-dcf3fa3c08f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:08.622713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9565-3fd7-457e-8e6e-dcf3fa3c08f4 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:08.643182 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1373/2731] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:08.678942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d45e4edfc14265b9464ae54cdfa434', 'request_id': 'req-287c9410-9b39-4443-b5ca-76bc1d437c43'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:08.694646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d45e4edfc14265b9464ae54cdfa434', 'request_id': 'req-287c9410-9b39-4443-b5ca-76bc1d437c43'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:08.708048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d45e4edfc14265b9464ae54cdfa434', 'request_id': 'req-287c9410-9b39-4443-b5ca-76bc1d437c43'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:08.731877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] The token cache is being invalidate because project 51d45e4edfc14265b9464ae54cdfa434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:08.732144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:08.732874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-287c9410-9b39-4443-b5ca-76bc1d437c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:08.738489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1359/2732] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:08 2022] DELETE /identity/v3/projects/51d45e4edfc14265b9464ae54cdfa434 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:08.743836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b136f0-58ff-4e88-a3a4-9a595938f35f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:08.744099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b136f0-58ff-4e88-a3a4-9a595938f35f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:08.744405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b136f0-58ff-4e88-a3a4-9a595938f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:08.772073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b7b136f0-58ff-4e88-a3a4-9a595938f35f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:08.773269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b7b136f0-58ff-4e88-a3a4-9a595938f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:08.897771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:08.933279 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1374/2733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:08.941303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c06f-fc15-4c1a-b6e0-decad7474862 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:08.941645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c06f-fc15-4c1a-b6e0-decad7474862 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:08.941878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c06f-fc15-4c1a-b6e0-decad7474862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:08.971755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cb42c06f-fc15-4c1a-b6e0-decad7474862 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:08.973553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cb42c06f-fc15-4c1a-b6e0-decad7474862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:08.989369 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1360/2734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:08.993148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b136f0-58ff-4e88-a3a4-9a595938f35f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:09.017467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b136f0-58ff-4e88-a3a4-9a595938f35f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:09.039781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:09.040736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.041337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.041831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.043526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:05:09.045515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:09.047269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:09.077429 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1375/2735] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:05:09.081989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42c06f-fc15-4c1a-b6e0-decad7474862 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:09.100411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42c06f-fc15-4c1a-b6e0-decad7474862 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:09.108173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:09.109070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.109558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.110497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.111645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:09.114501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:09.174398 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1361/2736] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:09 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:05:09.175748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:09.194562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc399f1-e507-45d3-aa9e-0a4a0895b4f8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:09.327701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:09.328777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.329782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.330178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.330957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:09.333761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:09.368150 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1376/2737] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:09 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:09.372192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:09.384849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0475-4def-4a30-b6ce-a0c2c4df5b66 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:09.390409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:09.391168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.391457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.391730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.392582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:09.394366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:09.413439 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1362/2738] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:09.415859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:09.434015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24752a-e98d-45e0-8222-2c9e0389791c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:09.440317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5305e-b94d-4f86-b646-10ccf68a3f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:09.442871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5305e-b94d-4f86-b646-10ccf68a3f8e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.443536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5305e-b94d-4f86-b646-10ccf68a3f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.443996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5305e-b94d-4f86-b646-10ccf68a3f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.446001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5305e-b94d-4f86-b646-10ccf68a3f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:09.448126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5305e-b94d-4f86-b646-10ccf68a3f8e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:09.464861 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1377/2739] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:09.469016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:09.483641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d236a40-99cf-4a40-955c-f3d14eebe754 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:09.493429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:09.503489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.503994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.504606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] PATH_INFO: `/v3/projects/bc547901615d4525a499e797c6118702/users/75bfafd0f32940f9877a13b288f8cadd/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.523605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:09.545420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc547901615d4525a499e797c6118702, user_id=75bfafd0f32940f9877a13b288f8cadd, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:09.549466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:09.597080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1363/2740] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:09 2022] PUT /identity/v3/projects/bc547901615d4525a499e797c6118702/users/75bfafd0f32940f9877a13b288f8cadd/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:05:09.609561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f9b86-edcd-4cb0-ae95-0b04da8881f6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.610089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f9b86-edcd-4cb0-ae95-0b04da8881f6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.611972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f9b86-edcd-4cb0-ae95-0b04da8881f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.663793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0f7f9b86-edcd-4cb0-ae95-0b04da8881f6 None None] MFA Rules not processed for user `75bfafd0f32940f9877a13b288f8cadd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:09.665045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f7f9b86-edcd-4cb0-ae95-0b04da8881f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:09.770487 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1378/2741] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:09.774212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:09.967460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4710fb-9d79-4c5b-b20c-f843122526b1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:09.981923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:09.982683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:09.983055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:09.983343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:09.984049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:09.989686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:10.066542 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1364/2742] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:09 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:05:10.070444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f9b86-edcd-4cb0-ae95-0b04da8881f6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:10.086878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f9b86-edcd-4cb0-ae95-0b04da8881f6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:10.165987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:10.192380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:10.192822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:10.193340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:10.193618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:10.195393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:10.197557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:10.248052 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1379/2743] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:10 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:10.249299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:10.267819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7d93-5243-4b9b-9364-958c5b75dd8f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:10.286151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:10.286926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:10.287211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:10.287499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:10.288240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:10.289909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:10.311642 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1365/2744] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:10.315903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:10.330734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405ea01-c125-480b-ad9e-1ec5f777ed3c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:10.335946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:10.336866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:10.337271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:10.337486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] PATH_INFO: `/v3/projects/e1335976f1f94e55b88873e5d84bdf46/users/bbce4cd6002944ce8bfb64ce9b01cdc0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:10.356139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1335976f1f94e55b88873e5d84bdf46, user_id=bbce4cd6002944ce8bfb64ce9b01cdc0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:10.359129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:10.390693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1380/2745] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:10 2022] PUT /identity/v3/projects/e1335976f1f94e55b88873e5d84bdf46/users/bbce4cd6002944ce8bfb64ce9b01cdc0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:10.394922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:10.410527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369808-7cb1-4ab5-a23a-4dd023188288 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:10.595597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec8fa2-6c6d-4d40-bbbf-3baaecf201e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:10.597714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8fa2-6c6d-4d40-bbbf-3baaecf201e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:10.604160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8fa2-6c6d-4d40-bbbf-3baaecf201e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:10.604720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec8fa2-6c6d-4d40-bbbf-3baaecf201e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:10.607654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec8fa2-6c6d-4d40-bbbf-3baaecf201e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:10.611732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec8fa2-6c6d-4d40-bbbf-3baaecf201e6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:10.661475 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1366/2746] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:10.661834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:10.678085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d1a5d-51a8-4603-8571-9f8ff55fb88a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:10.689138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:10.691531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:10.692559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:10.692902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] PATH_INFO: `/v3/projects/e1335976f1f94e55b88873e5d84bdf46/users/bbce4cd6002944ce8bfb64ce9b01cdc0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:10.704429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1335976f1f94e55b88873e5d84bdf46, user_id=bbce4cd6002944ce8bfb64ce9b01cdc0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:10.708244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:10.737658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1381/2747] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:10 2022] PUT /identity/v3/projects/e1335976f1f94e55b88873e5d84bdf46/users/bbce4cd6002944ce8bfb64ce9b01cdc0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:10.749672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca4c2-0b08-4e56-b89b-485b0c46c519 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:10.750057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca4c2-0b08-4e56-b89b-485b0c46c519 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:10.750234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ca4c2-0b08-4e56-b89b-485b0c46c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:10.808559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-907ca4c2-0b08-4e56-b89b-485b0c46c519 None None] MFA Rules not processed for user `bbce4cd6002944ce8bfb64ce9b01cdc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:10.810655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-907ca4c2-0b08-4e56-b89b-485b0c46c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:10.970901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:11.059698 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1367/2748] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:11.072599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:11.075215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:11.270346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b1aa9-8311-4955-bd86-2ae6829269ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:11.290244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd11cf9-c2b4-4eae-9d0d-a9c9d6cdbbfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:11.291272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11cf9-c2b4-4eae-9d0d-a9c9d6cdbbfc service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:11.292956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11cf9-c2b4-4eae-9d0d-a9c9d6cdbbfc service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:11.294753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd11cf9-c2b4-4eae-9d0d-a9c9d6cdbbfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:11.316413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd11cf9-c2b4-4eae-9d0d-a9c9d6cdbbfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:11.320696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd11cf9-c2b4-4eae-9d0d-a9c9d6cdbbfc service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:11.335520 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1382/2749] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:13.066773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ca4c2-0b08-4e56-b89b-485b0c46c519 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:13.235451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ca4c2-0b08-4e56-b89b-485b0c46c519 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:13.244945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:13.248439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:13.249409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:13.252771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] PATH_INFO: `/v3/users/75bfafd0f32940f9877a13b288f8cadd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:13.254416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bfafd0f32940f9877a13b288f8cadd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:13.258044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:13.376017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bfafd0f32940f9877a13b288f8cadd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:13.376960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bfafd0f32940f9877a13b288f8cadd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:13.397939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bfafd0f32940f9877a13b288f8cadd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:13.399546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bfafd0f32940f9877a13b288f8cadd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:13.413668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bfafd0f32940f9877a13b288f8cadd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:13.459194 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1368/2750] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:13 2022] DELETE /identity/v3/users/75bfafd0f32940f9877a13b288f8cadd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:05:13.461439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:13.461911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:13.462198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:13.498009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:13.499482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:13.644177 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1383/2751] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:13.702383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:13.711870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:14.010549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0ab55-d7ee-44f8-9ff1-ae256a820eb8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:14.018789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:14.020403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:14.020851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:14.021336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:14.049913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:14.058018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:14.102310 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1369/2752] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:16.078533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:16.080002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:16.102882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89384-d9b5-47e8-83cf-dcee2d76b500 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:16.115351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:16.116254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:16.116532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:16.116808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] PATH_INFO: `/v3/projects/bc547901615d4525a499e797c6118702` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:16.120497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc547901615d4525a499e797c6118702)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:16.122893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:16.186624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:16.235969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc547901615d4525a499e797c6118702', 'request_id': 'req-216f800e-4300-441a-b4bf-708da2234ab5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.246287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc547901615d4525a499e797c6118702', 'request_id': 'req-216f800e-4300-441a-b4bf-708da2234ab5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.266090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc547901615d4525a499e797c6118702', 'request_id': 'req-216f800e-4300-441a-b4bf-708da2234ab5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.293356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] The token cache is being invalidate because project bc547901615d4525a499e797c6118702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:16.293589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.294248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.296114 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1384/2753] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:16 2022] DELETE /identity/v3/projects/bc547901615d4525a499e797c6118702 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:16.300802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:16.308279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:16.316317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b7954-19e2-43c1-8b09-c66f706b4a22 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:16.568303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:16.569502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:16.569790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:16.570069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] PATH_INFO: `/v3/users/bbce4cd6002944ce8bfb64ce9b01cdc0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:16.572121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbce4cd6002944ce8bfb64ce9b01cdc0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:16.574166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:16.683689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbce4cd6002944ce8bfb64ce9b01cdc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.684703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbce4cd6002944ce8bfb64ce9b01cdc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.714657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbce4cd6002944ce8bfb64ce9b01cdc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.719088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbce4cd6002944ce8bfb64ce9b01cdc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.736724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d83fc25-b9d5-4a8a-aab0-b235015ed0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbce4cd6002944ce8bfb64ce9b01cdc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:16.767897 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1370/2754] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:16 2022] DELETE /identity/v3/users/bbce4cd6002944ce8bfb64ce9b01cdc0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:17.721771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:17.723777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:17.753501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f800e-4300-441a-b4bf-708da2234ab5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:17.977413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:17.978841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:17.979215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:17.979590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] PATH_INFO: `/v3/projects/e1335976f1f94e55b88873e5d84bdf46` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:17.983779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1335976f1f94e55b88873e5d84bdf46)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:17.987647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:18.129762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1335976f1f94e55b88873e5d84bdf46', 'request_id': 'req-f6172633-7152-4b2a-afa4-07749a5f70f1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:18.143037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1335976f1f94e55b88873e5d84bdf46', 'request_id': 'req-f6172633-7152-4b2a-afa4-07749a5f70f1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:18.159888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1335976f1f94e55b88873e5d84bdf46', 'request_id': 'req-f6172633-7152-4b2a-afa4-07749a5f70f1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:18.195630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] The token cache is being invalidate because project e1335976f1f94e55b88873e5d84bdf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:18.196404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:18.197773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6172633-7152-4b2a-afa4-07749a5f70f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:18.201360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1385/2755] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:17 2022] DELETE /identity/v3/projects/e1335976f1f94e55b88873e5d84bdf46 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:18.207341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40829-1830-4a3a-8163-666bacbf434c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:18.208466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40829-1830-4a3a-8163-666bacbf434c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:18.208904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40829-1830-4a3a-8163-666bacbf434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:18.249641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-71c40829-1830-4a3a-8163-666bacbf434c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:18.252049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71c40829-1830-4a3a-8163-666bacbf434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:18.405228 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1371/2756] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:18.413003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f9b64-2e2b-4e3b-876f-136b61ffd647 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:18.413328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f9b64-2e2b-4e3b-876f-136b61ffd647 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:18.413750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f9b64-2e2b-4e3b-876f-136b61ffd647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:18.449695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f16f9b64-2e2b-4e3b-876f-136b61ffd647 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:18.451059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f16f9b64-2e2b-4e3b-876f-136b61ffd647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:18.482494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1386/2757] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:18.484620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40829-1830-4a3a-8163-666bacbf434c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:18.502622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40829-1830-4a3a-8163-666bacbf434c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:18.510098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:18.510910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:18.511261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:18.512124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:18.512893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:05:18.513229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:18.514911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:18.543473 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1372/2758] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:05:18.547909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f9b64-2e2b-4e3b-876f-136b61ffd647 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:18.566958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f9b64-2e2b-4e3b-876f-136b61ffd647 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:18.584516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:18.585266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:18.585528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:18.585798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:18.586504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:18.588480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:18.642794 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1387/2759] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:18 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:18.646922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:18.665419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6ebf1-a71e-48cd-b744-33c02f316ffa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:18.686948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:18.802983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:18.803662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:18.803945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:18.804226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:18.804921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:18.807068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:18.857850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1373/2760] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:18 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:18.861668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:18.879951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf7ff-9693-4052-a085-98f95b32b064 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:18.902261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:18.903046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:18.903328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:18.903609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:18.904370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:18.906016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:18.937024 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1388/2761] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:18.938302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:18.957986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b74ee-482f-4c85-b8de-2cc0e3e06e58 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:18.969701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff11241-8ded-464e-bf64-3eb4c3445475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:18.970637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff11241-8ded-464e-bf64-3eb4c3445475 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:18.970924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff11241-8ded-464e-bf64-3eb4c3445475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:18.971244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff11241-8ded-464e-bf64-3eb4c3445475 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:18.971997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff11241-8ded-464e-bf64-3eb4c3445475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:18.973644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff11241-8ded-464e-bf64-3eb4c3445475 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:19.002519 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1374/2762] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:19.003794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:19.010368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:19.019433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0a9ac-ab17-4681-b9bc-7c16c4b42c8f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:19.049763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:19.051014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:19.051574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:19.052001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] PATH_INFO: `/v3/projects/fedb914d4fc948e3bba11c0c8bbc8070/users/ad853b9eebe341c8ab8c45ab0011a8cf/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:19.092422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedb914d4fc948e3bba11c0c8bbc8070, user_id=ad853b9eebe341c8ab8c45ab0011a8cf, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:19.100126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:19.136927 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1389/2763] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:19 2022] PUT /identity/v3/projects/fedb914d4fc948e3bba11c0c8bbc8070/users/ad853b9eebe341c8ab8c45ab0011a8cf/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:19.147900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62d8d-23de-4a33-bd7f-2ac2a66b7423 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:19.148673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62d8d-23de-4a33-bd7f-2ac2a66b7423 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:19.149721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62d8d-23de-4a33-bd7f-2ac2a66b7423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:19.208538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75d62d8d-23de-4a33-bd7f-2ac2a66b7423 None None] MFA Rules not processed for user `ad853b9eebe341c8ab8c45ab0011a8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:19.215122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75d62d8d-23de-4a33-bd7f-2ac2a66b7423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:19.401375 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1375/2764] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:19.407491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:19.508280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3724149-9ecb-490f-a485-852455a9b99f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:19.515618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:19.526367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:19.526998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:19.527472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:19.528770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:19.531641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:19.580747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62d8d-23de-4a33-bd7f-2ac2a66b7423 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:19.589632 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1390/2765] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:19 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:19.596333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d62d8d-23de-4a33-bd7f-2ac2a66b7423 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:19.680229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:19.680699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:19.680978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:19.683354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:19.684151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:19.686378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:19.724110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1376/2766] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:19 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:05:19.726166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:19.743555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0af2be-7e7b-49b6-9344-94d841bdb4a7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:19.752255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:19.753173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:19.753521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:19.753857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:19.754785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:19.756779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:19.774509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:19.785519 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1391/2767] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:19.787254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1b92a-7951-49ee-a212-6aca7c277f00 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:19.794324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:19.795352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:19.795705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:19.796047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] PATH_INFO: `/v3/projects/a76a01fddb914993a01decf0cc0ce931/users/236533706af8489abed755618c65e133/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:19.803366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:19.822962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76a01fddb914993a01decf0cc0ce931, user_id=236533706af8489abed755618c65e133, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:19.825714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:19.876312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1377/2768] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:19 2022] PUT /identity/v3/projects/a76a01fddb914993a01decf0cc0ce931/users/236533706af8489abed755618c65e133/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:19.877854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:19.899076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20dbe8-bbda-4afe-84e6-7987153f2c19 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:19.986462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c48a16-4c8c-4345-961e-bb7a1f9b769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:19.987228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48a16-4c8c-4345-961e-bb7a1f9b769f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:19.987575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48a16-4c8c-4345-961e-bb7a1f9b769f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:19.987914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c48a16-4c8c-4345-961e-bb7a1f9b769f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:19.988827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c48a16-4c8c-4345-961e-bb7a1f9b769f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:19.992658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c48a16-4c8c-4345-961e-bb7a1f9b769f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:20.021452 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1392/2769] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:20.022816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:20.068522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878fb9f-0dc8-4930-868e-53d0778c0d4f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:20.076414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:20.078558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:20.079606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:20.079898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] PATH_INFO: `/v3/projects/a76a01fddb914993a01decf0cc0ce931/users/236533706af8489abed755618c65e133/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:20.082345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76a01fddb914993a01decf0cc0ce931, user_id=236533706af8489abed755618c65e133, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:20.086860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:20.130399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c96fe-e5c9-4f6c-a489-6055cea23dd9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:20.130629 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1378/2770] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:20 2022] PUT /identity/v3/projects/a76a01fddb914993a01decf0cc0ce931/users/236533706af8489abed755618c65e133/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:20.131390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c96fe-e5c9-4f6c-a489-6055cea23dd9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:20.131666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c96fe-e5c9-4f6c-a489-6055cea23dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:20.228273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a82c96fe-e5c9-4f6c-a489-6055cea23dd9 None None] MFA Rules not processed for user `236533706af8489abed755618c65e133`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:20.229697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a82c96fe-e5c9-4f6c-a489-6055cea23dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:20.335700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:20.454801 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1393/2771] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:20.611750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:20.612598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:20.869672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f953271-a271-4834-ad35-31ec40934a6a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:20.899248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2566-fc7e-4083-8a08-6c1fee258f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:20.900252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2566-fc7e-4083-8a08-6c1fee258f34 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:20.900725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2566-fc7e-4083-8a08-6c1fee258f34 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:20.901204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2566-fc7e-4083-8a08-6c1fee258f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:20.971845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d2566-fc7e-4083-8a08-6c1fee258f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:20.974189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d2566-fc7e-4083-8a08-6c1fee258f34 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:21.029518 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1379/2772] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:21.856344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c96fe-e5c9-4f6c-a489-6055cea23dd9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:22.101870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c96fe-e5c9-4f6c-a489-6055cea23dd9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:22.121418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:22.122602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:22.125527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:22.126056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] PATH_INFO: `/v3/users/ad853b9eebe341c8ab8c45ab0011a8cf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:22.138894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad853b9eebe341c8ab8c45ab0011a8cf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:22.141748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:22.285971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad853b9eebe341c8ab8c45ab0011a8cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:22.286790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad853b9eebe341c8ab8c45ab0011a8cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:22.339532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad853b9eebe341c8ab8c45ab0011a8cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:22.340365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad853b9eebe341c8ab8c45ab0011a8cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:22.359380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad853b9eebe341c8ab8c45ab0011a8cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:22.394861 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1394/2773] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:21 2022] DELETE /identity/v3/users/ad853b9eebe341c8ab8c45ab0011a8cf => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:22.396651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:22.397159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:22.397258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:22.450184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:22.451504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:22.532079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1380/2774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:22.542286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:22.543933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:22.713938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb7ef8-483a-4227-8a05-33a9df2c11a9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:22.723709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:22.724817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:22.725425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:22.726487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:22.747587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:22.755077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:22.760083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:22.787399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1395/2775] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:23.493828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:23.496063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:23.536405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5507ba1-d833-47fa-94d6-076e74cd5470 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:23.559040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:23.560154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:23.560541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:23.560936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] PATH_INFO: `/v3/projects/fedb914d4fc948e3bba11c0c8bbc8070` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:23.574458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedb914d4fc948e3bba11c0c8bbc8070)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:23.578087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:23.806084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedb914d4fc948e3bba11c0c8bbc8070', 'request_id': 'req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:23.809782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:23.819074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedb914d4fc948e3bba11c0c8bbc8070', 'request_id': 'req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:23.838312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedb914d4fc948e3bba11c0c8bbc8070', 'request_id': 'req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:23.860956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] The token cache is being invalidate because project fedb914d4fc948e3bba11c0c8bbc8070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:23.861631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:23.862496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6a7f88a4-b495-40a6-8f1b-3b527e5de4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:23.864271 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1381/2776] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:23 2022] DELETE /identity/v3/projects/fedb914d4fc948e3bba11c0c8bbc8070 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:23.868606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:23.882978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55e2d-2461-44e2-b8d5-d0c2adc1c22e service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:23.906238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:23.906775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:23.907269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:23.978379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] MFA Rules not processed for user `035a5cccca15429e845012dd629d5038`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:23.979856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:24.065193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:24.066473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:24.066763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:24.067050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] PATH_INFO: `/v3/users/236533706af8489abed755618c65e133` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:24.069435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236533706af8489abed755618c65e133)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:24.077667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:24.135136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1382/2777] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:05:24.144581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:24.149252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:24.152081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236533706af8489abed755618c65e133'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:24.152081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236533706af8489abed755618c65e133'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:24.171173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236533706af8489abed755618c65e133'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:24.174027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236533706af8489abed755618c65e133'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:24.182960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3cc16fd-2f36-4dcb-97bc-1c6d59ff8525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236533706af8489abed755618c65e133'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:24.223432 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1396/2778] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:05:23 2022] DELETE /identity/v3/users/236533706af8489abed755618c65e133 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:24.248384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb72a-5c23-4a2c-b84d-1d60438ebf96 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:24.248689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb72a-5c23-4a2c-b84d-1d60438ebf96 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:24.248961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedb72a-5c23-4a2c-b84d-1d60438ebf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:24.321252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ced43-ae50-45b8-b2a1-8c4df0d45f61 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:24.354384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-daedb72a-5c23-4a2c-b84d-1d60438ebf96 None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:24.355787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-daedb72a-5c23-4a2c-b84d-1d60438ebf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:24.507892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:24.508502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:24.508746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:24.509021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:24.513798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:24.525802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:24.538949 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1397/2779] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:24.543292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:24.543621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:24.543909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:24.562397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:24.597206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:24.598389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:24.617545 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1398/2780] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:24.642464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:24.644681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:24.672465 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1383/2781] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:05:24.701613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:24.703501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:24.733694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcffcd2-c70c-4f02-b51a-14be9454c2d3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:24.754743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ae011-7390-4219-9bf5-dc845a92be56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:24.755732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae011-7390-4219-9bf5-dc845a92be56 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:24.756311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae011-7390-4219-9bf5-dc845a92be56 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:24.756728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ae011-7390-4219-9bf5-dc845a92be56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:24.775227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ae011-7390-4219-9bf5-dc845a92be56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:24.777244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ae011-7390-4219-9bf5-dc845a92be56 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:24.800488 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1399/2782] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:25.104542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:25.106173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:25.293747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f93f-87bf-43d9-a45a-929f261454d8 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:25.363145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:25.370353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:25.371112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:25.371746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] PATH_INFO: `/v3/projects/a76a01fddb914993a01decf0cc0ce931` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:25.374126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76a01fddb914993a01decf0cc0ce931)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:25.377575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:25.519346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76a01fddb914993a01decf0cc0ce931', 'request_id': 'req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:25.538058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76a01fddb914993a01decf0cc0ce931', 'request_id': 'req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:25.568970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76a01fddb914993a01decf0cc0ce931', 'request_id': 'req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:25.582936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] The token cache is being invalidate because project a76a01fddb914993a01decf0cc0ce931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:05:25.583324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:25.585000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-644cd99e-a3f7-45b7-a7f5-2121a2dabe54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:05:25.588674 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1384/2783] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:25 2022] DELETE /identity/v3/projects/a76a01fddb914993a01decf0cc0ce931 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:25.594415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f9de9-bebf-4752-89d7-638a7c59e1aa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:25.595114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f9de9-bebf-4752-89d7-638a7c59e1aa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:25.595114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f9de9-bebf-4752-89d7-638a7c59e1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:25.657568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-332f9de9-bebf-4752-89d7-638a7c59e1aa None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:25.661924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-332f9de9-bebf-4752-89d7-638a7c59e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:25.893640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1400/2784] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:25.901271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be291b-cf3a-4b5f-88cc-57362cc21234 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:25.901606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be291b-cf3a-4b5f-88cc-57362cc21234 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:25.901940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be291b-cf3a-4b5f-88cc-57362cc21234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:25.927728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f0be291b-cf3a-4b5f-88cc-57362cc21234 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:25.929144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0be291b-cf3a-4b5f-88cc-57362cc21234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:25.965300 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1385/2785] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:05:25.966666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f9de9-bebf-4752-89d7-638a7c59e1aa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:25.997310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f9de9-bebf-4752-89d7-638a7c59e1aa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:26.006778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:26.007616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:26.007912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:26.022946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:26.024168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:05:26.025406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:26.027378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:26.048360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1401/2786] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:05:26.052923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be291b-cf3a-4b5f-88cc-57362cc21234 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:26.070359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be291b-cf3a-4b5f-88cc-57362cc21234 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:26.085790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:26.087086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:26.087739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:26.088286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:26.091134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:26.119372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:26.267974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1386/2787] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:26 2022] POST /identity/v3/projects => generated 405 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:26.271422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:26.289257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858efd9e-d908-45e6-8246-7fc0454a1550 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:26.457870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:26.458781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:26.459207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:26.459592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:26.460497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:26.462868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:26.524539 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1402/2788] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:26 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:26.528760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:26.551001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de65d-f5e9-4e57-88d3-0d52314606b6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:26.568485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:26.569288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:26.569577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:26.569859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:26.570669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:26.583060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:26.589834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:26.617019 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1387/2789] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:26.620755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:26.653425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40603cae-b7a3-4bfc-965a-064cb912f592 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:26.664887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bc5c1-d337-4f35-8deb-6ac979a424d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:26.665619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bc5c1-d337-4f35-8deb-6ac979a424d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:26.665923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bc5c1-d337-4f35-8deb-6ac979a424d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:26.666194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bc5c1-d337-4f35-8deb-6ac979a424d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:26.667552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bc5c1-d337-4f35-8deb-6ac979a424d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:26.672690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bc5c1-d337-4f35-8deb-6ac979a424d9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:26.723741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:26.735793 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1403/2790] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:26.753451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6140d-aabc-43ed-9ed5-27c34f377dfd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:26.777245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6cc66-d7dd-49c6-8fb6-02bbff0fe9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:26.778332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6cc66-d7dd-49c6-8fb6-02bbff0fe9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:26.778644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6cc66-d7dd-49c6-8fb6-02bbff0fe9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:26.778957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6cc66-d7dd-49c6-8fb6-02bbff0fe9d4 admin admin] PATH_INFO: `/v3/projects/49417f8363204aa48ab7ba9ef892358e/users/5e216b8e6ecf4f0793f18d079664ef2a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:26.860084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6cc66-d7dd-49c6-8fb6-02bbff0fe9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49417f8363204aa48ab7ba9ef892358e, user_id=5e216b8e6ecf4f0793f18d079664ef2a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:26.874646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6cc66-d7dd-49c6-8fb6-02bbff0fe9d4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:26.905311 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1388/2791] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:26 2022] PUT /identity/v3/projects/49417f8363204aa48ab7ba9ef892358e/users/5e216b8e6ecf4f0793f18d079664ef2a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:26.910888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:26.911138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:26.911420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:26.986162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:26.987546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:27.047062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60581-f3f8-472c-8bec-fbac34b9882f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:27.047364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60581-f3f8-472c-8bec-fbac34b9882f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:27.047635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60581-f3f8-472c-8bec-fbac34b9882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:27.092888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-66f60581-f3f8-472c-8bec-fbac34b9882f None None] MFA Rules not processed for user `035a5cccca15429e845012dd629d5038`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:27.094119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-66f60581-f3f8-472c-8bec-fbac34b9882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:27.094407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:27.137879 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1404/2792] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:27.157631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:27.159375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:27.309921 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1389/2793] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:27.392966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f1ed6-7350-429d-8127-b19fe7e18b3e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:27.404686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f6f5-9b9b-4a6d-ad32-6541cf3f0844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:27.405417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f6f5-9b9b-4a6d-ad32-6541cf3f0844 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:27.405689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f6f5-9b9b-4a6d-ad32-6541cf3f0844 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:27.405962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f6f5-9b9b-4a6d-ad32-6541cf3f0844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:27.437339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f6f5-9b9b-4a6d-ad32-6541cf3f0844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:27.440872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f6f5-9b9b-4a6d-ad32-6541cf3f0844 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:27.486223 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1405/2794] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:28.884030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:28.884609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:28.885007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:28.969683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] MFA Rules not processed for user `545b6c16175f418587d6c8649b3ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:28.976167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:29.415041 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1390/2795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:29.489974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c196d2-f8a0-4d92-882a-4883eb047268 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:29.490503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c196d2-f8a0-4d92-882a-4883eb047268 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:29.490503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c196d2-f8a0-4d92-882a-4883eb047268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:29.523392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-51c196d2-f8a0-4d92-882a-4883eb047268 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:29.524926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-51c196d2-f8a0-4d92-882a-4883eb047268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:29.721856 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1406/2796] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:05:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:29.737077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:29.738779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:29.918691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6625-1c3d-401b-9693-2d872b6208a0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:29.928279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9500b9-ef41-4b5c-b276-e2ac696ca95a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:29.930116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9500b9-ef41-4b5c-b276-e2ac696ca95a service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:29.930600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9500b9-ef41-4b5c-b276-e2ac696ca95a service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:29.931138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9500b9-ef41-4b5c-b276-e2ac696ca95a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:29.949263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9500b9-ef41-4b5c-b276-e2ac696ca95a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:29.951855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9500b9-ef41-4b5c-b276-e2ac696ca95a service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:29.997336 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1391/2797] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:05:31.530654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e9482-8f25-4907-b662-2ed49f003bc9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:31.531142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e9482-8f25-4907-b662-2ed49f003bc9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:31.531412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e9482-8f25-4907-b662-2ed49f003bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:31.577508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-eb2e9482-8f25-4907-b662-2ed49f003bc9 None None] MFA Rules not processed for user `4eef98c56e744064b2b5f131c3766c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:31.581763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eb2e9482-8f25-4907-b662-2ed49f003bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:31.784252 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1407/2798] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:39.054016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533c55-915e-4126-8485-a999738ac299 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:39.054961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533c55-915e-4126-8485-a999738ac299 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:39.055451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b533c55-915e-4126-8485-a999738ac299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:39.082400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:39.331630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8b533c55-915e-4126-8485-a999738ac299 None None] MFA Rules not processed for user `5e216b8e6ecf4f0793f18d079664ef2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:39.345620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b533c55-915e-4126-8485-a999738ac299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:39.488673 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1392/2799] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:05:39.490638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e9482-8f25-4907-b662-2ed49f003bc9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:39.504324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e9482-8f25-4907-b662-2ed49f003bc9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:39.518419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:39.519441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:39.520126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:39.520606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:39.523184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:39.545105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:39.618126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1408/2800] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:05:39 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:39.621405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533c55-915e-4126-8485-a999738ac299 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:39.641016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b533c55-915e-4126-8485-a999738ac299 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:39.743771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:39.744603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:39.744988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:39.756674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:39.758760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:39.763106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:39.813246 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1393/2801] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:05:39 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:05:39.825285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:39.868441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d0dea-f5ad-4d6b-9585-1399b5bb10df admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:39.877839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:39.878572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:39.878853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:39.879125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:39.880705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:39.883840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:39.925180 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1409/2802] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:39.930021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:39.945875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924f6db-fa5d-406e-9aa8-9c46f2c9c0a9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:39.972863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:39.973978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:39.976322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:39.976685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] PATH_INFO: `/v3/projects/9b315d2833e541a19f3d51ca148be645/users/17bdf275259747bda83ce333f255bded/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:40.004312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b315d2833e541a19f3d51ca148be645, user_id=17bdf275259747bda83ce333f255bded, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:40.007156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:40.063580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1394/2803] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:39 2022] PUT /identity/v3/projects/9b315d2833e541a19f3d51ca148be645/users/17bdf275259747bda83ce333f255bded/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:05:40.067882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:40.088385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60286411-a9c0-476b-801b-5dacfe9c6138 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:40.102835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:40.249678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7d594-ad43-4de3-81d5-095cafd1856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:40.251341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d594-ad43-4de3-81d5-095cafd1856d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:40.251818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d594-ad43-4de3-81d5-095cafd1856d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:40.252247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d594-ad43-4de3-81d5-095cafd1856d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:40.253395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7d594-ad43-4de3-81d5-095cafd1856d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:40.255730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7d594-ad43-4de3-81d5-095cafd1856d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:40.272186 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1410/2804] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:05:40.276652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:40.295405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43a18-3e1d-4753-a8cf-890d3e6c220d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:40.302767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcb0a7-6f99-4380-a4b4-ff4578750bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:40.303891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb0a7-6f99-4380-a4b4-ff4578750bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:40.304200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb0a7-6f99-4380-a4b4-ff4578750bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:40.304511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb0a7-6f99-4380-a4b4-ff4578750bc4 admin admin] PATH_INFO: `/v3/projects/9b315d2833e541a19f3d51ca148be645/users/17bdf275259747bda83ce333f255bded/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:40.311984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcb0a7-6f99-4380-a4b4-ff4578750bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b315d2833e541a19f3d51ca148be645, user_id=17bdf275259747bda83ce333f255bded, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:40.315285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcb0a7-6f99-4380-a4b4-ff4578750bc4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:40.331805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1395/2805] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:05:40 2022] PUT /identity/v3/projects/9b315d2833e541a19f3d51ca148be645/users/17bdf275259747bda83ce333f255bded/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:05:47.536897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848986d9-45ec-4bac-926a-8138159ec7ac None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:47.537408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848986d9-45ec-4bac-926a-8138159ec7ac None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:47.537524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848986d9-45ec-4bac-926a-8138159ec7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:47.568673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-848986d9-45ec-4bac-926a-8138159ec7ac None None] MFA Rules not processed for user `17bdf275259747bda83ce333f255bded`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:47.569870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-848986d9-45ec-4bac-926a-8138159ec7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:47.645537 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1411/2806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:50.326121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:53.846257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfd375-dedb-4d37-8679-2acddd91bacb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:53.847199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfd375-dedb-4d37-8679-2acddd91bacb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:53.847629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfd375-dedb-4d37-8679-2acddd91bacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:53.896379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c4cfd375-dedb-4d37-8679-2acddd91bacb None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:53.898124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4cfd375-dedb-4d37-8679-2acddd91bacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:54.054173 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1396/2807] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:05:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:56.224194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fb32e-0d63-48a8-baf6-132ec6b4f3a9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:56.224729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fb32e-0d63-48a8-baf6-132ec6b4f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:56.224729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fb32e-0d63-48a8-baf6-132ec6b4f3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:56.258208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b07fb32e-0d63-48a8-baf6-132ec6b4f3a9 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:05:56.259433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b07fb32e-0d63-48a8-baf6-132ec6b4f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:05:56.393284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1412/2808] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:05:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:05:56.409610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfd375-dedb-4d37-8679-2acddd91bacb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:05:56.551545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfd375-dedb-4d37-8679-2acddd91bacb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:05:56.562686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:05:56.563679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:05:56.566116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:05:56.566651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:05:56.585776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:05:56.587413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:05:56.613096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1397/2809] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:00.699608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fb32e-0d63-48a8-baf6-132ec6b4f3a9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:00.789299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:00.838928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fb32e-0d63-48a8-baf6-132ec6b4f3a9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:00.846596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:00.847657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:00.848062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:00.848435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] PATH_INFO: `/v3/users/5e216b8e6ecf4f0793f18d079664ef2a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:00.851079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e216b8e6ecf4f0793f18d079664ef2a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:00.855197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:00.949994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e216b8e6ecf4f0793f18d079664ef2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:00.950995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e216b8e6ecf4f0793f18d079664ef2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:00.978200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e216b8e6ecf4f0793f18d079664ef2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:00.999596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e216b8e6ecf4f0793f18d079664ef2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:01.017085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e216b8e6ecf4f0793f18d079664ef2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:01.080436 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1413/2810] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:00 2022] DELETE /identity/v3/users/5e216b8e6ecf4f0793f18d079664ef2a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:01.996391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:02.039211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db31c-d1f6-47e0-acf8-f9ce63291d2b service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:02.184672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:02.186093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:02.186540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:02.186974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] PATH_INFO: `/v3/projects/49417f8363204aa48ab7ba9ef892358e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:02.188431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49417f8363204aa48ab7ba9ef892358e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:02.190412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:02.285766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:02.326294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49417f8363204aa48ab7ba9ef892358e', 'request_id': 'req-7563b73a-486f-497c-8a93-f3ea482bffc6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.355887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49417f8363204aa48ab7ba9ef892358e', 'request_id': 'req-7563b73a-486f-497c-8a93-f3ea482bffc6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.374443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49417f8363204aa48ab7ba9ef892358e', 'request_id': 'req-7563b73a-486f-497c-8a93-f3ea482bffc6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.388865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] The token cache is being invalidate because project 49417f8363204aa48ab7ba9ef892358e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:02.389243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.390119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.396500 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1398/2811] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:01 2022] DELETE /identity/v3/projects/49417f8363204aa48ab7ba9ef892358e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:02.397355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:02.398817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:02.438470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f0ce1-a159-4032-b6c0-a7de1f34c057 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:02.559641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:02.561436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:02.561986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:02.562459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] PATH_INFO: `/v3/users/17bdf275259747bda83ce333f255bded` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:02.563962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bdf275259747bda83ce333f255bded)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:02.569103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:02.674189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bdf275259747bda83ce333f255bded'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.674910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bdf275259747bda83ce333f255bded'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.688983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:02.697988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bdf275259747bda83ce333f255bded'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.698921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bdf275259747bda83ce333f255bded'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.717140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d3c5530-496e-41de-873f-cbfab536a3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bdf275259747bda83ce333f255bded'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:02.749101 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1414/2812] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:02 2022] DELETE /identity/v3/users/17bdf275259747bda83ce333f255bded => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:06:03.398215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:03.399703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:03.423069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563b73a-486f-497c-8a93-f3ea482bffc6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:03.569817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:03.570990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:03.571278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:03.571663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] PATH_INFO: `/v3/projects/9b315d2833e541a19f3d51ca148be645` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:03.572939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b315d2833e541a19f3d51ca148be645)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:03.576214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:03.710336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b315d2833e541a19f3d51ca148be645', 'request_id': 'req-b96ae545-87bc-409c-a436-506ac0d8041c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:03.726405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b315d2833e541a19f3d51ca148be645', 'request_id': 'req-b96ae545-87bc-409c-a436-506ac0d8041c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:03.743960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b315d2833e541a19f3d51ca148be645', 'request_id': 'req-b96ae545-87bc-409c-a436-506ac0d8041c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:03.770347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] The token cache is being invalidate because project 9b315d2833e541a19f3d51ca148be645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:03.770710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:03.772407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b96ae545-87bc-409c-a436-506ac0d8041c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:03.779893 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1399/2813] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:03 2022] DELETE /identity/v3/projects/9b315d2833e541a19f3d51ca148be645 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:03.782020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a67c-0964-49e4-bc48-9be71a2bf88f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:03.782638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a67c-0964-49e4-bc48-9be71a2bf88f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:03.782638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518a67c-0964-49e4-bc48-9be71a2bf88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:03.821838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8518a67c-0964-49e4-bc48-9be71a2bf88f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:03.823133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8518a67c-0964-49e4-bc48-9be71a2bf88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:03.962768 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1415/2814] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:03.964822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032d36d-ce09-43c3-b538-d3139eeede24 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:03.965184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032d36d-ce09-43c3-b538-d3139eeede24 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:03.965470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032d36d-ce09-43c3-b538-d3139eeede24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.006080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6032d36d-ce09-43c3-b538-d3139eeede24 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:04.007359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6032d36d-ce09-43c3-b538-d3139eeede24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:04.050523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1400/2815] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:06:04.058005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518a67c-0964-49e4-bc48-9be71a2bf88f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:04.068776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518a67c-0964-49e4-bc48-9be71a2bf88f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:04.087917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:04.088641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.088927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.089249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.090021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:06:04.090317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:04.092093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:04.118942 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1416/2816] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:04.124027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032d36d-ce09-43c3-b538-d3139eeede24 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:04.137968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032d36d-ce09-43c3-b538-d3139eeede24 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:04.149948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:04.150904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.151344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.151952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.153192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:04.156215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:04.230183 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1401/2817] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:04 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:04.232844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:04.248203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54efdcc-fecd-40f2-bed5-aab00604f5bf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:04.371178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:04.372445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.373229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.374059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.375045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:04.378235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:04.440093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1417/2818] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:04 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:04.444493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:04.457079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced26c2-2aa9-46f6-b235-af325d1f3f36 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:04.465145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:04.465145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.465145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.465145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.465888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:04.468629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:04.481817 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1402/2819] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:06:04.485584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:04.500111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a28017-6cd0-43ee-b2d7-ae6c5c13e52c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:04.506223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe1598-a904-48a3-837f-0433362fdfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:04.507076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1598-a904-48a3-837f-0433362fdfae admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.507478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1598-a904-48a3-837f-0433362fdfae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.507873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1598-a904-48a3-837f-0433362fdfae admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.508745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1598-a904-48a3-837f-0433362fdfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:04.510976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1598-a904-48a3-837f-0433362fdfae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:04.525204 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1418/2820] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:04.528526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:04.545149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a51b-2b8c-4da3-96bb-1e87c24ea511 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:04.553013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92787d9-088a-4c06-8445-6ea1f0654dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:04.555298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92787d9-088a-4c06-8445-6ea1f0654dff admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.555742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92787d9-088a-4c06-8445-6ea1f0654dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.556217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92787d9-088a-4c06-8445-6ea1f0654dff admin admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2/users/d9fb28e51c6a4d88b03e3c1ed3365756/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.562602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:04.585501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92787d9-088a-4c06-8445-6ea1f0654dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f8b57202054341bfceac7ac36e6aa2, user_id=d9fb28e51c6a4d88b03e3c1ed3365756, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:04.589091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92787d9-088a-4c06-8445-6ea1f0654dff admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:04.611879 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1403/2821] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:04 2022] PUT /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2/users/d9fb28e51c6a4d88b03e3c1ed3365756/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:04.627243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467d4a-31b8-47b4-b590-1934eb7b2a23 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.627809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467d4a-31b8-47b4-b590-1934eb7b2a23 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.628222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467d4a-31b8-47b4-b590-1934eb7b2a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.664472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0a467d4a-31b8-47b4-b590-1934eb7b2a23 None None] MFA Rules not processed for user `d9fb28e51c6a4d88b03e3c1ed3365756`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:04.665778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0a467d4a-31b8-47b4-b590-1934eb7b2a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:04.723829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:04.780268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cce1ef-8776-4e80-af46-428f45ca841c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.780966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cce1ef-8776-4e80-af46-428f45ca841c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.780966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cce1ef-8776-4e80-af46-428f45ca841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.792572 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1419/2822] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:04.808472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-12cce1ef-8776-4e80-af46-428f45ca841c None None] MFA Rules not processed for user `035a5cccca15429e845012dd629d5038`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:04.809866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-12cce1ef-8776-4e80-af46-428f45ca841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:04.816529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467d4a-31b8-47b4-b590-1934eb7b2a23 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:04.925761 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1404/2823] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:04.940832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467d4a-31b8-47b4-b590-1934eb7b2a23 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:04.948786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:04.949506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:04.949781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:04.950055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:04.951214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:04.953802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:05.016179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1420/2824] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:04 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:05.017179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cce1ef-8776-4e80-af46-428f45ca841c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:05.038668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cce1ef-8776-4e80-af46-428f45ca841c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:05.135052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:05.135846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:05.136498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:05.136859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:05.137933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:05.140628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:05.176262 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1405/2825] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:05 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:05.180533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:05.195567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c274b0-de55-4dc2-a1c0-12dd648e4227 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:05.206839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:05.207661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:05.207976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:05.208316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:05.209153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:05.210841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:05.231279 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1421/2826] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:05.233540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:05.253935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff04f6-e12e-4f88-907a-3f17230a4cff admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:05.271438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:05.272697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:05.273213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:05.273720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] PATH_INFO: `/v3/projects/6de7e712204c45668865431891b4b1c1/users/41114174cd7d403d943506f4a171fcad/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:05.306287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de7e712204c45668865431891b4b1c1, user_id=41114174cd7d403d943506f4a171fcad, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:05.311257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:05.344919 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1406/2827] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:05 2022] PUT /identity/v3/projects/6de7e712204c45668865431891b4b1c1/users/41114174cd7d403d943506f4a171fcad/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:06:05.347352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:05.363136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b227c9f-9d7b-44f3-babe-6d39e3f6fee6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:05.484482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5788-3da8-47e5-8672-2f0e5f9aecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:05.485624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5788-3da8-47e5-8672-2f0e5f9aecf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:05.486177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5788-3da8-47e5-8672-2f0e5f9aecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:05.486675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5788-3da8-47e5-8672-2f0e5f9aecf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:05.487864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5788-3da8-47e5-8672-2f0e5f9aecf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:05.490107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5788-3da8-47e5-8672-2f0e5f9aecf1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:05.504071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1422/2828] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:05.508217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:05.527843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a851d-f1fc-4cb3-9ff1-86810ca54d49 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:05.539269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:05.540214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:05.540594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:05.540872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] PATH_INFO: `/v3/projects/6de7e712204c45668865431891b4b1c1/users/41114174cd7d403d943506f4a171fcad/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:05.548496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de7e712204c45668865431891b4b1c1, user_id=41114174cd7d403d943506f4a171fcad, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:05.556478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:05.588134 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1407/2829] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:05 2022] PUT /identity/v3/projects/6de7e712204c45668865431891b4b1c1/users/41114174cd7d403d943506f4a171fcad/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:05.603802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c017a3-5b2c-4a14-9931-f8235615f4e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:05.604980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c017a3-5b2c-4a14-9931-f8235615f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:05.605318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c017a3-5b2c-4a14-9931-f8235615f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:05.637764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-95c017a3-5b2c-4a14-9931-f8235615f4e1 None None] MFA Rules not processed for user `41114174cd7d403d943506f4a171fcad`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:05.639366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-95c017a3-5b2c-4a14-9931-f8235615f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:05.678492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:05.732600 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1423/2830] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:06.244428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:06.246575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:06.415155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:06.505700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84ace-186f-4b7e-a518-34ce460e3009 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:06.536412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:06.540683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:06.541123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:06.541618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:06.571480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:06.575676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:06.619544 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1408/2831] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:06.642634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752847-891c-4a2a-88c6-0210fd3ff133 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:06.643608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752847-891c-4a2a-88c6-0210fd3ff133 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:06.644073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752847-891c-4a2a-88c6-0210fd3ff133 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:06.646330 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1424/2832] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:06.658844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:06.673077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:06.702059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a38e89-dcb4-4f6f-b78e-3ea0f584e2e4 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:06.722720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:06.723534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:06.725943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:06.726228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:06.734803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:06.739514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:06.764197 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1409/2833] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:06 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:06.886725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a4df-4332-4c83-ab12-ef893f0cc779 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:06.886932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a4df-4332-4c83-ab12-ef893f0cc779 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:06.887191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a4df-4332-4c83-ab12-ef893f0cc779 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:06.891004 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1425/2834] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:06.911854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:06.939559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:06.958549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb094b5d-36e9-450b-a76b-cdcb949c6725 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:06.965275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:06.966254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:06.966601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:06.967051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:06.968771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:06.971085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:06.973857 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1410/2835] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:06 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:07.172399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce2a81-4523-4e1c-9243-fb901138cf9a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:07.173222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce2a81-4523-4e1c-9243-fb901138cf9a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:07.173541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce2a81-4523-4e1c-9243-fb901138cf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:07.221936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7fce2a81-4523-4e1c-9243-fb901138cf9a None None] MFA Rules not processed for user `d9fb28e51c6a4d88b03e3c1ed3365756`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:07.223206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7fce2a81-4523-4e1c-9243-fb901138cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:07.355486 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1426/2836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:07.363996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:07.366233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:07.395983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180576-d703-4d7b-a703-f5ceca27ba5c tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:07.404495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:07.415151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:07.415368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:07.415477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:07.458317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:07.460156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:07.498781 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1411/2837] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:08.171816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce123-61d4-496b-a674-c873896173d3 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:08.173072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce123-61d4-496b-a674-c873896173d3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:08.173522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce123-61d4-496b-a674-c873896173d3 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:08.175307 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1427/2838] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:08.194052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:08.214679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:08.255870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79547aca-3b5e-43ef-b3a8-1969a8db5b6a service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:08.275975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:08.276868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:08.277174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:08.277444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:08.279814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:08.281906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:08.286703 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1412/2839] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:08 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:08.506261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bce87-6819-4d97-999f-d3634e853188 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:08.508154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bce87-6819-4d97-999f-d3634e853188 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:08.508457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bce87-6819-4d97-999f-d3634e853188 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:08.510608 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1428/2840] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:08.522595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:08.541245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:08.554977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3bc9-e172-443b-b82b-0a99aaf3daaa tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:08.563710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:08.565334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:08.565865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:08.566581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:08.569756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:08.572144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:08.583363 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1413/2841] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:08 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:08.821154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854887-d855-4ef1-a75e-026f1df519ba None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:08.821446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854887-d855-4ef1-a75e-026f1df519ba None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:08.821725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854887-d855-4ef1-a75e-026f1df519ba None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:08.823402 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1429/2842] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:08.844496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:08.866908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:08.884180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b6f92-bbaa-4800-b04b-4ce71868f2b2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:08.893603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709ab1b-89ee-463f-b57d-01aeba403e1a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:08.895098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ab1b-89ee-463f-b57d-01aeba403e1a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:08.895738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ab1b-89ee-463f-b57d-01aeba403e1a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:08.896182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ab1b-89ee-463f-b57d-01aeba403e1a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:08.898259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ab1b-89ee-463f-b57d-01aeba403e1a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:08.900704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ab1b-89ee-463f-b57d-01aeba403e1a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:08.914089 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1414/2843] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:08 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:09.035674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:09.035881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:09.036130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:09.057831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] MFA Rules not processed for user `d9fb28e51c6a4d88b03e3c1ed3365756`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:09.059043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:09.069527 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1430/2844] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:09.664848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8071bcb-787e-48e5-88df-7df6d7fb5504 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:09.665497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8071bcb-787e-48e5-88df-7df6d7fb5504 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:09.665582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8071bcb-787e-48e5-88df-7df6d7fb5504 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:09.667158 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1415/2845] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:09.681658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:09.702833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:09.721770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f58c0-21ca-4e2d-bd92-9a448b5e073a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:09.731614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:09.733000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:09.734160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:09.734681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:09.736245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:09.738648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:09.744083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1431/2846] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:09 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:09.919543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854580-6de2-46c2-b00f-533e401250cb None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:09.919923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854580-6de2-46c2-b00f-533e401250cb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:09.920198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854580-6de2-46c2-b00f-533e401250cb None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:09.923376 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1416/2847] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:09.936752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:09.974433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:09.988843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5381331-068d-4b82-827d-fc2e99c69edb tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:09.997081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:09.998327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:09.998842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:09.999353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:10.001247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:10.003627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:10.006140 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1432/2848] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:09 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:10.330831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4586-2970-4bad-84be-e1787754d2bb None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:10.331118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4586-2970-4bad-84be-e1787754d2bb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:10.331431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4586-2970-4bad-84be-e1787754d2bb None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:10.332829 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1417/2849] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:10.342316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:10.377003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:10.387097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269c7d-c607-436d-9a14-f28f3570199e tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:10.392817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e382fe-d43c-4886-9c47-5769054ab29a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:10.393988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e382fe-d43c-4886-9c47-5769054ab29a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:10.394340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e382fe-d43c-4886-9c47-5769054ab29a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:10.394735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e382fe-d43c-4886-9c47-5769054ab29a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:10.396129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e382fe-d43c-4886-9c47-5769054ab29a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:10.398507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e382fe-d43c-4886-9c47-5769054ab29a tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:10.401019 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1433/2850] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:10 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:10.582329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:10.582329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:10.582635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:10.643647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] MFA Rules not processed for user `d9fb28e51c6a4d88b03e3c1ed3365756`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:10.651887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:10.691529 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1418/2851] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:11.895264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328f0f-3342-4b15-8971-b5657286efe2 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:11.895893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328f0f-3342-4b15-8971-b5657286efe2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:11.895997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5328f0f-3342-4b15-8971-b5657286efe2 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:11.898055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1434/2852] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:11.908378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:06:11.929619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:11.962245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f984e4-cfda-44d5-951b-ce19feaf61f5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:11.980859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b61e5-c568-41d9-a6e0-c8e01c7c06f2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41114174cd7d403d943506f4a171fcad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6de7e712204c45668865431891b4b1c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:11.983813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b61e5-c568-41d9-a6e0-c8e01c7c06f2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:11.985583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b61e5-c568-41d9-a6e0-c8e01c7c06f2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:11.986701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b61e5-c568-41d9-a6e0-c8e01c7c06f2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:11.989971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b61e5-c568-41d9-a6e0-c8e01c7c06f2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:11.994176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b61e5-c568-41d9-a6e0-c8e01c7c06f2 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:12.011832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1419/2853] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:06:11 2022] GET /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 383 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:12.173402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328f0f-3342-4b15-8971-b5657286efe2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:12.320989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5328f0f-3342-4b15-8971-b5657286efe2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:12.327213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:12.328261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:12.328571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:12.328904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] PATH_INFO: `/v3/users/d9fb28e51c6a4d88b03e3c1ed3365756` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:12.330496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fb28e51c6a4d88b03e3c1ed3365756)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:12.333315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:12.405548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:12.419972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fb28e51c6a4d88b03e3c1ed3365756'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:12.420987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fb28e51c6a4d88b03e3c1ed3365756'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:12.443248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fb28e51c6a4d88b03e3c1ed3365756'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:12.445291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fb28e51c6a4d88b03e3c1ed3365756'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:12.454385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fb28e51c6a4d88b03e3c1ed3365756'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:12.491837 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1435/2854] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:12 2022] DELETE /identity/v3/users/d9fb28e51c6a4d88b03e3c1ed3365756 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:12.493511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:12.493798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:12.494071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:12.537506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:12.538764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:12.676217 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1420/2855] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:12.687417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:12.690072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:12.816288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290024a1-eb69-47b6-bb0d-142725922806 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:12.826831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:12.827530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:12.827855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:12.828132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:12.858931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:12.867345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:12.890853 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1436/2856] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:14.682617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:14.684455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:14.709290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6cc49-4572-4465-89e2-6bef0bbe49ee None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:14.727017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:14.732957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:14.734312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:14.740402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] PATH_INFO: `/v3/projects/d8f8b57202054341bfceac7ac36e6aa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:14.743292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f8b57202054341bfceac7ac36e6aa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:14.749997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:14.889436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:14.892977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f8b57202054341bfceac7ac36e6aa2', 'request_id': 'req-6baca1e1-2795-4938-81ae-366734af508e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:14.907195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f8b57202054341bfceac7ac36e6aa2', 'request_id': 'req-6baca1e1-2795-4938-81ae-366734af508e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:14.923273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f8b57202054341bfceac7ac36e6aa2', 'request_id': 'req-6baca1e1-2795-4938-81ae-366734af508e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:14.942036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] The token cache is being invalidate because project d8f8b57202054341bfceac7ac36e6aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:14.943236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:14.944117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:14.949778 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1421/2857] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:14 2022] DELETE /identity/v3/projects/d8f8b57202054341bfceac7ac36e6aa2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:14.950863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:14.965100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1c35c-69d2-47b2-b12f-fbe8e7ea5a91 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:15.047881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:15.049022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.049332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.049612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] PATH_INFO: `/v3/users/41114174cd7d403d943506f4a171fcad` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.051284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41114174cd7d403d943506f4a171fcad)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:15.053262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:15.140939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41114174cd7d403d943506f4a171fcad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.141794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41114174cd7d403d943506f4a171fcad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.175138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41114174cd7d403d943506f4a171fcad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.175138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:15.175611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41114174cd7d403d943506f4a171fcad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.191450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17055b27-791b-43d3-8f06-1e28284a455e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41114174cd7d403d943506f4a171fcad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.208176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1437/2858] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:14 2022] DELETE /identity/v3/users/41114174cd7d403d943506f4a171fcad => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:15.516303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:15.517745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:15.539409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca1e1-2795-4938-81ae-366734af508e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:15.561731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.562133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.562526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.584460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:15.585736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:15.606621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:15.607887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.608272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.608823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] PATH_INFO: `/v3/projects/6de7e712204c45668865431891b4b1c1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.611342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de7e712204c45668865431891b4b1c1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:15.614885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:15.656453 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1438/2859] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:06:15.667343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de7e712204c45668865431891b4b1c1', 'request_id': 'req-597833be-5473-482a-8f49-614fe816d11a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.674251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de7e712204c45668865431891b4b1c1', 'request_id': 'req-597833be-5473-482a-8f49-614fe816d11a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.681766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:15.683577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:15.686049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de7e712204c45668865431891b4b1c1', 'request_id': 'req-597833be-5473-482a-8f49-614fe816d11a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.705267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] The token cache is being invalidate because project 6de7e712204c45668865431891b4b1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:15.706108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.706911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-597833be-5473-482a-8f49-614fe816d11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:15.726609 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1422/2860] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:15 2022] DELETE /identity/v3/projects/6de7e712204c45668865431891b4b1c1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:15.728245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd64e1-77c9-4b1c-aaed-37f4a6420746 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.728521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd64e1-77c9-4b1c-aaed-37f4a6420746 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.728798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd64e1-77c9-4b1c-aaed-37f4a6420746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.748982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-17fd64e1-77c9-4b1c-aaed-37f4a6420746 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:15.750883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-17fd64e1-77c9-4b1c-aaed-37f4a6420746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:15.781350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ac6ae-4d4f-497f-ab13-e3df871cfcb9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:15.827602 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1423/2861] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:15.836925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a4d9-b399-4bc2-b744-7b318fe72855 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.837344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a4d9-b399-4bc2-b744-7b318fe72855 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.838338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a4d9-b399-4bc2-b744-7b318fe72855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.862488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:15.870583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5583a4d9-b399-4bc2-b744-7b318fe72855 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:15.872683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5583a4d9-b399-4bc2-b744-7b318fe72855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:15.877530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:15.878234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.878650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.878916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.880934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:15.886276 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1424/2862] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:06:15.890669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a4d9-b399-4bc2-b744-7b318fe72855 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:15.914813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a4d9-b399-4bc2-b744-7b318fe72855 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:15.927685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:15.929297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.929563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.931897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.932773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:06:15.933118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:15.936996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:15.961090 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1425/2863] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:15.961933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:15.962505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:15.976702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6124e76-2295-45f7-b124-26946a262e5b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:15.982427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:15.983264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:15.983689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:15.984066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:15.984668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:15.987309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.036750 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1426/2864] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:15 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:06:16.037643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.040104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.042095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.054167 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1439/2865] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:06:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:16.123209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7fd43-3a2b-46d8-a168-d08c71ddf7fd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.128793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.129684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.131262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.131609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.132308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.134355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.166975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1427/2866] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:16 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:16.168352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.188695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413be90d-37a8-45ee-b169-0ff7b1259d5c service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.194611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.195317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.195602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.195880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.196625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.199280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.243984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1440/2867] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:06:16.245518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.257816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f5f8b-d173-44de-a493-3045beeaf628 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.263067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db41dc9-4604-43ec-8a4f-ff309988ba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.263996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db41dc9-4604-43ec-8a4f-ff309988ba5a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.264247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db41dc9-4604-43ec-8a4f-ff309988ba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.264574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db41dc9-4604-43ec-8a4f-ff309988ba5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.265934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db41dc9-4604-43ec-8a4f-ff309988ba5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.267626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db41dc9-4604-43ec-8a4f-ff309988ba5a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.281630 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1428/2868] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:16.283487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.295401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0a6a5-c33e-4465-8e7c-23f26527eb27 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.300581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.301738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.302093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.303008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] PATH_INFO: `/v3/projects/1bd5b89d294a4ce588fc4dd900fe952c/users/33ec146b95734dcea62aad13f5105bdd/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.320395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd5b89d294a4ce588fc4dd900fe952c, user_id=33ec146b95734dcea62aad13f5105bdd, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.323517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.339289 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1441/2869] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:16 2022] PUT /identity/v3/projects/1bd5b89d294a4ce588fc4dd900fe952c/users/33ec146b95734dcea62aad13f5105bdd/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:16.351287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.351656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.352042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.389652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] MFA Rules not processed for user `33ec146b95734dcea62aad13f5105bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:16.392237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:16.489119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1429/2870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:16.492234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.526401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.527794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:16.565013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:16.576908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4eb6-0be7-42eb-ab95-8535fe42b59c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.581768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.582442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.582721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.582989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.583745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.585709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.592251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b4eb5-b600-40b2-9223-4000e4ba6748 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.596165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604000a6-e827-4ce8-9c98-827fbee3fe12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.596902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604000a6-e827-4ce8-9c98-827fbee3fe12 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.597288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604000a6-e827-4ce8-9c98-827fbee3fe12 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.597636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604000a6-e827-4ce8-9c98-827fbee3fe12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.599512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-604000a6-e827-4ce8-9c98-827fbee3fe12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:16.615019 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1442/2871] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:16 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:16.618928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.693827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604000a6-e827-4ce8-9c98-827fbee3fe12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.695051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001af2-fe3a-49a4-be45-7997b0b357e6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.695189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604000a6-e827-4ce8-9c98-827fbee3fe12 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.700992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.702029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.702505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.702831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.703632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.705793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.707539 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1430/2872] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:06:16.708990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8711b-f6ca-4af6-b29c-7216f771cfa9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.709326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8711b-f6ca-4af6-b29c-7216f771cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.709601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8711b-f6ca-4af6-b29c-7216f771cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.727931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-52b8711b-f6ca-4af6-b29c-7216f771cfa9 None None] MFA Rules not processed for user `4eef98c56e744064b2b5f131c3766c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:16.729271 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1443/2873] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:16 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:06:16.729403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-52b8711b-f6ca-4af6-b29c-7216f771cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:16.733524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.746188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3723d-e21a-4295-be4e-c45409806583 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.752387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.753338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.753623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.753899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.754638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.757078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.760297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:16.775779 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1444/2874] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:06:16.777180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.788295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca8a6d-b02d-4870-8df3-d8aac86fc101 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.792297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1431/2875] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:16.794038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.795024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.795309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.795952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] PATH_INFO: `/v3/projects/3cc1ea33e5234f28a39320c835dca69c/users/8d0510f569a64acd8d80a58399597124/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.816568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc1ea33e5234f28a39320c835dca69c, user_id=8d0510f569a64acd8d80a58399597124, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.820926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.835901 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1445/2876] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:16 2022] PUT /identity/v3/projects/3cc1ea33e5234f28a39320c835dca69c/users/8d0510f569a64acd8d80a58399597124/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:16.839897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8711b-f6ca-4af6-b29c-7216f771cfa9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.851203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8711b-f6ca-4af6-b29c-7216f771cfa9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.912493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d574bc-1efd-49ec-a732-ee21f42158aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.913208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d574bc-1efd-49ec-a732-ee21f42158aa admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.913607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d574bc-1efd-49ec-a732-ee21f42158aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.913888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d574bc-1efd-49ec-a732-ee21f42158aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.914620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d574bc-1efd-49ec-a732-ee21f42158aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.916979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d574bc-1efd-49ec-a732-ee21f42158aa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.928581 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1432/2877] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:16.932415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:16.944788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab682d-abf6-4390-898a-517344fb74ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:16.954505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b84a0e-9aa7-4676-8a74-b9eb3a08c38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:16.954505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b84a0e-9aa7-4676-8a74-b9eb3a08c38d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.954505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b84a0e-9aa7-4676-8a74-b9eb3a08c38d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.954505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b84a0e-9aa7-4676-8a74-b9eb3a08c38d admin admin] PATH_INFO: `/v3/projects/3cc1ea33e5234f28a39320c835dca69c/users/8d0510f569a64acd8d80a58399597124/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:16.957062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b84a0e-9aa7-4676-8a74-b9eb3a08c38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc1ea33e5234f28a39320c835dca69c, user_id=8d0510f569a64acd8d80a58399597124, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:16.959789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b84a0e-9aa7-4676-8a74-b9eb3a08c38d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:16.973990 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1446/2878] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:16 2022] PUT /identity/v3/projects/3cc1ea33e5234f28a39320c835dca69c/users/8d0510f569a64acd8d80a58399597124/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:16.985679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:16.986014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:16.986272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:17.032765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] MFA Rules not processed for user `8d0510f569a64acd8d80a58399597124`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:17.034023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:17.039446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:17.138603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc795-0eae-4476-8d7d-3f3625c14512 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:17.138895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc795-0eae-4476-8d7d-3f3625c14512 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:17.139107 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1433/2879] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:17.139663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dc795-0eae-4476-8d7d-3f3625c14512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:17.172247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6f5dc795-0eae-4476-8d7d-3f3625c14512 None None] MFA Rules not processed for user `33ec146b95734dcea62aad13f5105bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:17.173703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6f5dc795-0eae-4476-8d7d-3f3625c14512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:17.239921 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1447/2880] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:17.414988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:17.416597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:17.539374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647a6dc-1765-4862-9e9c-26a939b859f3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:17.546030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:17.546900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:17.547215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:17.547465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:17.561262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:17.563941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:17.583968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1434/2881] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:18.285270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc795-0eae-4476-8d7d-3f3625c14512 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:18.323023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:18.325172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:18.426045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ece90-95eb-46e3-b467-c7ecf13cb855 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:18.432659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca660b-6531-4399-89c4-54a6218bd9ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:18.434505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca660b-6531-4399-89c4-54a6218bd9ed service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:18.434505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca660b-6531-4399-89c4-54a6218bd9ed service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:18.434505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca660b-6531-4399-89c4-54a6218bd9ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:18.437361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5dca660b-6531-4399-89c4-54a6218bd9ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:18.453525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca660b-6531-4399-89c4-54a6218bd9ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:18.455395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca660b-6531-4399-89c4-54a6218bd9ed service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:18.470336 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1435/2882] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:06:18.484322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dc795-0eae-4476-8d7d-3f3625c14512 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:18.493339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7790-4955-4f91-bae5-acc7805a0d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:18.494076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7790-4955-4f91-bae5-acc7805a0d1e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:18.494361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7790-4955-4f91-bae5-acc7805a0d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:18.494632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7790-4955-4f91-bae5-acc7805a0d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:18.498184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-27cb7790-4955-4f91-bae5-acc7805a0d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:18.518936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7790-4955-4f91-bae5-acc7805a0d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:18.522072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7790-4955-4f91-bae5-acc7805a0d1e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:18.543345 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1448/2883] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:21.232566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805918b-d2fa-43c6-9a82-2783380a60fc None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:21.233142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805918b-d2fa-43c6-9a82-2783380a60fc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:21.233524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805918b-d2fa-43c6-9a82-2783380a60fc None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:21.235927 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1436/2884] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:06:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:21.241907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:21.242874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:21.243383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:21.264898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:21.266537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:21.277767 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1449/2885] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:06:21.302541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805918b-d2fa-43c6-9a82-2783380a60fc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:21.325590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805918b-d2fa-43c6-9a82-2783380a60fc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:21.352905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:21.353849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:21.354224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:21.354597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:21.380695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:21.386078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:21.413834 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1437/2886] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:25.268260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:25.269908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:25.293726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713986d8-1e7b-4650-bc64-e59c25583612 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:25.304280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0e99-b6a2-4c9a-95a0-70e6bcdd947a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:25.305217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0e99-b6a2-4c9a-95a0-70e6bcdd947a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:25.305911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0e99-b6a2-4c9a-95a0-70e6bcdd947a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:25.306358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0e99-b6a2-4c9a-95a0-70e6bcdd947a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:25.309369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-68ad0e99-b6a2-4c9a-95a0-70e6bcdd947a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:25.327769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:25.332466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:25.337122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0e99-b6a2-4c9a-95a0-70e6bcdd947a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:25.339932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8c49-cc46-4aa3-996a-946ec21324b9 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:25.344383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0e99-b6a2-4c9a-95a0-70e6bcdd947a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:25.348165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:25.348953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:25.349375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:25.349732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:25.369107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:25.369398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1450/2887] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:25.371025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:25.388851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1438/2888] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:35.361609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:35.384688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:38.041978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:38.042456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:38.042586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:38.093192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:38.093653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:38.245399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1451/2889] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:38.692888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:38.694893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:38.738324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628dbfd-4d5c-4e28-b856-61978a39c9b3 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:38.753600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c0d4-55ed-4b05-9963-783deb1957d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:38.754309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c0d4-55ed-4b05-9963-783deb1957d8 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:38.754600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c0d4-55ed-4b05-9963-783deb1957d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:38.754871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c0d4-55ed-4b05-9963-783deb1957d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:38.765217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5bb3c0d4-55ed-4b05-9963-783deb1957d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:38.794968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c0d4-55ed-4b05-9963-783deb1957d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:38.798112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c0d4-55ed-4b05-9963-783deb1957d8 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:38.827213 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1439/2890] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:40.143755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:40.145335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:40.239021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e0d1e-ccf1-4ef6-89c4-4ee5b244bd66 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:40.245659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:40.247063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:40.247472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:40.247726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] PATH_INFO: `/v3/users/f8783e0de2414f20ade6604bd0089fab` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:40.250038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8783e0de2414f20ade6604bd0089fab)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:40.252512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:40.326180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8783e0de2414f20ade6604bd0089fab'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:40.326650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8783e0de2414f20ade6604bd0089fab'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:40.359821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8783e0de2414f20ade6604bd0089fab'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:40.360787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8783e0de2414f20ade6604bd0089fab'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:40.370524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8783e0de2414f20ade6604bd0089fab'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:40.387773 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1452/2891] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:40 2022] DELETE /identity/v3/users/f8783e0de2414f20ade6604bd0089fab => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:40.392516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:40.393068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:40.393339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:40.412873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:40.414127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:40.512885 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1440/2892] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:40.522602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:40.524132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:40.558199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:40.596020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efbf74-c14d-48ff-8dd0-69f17fa040e7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:40.606871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:40.607840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:40.608178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:40.608460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:40.619992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:40.622131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:40.634176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1453/2893] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:40.849814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:40.852355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:40.877998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8569a-1eb4-4767-9689-a1d504ac847c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:40.887462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:40.898508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:40.899739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:40.900254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] PATH_INFO: `/v3/projects/24245a540466462bb9a908267f505f28` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:40.906526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24245a540466462bb9a908267f505f28)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:40.908918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:40.988715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24245a540466462bb9a908267f505f28', 'request_id': 'req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:40.997543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24245a540466462bb9a908267f505f28', 'request_id': 'req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.008650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24245a540466462bb9a908267f505f28', 'request_id': 'req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.022923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] The token cache is being invalidate because project 24245a540466462bb9a908267f505f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:41.023314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.026530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f8b6048-576c-4aa7-9c3e-57ea27375ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.028658 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1441/2894] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:40 2022] DELETE /identity/v3/projects/24245a540466462bb9a908267f505f28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:41.033677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:41.047753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9b3b-6a53-4e4f-a305-3bd28158c391 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:41.113752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:41.115309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.115730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.116098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] PATH_INFO: `/v3/users/4fbe8bdaf5d54ddcac851d92ae9b1a7c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.117670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbe8bdaf5d54ddcac851d92ae9b1a7c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:41.119772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:41.179765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbe8bdaf5d54ddcac851d92ae9b1a7c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.180495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbe8bdaf5d54ddcac851d92ae9b1a7c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.213577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbe8bdaf5d54ddcac851d92ae9b1a7c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.214721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbe8bdaf5d54ddcac851d92ae9b1a7c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.222970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-247f709b-5633-4569-a217-0dee44587c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbe8bdaf5d54ddcac851d92ae9b1a7c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.244887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d50e-49e7-4315-8feb-1702a123de20 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.245403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d50e-49e7-4315-8feb-1702a123de20 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.245835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d50e-49e7-4315-8feb-1702a123de20 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.248168 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1442/2896] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:06:41.250148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1454/2896] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:41 2022] DELETE /identity/v3/users/4fbe8bdaf5d54ddcac851d92ae9b1a7c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:41.251998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65d50e-49e7-4315-8feb-1702a123de20 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:41.255092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ac65d50e-49e7-4315-8feb-1702a123de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.262844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.263497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.266372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.304803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:41.306702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.376746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65d50e-49e7-4315-8feb-1702a123de20 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:41.384058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:41.385741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.386238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.386521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] PATH_INFO: `/v3/users/545b6c16175f418587d6c8649b3ba8b0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.387825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] RBAC: Authorizing `identity:delete_user(user_id=545b6c16175f418587d6c8649b3ba8b0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:41.391150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:41.398879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:41.413521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:41.455615 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1455/2897] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:41.471170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545b6c16175f418587d6c8649b3ba8b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.471928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545b6c16175f418587d6c8649b3ba8b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.489444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545b6c16175f418587d6c8649b3ba8b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.490298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545b6c16175f418587d6c8649b3ba8b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.491272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:41.500579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.502701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545b6c16175f418587d6c8649b3ba8b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.529214 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1443/2898] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:41 2022] DELETE /identity/v3/users/545b6c16175f418587d6c8649b3ba8b0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:06:41.530903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:41.533307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.536487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326954e8-6b03-4cc4-9153-3ba0c19f56f7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:41.657939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7d686-bb18-4e6e-8bca-e632ae649211 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:41.659191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d686-bb18-4e6e-8bca-e632ae649211 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.659696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d686-bb18-4e6e-8bca-e632ae649211 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.660233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d686-bb18-4e6e-8bca-e632ae649211 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.670857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a6f7d686-bb18-4e6e-8bca-e632ae649211 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.673833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35505350-d5d0-4aa5-ab86-14581e36298d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:41.683265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:41.684635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.685084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.686196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] PATH_INFO: `/v3/projects/a6a5988d0538426288555ee3fc2bfec4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.688406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a5988d0538426288555ee3fc2bfec4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:41.689022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7d686-bb18-4e6e-8bca-e632ae649211 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:41.691030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7d686-bb18-4e6e-8bca-e632ae649211 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:41.693265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:41.706162 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1456/2899] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:41.708496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b196-6e81-4ec5-ae57-c47f35e8b962 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.709021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b196-6e81-4ec5-ae57-c47f35e8b962 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.709846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b196-6e81-4ec5-ae57-c47f35e8b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.735420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1148b196-6e81-4ec5-ae57-c47f35e8b962 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:41.744375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1148b196-6e81-4ec5-ae57-c47f35e8b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.766138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a5988d0538426288555ee3fc2bfec4', 'request_id': 'req-d4bdb96b-07ef-4531-944d-1cd9011be113'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.774965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a5988d0538426288555ee3fc2bfec4', 'request_id': 'req-d4bdb96b-07ef-4531-944d-1cd9011be113'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.787746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a5988d0538426288555ee3fc2bfec4', 'request_id': 'req-d4bdb96b-07ef-4531-944d-1cd9011be113'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.805853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] The token cache is being invalidate because project a6a5988d0538426288555ee3fc2bfec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:41.806296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.807115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:41.815064 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1444/2900] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:41 2022] DELETE /identity/v3/projects/a6a5988d0538426288555ee3fc2bfec4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:41.815064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:41.815064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.857292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:41.870430 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1457/2901] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:41.872048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.872346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.872616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:41.901872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:41.907106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.932690 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1458/2902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:41.932690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:41.933705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:41.962960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdb96b-07ef-4531-944d-1cd9011be113 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:41.990765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:41.992808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:41.993171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:41.993484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.003011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:42.033258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7f4d-80d8-4d56-8554-494a4b95c492 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.037653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb216f-c683-4aba-839c-65ad8db01472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.038351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb216f-c683-4aba-839c-65ad8db01472 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.038661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb216f-c683-4aba-839c-65ad8db01472 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.039593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb216f-c683-4aba-839c-65ad8db01472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.069426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb216f-c683-4aba-839c-65ad8db01472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.070932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb216f-c683-4aba-839c-65ad8db01472 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.091682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1459/2903] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:42.093285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1d85-0b6d-45c2-a769-58cd29a55a26 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.093727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1d85-0b6d-45c2-a769-58cd29a55a26 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.094009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1d85-0b6d-45c2-a769-58cd29a55a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.124739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-70ec1d85-0b6d-45c2-a769-58cd29a55a26 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:42.126512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-70ec1d85-0b6d-45c2-a769-58cd29a55a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:42.140489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.147959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.155093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1460/2904] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:42.159498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec1d85-0b6d-45c2-a769-58cd29a55a26 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.167930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:42.173366 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1445/2905] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:42.176712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec1d85-0b6d-45c2-a769-58cd29a55a26 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.183337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809098a-0524-4bc0-8c81-02e9061c9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.184963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809098a-0524-4bc0-8c81-02e9061c9326 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.185435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809098a-0524-4bc0-8c81-02e9061c9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.185711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809098a-0524-4bc0-8c81-02e9061c9326 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.186499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809098a-0524-4bc0-8c81-02e9061c9326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:06:42.186803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809098a-0524-4bc0-8c81-02e9061c9326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.188570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809098a-0524-4bc0-8c81-02e9061c9326 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.205529 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1461/2906] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:42.213414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.227241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9179b1-6eab-45c2-8038-e484732f9f16 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.232092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.232805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.233208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.253796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.254300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.254726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.255007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.257558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.261938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.271222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] MFA Rules not processed for user `33ec146b95734dcea62aad13f5105bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:42.275138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:42.328143 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1446/2907] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:42 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:06:42.331306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.436685 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1462/2908] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:42.437853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.439936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:42.455510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2de9f2-65df-480c-8646-df8a87f6717e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.489482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250052b-74f4-4e47-87a4-d10eccd0fee6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.497252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.498582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.498866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.499139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.499882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.501922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.536427 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1447/2909] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:42 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:42.540847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.546130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.547112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.547402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.547675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] PATH_INFO: `/v3/projects/c5285b07988c4c8581f047981271fee1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.550221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5285b07988c4c8581f047981271fee1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.552202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.558788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee988d3-9d05-4620-ae73-37fd978baa14 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.566928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.567587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.567869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.568260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.569263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.570931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.582291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1448/2910] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:06:42.588388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.604948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed60eeb-7b7b-4978-89bf-4a0c24950f1b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.614737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.616768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.617080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.617663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.618247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.619853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.622312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:42.636999 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1449/2911] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:42.642073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.643696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5285b07988c4c8581f047981271fee1', 'request_id': 'req-af9ac40c-2b90-4999-9599-85210d463198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:42.652962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5285b07988c4c8581f047981271fee1', 'request_id': 'req-af9ac40c-2b90-4999-9599-85210d463198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:42.654671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012489a-8114-47b7-84fe-3b7f8bf919cf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.680913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5285b07988c4c8581f047981271fee1', 'request_id': 'req-af9ac40c-2b90-4999-9599-85210d463198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:42.698224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] The token cache is being invalidate because project c5285b07988c4c8581f047981271fee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:42.698529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:42.699361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:42.701997 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1463/2912] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:42 2022] DELETE /identity/v3/projects/c5285b07988c4c8581f047981271fee1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:42.706608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.710885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:42.730659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b67ae1-bee0-4945-85ac-e28f05b6e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.732174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b67ae1-bee0-4945-85ac-e28f05b6e2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.732816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b67ae1-bee0-4945-85ac-e28f05b6e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.733465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b67ae1-bee0-4945-85ac-e28f05b6e2a5 admin admin] PATH_INFO: `/v3/projects/6a3b4b4b24df43cdb92b0a8206d14ef0/users/8097bb116d8f47b2aca3970d51a46030/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.752258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:42.752951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b67ae1-bee0-4945-85ac-e28f05b6e2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3b4b4b24df43cdb92b0a8206d14ef0, user_id=8097bb116d8f47b2aca3970d51a46030, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.758602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b67ae1-bee0-4945-85ac-e28f05b6e2a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.786448 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1450/2913] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:42 2022] PUT /identity/v3/projects/6a3b4b4b24df43cdb92b0a8206d14ef0/users/8097bb116d8f47b2aca3970d51a46030/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:42.788238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.788629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.788946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.810423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ac40c-2b90-4999-9599-85210d463198 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.836944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] MFA Rules not processed for user `8097bb116d8f47b2aca3970d51a46030`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:42.839060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:42.898645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.900223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.900597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.900945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] PATH_INFO: `/v3/users/7c9c0427e9ba4117993b96d033cb767c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.902893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9c0427e9ba4117993b96d033cb767c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.909456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.938395 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1451/2914] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:42.943274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:42.945809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:42.963890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8869bb-0db7-4122-ae68-dc889cdd4ac3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:42.971035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:42.971981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:42.972361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:42.972794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:42.973838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:42.976077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:42.979282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9c0427e9ba4117993b96d033cb767c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:42.979995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9c0427e9ba4117993b96d033cb767c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.000222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9c0427e9ba4117993b96d033cb767c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.001310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9c0427e9ba4117993b96d033cb767c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.015263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9c0427e9ba4117993b96d033cb767c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.019054 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1452/2915] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:42 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:06:43.024696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:43.027794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:43.041510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1464/2916] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:42 2022] DELETE /identity/v3/users/7c9c0427e9ba4117993b96d033cb767c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:43.097172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:43.128055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b691c9-34ef-4b7b-9182-5087c55689f7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:43.206673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:43.207937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.207937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.208163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.209130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:43.211753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:43.236344 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1453/2917] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:43 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:43.240477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:43.255477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3197-60fe-4322-8d55-faec4bd9321c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:43.263889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:43.264271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.264563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.264842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.265695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:43.267356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:43.283622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:43.284584 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1465/2918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:43.295516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db31b6-1cf6-40c4-a797-7a699abeb317 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:43.300995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:43.302143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.302524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.302943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] PATH_INFO: `/v3/projects/f0a214b7d9ac42b2a43d434f3593178d/users/d5571a432f114a9a9bef8f52a213a759/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.331525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a214b7d9ac42b2a43d434f3593178d, user_id=d5571a432f114a9a9bef8f52a213a759, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:43.335586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:43.356822 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1454/2919] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:43 2022] PUT /identity/v3/projects/f0a214b7d9ac42b2a43d434f3593178d/users/d5571a432f114a9a9bef8f52a213a759/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:43.361078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:43.383295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c9d6-7008-421a-8d16-a020079e7f52 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:43.455060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:43.490144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:43.491129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.491695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.492285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.493638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:43.496365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:43.518075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:43.525389 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1466/2920] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:06:43.540552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049af39e-7d19-4d30-8153-cef917844e57 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:43.551520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996133a-319a-473f-be26-ed56163344f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:43.552469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996133a-319a-473f-be26-ed56163344f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.552756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996133a-319a-473f-be26-ed56163344f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.553917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996133a-319a-473f-be26-ed56163344f2 admin admin] PATH_INFO: `/v3/projects/f0a214b7d9ac42b2a43d434f3593178d/users/d5571a432f114a9a9bef8f52a213a759/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.556765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996133a-319a-473f-be26-ed56163344f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a214b7d9ac42b2a43d434f3593178d, user_id=d5571a432f114a9a9bef8f52a213a759, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:43.562039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996133a-319a-473f-be26-ed56163344f2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:43.573624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:43.575708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:43.606275 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1455/2921] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:43 2022] PUT /identity/v3/projects/f0a214b7d9ac42b2a43d434f3593178d/users/d5571a432f114a9a9bef8f52a213a759/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:43.606473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a5aff-0deb-4b42-bf25-d74b5291a248 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:43.684956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456e24-d701-489f-8045-7b0fa45654ac None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.685296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456e24-d701-489f-8045-7b0fa45654ac None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.685578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456e24-d701-489f-8045-7b0fa45654ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.699458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:43.700458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.700753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.701071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] PATH_INFO: `/v3/projects/988e1078e63647239bfe684b17aba6c7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.702542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=988e1078e63647239bfe684b17aba6c7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:43.704780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:43.744035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-44456e24-d701-489f-8045-7b0fa45654ac None None] MFA Rules not processed for user `d5571a432f114a9a9bef8f52a213a759`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:43.746247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-44456e24-d701-489f-8045-7b0fa45654ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:43.819416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988e1078e63647239bfe684b17aba6c7', 'request_id': 'req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.827814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988e1078e63647239bfe684b17aba6c7', 'request_id': 'req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.840759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988e1078e63647239bfe684b17aba6c7', 'request_id': 'req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.857359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1456/2922] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:43.863398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54dd80-e7ac-41d8-9699-8fc9aed66a95 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.863684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54dd80-e7ac-41d8-9699-8fc9aed66a95 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.863999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54dd80-e7ac-41d8-9699-8fc9aed66a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.866083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] The token cache is being invalidate because project 988e1078e63647239bfe684b17aba6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:43.866710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.867802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9166be27-f7f9-413b-85d4-3ba40e2cc3cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:43.870108 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1467/2923] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:43 2022] DELETE /identity/v3/projects/988e1078e63647239bfe684b17aba6c7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:43.876864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63467e4-c07b-4b5d-a5b4-778b665d5a92 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:43.877223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63467e4-c07b-4b5d-a5b4-778b665d5a92 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:43.877549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63467e4-c07b-4b5d-a5b4-778b665d5a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:43.892817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ce54dd80-e7ac-41d8-9699-8fc9aed66a95 None None] MFA Rules not processed for user `8097bb116d8f47b2aca3970d51a46030`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:43.894948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce54dd80-e7ac-41d8-9699-8fc9aed66a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:43.951033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c63467e4-c07b-4b5d-a5b4-778b665d5a92 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:43.952127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c63467e4-c07b-4b5d-a5b4-778b665d5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:43.977881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:44.050022 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1457/2924] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:44.078494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1468/2925] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:44.086434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2ed9-f85a-42f2-9a9a-e954a9b787c0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.086722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2ed9-f85a-42f2-9a9a-e954a9b787c0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.087017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c2ed9-f85a-42f2-9a9a-e954a9b787c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.117948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-491c2ed9-f85a-42f2-9a9a-e954a9b787c0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:44.121073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-491c2ed9-f85a-42f2-9a9a-e954a9b787c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:44.137003 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1458/2926] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:44.138108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63467e4-c07b-4b5d-a5b4-778b665d5a92 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.151335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63467e4-c07b-4b5d-a5b4-778b665d5a92 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.157006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da043-8dcf-4cea-8074-1d5395b8b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.157870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da043-8dcf-4cea-8074-1d5395b8b02f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.158057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da043-8dcf-4cea-8074-1d5395b8b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.158458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da043-8dcf-4cea-8074-1d5395b8b02f admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.159312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da043-8dcf-4cea-8074-1d5395b8b02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:06:44.159527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da043-8dcf-4cea-8074-1d5395b8b02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.161224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da043-8dcf-4cea-8074-1d5395b8b02f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.163186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:44.189108 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1469/2927] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:44.190121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c2ed9-f85a-42f2-9a9a-e954a9b787c0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.203962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c2ed9-f85a-42f2-9a9a-e954a9b787c0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.226693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.226693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.226693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.227166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.227331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.230213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.230213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.230213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.233299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.258642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:44.259817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:44.297207 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1459/2928] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:44 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:44.301751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.368532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1470/2929] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:06:44.405016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1203f47-d530-4700-a9b0-a571d5470afa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.416432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.417716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.418524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.418830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.419550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.422146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.456312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1460/2930] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:44 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:44.460211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.461977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:44.462119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.473009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb5618-dc9e-4071-8055-3dec22a7bd35 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.478336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.479101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.479419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.479702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.480584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.482799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.511964 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1461/2931] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:44.511964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.535578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643715d-96fa-44bb-9495-984e706b35da admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.544846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.545816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.547285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.547582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.549597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.554454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.572808 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1462/2932] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:44.573764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513bb2c-0d7d-4674-934d-fa7122e70c63 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.577798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.595775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1cb54-34c2-472a-b757-535c16372be6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.602143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e84fa-31b2-4f23-bd67-a1b55993000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.603499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e84fa-31b2-4f23-bd67-a1b55993000b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.604117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e84fa-31b2-4f23-bd67-a1b55993000b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.604609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e84fa-31b2-4f23-bd67-a1b55993000b admin admin] PATH_INFO: `/v3/projects/1af16d79d0c44cf992d8b15c1c6cf026/users/26282b93d7aa4076b0ed1bc239f0fefd/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.626563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e84fa-31b2-4f23-bd67-a1b55993000b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af16d79d0c44cf992d8b15c1c6cf026, user_id=26282b93d7aa4076b0ed1bc239f0fefd, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.630877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e84fa-31b2-4f23-bd67-a1b55993000b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.646933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.647641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.647925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.648213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.649447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1463/2933] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:44 2022] PUT /identity/v3/projects/1af16d79d0c44cf992d8b15c1c6cf026/users/26282b93d7aa4076b0ed1bc239f0fefd/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:44.650488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:44.659779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.660137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.660349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.701647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:44.704115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] MFA Rules not processed for user `26282b93d7aa4076b0ed1bc239f0fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:44.706160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:44.755660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.757271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.768288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:44.768522 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1471/2934] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:44.801086 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1464/2935] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:06:44.804646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.817079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02843-cdef-4310-9f73-2dd917675bdd service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.842790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.847846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:44.880991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.881788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.882079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.882356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.883081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:44.885008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:44.916969 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1472/2936] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:44 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:44.921408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:44.932781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c221ba8-f5f9-49d3-9a27-e7448176a2ee None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:44.986669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:44.988170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:44.988525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:44.990031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:44.993274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:44.995806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aecb23-8e72-488e-87cc-8924590a09b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:45.000855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:45.002410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:45.002693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:45.003142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:45.003881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:45.005950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:45.007635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:45.010629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:45.029185 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1473/2937] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:44 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:06:45.030375 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1465/2938] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:06:45.033443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:45.049242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be31ce-5465-4345-a296-1937493b1373 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:45.054328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:45.055111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:45.055401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:45.055680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:45.056458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:45.058240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:45.080823 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1474/2939] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:45.081822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:45.096515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19528-834f-4af6-a3aa-7d2ccb2ffb8b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:45.101567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:45.102466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:45.102741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:45.103013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] PATH_INFO: `/v3/projects/f0536c974290437794d46c7e6dbb83bc/users/710dccdea77448338f243c9fe3ecfa06/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:45.124768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0536c974290437794d46c7e6dbb83bc, user_id=710dccdea77448338f243c9fe3ecfa06, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:45.127584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:45.161100 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1466/2940] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:45 2022] PUT /identity/v3/projects/f0536c974290437794d46c7e6dbb83bc/users/710dccdea77448338f243c9fe3ecfa06/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:06:45.162735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:45.175793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d44784-c66f-40c4-90aa-fd8acb7e76d3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:45.256423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:45.314837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b5e93-661f-4ef1-908d-69bc832a9e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:45.316376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b5e93-661f-4ef1-908d-69bc832a9e7c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:45.316665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b5e93-661f-4ef1-908d-69bc832a9e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:45.316945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b5e93-661f-4ef1-908d-69bc832a9e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:45.317726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b5e93-661f-4ef1-908d-69bc832a9e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:45.323284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b5e93-661f-4ef1-908d-69bc832a9e7c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:45.372830 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1475/2941] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:45.378750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:45.415937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5c7b2-6971-4535-b2c9-bb560b8ece85 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:45.432402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:45.434292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:45.434292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:45.434527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] PATH_INFO: `/v3/projects/f0536c974290437794d46c7e6dbb83bc/users/710dccdea77448338f243c9fe3ecfa06/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:45.436876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0536c974290437794d46c7e6dbb83bc, user_id=710dccdea77448338f243c9fe3ecfa06, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:45.448286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:45.483156 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1467/2942] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:45 2022] PUT /identity/v3/projects/f0536c974290437794d46c7e6dbb83bc/users/710dccdea77448338f243c9fe3ecfa06/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:45.489781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaaf1e-f20f-4120-84e0-a4c720b2c94c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:45.490042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaaf1e-f20f-4120-84e0-a4c720b2c94c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:45.491709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaaf1e-f20f-4120-84e0-a4c720b2c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:45.527690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bdaaaf1e-f20f-4120-84e0-a4c720b2c94c None None] MFA Rules not processed for user `710dccdea77448338f243c9fe3ecfa06`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:45.529243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bdaaaf1e-f20f-4120-84e0-a4c720b2c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:45.671374 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1476/2943] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:46.512956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:46.691999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:46.705711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239b4b7-17bc-480f-a6eb-903508cd9722 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:46.720973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bd86a-52b5-40f4-a722-40652ae773c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:46.722840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd86a-52b5-40f4-a722-40652ae773c0 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:46.726335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd86a-52b5-40f4-a722-40652ae773c0 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:46.726893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bd86a-52b5-40f4-a722-40652ae773c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:46.745623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bd86a-52b5-40f4-a722-40652ae773c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:46.757507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bd86a-52b5-40f4-a722-40652ae773c0 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:46.795348 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1468/2944] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:06:48.203617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaaf1e-f20f-4120-84e0-a4c720b2c94c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:48.295499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaaf1e-f20f-4120-84e0-a4c720b2c94c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:48.301204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:48.301576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:48.301878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:48.302349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] PATH_INFO: `/v3/users/26282b93d7aa4076b0ed1bc239f0fefd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:48.304032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26282b93d7aa4076b0ed1bc239f0fefd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:48.306192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:48.394640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26282b93d7aa4076b0ed1bc239f0fefd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:48.395714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26282b93d7aa4076b0ed1bc239f0fefd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:48.409982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:48.412662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26282b93d7aa4076b0ed1bc239f0fefd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:48.413777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26282b93d7aa4076b0ed1bc239f0fefd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:48.422883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26282b93d7aa4076b0ed1bc239f0fefd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:48.440148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1477/2945] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:48 2022] DELETE /identity/v3/users/26282b93d7aa4076b0ed1bc239f0fefd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:48.445365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:48.445912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:48.445912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:48.474391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:48.476426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:48.555918 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1469/2946] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:48.583047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:48.585438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:48.668553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9832e10-8f08-47b3-b965-724849c3432b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:48.677756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:48.678434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:48.678704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:48.678976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:48.692785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:48.696235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:48.714178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1478/2947] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:49.449688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:49.451804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:49.469075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529470f-1ad9-4f5c-8c36-ef3f59a7afb3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:49.479331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:49.480572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:49.481009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:49.481532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] PATH_INFO: `/v3/projects/1af16d79d0c44cf992d8b15c1c6cf026` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:49.483670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af16d79d0c44cf992d8b15c1c6cf026)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:49.486458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:49.554171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af16d79d0c44cf992d8b15c1c6cf026', 'request_id': 'req-bf21f7a9-453d-47d9-9476-3037b49ce89c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.561022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af16d79d0c44cf992d8b15c1c6cf026', 'request_id': 'req-bf21f7a9-453d-47d9-9476-3037b49ce89c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.570052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af16d79d0c44cf992d8b15c1c6cf026', 'request_id': 'req-bf21f7a9-453d-47d9-9476-3037b49ce89c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.580886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] The token cache is being invalidate because project 1af16d79d0c44cf992d8b15c1c6cf026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:49.581362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.582165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.583827 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1470/2948] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:49 2022] DELETE /identity/v3/projects/1af16d79d0c44cf992d8b15c1c6cf026 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:06:49.588980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:49.600045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509b938-ada1-46ab-b335-a96ac4bb2769 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:49.660984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:49.661921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:49.662199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:49.662472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] PATH_INFO: `/v3/users/710dccdea77448338f243c9fe3ecfa06` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:49.663703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=710dccdea77448338f243c9fe3ecfa06)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:49.665691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:49.725608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710dccdea77448338f243c9fe3ecfa06'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.726645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710dccdea77448338f243c9fe3ecfa06'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.748095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710dccdea77448338f243c9fe3ecfa06'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.749289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710dccdea77448338f243c9fe3ecfa06'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.776504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef1c92a2-16ec-44ea-aa85-f7d0e7ca94dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710dccdea77448338f243c9fe3ecfa06'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:49.798952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:49.829768 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1479/2949] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:49 2022] DELETE /identity/v3/users/710dccdea77448338f243c9fe3ecfa06 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:51.217772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:51.221260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:51.247665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21f7a9-453d-47d9-9476-3037b49ce89c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:51.363744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:51.364704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:51.364987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:51.365282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] PATH_INFO: `/v3/projects/f0536c974290437794d46c7e6dbb83bc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:51.366734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0536c974290437794d46c7e6dbb83bc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:51.368719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:51.391728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:51.455197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0536c974290437794d46c7e6dbb83bc', 'request_id': 'req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:51.464065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0536c974290437794d46c7e6dbb83bc', 'request_id': 'req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:51.475520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0536c974290437794d46c7e6dbb83bc', 'request_id': 'req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:51.489955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] The token cache is being invalidate because project f0536c974290437794d46c7e6dbb83bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:51.490412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:51.491095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec46dc8c-4225-4083-ba56-7e41fb1ff2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:51.493752 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1471/2950] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:51 2022] DELETE /identity/v3/projects/f0536c974290437794d46c7e6dbb83bc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:51.498795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45665e-f08b-4e6d-b0a1-bc4707ae2005 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:51.499345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45665e-f08b-4e6d-b0a1-bc4707ae2005 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:51.499345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45665e-f08b-4e6d-b0a1-bc4707ae2005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:51.549996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2b45665e-f08b-4e6d-b0a1-bc4707ae2005 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:51.558862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b45665e-f08b-4e6d-b0a1-bc4707ae2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:51.654090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1480/2951] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:51.662088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ede1f-907c-4faa-86d0-a6813ee122f3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:51.662381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ede1f-907c-4faa-86d0-a6813ee122f3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:51.662664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ede1f-907c-4faa-86d0-a6813ee122f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:51.703445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e51ede1f-907c-4faa-86d0-a6813ee122f3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:51.717615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e51ede1f-907c-4faa-86d0-a6813ee122f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:51.773090 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1472/2952] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:51.777338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45665e-f08b-4e6d-b0a1-bc4707ae2005 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:51.788809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45665e-f08b-4e6d-b0a1-bc4707ae2005 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:51.797077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:51.798183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:51.798928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:51.799439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:51.800459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:06:51.801000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:51.802908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:51.848036 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1481/2953] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:06:51.848304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ede1f-907c-4faa-86d0-a6813ee122f3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:51.862762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ede1f-907c-4faa-86d0-a6813ee122f3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:51.877848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:51.879768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:51.880077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:51.880994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:51.883270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:51.887524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:51.992009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1473/2954] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:51 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:06:51.993211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:52.006742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5bec4-d8e9-4ec2-8f84-bd53625fee0c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:52.208406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:52.209185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:52.209474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:52.209753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:52.210474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:52.212433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:52.278517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1482/2955] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:51 2022] POST /identity/v3/users => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:52.279690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:52.304370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70463d6-3361-46a1-97fe-f43119afc547 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:52.319643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:52.320441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:52.320824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:52.322518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:52.324179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:52.326428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:52.343328 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1474/2956] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:52.347257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:52.359611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890a3c5-26df-4f05-93d1-dab4ccb250e7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:52.369828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dea29-e235-42b0-8266-0586b6f31490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:52.370944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dea29-e235-42b0-8266-0586b6f31490 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:52.371446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dea29-e235-42b0-8266-0586b6f31490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:52.371960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dea29-e235-42b0-8266-0586b6f31490 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:52.374365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dea29-e235-42b0-8266-0586b6f31490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:52.376652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dea29-e235-42b0-8266-0586b6f31490 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:52.392739 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1483/2957] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:06:52.396982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:52.411102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79027df-552c-4ab0-80a1-60b9f19d24b1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:52.418713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:52.420036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:52.420686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:52.421302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] PATH_INFO: `/v3/projects/c08e600159f44a07a1f3550bc30474ec/users/dfe8a7c180bc42fca23b130984d7ef14/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:52.448357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08e600159f44a07a1f3550bc30474ec, user_id=dfe8a7c180bc42fca23b130984d7ef14, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:52.452188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:52.475457 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1475/2958] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:52 2022] PUT /identity/v3/projects/c08e600159f44a07a1f3550bc30474ec/users/dfe8a7c180bc42fca23b130984d7ef14/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:52.496787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148f8ea-18a2-4da4-8764-20581240d752 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:52.497140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148f8ea-18a2-4da4-8764-20581240d752 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:52.497429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148f8ea-18a2-4da4-8764-20581240d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:52.555635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b148f8ea-18a2-4da4-8764-20581240d752 None None] MFA Rules not processed for user `dfe8a7c180bc42fca23b130984d7ef14`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:52.557062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b148f8ea-18a2-4da4-8764-20581240d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:52.610661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:52.614449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:52.752130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3ab59-bdc4-40b9-b745-62baa25d8061 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:52.759400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:52.760196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:52.760716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:52.761361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:52.764941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:52.771831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:52.782132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:52.783977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:52.799031 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1484/2959] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:52.817208 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1476/2960] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:06:52.829273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148f8ea-18a2-4da4-8764-20581240d752 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:52.996816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148f8ea-18a2-4da4-8764-20581240d752 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:53.014796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:53.015868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:53.016471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:53.016923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:53.017913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:53.020223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:53.097587 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1485/2961] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:06:52 2022] POST /identity/v3/projects => generated 401 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:06:53.099164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:53.117499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1174d2-232a-4809-afb1-d983c3241382 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:53.148878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:53.218482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:53.222390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:53.223055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:53.223398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:53.224242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:53.230502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:53.273974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1477/2962] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:06:53 2022] POST /identity/v3/users => generated 307 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:06:53.278067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:53.294413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925f8a-428c-45f8-a915-6696b0bcd6ec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:53.300464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:53.301379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:53.301774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:53.302111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:53.303004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:53.305001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:53.321162 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1486/2963] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:06:53.325906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:53.338012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb920e-247b-4ef0-b81f-0d12c7290dbc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:53.346123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:53.347658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:53.348149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:53.348521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] PATH_INFO: `/v3/projects/0fc3e2c4154e4629bbc63486a960d8c1/users/8286097bc8b6404589fd9206809f32e3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:53.368942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc3e2c4154e4629bbc63486a960d8c1, user_id=8286097bc8b6404589fd9206809f32e3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:53.372039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:53.393970 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1478/2964] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:53 2022] PUT /identity/v3/projects/0fc3e2c4154e4629bbc63486a960d8c1/users/8286097bc8b6404589fd9206809f32e3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:53.399583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:53.418507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65aa7-61a1-4737-9407-621fcb62391f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:53.507662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61ba16-1061-479f-95c6-9cb6ff7a266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:53.508481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61ba16-1061-479f-95c6-9cb6ff7a266a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:53.508862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61ba16-1061-479f-95c6-9cb6ff7a266a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:53.509280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61ba16-1061-479f-95c6-9cb6ff7a266a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:53.510103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61ba16-1061-479f-95c6-9cb6ff7a266a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:53.513068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61ba16-1061-479f-95c6-9cb6ff7a266a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:53.525938 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1487/2965] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:06:53.530952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:53.550381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201995-ab05-418b-a577-606cd530e7a8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:53.555789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:53.557215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:53.557515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:53.557788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] PATH_INFO: `/v3/projects/0fc3e2c4154e4629bbc63486a960d8c1/users/8286097bc8b6404589fd9206809f32e3/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:53.560241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc3e2c4154e4629bbc63486a960d8c1, user_id=8286097bc8b6404589fd9206809f32e3, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:53.563090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:53.580122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1479/2966] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:06:53 2022] PUT /identity/v3/projects/0fc3e2c4154e4629bbc63486a960d8c1/users/8286097bc8b6404589fd9206809f32e3/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:06:53.657289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872602c2-09ed-49ca-9f56-a1f83a354f4c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:53.658194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872602c2-09ed-49ca-9f56-a1f83a354f4c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:53.658650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872602c2-09ed-49ca-9f56-a1f83a354f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:53.703578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-872602c2-09ed-49ca-9f56-a1f83a354f4c None None] MFA Rules not processed for user `8286097bc8b6404589fd9206809f32e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:53.705823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-872602c2-09ed-49ca-9f56-a1f83a354f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:53.798789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:53.825086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1488/2967] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:06:54.177359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:54.399584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9ecad-1cd5-4462-8e3c-1c8faa25862c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:54.429604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:54.430314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:54.430595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:54.430872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:54.456554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:54.459605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:54.484699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1480/2968] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:55.082697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41083a-e071-4b7b-8acc-a61aa2c22edc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:55.084551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41083a-e071-4b7b-8acc-a61aa2c22edc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:55.085004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41083a-e071-4b7b-8acc-a61aa2c22edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:55.138279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8b41083a-e071-4b7b-8acc-a61aa2c22edc None None] MFA Rules not processed for user `681cfb0e560145b4abef98dbd417f3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:55.139610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8b41083a-e071-4b7b-8acc-a61aa2c22edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:55.234463 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1489/2969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:56.378325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:56.395283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d8fa-f124-4a25-aa2f-70d71e589512 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:56.409237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38426f-fd78-4aa4-841a-d67304c0565a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:56.413504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38426f-fd78-4aa4-841a-d67304c0565a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:56.414736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38426f-fd78-4aa4-841a-d67304c0565a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:56.415038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38426f-fd78-4aa4-841a-d67304c0565a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:56.540873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38426f-fd78-4aa4-841a-d67304c0565a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:56.542942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38426f-fd78-4aa4-841a-d67304c0565a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:56.563612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:56.571125 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1481/2970] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:56.609675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41083a-e071-4b7b-8acc-a61aa2c22edc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:56.775742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41083a-e071-4b7b-8acc-a61aa2c22edc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:56.781602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:56.783293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:56.784911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:56.785233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] PATH_INFO: `/v3/users/dfe8a7c180bc42fca23b130984d7ef14` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:56.786746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe8a7c180bc42fca23b130984d7ef14)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:56.789134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:56.853663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe8a7c180bc42fca23b130984d7ef14'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:56.854480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe8a7c180bc42fca23b130984d7ef14'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:56.869976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe8a7c180bc42fca23b130984d7ef14'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:56.870674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe8a7c180bc42fca23b130984d7ef14'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:56.879159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe8a7c180bc42fca23b130984d7ef14'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:56.906143 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1490/2971] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:56 2022] DELETE /identity/v3/users/dfe8a7c180bc42fca23b130984d7ef14 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:56.908839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:56.909320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:56.909757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:56.945608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:56.946931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:57.043848 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1482/2972] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:06:57.050832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:57.052460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:57.075620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:57.128472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dafe28-1f5e-42d6-bc4e-45302ce87470 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:57.132542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:57.135095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:57.135095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:57.135095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:57.146329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:57.147815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:57.159413 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1491/2973] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:57.546332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:57.547926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:57.568959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dba66c-2fdb-4653-ae1a-58e00e7c1888 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:57.580793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:57.593420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:57.593992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:57.594505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] PATH_INFO: `/v3/projects/c08e600159f44a07a1f3550bc30474ec` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:57.596613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08e600159f44a07a1f3550bc30474ec)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:57.600100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:57.669796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08e600159f44a07a1f3550bc30474ec', 'request_id': 'req-73e2cc8d-5025-4ef8-9b76-69904b2d9165'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.681348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08e600159f44a07a1f3550bc30474ec', 'request_id': 'req-73e2cc8d-5025-4ef8-9b76-69904b2d9165'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.690500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08e600159f44a07a1f3550bc30474ec', 'request_id': 'req-73e2cc8d-5025-4ef8-9b76-69904b2d9165'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.706515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] The token cache is being invalidate because project c08e600159f44a07a1f3550bc30474ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:57.706875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.707629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.709476 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1483/2974] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:57 2022] DELETE /identity/v3/projects/c08e600159f44a07a1f3550bc30474ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:57.713926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:57.724917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82cadf-7b85-4b3f-bbab-85c94e3429a2 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:57.799487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:57.800376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:57.800654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:57.800929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] PATH_INFO: `/v3/users/8286097bc8b6404589fd9206809f32e3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:57.802253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8286097bc8b6404589fd9206809f32e3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:57.804552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:57.890699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8286097bc8b6404589fd9206809f32e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.891566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8286097bc8b6404589fd9206809f32e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.921265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8286097bc8b6404589fd9206809f32e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.922018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8286097bc8b6404589fd9206809f32e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.954593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8286097bc8b6404589fd9206809f32e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:57.980027 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1492/2975] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:06:57 2022] DELETE /identity/v3/users/8286097bc8b6404589fd9206809f32e3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:06:57.995906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:57.997996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:58.169353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2cc8d-5025-4ef8-9b76-69904b2d9165 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:58.221915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:58.223675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:58.242055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:58.272915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:58.273645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:58.273931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:58.274190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:58.278231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:58.296458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:58.297958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:58.309609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:58.322653 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1484/2976] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:06:58.349514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1392056-39c0-41e4-82ed-2aca260489bc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:58.355348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf624c7-77cd-4247-89a1-f5c0f16c65f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:58.358312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf624c7-77cd-4247-89a1-f5c0f16c65f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:58.359434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf624c7-77cd-4247-89a1-f5c0f16c65f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:58.360309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf624c7-77cd-4247-89a1-f5c0f16c65f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:58.382255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf624c7-77cd-4247-89a1-f5c0f16c65f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:58.385209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf624c7-77cd-4247-89a1-f5c0f16c65f0 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:58.409786 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1493/2977] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:06:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:06:59.340725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:06:59.343193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:06:59.539555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68347e-0d19-4733-acd7-05dd20114543 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:06:59.555973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:06:59.556369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:59.557722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:59.558066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] PATH_INFO: `/v3/projects/0fc3e2c4154e4629bbc63486a960d8c1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:59.559744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc3e2c4154e4629bbc63486a960d8c1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:06:59.564779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:06:59.694133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc3e2c4154e4629bbc63486a960d8c1', 'request_id': 'req-477a1418-7c52-47b1-ad93-511bec960141'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:59.704187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc3e2c4154e4629bbc63486a960d8c1', 'request_id': 'req-477a1418-7c52-47b1-ad93-511bec960141'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:59.738123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc3e2c4154e4629bbc63486a960d8c1', 'request_id': 'req-477a1418-7c52-47b1-ad93-511bec960141'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:59.768488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] The token cache is being invalidate because project 0fc3e2c4154e4629bbc63486a960d8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:06:59.771612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:59.774335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-477a1418-7c52-47b1-ad93-511bec960141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:06:59.782672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1485/2978] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:59 2022] DELETE /identity/v3/projects/0fc3e2c4154e4629bbc63486a960d8c1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:06:59.789131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579af44-fe2a-4027-83cd-9203c107a34b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:06:59.790074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579af44-fe2a-4027-83cd-9203c107a34b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:06:59.790516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579af44-fe2a-4027-83cd-9203c107a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:06:59.822589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1579af44-fe2a-4027-83cd-9203c107a34b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:06:59.825642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1579af44-fe2a-4027-83cd-9203c107a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:00.008950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0d9a-2ddc-404f-a1f5-b2f80b993df1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.009355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0d9a-2ddc-404f-a1f5-b2f80b993df1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.009543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0d9a-2ddc-404f-a1f5-b2f80b993df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.010644 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1494/2979] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:00.073762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-65aa0d9a-2ddc-404f-a1f5-b2f80b993df1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:00.075035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65aa0d9a-2ddc-404f-a1f5-b2f80b993df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:00.105674 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1486/2980] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:07:00.109732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579af44-fe2a-4027-83cd-9203c107a34b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:00.140279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579af44-fe2a-4027-83cd-9203c107a34b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:00.163162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:00.164171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.164546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.164917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.166097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:07:00.166619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:00.168823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:00.207668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0d9a-2ddc-404f-a1f5-b2f80b993df1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:00.208457 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1495/2981] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:07:00.223634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0d9a-2ddc-404f-a1f5-b2f80b993df1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:00.252210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:00.253057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.254098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.254294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.255025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:00.257055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:00.345646 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1487/2982] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:00 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:07:00.351107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:00.366113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b7525-35be-40e2-b6ae-ddd26b181654 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:00.537827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:00.539039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.539498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.539953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.546249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:00.549858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:00.590745 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1496/2983] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:00 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:00.594421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:00.616360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c50bc-32f9-4142-999e-f6a36506fe33 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:00.642651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:00.643851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.644438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.655659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.657296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:00.677879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:00.701670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:00.705536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1488/2984] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:00.719939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0870-0abc-49a2-a222-24ac8fa93068 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:00.733361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff362c5-bea3-4f3d-91e3-6c7b3fd717b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:00.734204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff362c5-bea3-4f3d-91e3-6c7b3fd717b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.734732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff362c5-bea3-4f3d-91e3-6c7b3fd717b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.735162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff362c5-bea3-4f3d-91e3-6c7b3fd717b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.736022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff362c5-bea3-4f3d-91e3-6c7b3fd717b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:00.738018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff362c5-bea3-4f3d-91e3-6c7b3fd717b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:00.764383 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1497/2985] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:00.769529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:00.788756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c95845-edbc-4ddc-a655-945e58a2cbf9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:00.801841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:00.803298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.803639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.803921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] PATH_INFO: `/v3/projects/5d60e61526824a71bdae0df1099f625c/users/eb755a019e2c4243a89e682a06d42c3f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.854420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d60e61526824a71bdae0df1099f625c, user_id=eb755a019e2c4243a89e682a06d42c3f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:00.870745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:00.914703 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1489/2986] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:00 2022] PUT /identity/v3/projects/5d60e61526824a71bdae0df1099f625c/users/eb755a019e2c4243a89e682a06d42c3f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:00.916110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:00.916618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:00.916977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:00.955227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:00.957009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:01.128713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:01.188610 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1498/2987] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:01.213713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:01.216549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:01.278026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:01.410458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0632b-cc8d-431c-990d-0c754880658d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:01.417210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:01.422873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:01.430597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:01.431211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:01.472433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:01.475717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:01.518109 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1490/2988] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:04.795805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:04.797367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:04.825316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1bd23-70b0-4558-8658-daa10c819b16 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:04.839072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:04.840341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:04.840787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:04.841327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] PATH_INFO: `/v3/users/035a5cccca15429e845012dd629d5038` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:04.842937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035a5cccca15429e845012dd629d5038)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:04.845756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:04.971704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035a5cccca15429e845012dd629d5038'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:04.973164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035a5cccca15429e845012dd629d5038'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:05.007552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035a5cccca15429e845012dd629d5038'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:05.009306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035a5cccca15429e845012dd629d5038'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:05.034469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-482ef768-7db4-4144-be6b-f03436e1fbf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035a5cccca15429e845012dd629d5038'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:05.104833 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1499/2989] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:04 2022] DELETE /identity/v3/users/035a5cccca15429e845012dd629d5038 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:05.639237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:05.656155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef040c67-4fda-4afe-8ef1-c487150e5789 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:05.812669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:05.813617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:05.814268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:05.830718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] PATH_INFO: `/v3/projects/1d3c1a33ed1449bdbec74fb4d3c0784f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:05.834949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3c1a33ed1449bdbec74fb4d3c0784f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:05.873366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:06.044820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'request_id': 'req-f81b3c20-491b-4855-9b89-77a429b8b800'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:06.072611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'request_id': 'req-f81b3c20-491b-4855-9b89-77a429b8b800'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:06.098030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'request_id': 'req-f81b3c20-491b-4855-9b89-77a429b8b800'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:06.125442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] The token cache is being invalidate because project 1d3c1a33ed1449bdbec74fb4d3c0784f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:06.125740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:06.127877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f81b3c20-491b-4855-9b89-77a429b8b800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:06.132318 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1491/2990] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:05 2022] DELETE /identity/v3/projects/1d3c1a33ed1449bdbec74fb4d3c0784f => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:06.135928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f1ba-6fdb-4c82-a56b-37b47ea2ab75 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.137178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f1ba-6fdb-4c82-a56b-37b47ea2ab75 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.137696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f1ba-6fdb-4c82-a56b-37b47ea2ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.179503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f1e6f1ba-6fdb-4c82-a56b-37b47ea2ab75 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:06.181004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f1e6f1ba-6fdb-4c82-a56b-37b47ea2ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:06.323483 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1500/2991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:06.331432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978918c-eafa-4b2c-a49f-fa4e1dd116c5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.331830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978918c-eafa-4b2c-a49f-fa4e1dd116c5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.332121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978918c-eafa-4b2c-a49f-fa4e1dd116c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.360817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f978918c-eafa-4b2c-a49f-fa4e1dd116c5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:06.364303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f978918c-eafa-4b2c-a49f-fa4e1dd116c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:06.383038 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1492/2992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:06.387647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f1ba-6fdb-4c82-a56b-37b47ea2ab75 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:06.398834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f1ba-6fdb-4c82-a56b-37b47ea2ab75 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:06.406864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:06.408457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.408910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.409803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.411114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:07:06.411114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:06.421539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:06.439737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1501/2993] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:07:06.443464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978918c-eafa-4b2c-a49f-fa4e1dd116c5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:06.455290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978918c-eafa-4b2c-a49f-fa4e1dd116c5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:06.463244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:06.464161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.464832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.465311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.466143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:06.472697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:06.556348 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1493/2994] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:06 2022] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:06.559818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:06.573953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525ac01-3ee7-490f-9fb6-cca6a650dcf1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:06.641460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:06.679321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:06.680043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.680315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.680588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.681348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:06.683314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:06.721540 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1502/2995] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:06 2022] POST /identity/v3/users => generated 280 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:06.725909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:06.738164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d055-dc86-4c18-8a92-67e400edc345 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:06.764951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:06.765881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.766413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.766862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.772193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:06.779012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:06.794331 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1494/2996] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:06.802521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:06.816666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fc703-6990-4106-ab24-284ca7eac57e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:06.823567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb61424-4e09-40eb-93de-8db1fbd57d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:06.830037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb61424-4e09-40eb-93de-8db1fbd57d10 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.830037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb61424-4e09-40eb-93de-8db1fbd57d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.830037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb61424-4e09-40eb-93de-8db1fbd57d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.830037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb61424-4e09-40eb-93de-8db1fbd57d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:06.830037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb61424-4e09-40eb-93de-8db1fbd57d10 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:06.851513 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1503/2997] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:06.853563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:06.864221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:06.883500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914a85b-387d-41b9-b0e2-c5ffea4757e4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:06.898442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:06.899741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.900258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.900801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] PATH_INFO: `/v3/projects/eebc4e6d9ebf4f1c8657e841e2269368/users/625f1874d727489092c8ac3bf5752759/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:06.945952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eebc4e6d9ebf4f1c8657e841e2269368, user_id=625f1874d727489092c8ac3bf5752759, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:06.953315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:06.977708 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1495/2998] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:06 2022] PUT /identity/v3/projects/eebc4e6d9ebf4f1c8657e841e2269368/users/625f1874d727489092c8ac3bf5752759/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:06.990044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0803-644b-4ee6-8c7f-fbf38f4e0af7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:06.990397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0803-644b-4ee6-8c7f-fbf38f4e0af7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:06.990601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0803-644b-4ee6-8c7f-fbf38f4e0af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:07.100982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7acc0803-644b-4ee6-8c7f-fbf38f4e0af7 None None] MFA Rules not processed for user `625f1874d727489092c8ac3bf5752759`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:07.102246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7acc0803-644b-4ee6-8c7f-fbf38f4e0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:07.378332 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1504/2999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:08.083283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:08.085611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:08.318046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafb438-62f2-4c5f-b384-ac36e858e9b5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:08.334347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:08.339883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:08.339883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:08.340197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:08.369141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:08.370835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:08.397798 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1496/3000] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:08 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:08.484611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0803-644b-4ee6-8c7f-fbf38f4e0af7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:08.703684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0803-644b-4ee6-8c7f-fbf38f4e0af7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:08.722728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:08.728089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:08.728920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:08.729283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:08.729518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] PATH_INFO: `/v3/users/625f1874d727489092c8ac3bf5752759` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:08.730340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:08.736660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=625f1874d727489092c8ac3bf5752759)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:08.744420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:08.759875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f09e03-e77d-4bc3-8750-bfcd8be672af service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:08.778728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:08.779731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:08.781644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:08.783621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:08.787662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:08.873008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625f1874d727489092c8ac3bf5752759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:08.873794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625f1874d727489092c8ac3bf5752759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:08.888354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:08.909810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625f1874d727489092c8ac3bf5752759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:08.911665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625f1874d727489092c8ac3bf5752759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:08.934919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9e972f6a-647c-4e76-85a9-16e0a01c1fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625f1874d727489092c8ac3bf5752759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:08.972026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:08.973761 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1505/3001] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:08 2022] DELETE /identity/v3/users/625f1874d727489092c8ac3bf5752759 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:08.974774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:08.978578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:08.978974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:08.979343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:09.003066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:09.004715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:09.030050 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1497/3002] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:07:09.161984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1506/3003] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:07:09.354240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:09.361557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:09.476616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8b4e7-1e3c-49e0-b38c-b0297e9d2363 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:09.496552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:09.600421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b90a1-9824-4ce4-bbda-a8dd7fc8d009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:09.602373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b90a1-9824-4ce4-bbda-a8dd7fc8d009 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:09.602657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b90a1-9824-4ce4-bbda-a8dd7fc8d009 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:09.603676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b90a1-9824-4ce4-bbda-a8dd7fc8d009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:09.644212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b90a1-9824-4ce4-bbda-a8dd7fc8d009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:09.649686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b90a1-9824-4ce4-bbda-a8dd7fc8d009 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:09.675404 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1498/3004] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:11.674898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:11.678834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:11.712357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f58404-6c6b-409a-ac8c-bf8687c9ab18 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:11.722041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:11.723245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:11.727763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:11.728533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] PATH_INFO: `/v3/projects/eebc4e6d9ebf4f1c8657e841e2269368` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:11.730745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eebc4e6d9ebf4f1c8657e841e2269368)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:11.738203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:11.831821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eebc4e6d9ebf4f1c8657e841e2269368', 'request_id': 'req-0763131e-5b2a-43f4-bad8-b2eb54c6b956'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:11.841827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eebc4e6d9ebf4f1c8657e841e2269368', 'request_id': 'req-0763131e-5b2a-43f4-bad8-b2eb54c6b956'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:11.858253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eebc4e6d9ebf4f1c8657e841e2269368', 'request_id': 'req-0763131e-5b2a-43f4-bad8-b2eb54c6b956'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:11.878818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] The token cache is being invalidate because project eebc4e6d9ebf4f1c8657e841e2269368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:11.879546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:11.881647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0763131e-5b2a-43f4-bad8-b2eb54c6b956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:11.891618 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1507/3005] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:11 2022] DELETE /identity/v3/projects/eebc4e6d9ebf4f1c8657e841e2269368 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:11.893174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba555f-8750-496c-ac55-b3ba5edd2835 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:11.894001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba555f-8750-496c-ac55-b3ba5edd2835 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:11.894644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba555f-8750-496c-ac55-b3ba5edd2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:11.990839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75ba555f-8750-496c-ac55-b3ba5edd2835 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:11.992717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75ba555f-8750-496c-ac55-b3ba5edd2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:12.194018 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1499/3006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:12.202639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d774a-2ffe-4081-b393-dd6166d2d838 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:12.203085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d774a-2ffe-4081-b393-dd6166d2d838 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:12.203305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d774a-2ffe-4081-b393-dd6166d2d838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:12.246855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-701d774a-2ffe-4081-b393-dd6166d2d838 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:12.248257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-701d774a-2ffe-4081-b393-dd6166d2d838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:12.262182 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1508/3007] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:12.262692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba555f-8750-496c-ac55-b3ba5edd2835 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:12.277561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba555f-8750-496c-ac55-b3ba5edd2835 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:12.295315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:12.297337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:12.298339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:12.298928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:12.300821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:07:12.302974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:12.309307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:12.389777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d774a-2ffe-4081-b393-dd6166d2d838 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:12.390213 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1500/3008] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:07:12.405308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d774a-2ffe-4081-b393-dd6166d2d838 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:12.427915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:12.432087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:12.432377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:12.432674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:12.433461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:12.443914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:12.534219 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1509/3009] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:12 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:12.538215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:12.560146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4855-2e70-4408-b722-8e5a38bab962 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:12.739741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:12.740440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:12.740722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:12.741003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:12.741734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:12.747930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:12.796253 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1501/3010] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:12 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:12.797374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:12.816844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada6771-dcb9-4770-9efb-f651f3c256cc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:12.835771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:12.837000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:12.840640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:12.841240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:12.842772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:12.852818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:12.897984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1510/3011] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:07:12.902700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:12.917787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f76c9-62ee-4944-95b8-fced5c689c6b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:12.931667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e73e3-d783-467d-9f9e-c9d1b61fd2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:12.932850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e73e3-d783-467d-9f9e-c9d1b61fd2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:12.940349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e73e3-d783-467d-9f9e-c9d1b61fd2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:12.941482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e73e3-d783-467d-9f9e-c9d1b61fd2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:12.943926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e73e3-d783-467d-9f9e-c9d1b61fd2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:12.955484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e73e3-d783-467d-9f9e-c9d1b61fd2a3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:12.984463 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1502/3012] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:12.988744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:13.006019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5edb2-1b69-413f-9ae2-5f33e031fec5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:13.016362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:13.020438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:13.025581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:13.026343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] PATH_INFO: `/v3/projects/e25c9a06b279434b8c8f262a3c0a968b/users/86d98b6f30884d13a94ea2d4cabff826/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:13.056281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25c9a06b279434b8c8f262a3c0a968b, user_id=86d98b6f30884d13a94ea2d4cabff826, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:13.063348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:13.073171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:13.105200 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1511/3013] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:12 2022] PUT /identity/v3/projects/e25c9a06b279434b8c8f262a3c0a968b/users/86d98b6f30884d13a94ea2d4cabff826/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:13.110106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819d173-3527-46d0-8d8e-a8a387071898 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:13.110430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819d173-3527-46d0-8d8e-a8a387071898 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:13.110904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819d173-3527-46d0-8d8e-a8a387071898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:13.138531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2819d173-3527-46d0-8d8e-a8a387071898 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:13.141908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2819d173-3527-46d0-8d8e-a8a387071898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:13.203120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:13.343313 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1503/3014] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:13.396269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:13.400103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:13.612174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b41ba9-8112-46f7-9ed9-de81371edecc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:13.618293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:13.619056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:13.619438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:13.619821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:13.633986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:13.635570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:13.667366 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1512/3015] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:14.667755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:14.668891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:14.669433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:14.729491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] MFA Rules not processed for user `eb755a019e2c4243a89e682a06d42c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:14.731728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:14.861854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1504/3016] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:07:15.451905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:15.453591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:15.610524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab5e02-9efa-4514-9e46-6a8a9d2408f4 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:15.616268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:15.617934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:15.618652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:15.619159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:15.630833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:15.632677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:15.646516 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1513/3017] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:17.858594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:17.862162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:17.884688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c88b06-858a-4be7-9010-4174f81c9c22 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:17.899353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:17.900553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:17.901011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:17.901463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] PATH_INFO: `/v3/users/4eef98c56e744064b2b5f131c3766c0c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:17.905769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eef98c56e744064b2b5f131c3766c0c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:17.908412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:17.986810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eef98c56e744064b2b5f131c3766c0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:17.987992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eef98c56e744064b2b5f131c3766c0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:18.009006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eef98c56e744064b2b5f131c3766c0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:18.018598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eef98c56e744064b2b5f131c3766c0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:18.030671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-416c762a-954b-4b50-bdd3-2f5e94b10560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eef98c56e744064b2b5f131c3766c0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:18.066160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1505/3018] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:17 2022] DELETE /identity/v3/users/4eef98c56e744064b2b5f131c3766c0c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:18.596713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:18.610759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb9d55-4bc0-497f-a359-bb40c46ff03f service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:18.803638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:18.804755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:18.805968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:18.807394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] PATH_INFO: `/v3/projects/df7809024c414efd8534cefdecd980cf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:18.815805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7809024c414efd8534cefdecd980cf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:18.818239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:18.927565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:18.983062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7809024c414efd8534cefdecd980cf', 'request_id': 'req-807f3145-ca65-4613-a44e-6bef8fc944bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.004235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7809024c414efd8534cefdecd980cf', 'request_id': 'req-807f3145-ca65-4613-a44e-6bef8fc944bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.019304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7809024c414efd8534cefdecd980cf', 'request_id': 'req-807f3145-ca65-4613-a44e-6bef8fc944bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.066539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] The token cache is being invalidate because project df7809024c414efd8534cefdecd980cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:19.067151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.068344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-807f3145-ca65-4613-a44e-6bef8fc944bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.075086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1514/3019] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:18 2022] DELETE /identity/v3/projects/df7809024c414efd8534cefdecd980cf => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:19.077342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940654-309d-4af8-96cf-f6a1ffd14ab3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:19.077831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940654-309d-4af8-96cf-f6a1ffd14ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:19.078119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35940654-309d-4af8-96cf-f6a1ffd14ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:19.100924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-35940654-309d-4af8-96cf-f6a1ffd14ab3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:19.102834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-35940654-309d-4af8-96cf-f6a1ffd14ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:19.168775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:19.318355 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1506/3020] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:07:19.329333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:19.333403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:19.333695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:19.380466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:19.381734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:19.404994 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1515/3021] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:19.409916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35940654-309d-4af8-96cf-f6a1ffd14ab3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:19.432028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35940654-309d-4af8-96cf-f6a1ffd14ab3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:19.446098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:19.446876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:19.465549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:19.468216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:19.473291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:19.475960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:07:19.476352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:19.476801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:19.478058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:19.531666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b7883-6dd1-4f7a-a127-37c0f27fe0d1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:19.551200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1507/3022] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:07:19.553619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:19.554872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:19.557919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:19.570652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:19.571084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] PATH_INFO: `/v3/users/8097bb116d8f47b2aca3970d51a46030` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:19.578617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8097bb116d8f47b2aca3970d51a46030)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:19.583830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a9712-ea80-4032-800e-182e42517483 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:19.588605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:19.597777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:19.598510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:19.598790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:19.599063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:19.599826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:19.601918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:19.667575 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1508/3023] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:19 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:19.672555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:19.748388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8097bb116d8f47b2aca3970d51a46030'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.750002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8097bb116d8f47b2aca3970d51a46030'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.788742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8097bb116d8f47b2aca3970d51a46030'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.790465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8097bb116d8f47b2aca3970d51a46030'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.812047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c64189dd-d8a8-48d2-8486-745a11ecf47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8097bb116d8f47b2aca3970d51a46030'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:19.839557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea014-472e-4fd6-bbde-583945dfe9ec admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:19.846596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1516/3024] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:19 2022] DELETE /identity/v3/users/8097bb116d8f47b2aca3970d51a46030 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:19.852121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19c28e-f4f1-4c48-90a4-2ba029dbb671 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:19.852458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19c28e-f4f1-4c48-90a4-2ba029dbb671 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:19.852689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19c28e-f4f1-4c48-90a4-2ba029dbb671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:19.853499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:19.854119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:19.854408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:19.854686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:19.855415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:19.857414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:19.903472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5f19c28e-f4f1-4c48-90a4-2ba029dbb671 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:19.908352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1509/3025] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:19 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:19.909555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:19.916977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5f19c28e-f4f1-4c48-90a4-2ba029dbb671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:19.919190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:19.936945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92100d3-849f-409e-b0b9-e0aca7961c4a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:20.088705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:20.090304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.090835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.091276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.092218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:20.097525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:20.120427 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1510/3026] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:20.126084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:20.143482 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1517/3027] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:20.152440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5720d2c-4a6d-44c2-8ecb-ddb9addfd81e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:20.168554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:20.168554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.169103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.169103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.170511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:20.171568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:20.187423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4109446-353a-479c-9b1d-cf7561ccce3c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.187821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4109446-353a-479c-9b1d-cf7561ccce3c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.188304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4109446-353a-479c-9b1d-cf7561ccce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.203141 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1511/3028] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:20.203141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:20.206651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:20.226237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e4109446-353a-479c-9b1d-cf7561ccce3c None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:20.226723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:20.227723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e4109446-353a-479c-9b1d-cf7561ccce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:20.258603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:20.364974 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1518/3029] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:20.366109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4109446-353a-479c-9b1d-cf7561ccce3c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:20.371043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fa383-99da-45ff-8317-af93e562c49d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:20.380123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:20.382285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.382849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.383719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.394852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4109446-353a-479c-9b1d-cf7561ccce3c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:20.406967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4f4d2-845a-4984-bd0b-d19e4b685303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:20.407877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:20.408231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4f4d2-845a-4984-bd0b-d19e4b685303 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.408621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4f4d2-845a-4984-bd0b-d19e4b685303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.409002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4f4d2-845a-4984-bd0b-d19e4b685303 admin admin] PATH_INFO: `/v3/projects/637c113ab85b43cb815b1e6e2d868a29/users/1b0598fbccf348148fda392a40bf0078/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.409373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:20.428200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4f4d2-845a-4984-bd0b-d19e4b685303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637c113ab85b43cb815b1e6e2d868a29, user_id=1b0598fbccf348148fda392a40bf0078, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:20.434172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4f4d2-845a-4984-bd0b-d19e4b685303 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:20.437270 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1512/3030] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:20.466385 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1519/3031] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:20 2022] PUT /identity/v3/projects/637c113ab85b43cb815b1e6e2d868a29/users/1b0598fbccf348148fda392a40bf0078/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:20.481668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:20.483309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:20.509792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea326d-2348-4d1e-8a01-3cd5395c8476 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:20.554595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.554798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.555139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.580620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:20.586095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:20.624793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:20.625891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.626172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.626448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] PATH_INFO: `/v3/users/33ec146b95734dcea62aad13f5105bdd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.630165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ec146b95734dcea62aad13f5105bdd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:20.632144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:20.729924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ec146b95734dcea62aad13f5105bdd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:20.732127 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1520/3032] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:20.733576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ec146b95734dcea62aad13f5105bdd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:20.754439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:20.759047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:20.782687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ec146b95734dcea62aad13f5105bdd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:20.783602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ec146b95734dcea62aad13f5105bdd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:20.799253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cf95e5ce-0ae7-4f50-ba9e-946fc6435f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ec146b95734dcea62aad13f5105bdd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:20.819715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1513/3033] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:20 2022] DELETE /identity/v3/users/33ec146b95734dcea62aad13f5105bdd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:20.829278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:20.829913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:20.830450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:20.887385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:20.889058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:20.943428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:20.953840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfe020-beac-45e1-899b-e6cdd45d4862 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:21.013608 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1514/3034] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:21.060660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:21.061734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:21.083572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:21.084453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:21.084785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:21.085562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:21.086997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:21.100393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:21.102278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:21.106968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:21.116153 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1521/3035] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:07:21.166362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966137c-6b54-4ebd-b90c-76c84938e214 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:21.173412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:21.174932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:21.175806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:21.175806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:21.192826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:21.194904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:21.211940 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1515/3036] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:07:21.280582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:21.282779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:21.300557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8df970-a021-4c93-9726-20414c8b1ae7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:21.313502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:21.314676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:21.315151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:21.315503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] PATH_INFO: `/v3/projects/6a3b4b4b24df43cdb92b0a8206d14ef0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:21.317007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3b4b4b24df43cdb92b0a8206d14ef0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:21.320604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:21.433491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'request_id': 'req-a0768837-6c53-4c3e-a0ed-eb8e2c292454'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.441290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'request_id': 'req-a0768837-6c53-4c3e-a0ed-eb8e2c292454'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.454859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'request_id': 'req-a0768837-6c53-4c3e-a0ed-eb8e2c292454'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.478603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] The token cache is being invalidate because project 6a3b4b4b24df43cdb92b0a8206d14ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:21.478896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.479619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.481668 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1522/3037] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:21 2022] DELETE /identity/v3/projects/6a3b4b4b24df43cdb92b0a8206d14ef0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:21.487798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:21.505715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49aa95d-ffe0-49f1-a376-2f07fe8e136d service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:21.631964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:21.633151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:21.633825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:21.634204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] PATH_INFO: `/v3/users/d5571a432f114a9a9bef8f52a213a759` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:21.636794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5571a432f114a9a9bef8f52a213a759)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:21.647100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:21.786442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5571a432f114a9a9bef8f52a213a759'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.787456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5571a432f114a9a9bef8f52a213a759'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.835476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5571a432f114a9a9bef8f52a213a759'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.836734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5571a432f114a9a9bef8f52a213a759'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.847395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:21.850293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1dcfe88c-dae5-45c4-87bc-2ef347eee7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5571a432f114a9a9bef8f52a213a759'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:21.875516 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1516/3038] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:21 2022] DELETE /identity/v3/users/d5571a432f114a9a9bef8f52a213a759 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:22.434456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:22.437412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:22.469936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0768837-6c53-4c3e-a0ed-eb8e2c292454 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:22.697897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:22.699605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:22.700002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:22.700445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] PATH_INFO: `/v3/projects/1bd5b89d294a4ce588fc4dd900fe952c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:22.704708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd5b89d294a4ce588fc4dd900fe952c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:22.707166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:22.906703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd5b89d294a4ce588fc4dd900fe952c', 'request_id': 'req-97fae00f-4373-4a0a-a680-123241eb1b2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:22.920922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd5b89d294a4ce588fc4dd900fe952c', 'request_id': 'req-97fae00f-4373-4a0a-a680-123241eb1b2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:22.937920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:22.938641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:22.939327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:22.942117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd5b89d294a4ce588fc4dd900fe952c', 'request_id': 'req-97fae00f-4373-4a0a-a680-123241eb1b2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:22.966078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] The token cache is being invalidate because project 1bd5b89d294a4ce588fc4dd900fe952c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:22.966420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:22.969939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:22.975932 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1523/3039] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:22 2022] DELETE /identity/v3/projects/1bd5b89d294a4ce588fc4dd900fe952c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:22.976962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:22.982403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:22.985237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] MFA Rules not processed for user `76897f7be7494bb589de747493240449`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:22.987272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:23.060330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:23.136067 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1517/3040] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:23.351670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fae00f-4373-4a0a-a680-123241eb1b2e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:23.366994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:23.370958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:23.371284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:23.371601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] PATH_INFO: `/v3/users/8d0510f569a64acd8d80a58399597124` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:23.375539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0510f569a64acd8d80a58399597124)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:23.377818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:23.529183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0510f569a64acd8d80a58399597124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:23.532984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0510f569a64acd8d80a58399597124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:23.574185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0510f569a64acd8d80a58399597124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:23.575729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0510f569a64acd8d80a58399597124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:23.597089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d0e68e45-b3b5-47f0-80af-9ca07ac7bd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0510f569a64acd8d80a58399597124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:23.627222 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1524/3041] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:22 2022] DELETE /identity/v3/users/8d0510f569a64acd8d80a58399597124 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:23.754431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:23.755958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:23.789716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d016b77-89ea-4512-9226-158f30da1195 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:24.013293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:24.015845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:24.016589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:24.017077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] PATH_INFO: `/v3/projects/f0a214b7d9ac42b2a43d434f3593178d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:24.019076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a214b7d9ac42b2a43d434f3593178d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:24.042700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:24.199188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a214b7d9ac42b2a43d434f3593178d', 'request_id': 'req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:24.210712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a214b7d9ac42b2a43d434f3593178d', 'request_id': 'req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:24.235795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a214b7d9ac42b2a43d434f3593178d', 'request_id': 'req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:24.264424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] The token cache is being invalidate because project f0a214b7d9ac42b2a43d434f3593178d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:24.264783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:24.265527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e80ef8d-f2eb-44d6-b698-a0b8ead9a60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:24.276286 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1518/3042] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:23 2022] DELETE /identity/v3/projects/f0a214b7d9ac42b2a43d434f3593178d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:24.278079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacfcd-44d1-4648-a3d6-d45e6b931371 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:24.278464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacfcd-44d1-4648-a3d6-d45e6b931371 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:24.278822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dacfcd-44d1-4648-a3d6-d45e6b931371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:24.324898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e7dacfcd-44d1-4648-a3d6-d45e6b931371 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:24.328846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e7dacfcd-44d1-4648-a3d6-d45e6b931371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:24.498508 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1525/3043] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:24.506616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796acd-8149-4327-be16-7087fd7326cd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:24.506934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796acd-8149-4327-be16-7087fd7326cd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:24.507217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40796acd-8149-4327-be16-7087fd7326cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:24.554952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40796acd-8149-4327-be16-7087fd7326cd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:24.557335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40796acd-8149-4327-be16-7087fd7326cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:24.580275 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1519/3044] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:24.584517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dacfcd-44d1-4648-a3d6-d45e6b931371 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:24.615936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dacfcd-44d1-4648-a3d6-d45e6b931371 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:24.637220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:24.638238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:24.638690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:24.639129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:24.644921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:07:24.645535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:24.647457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:24.681008 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1526/3045] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:07:24.681865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40796acd-8149-4327-be16-7087fd7326cd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:24.692512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40796acd-8149-4327-be16-7087fd7326cd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:24.697753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:24.698645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:24.698931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:24.699207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:24.700310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:24.702514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:24.732789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:24.759441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1520/3046] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:24 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:24.760180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:24.775483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02419f15-3740-4d7a-a5e1-9c5b61dffcca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:24.821581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:24.958594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:24.959710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:24.960002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:24.960327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:24.971820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:24.979481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:25.021370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.023473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:25.050014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1527/3047] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:24 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:07:25.059941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b03df-bacb-4f31-aee5-2381c2631e12 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:25.060733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.066069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:25.067005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.067296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.067570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] PATH_INFO: `/v3/projects/3cc1ea33e5234f28a39320c835dca69c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.068829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc1ea33e5234f28a39320c835dca69c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:25.071370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:25.104174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b0aa9-ea07-46c8-a14e-070e724e122c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:25.125223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:25.126843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.127367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.128137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.129384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:25.131658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:25.157124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1528/3048] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:25.162361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.189660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f23537-57b6-4e44-9b2e-46200f110382 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:25.259774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc1ea33e5234f28a39320c835dca69c', 'request_id': 'req-020258bf-946e-4052-a953-9d05cb678516'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:25.287961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc1ea33e5234f28a39320c835dca69c', 'request_id': 'req-020258bf-946e-4052-a953-9d05cb678516'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:25.306287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc1ea33e5234f28a39320c835dca69c', 'request_id': 'req-020258bf-946e-4052-a953-9d05cb678516'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:25.331397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] The token cache is being invalidate because project 3cc1ea33e5234f28a39320c835dca69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:25.333415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:25.335733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-020258bf-946e-4052-a953-9d05cb678516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:25.340615 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1521/3049] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:25 2022] DELETE /identity/v3/projects/3cc1ea33e5234f28a39320c835dca69c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:07:25.348969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf0aa8-b7ed-4a70-b64e-0c24e2cd4fa8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.349291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf0aa8-b7ed-4a70-b64e-0c24e2cd4fa8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.349570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf0aa8-b7ed-4a70-b64e-0c24e2cd4fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.368194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:25.368578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.368578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.368972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.369690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:25.371359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:25.408108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-09cf0aa8-b7ed-4a70-b64e-0c24e2cd4fa8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:25.409178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-09cf0aa8-b7ed-4a70-b64e-0c24e2cd4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:25.417144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1529/3050] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:25.420849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.427800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:25.439155 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1522/3051] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:07:25.448981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de827a5-3fc5-49f6-b99d-b7968f37a531 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.449416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de827a5-3fc5-49f6-b99d-b7968f37a531 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.449634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de827a5-3fc5-49f6-b99d-b7968f37a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.459563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d95733-251b-4e8c-bf3f-6160f8607fb2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:25.491990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1de827a5-3fc5-49f6-b99d-b7968f37a531 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:25.493324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7fc4f-75b7-4f20-a335-7a32d9ae8ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:25.493535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1de827a5-3fc5-49f6-b99d-b7968f37a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:25.494859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7fc4f-75b7-4f20-a335-7a32d9ae8ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.498103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7fc4f-75b7-4f20-a335-7a32d9ae8ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.500107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7fc4f-75b7-4f20-a335-7a32d9ae8ad1 admin admin] PATH_INFO: `/v3/projects/4643e24233bd4af1a0c020e4d9a474fb/users/cf9fa8d3d2bc4f9fa12fab743b7090ad/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.528354 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1523/3052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:25.528874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de827a5-3fc5-49f6-b99d-b7968f37a531 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.560466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de827a5-3fc5-49f6-b99d-b7968f37a531 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:25.575866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:25.576108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7fc4f-75b7-4f20-a335-7a32d9ae8ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4643e24233bd4af1a0c020e4d9a474fb, user_id=cf9fa8d3d2bc4f9fa12fab743b7090ad, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:25.576244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.576521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.576710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.577583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:07:25.577923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:25.578515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7fc4f-75b7-4f20-a335-7a32d9ae8ad1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:25.585761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:25.605971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1530/3053] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:25 2022] PUT /identity/v3/projects/4643e24233bd4af1a0c020e4d9a474fb/users/cf9fa8d3d2bc4f9fa12fab743b7090ad/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:25.614156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.614444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.614909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.616156 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1524/3054] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:07:25.621722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.651646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e6303-f1af-43cc-a237-a41aad870478 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:25.654381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:25.658483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:25.797381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:25.798089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:25.798427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:25.798710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:25.799663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:25.805024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:25.816789 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1531/3055] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:25.857883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.860238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:25.873259 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1525/3056] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:25 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:25.882755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:25.883097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:25.995221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:26.025322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bb158-2ffc-420c-b3e1-1da6ee985e01 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:26.083776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cfde6-1088-414d-9b78-e123e86f1e33 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:26.107384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:26.108101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:26.108435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:26.108714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:26.109440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:26.115759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:26.168564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:26.169517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:26.172601 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1526/3057] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:25 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:26.173099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:26.173524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:26.177420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:26.190356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:26.192916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:26.196822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678307-f87a-4066-b586-5391d95f7428 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:26.202606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:26.203743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:26.204276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:26.204761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:26.205803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:26.207783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:26.223180 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1532/3058] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:26.231496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1527/3059] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:26.235816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:26.247433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cfc7d-04f5-4c1b-a84d-90da4095ba9e service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:26.253759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b16710-ca54-41a8-9e3f-7d070af003fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:26.254453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b16710-ca54-41a8-9e3f-7d070af003fb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:26.254733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b16710-ca54-41a8-9e3f-7d070af003fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:26.255066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b16710-ca54-41a8-9e3f-7d070af003fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:26.255923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b16710-ca54-41a8-9e3f-7d070af003fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:26.257851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b16710-ca54-41a8-9e3f-7d070af003fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:26.273550 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1533/3060] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:26.277221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:26.288169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b87192-fd1d-496d-af5f-a03d9fb000c7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:26.294101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:26.295598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:26.296514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:26.298750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] PATH_INFO: `/v3/projects/a632e920b1a9473780187e280f6403db/users/fa2ca694acec4a07963aeeb2cd1b007c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:26.323056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a632e920b1a9473780187e280f6403db, user_id=fa2ca694acec4a07963aeeb2cd1b007c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:26.327910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:26.360409 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1528/3061] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:26 2022] PUT /identity/v3/projects/a632e920b1a9473780187e280f6403db/users/fa2ca694acec4a07963aeeb2cd1b007c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:26.447939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff451241-d319-46d8-b856-fecf650c2055 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:26.448236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff451241-d319-46d8-b856-fecf650c2055 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:26.448733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff451241-d319-46d8-b856-fecf650c2055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:26.514124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ff451241-d319-46d8-b856-fecf650c2055 None None] MFA Rules not processed for user `fa2ca694acec4a07963aeeb2cd1b007c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:26.517721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ff451241-d319-46d8-b856-fecf650c2055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:26.672526 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1534/3062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:26.681354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:26.683743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:26.848135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bd8bd-6781-48d2-982f-459dd622298a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:26.867433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:26.868635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:26.868971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:26.869274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:26.894891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:26.900390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:26.938758 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1529/3063] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:27.194949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96bcc5-f8a9-4503-aaf8-b9c9ae98a268 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:27.195850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96bcc5-f8a9-4503-aaf8-b9c9ae98a268 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:27.196347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96bcc5-f8a9-4503-aaf8-b9c9ae98a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:27.225418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ac96bcc5-f8a9-4503-aaf8-b9c9ae98a268 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:27.227178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ac96bcc5-f8a9-4503-aaf8-b9c9ae98a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:27.285405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:27.319174 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1535/3064] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:27.379381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:27.382137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:27.581134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb2a5-8222-4ad8-8413-41bf51d0deac service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:27.601301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b571ab-3419-48c6-9d94-386fff5c5e52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:27.602456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b571ab-3419-48c6-9d94-386fff5c5e52 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:27.602744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b571ab-3419-48c6-9d94-386fff5c5e52 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:27.603026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b571ab-3419-48c6-9d94-386fff5c5e52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:27.629413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b571ab-3419-48c6-9d94-386fff5c5e52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:27.631068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b571ab-3419-48c6-9d94-386fff5c5e52 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:27.649949 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1530/3065] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:27.849452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f3c8a-96be-446d-af63-99565ea66f08 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:27.849957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f3c8a-96be-446d-af63-99565ea66f08 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:27.851894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f3c8a-96be-446d-af63-99565ea66f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:27.890403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-843f3c8a-96be-446d-af63-99565ea66f08 None None] MFA Rules not processed for user `fa2ca694acec4a07963aeeb2cd1b007c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:27.891835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-843f3c8a-96be-446d-af63-99565ea66f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:27.900969 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1536/3066] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:28.314237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ecc67-bb70-44b7-821f-93fc7a8598ed None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:28.314562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ecc67-bb70-44b7-821f-93fc7a8598ed None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:28.314787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ecc67-bb70-44b7-821f-93fc7a8598ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:28.364103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:28.439467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b46ecc67-bb70-44b7-821f-93fc7a8598ed None None] MFA Rules not processed for user `86d98b6f30884d13a94ea2d4cabff826`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:28.441197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b46ecc67-bb70-44b7-821f-93fc7a8598ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:28.701392 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1531/3067] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:07:28.712109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb4b9-3f50-4f58-b5ca-0b9f6b30e1ab None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:28.712403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb4b9-3f50-4f58-b5ca-0b9f6b30e1ab None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:28.712683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb4b9-3f50-4f58-b5ca-0b9f6b30e1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:28.812190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b90eb4b9-3f50-4f58-b5ca-0b9f6b30e1ab None None] MFA Rules not processed for user `86d98b6f30884d13a94ea2d4cabff826`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:28.824576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b90eb4b9-3f50-4f58-b5ca-0b9f6b30e1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:28.891849 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1537/3068] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:30.552315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15932de2-0478-4f7e-880a-1cbcb02078d1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:30.552946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15932de2-0478-4f7e-880a-1cbcb02078d1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:30.553150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15932de2-0478-4f7e-880a-1cbcb02078d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:30.604744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-15932de2-0478-4f7e-880a-1cbcb02078d1 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:30.609569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15932de2-0478-4f7e-880a-1cbcb02078d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:30.639126 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1532/3069] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:07:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:30.656523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb4b9-3f50-4f58-b5ca-0b9f6b30e1ab None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:30.677409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb4b9-3f50-4f58-b5ca-0b9f6b30e1ab None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:30.698393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:30.699746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:30.701509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:30.704241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:30.727742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:30.736493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:30.765217 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1538/3070] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:07:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:31.028211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15932de2-0478-4f7e-880a-1cbcb02078d1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:31.209296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15932de2-0478-4f7e-880a-1cbcb02078d1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:31.214610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:31.216034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:31.216545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:31.217053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] PATH_INFO: `/v3/users/fa2ca694acec4a07963aeeb2cd1b007c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:31.218639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2ca694acec4a07963aeeb2cd1b007c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:31.220957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:31.300887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2ca694acec4a07963aeeb2cd1b007c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:31.301658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2ca694acec4a07963aeeb2cd1b007c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:31.317384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2ca694acec4a07963aeeb2cd1b007c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:31.319278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2ca694acec4a07963aeeb2cd1b007c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:31.339577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f688780-7623-4bc5-8470-bfc5628c5503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2ca694acec4a07963aeeb2cd1b007c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:31.367751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:31.371035 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1533/3071] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:07:31 2022] DELETE /identity/v3/users/fa2ca694acec4a07963aeeb2cd1b007c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:31.375901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56046b9-08af-460f-9502-591470caa215 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:31.376198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56046b9-08af-460f-9502-591470caa215 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:31.376479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56046b9-08af-460f-9502-591470caa215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:31.399785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71acd71-356c-4395-a1a4-3b2bc9e69b9c service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:31.444177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e56046b9-08af-460f-9502-591470caa215 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:31.452226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e56046b9-08af-460f-9502-591470caa215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:31.464126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:31.613851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1534/3072] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:31.629914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:31.630657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:31.645433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:31.648131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:31.660977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:31.703148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56046b9-08af-460f-9502-591470caa215 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:31.704611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e56046b9-08af-460f-9502-591470caa215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:31.895542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:31.898995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56046b9-08af-460f-9502-591470caa215 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:31.900605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:31.916791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f50c0a-4d65-401e-ad1f-07f1b005a128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:31.918667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f50c0a-4d65-401e-ad1f-07f1b005a128 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:31.919146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f50c0a-4d65-401e-ad1f-07f1b005a128 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:31.919577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f50c0a-4d65-401e-ad1f-07f1b005a128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:31.934413 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1539/3073] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:31.947266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f50c0a-4d65-401e-ad1f-07f1b005a128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:31.949991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f50c0a-4d65-401e-ad1f-07f1b005a128 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:31.976662 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1535/3074] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:07:34.541492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:34.544443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:34.576206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb0ed-a7e5-402c-9f7c-9a2881648da4 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:34.582613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:34.584880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:34.585410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:34.586088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] PATH_INFO: `/v3/projects/a632e920b1a9473780187e280f6403db` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:34.587892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a632e920b1a9473780187e280f6403db)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:34.590199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:34.793174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a632e920b1a9473780187e280f6403db', 'request_id': 'req-71001782-e084-4135-917f-2aacb941a089'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:34.816909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a632e920b1a9473780187e280f6403db', 'request_id': 'req-71001782-e084-4135-917f-2aacb941a089'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:34.822309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:34.921544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a632e920b1a9473780187e280f6403db', 'request_id': 'req-71001782-e084-4135-917f-2aacb941a089'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:35.009525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] The token cache is being invalidate because project a632e920b1a9473780187e280f6403db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:07:35.013376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:35.016817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71001782-e084-4135-917f-2aacb941a089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:07:35.031401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c892a4-4c26-47ae-bd82-d3955cd8022f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:35.032038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c892a4-4c26-47ae-bd82-d3955cd8022f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:35.032038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c892a4-4c26-47ae-bd82-d3955cd8022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:35.050122 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1540/3075] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:07:34 2022] DELETE /identity/v3/projects/a632e920b1a9473780187e280f6403db => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:35.122868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f8c892a4-4c26-47ae-bd82-d3955cd8022f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:35.124524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f8c892a4-4c26-47ae-bd82-d3955cd8022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:35.527266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00243b-935f-4689-92f9-ba33e74c6555 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:35.527954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00243b-935f-4689-92f9-ba33e74c6555 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:35.528459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00243b-935f-4689-92f9-ba33e74c6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:35.530022 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1536/3076] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:35.643946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cd00243b-935f-4689-92f9-ba33e74c6555 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:35.645230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cd00243b-935f-4689-92f9-ba33e74c6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:35.678286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1541/3077] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:35.683450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c892a4-4c26-47ae-bd82-d3955cd8022f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:35.731212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c892a4-4c26-47ae-bd82-d3955cd8022f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:35.781508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:35.782490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:35.782751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:35.783464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:35.798312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:07:35.800672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:35.806643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:35.880975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1537/3078] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:07:35.882049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00243b-935f-4689-92f9-ba33e74c6555 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:35.916855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00243b-935f-4689-92f9-ba33e74c6555 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:35.973474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:35.973474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:35.973474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:35.973474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:35.975208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:35.975208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:36.097459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1542/3079] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:35 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:36.101948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:36.121894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b41ae-5c94-4c24-aa66-dcd6ef13b9f1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:36.343647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:36.499778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:36.503318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:36.505625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:36.510818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:36.518852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:36.526942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:36.670495 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1538/3080] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:36 2022] POST /identity/v3/users => generated 291 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:36.674894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:36.697571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f32dff-d2ae-4815-91e8-5b581c020aa1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:36.716862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:36.717924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:36.718501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:36.719004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:36.720032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:36.722073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:36.783690 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1543/3081] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:36.785344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:36.821738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf20b20-64ef-46ef-910c-5dce87e816f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:36.861829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d953fc-5aa7-479b-952c-de253135a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:36.868447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d953fc-5aa7-479b-952c-de253135a963 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:36.868955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d953fc-5aa7-479b-952c-de253135a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:36.872929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d953fc-5aa7-479b-952c-de253135a963 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:36.874890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d953fc-5aa7-479b-952c-de253135a963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:36.912689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d953fc-5aa7-479b-952c-de253135a963 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:36.955342 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1539/3082] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:36.955568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:36.969607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42d8c-d46f-4122-8c26-8cf303d37869 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:36.987993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64001155-803a-4f4e-8054-c2cd86a0255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:36.989876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001155-803a-4f4e-8054-c2cd86a0255c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:36.991174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001155-803a-4f4e-8054-c2cd86a0255c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:36.993723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64001155-803a-4f4e-8054-c2cd86a0255c admin admin] PATH_INFO: `/v3/projects/0f681d806f354b8682bdae077a9ece40/users/dd075f9744d644e38be2333789563d12/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:37.055730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64001155-803a-4f4e-8054-c2cd86a0255c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f681d806f354b8682bdae077a9ece40, user_id=dd075f9744d644e38be2333789563d12, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:37.058632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64001155-803a-4f4e-8054-c2cd86a0255c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:37.090664 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1544/3083] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:36 2022] PUT /identity/v3/projects/0f681d806f354b8682bdae077a9ece40/users/dd075f9744d644e38be2333789563d12/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:37.103774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:37.106682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:37.109065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:37.202240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] MFA Rules not processed for user `dd075f9744d644e38be2333789563d12`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:37.232489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:37.517815 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1540/3084] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:37.525835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070dd2f-c948-4733-bfaf-d033fadc94bc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:37.526462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070dd2f-c948-4733-bfaf-d033fadc94bc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:37.526954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070dd2f-c948-4733-bfaf-d033fadc94bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:37.590915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c070dd2f-c948-4733-bfaf-d033fadc94bc None None] MFA Rules not processed for user `dd075f9744d644e38be2333789563d12`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:37.599602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c070dd2f-c948-4733-bfaf-d033fadc94bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:37.634072 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1545/3085] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:38.616490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:38.618117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:38.865631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dff2e-83f5-4901-ad6c-786c4eb67cb2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:38.886525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:38.887223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:38.887503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:38.887780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:38.903962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:38.907473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:38.963677 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1541/3086] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:41.028808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc804-4410-4a60-9872-dfcd2ea8f0e4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:41.029888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc804-4410-4a60-9872-dfcd2ea8f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:41.030508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bc804-4410-4a60-9872-dfcd2ea8f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:41.082019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d40bc804-4410-4a60-9872-dfcd2ea8f0e4 None None] MFA Rules not processed for user `cf9fa8d3d2bc4f9fa12fab743b7090ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:41.084659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d40bc804-4410-4a60-9872-dfcd2ea8f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:41.272465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1546/3087] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:41.274294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:41.276868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:41.369013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:41.459929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0a2e-d039-40f5-908a-82c862374774 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:41.471961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:41.472855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:41.473345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:41.473794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:41.474660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:41.479562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:41.544240 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1542/3088] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:41 2022] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:41.546570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bc804-4410-4a60-9872-dfcd2ea8f0e4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:41.568214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bc804-4410-4a60-9872-dfcd2ea8f0e4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:41.711489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:41.717371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:41.725207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:41.725863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:41.726815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:41.729762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:41.770197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:41.800010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:41.815968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1547/3089] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:41 2022] POST /identity/v3/users => generated 298 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:41.816148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8b998-2f08-425b-a37b-6fd2d864fff4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:41.846577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:41.850343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:41.851408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:41.852483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:41.855361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:41.857539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:41.892691 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1543/3090] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:41.893550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:41.917149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a64845-2696-46cc-8bae-57a2bf15b26d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:41.924299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:41.925908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:41.926392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:41.926985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] PATH_INFO: `/v3/projects/fed1a319a984482eabb1873973e84b83/users/df66b9f0141a45a58b9a312c4c8a50f6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:41.955002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed1a319a984482eabb1873973e84b83, user_id=df66b9f0141a45a58b9a312c4c8a50f6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:41.960684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:41.994781 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1548/3091] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:41 2022] PUT /identity/v3/projects/fed1a319a984482eabb1873973e84b83/users/df66b9f0141a45a58b9a312c4c8a50f6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:41.999026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:42.014052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b4029-d06c-4274-a76a-2b8207819c57 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:42.157533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:42.158564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:42.159090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:42.159862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:42.160820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:42.165848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:42.191874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:42.193623 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1544/3092] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:42.208857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294da20-1b56-4971-9df1-5e2a060d1031 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:42.229637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f37ff-c8a6-4e9f-bbf4-2f12c2ceed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:42.230829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f37ff-c8a6-4e9f-bbf4-2f12c2ceed63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:42.231248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f37ff-c8a6-4e9f-bbf4-2f12c2ceed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:42.231881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f37ff-c8a6-4e9f-bbf4-2f12c2ceed63 admin admin] PATH_INFO: `/v3/projects/fed1a319a984482eabb1873973e84b83/users/df66b9f0141a45a58b9a312c4c8a50f6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:42.238668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f37ff-c8a6-4e9f-bbf4-2f12c2ceed63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed1a319a984482eabb1873973e84b83, user_id=df66b9f0141a45a58b9a312c4c8a50f6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:42.242816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f37ff-c8a6-4e9f-bbf4-2f12c2ceed63 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:42.273507 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1549/3093] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:42 2022] PUT /identity/v3/projects/fed1a319a984482eabb1873973e84b83/users/df66b9f0141a45a58b9a312c4c8a50f6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:07:44.219946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:44.395588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604ccc7-9047-4d1a-8f9a-bab7f9b084c4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:44.522309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:44.562075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:44.563742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:44.564376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:44.564873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:44.568105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:44.669598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:44.671904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:44.705434 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1545/3094] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:07:46.101915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22cbbb-9d8d-49d4-b1b6-5171e1245838 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:46.102497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22cbbb-9d8d-49d4-b1b6-5171e1245838 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:46.102497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22cbbb-9d8d-49d4-b1b6-5171e1245838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:46.173481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4d22cbbb-9d8d-49d4-b1b6-5171e1245838 None None] MFA Rules not processed for user `1b0598fbccf348148fda392a40bf0078`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:46.177681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4d22cbbb-9d8d-49d4-b1b6-5171e1245838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:46.352190 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1550/3095] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:07:46.353721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:46.355338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:46.582113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e0b1f-6b7e-4eca-8e7b-6258a47b99ce service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:46.600895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:46.600895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:46.600895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:46.601368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:46.601875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:46.606883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:46.713249 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1546/3096] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:07:46 2022] POST /identity/v3/projects => generated 377 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:46.716967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22cbbb-9d8d-49d4-b1b6-5171e1245838 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:46.745158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22cbbb-9d8d-49d4-b1b6-5171e1245838 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:46.882206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:46.882916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:46.883202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:46.883481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:46.884193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:46.887235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:46.958286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1551/3097] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:07:46 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:07:46.962257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:46.978734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40abb6-8c8d-4a3f-918e-f6b32c4f8f53 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:46.989959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:46.991160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:46.991624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:46.992064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:46.992994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:46.994826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:47.019474 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1547/3098] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:47.029594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:47.053635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4382b-664e-4dc6-a659-ea5f79c51c94 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:47.061916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:47.064829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:47.066252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:47.067009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] PATH_INFO: `/v3/projects/3e33efced4864cb4926d277d8addb0d6/users/b7f0f1fe26f546969d9f33194f8ed81f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:47.134653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e33efced4864cb4926d277d8addb0d6, user_id=b7f0f1fe26f546969d9f33194f8ed81f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:47.140318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:47.177781 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1552/3099] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:47 2022] PUT /identity/v3/projects/3e33efced4864cb4926d277d8addb0d6/users/b7f0f1fe26f546969d9f33194f8ed81f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:07:47.181696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:47.204061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780e37-68f6-4cb7-975d-b36ebf5ad1e3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:47.354398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:47.380831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:47.381901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:47.382980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:47.385006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:47.386750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:47.392299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:47.434158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:47.457733 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1548/3100] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:07:47.468859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f5404-3b0b-44ae-963e-957b69caedb2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:47.491107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14072-593d-4b38-a69e-f58f50c58a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:47.492577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14072-593d-4b38-a69e-f58f50c58a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:47.492867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14072-593d-4b38-a69e-f58f50c58a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:47.496009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14072-593d-4b38-a69e-f58f50c58a59 admin admin] PATH_INFO: `/v3/projects/3e33efced4864cb4926d277d8addb0d6/users/b7f0f1fe26f546969d9f33194f8ed81f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:47.501594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e14072-593d-4b38-a69e-f58f50c58a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e33efced4864cb4926d277d8addb0d6, user_id=b7f0f1fe26f546969d9f33194f8ed81f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:47.521852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e14072-593d-4b38-a69e-f58f50c58a59 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:47.540779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:47.559168 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1553/3101] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:07:47 2022] PUT /identity/v3/projects/3e33efced4864cb4926d277d8addb0d6/users/b7f0f1fe26f546969d9f33194f8ed81f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:07:50.843804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:07:50.846208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:51.112766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f69268-4460-49ba-9fe5-892a9979c363 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:07:51.276302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:07:51.277950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:51.279884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:51.280588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:51.291874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:51.466436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:07:51.483723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:07:51.510497 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1549/3102] 10.222.0.30 () {60 vars in 1396 bytes} [Sat Jun 18 22:07:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:57.559741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:59.419542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e8b80-3de8-4f03-814d-fad5694cd607 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:07:59.420453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e8b80-3de8-4f03-814d-fad5694cd607 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:07:59.421145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e8b80-3de8-4f03-814d-fad5694cd607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:07:59.488822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6d1e8b80-3de8-4f03-814d-fad5694cd607 None None] MFA Rules not processed for user `df66b9f0141a45a58b9a312c4c8a50f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:07:59.490596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6d1e8b80-3de8-4f03-814d-fad5694cd607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:07:59.681661 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1554/3103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:07:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:00.361392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:00.363673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:00.457847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:00.573833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9233a-6e02-4c7f-a2bd-81875313f193 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:00.611570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711d0d7-145d-478f-9e06-3ba87cf97706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:00.613822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d0d7-145d-478f-9e06-3ba87cf97706 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:00.615574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d0d7-145d-478f-9e06-3ba87cf97706 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:00.616160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711d0d7-145d-478f-9e06-3ba87cf97706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:00.819313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711d0d7-145d-478f-9e06-3ba87cf97706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:00.821868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711d0d7-145d-478f-9e06-3ba87cf97706 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:00.867066 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1550/3104] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:00.970592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e8b80-3de8-4f03-814d-fad5694cd607 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:00.990658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e8b80-3de8-4f03-814d-fad5694cd607 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:01.011061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:01.024544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:01.025970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:01.026446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:01.033006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:01.083144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:01.095123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:01.123634 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1555/3105] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:03.599292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe5a3-bfd3-4e06-a043-a7f69a74ef81 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:03.599735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe5a3-bfd3-4e06-a043-a7f69a74ef81 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:03.604817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fe5a3-bfd3-4e06-a043-a7f69a74ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:03.667956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e26fe5a3-bfd3-4e06-a043-a7f69a74ef81 None None] MFA Rules not processed for user `b7f0f1fe26f546969d9f33194f8ed81f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:03.673540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e26fe5a3-bfd3-4e06-a043-a7f69a74ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:03.845831 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1551/3106] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:03.862626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:03.864302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:03.910345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727df4a-d946-4132-a97b-5fe199b861d3 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:03.929916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:03.930617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:03.930900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:03.931175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:04.125379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:04.147575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:04.183667 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1556/3107] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:06.597412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253663f3-a75b-401e-8bfd-7ae387a74a0c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:06.598525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253663f3-a75b-401e-8bfd-7ae387a74a0c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:06.599144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253663f3-a75b-401e-8bfd-7ae387a74a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:06.651766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-253663f3-a75b-401e-8bfd-7ae387a74a0c None None] MFA Rules not processed for user `cf9fa8d3d2bc4f9fa12fab743b7090ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:06.654936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-253663f3-a75b-401e-8bfd-7ae387a74a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:06.682210 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1552/3108] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:08.149454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:08.153361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:08.320587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a469d-fd6f-40ed-adff-a5e25169febc service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:08.328607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:08.330191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:08.331149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:08.331973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] PATH_INFO: `/v3/users/eb755a019e2c4243a89e682a06d42c3f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:08.333985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb755a019e2c4243a89e682a06d42c3f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:08.336651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:08.376753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:08.431323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb755a019e2c4243a89e682a06d42c3f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:08.432424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb755a019e2c4243a89e682a06d42c3f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:08.448710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb755a019e2c4243a89e682a06d42c3f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:08.449566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb755a019e2c4243a89e682a06d42c3f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:08.464567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb755a019e2c4243a89e682a06d42c3f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:08.492138 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1557/3109] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:08:08 2022] DELETE /identity/v3/users/eb755a019e2c4243a89e682a06d42c3f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:08:08.904507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253663f3-a75b-401e-8bfd-7ae387a74a0c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:08.942669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253663f3-a75b-401e-8bfd-7ae387a74a0c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:09.127073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:09.141976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:09.143021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.146573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.147117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] PATH_INFO: `/v3/projects/5d60e61526824a71bdae0df1099f625c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.149798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d60e61526824a71bdae0df1099f625c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:09.153637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:09.262385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d60e61526824a71bdae0df1099f625c', 'request_id': 'req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:09.293145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d60e61526824a71bdae0df1099f625c', 'request_id': 'req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:09.309491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d60e61526824a71bdae0df1099f625c', 'request_id': 'req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:09.336779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] The token cache is being invalidate because project 5d60e61526824a71bdae0df1099f625c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:08:09.337093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:09.337638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:09.337939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-316e8a7c-4f0d-4c65-b1f8-8fd7405793c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:09.339645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:09.341549 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1553/3110] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:08 2022] DELETE /identity/v3/projects/5d60e61526824a71bdae0df1099f625c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:08:09.347138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1fb2d-9630-4fc8-b523-a0690d48ec2b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.347640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1fb2d-9630-4fc8-b523-a0690d48ec2b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.348086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1fb2d-9630-4fc8-b523-a0690d48ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.371563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bcb1fb2d-9630-4fc8-b523-a0690d48ec2b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:09.373994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bcb1fb2d-9630-4fc8-b523-a0690d48ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:09.456146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1e7e-3f79-4ebe-8ea2-2e5fd5107e3a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:09.486292 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1554/3111] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:09.488049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a20e2-8d95-4ac4-8faa-02d5fd6402e4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.488335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a20e2-8d95-4ac4-8faa-02d5fd6402e4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.488611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a20e2-8d95-4ac4-8faa-02d5fd6402e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.513625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3d7a20e2-8d95-4ac4-8faa-02d5fd6402e4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:09.514959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d7a20e2-8d95-4ac4-8faa-02d5fd6402e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:09.524056 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1555/3112] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:09.529500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a20e2-8d95-4ac4-8faa-02d5fd6402e4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:09.549347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:09.550229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a20e2-8d95-4ac4-8faa-02d5fd6402e4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:09.551015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.551567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.552127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.554952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:09.564186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:09.564863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.565348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.565909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.567141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:08:09.567383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:09.569461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:09.605951 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1556/3113] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:08:09.621859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:09.637936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a9ce-3caf-4550-9bad-75f9584cf1f0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:09.643139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:09.644468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:09.646900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.647589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.647739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.648524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:09.651558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:09.706208 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1557/3114] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:08:09 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:08:09.710147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:09.731935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:09.733909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:09.772331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1558/3115] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:09.793678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:09.831975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26a3fd-c54d-4764-87e2-eecb764ef435 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:09.839403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:09.840327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.840705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.841574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.842110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:09.844195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:09.873119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1558/3116] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:08:09 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:08:09.873912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:09.891900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb00f0-a84f-474b-9195-dada0d8afc52 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:09.898320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:09.901180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.901856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.902140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.903501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:09.904978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:09.919179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1559/3117] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:08:09.923935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:09.938704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2627e3-da6f-4062-83db-8cef23663c4c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:09.946350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd4e75-a0f3-4444-81f0-1d2b845620b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:09.947678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd4e75-a0f3-4444-81f0-1d2b845620b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:09.948099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd4e75-a0f3-4444-81f0-1d2b845620b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:09.948466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd4e75-a0f3-4444-81f0-1d2b845620b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:09.949350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd4e75-a0f3-4444-81f0-1d2b845620b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:09.951351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd4e75-a0f3-4444-81f0-1d2b845620b3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:09.980207 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1559/3118] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:08:09.984384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:10.011471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae577cd-080a-4367-be92-52304580eb2f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:10.030496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:10.031900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:10.032362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:10.032984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] PATH_INFO: `/v3/projects/8c1692835c294cf0b1173710c33b748d/users/ed68324e9fed4eb2885bfc608e009af2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:10.071329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1692835c294cf0b1173710c33b748d, user_id=ed68324e9fed4eb2885bfc608e009af2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:10.075946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:10.096747 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1560/3119] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:08:09 2022] PUT /identity/v3/projects/8c1692835c294cf0b1173710c33b748d/users/ed68324e9fed4eb2885bfc608e009af2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:08:10.107406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66d87a-24d4-40db-a02a-88ae99522249 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:10.107693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66d87a-24d4-40db-a02a-88ae99522249 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:10.107969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66d87a-24d4-40db-a02a-88ae99522249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:10.153719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7d66d87a-24d4-40db-a02a-88ae99522249 None None] MFA Rules not processed for user `ed68324e9fed4eb2885bfc608e009af2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:10.154978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7d66d87a-24d4-40db-a02a-88ae99522249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:10.267297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1560/3120] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:10.422326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:10.424306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:10.505783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933b6d-caa3-44d6-a9d5-d2100fe6512c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:10.515559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfababf-632b-4e20-b402-ecb9114168b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:10.516316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfababf-632b-4e20-b402-ecb9114168b5 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:10.516761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfababf-632b-4e20-b402-ecb9114168b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:10.517070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfababf-632b-4e20-b402-ecb9114168b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:10.526633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfababf-632b-4e20-b402-ecb9114168b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:10.528488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfababf-632b-4e20-b402-ecb9114168b5 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:10.541348 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1561/3121] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:08:10.774090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3bf8-2742-466a-b6f8-343ba448fc74 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:10.774464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3bf8-2742-466a-b6f8-343ba448fc74 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:10.774810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3bf8-2742-466a-b6f8-343ba448fc74 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:10.776866 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1561/3122] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:08:10.783068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0df35-40fb-44d7-b41e-68431b8d95db None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:10.783428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0df35-40fb-44d7-b41e-68431b8d95db None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:10.783768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0df35-40fb-44d7-b41e-68431b8d95db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:10.803856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-96c0df35-40fb-44d7-b41e-68431b8d95db None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:10.805001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-96c0df35-40fb-44d7-b41e-68431b8d95db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:10.888066 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1562/3123] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:08:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:10.911185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a3bf8-2742-466a-b6f8-343ba448fc74 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:10.913452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ff7a3bf8-2742-466a-b6f8-343ba448fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:10.933819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a3bf8-2742-466a-b6f8-343ba448fc74 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:10.939367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:10.940044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:10.940329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:10.940610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:10.951887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:10.953640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:10.966372 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1562/3124] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:11.193468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0df35-40fb-44d7-b41e-68431b8d95db None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:11.205631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0df35-40fb-44d7-b41e-68431b8d95db None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:11.211757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:11.212704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:11.213111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:11.213477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:11.217053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:11.246682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:11.253791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:11.256793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:11.279749 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1563/3125] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:11.771286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:11.773517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:11.909814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36855e47-4ef1-4af0-ad7b-97aa64340d90 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:11.928771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:11.928771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:11.929023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:11.929739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:11.939755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:11.962489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:11.964844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:11.986999 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1563/3126] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:12.076943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:12.094015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354e37-5546-4698-b5ca-31792f7ad1f8 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:12.110347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:12.119150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:12.119642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:12.120194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:12.123180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:12.137988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:12.139781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:12.148968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1564/3127] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:14.492196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:14.504597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69bf8-f005-4701-ab2c-1e5e76853dc4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:14.511866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6032e4-dea5-4eb8-b805-6aad05ff6ded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:14.512777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6032e4-dea5-4eb8-b805-6aad05ff6ded service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:14.513171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6032e4-dea5-4eb8-b805-6aad05ff6ded service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:14.513500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6032e4-dea5-4eb8-b805-6aad05ff6ded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:14.515542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9d6032e4-dea5-4eb8-b805-6aad05ff6ded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:14.574578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:14.603512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6032e4-dea5-4eb8-b805-6aad05ff6ded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:14.605376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6032e4-dea5-4eb8-b805-6aad05ff6ded service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:14.618112 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1564/3128] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:08:15.239590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:15.365970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b28df-0fd2-494f-b656-61350d516d75 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:15.370574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:15.371455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:15.371737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:15.372063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] PATH_INFO: `/v3/users/ed68324e9fed4eb2885bfc608e009af2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:15.373324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed68324e9fed4eb2885bfc608e009af2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:15.375298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:15.434483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e14d2-94a3-4613-9179-65f3a6fe53f0 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:15.435131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e14d2-94a3-4613-9179-65f3a6fe53f0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:15.435630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e14d2-94a3-4613-9179-65f3a6fe53f0 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:15.437413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed68324e9fed4eb2885bfc608e009af2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:15.438234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed68324e9fed4eb2885bfc608e009af2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:15.439243 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1565/3129] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:08:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:08:15.447229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:15.447786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:15.448260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:15.457012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed68324e9fed4eb2885bfc608e009af2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:15.457984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed68324e9fed4eb2885bfc608e009af2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:15.466506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020153a9-a7f0-455b-815b-028a951d571f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed68324e9fed4eb2885bfc608e009af2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:15.498412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:15.500568 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1565/3130] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:08:15 2022] DELETE /identity/v3/users/ed68324e9fed4eb2885bfc608e009af2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:08:15.502161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:15.502318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:15.502513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:15.503327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:15.524086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:15.525447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:15.591987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:15.612098 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1566/3131] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:15.622306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:15.623934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:15.625352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1566/3132] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:08:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:08:15.645369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:15.647094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:15.677496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f183b72-c627-4641-832f-9d4a1b0f8143 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:15.697738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:15.698694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:15.699627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:15.700108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:15.713863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a6e8-8774-4462-b80c-8d5576ee57c0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:15.720896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc637f-2b94-4f18-a0db-8ff3fa402c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:15.721713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc637f-2b94-4f18-a0db-8ff3fa402c8c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:15.722064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc637f-2b94-4f18-a0db-8ff3fa402c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:15.722764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc637f-2b94-4f18-a0db-8ff3fa402c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:15.726750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:15.728684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:15.739202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc637f-2b94-4f18-a0db-8ff3fa402c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:15.740635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc637f-2b94-4f18-a0db-8ff3fa402c8c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:15.751157 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1567/3133] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:08:15.783666 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1567/3134] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:16.522492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:16.524659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:16.589485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65430db-5535-40d2-8414-84eaecd08357 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:16.596915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:16.606335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:16.606626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:16.606914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] PATH_INFO: `/v3/projects/8c1692835c294cf0b1173710c33b748d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:16.609361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1692835c294cf0b1173710c33b748d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:16.611869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:16.725741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1692835c294cf0b1173710c33b748d', 'request_id': 'req-5a047b42-511b-4a9c-b4a6-422f1ab54dde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:16.738606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1692835c294cf0b1173710c33b748d', 'request_id': 'req-5a047b42-511b-4a9c-b4a6-422f1ab54dde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:16.753558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1692835c294cf0b1173710c33b748d', 'request_id': 'req-5a047b42-511b-4a9c-b4a6-422f1ab54dde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:16.771250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] The token cache is being invalidate because project 8c1692835c294cf0b1173710c33b748d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:08:16.774074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:16.775014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a047b42-511b-4a9c-b4a6-422f1ab54dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:08:16.777111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1568/3135] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:16 2022] DELETE /identity/v3/projects/8c1692835c294cf0b1173710c33b748d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:08:16.786626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74342-caff-4ab9-86ed-d152c7cbdb7e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:16.787147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74342-caff-4ab9-86ed-d152c7cbdb7e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:16.787924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74342-caff-4ab9-86ed-d152c7cbdb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:16.814049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d4c74342-caff-4ab9-86ed-d152c7cbdb7e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:16.817470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d4c74342-caff-4ab9-86ed-d152c7cbdb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:16.918080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1568/3136] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:16.927074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06366-6a80-4007-a68d-1a3b42400e5a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:16.927448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06366-6a80-4007-a68d-1a3b42400e5a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:16.927733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06366-6a80-4007-a68d-1a3b42400e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:16.949320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-56a06366-6a80-4007-a68d-1a3b42400e5a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:16.950777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-56a06366-6a80-4007-a68d-1a3b42400e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:16.964364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1569/3137] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:16.965140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74342-caff-4ab9-86ed-d152c7cbdb7e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:16.975817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74342-caff-4ab9-86ed-d152c7cbdb7e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:16.981347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:16.982259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:16.983034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:16.983034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:16.983549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:08:16.983929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:16.985764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:17.002712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1569/3138] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:08:17.006898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a06366-6a80-4007-a68d-1a3b42400e5a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:17.017633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a06366-6a80-4007-a68d-1a3b42400e5a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:17.022464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:17.023147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:17.027204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:17.027507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:17.028258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:17.030551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:17.094891 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1570/3139] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:08:17 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:08:17.100626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:17.117974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779e006-730d-44cc-8833-a12fa459dd07 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:17.325969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:17.328354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:17.330894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:17.332243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:17.335490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:17.345447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:17.393416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:17.393626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1570/3140] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:08:17 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:08:17.429908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29c845-7f82-45a2-9d42-52fead29da28 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:17.445892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:17.447455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:17.450717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:17.451003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:17.451779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:17.453598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:17.469988 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1571/3141] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:08:17.476199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:17.497800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e78009-ae85-4c64-8133-501169cee8f3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:17.514889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605f7a7-5e2d-4678-846d-e2025127eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:17.517243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605f7a7-5e2d-4678-846d-e2025127eb51 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:17.518980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605f7a7-5e2d-4678-846d-e2025127eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:17.519324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605f7a7-5e2d-4678-846d-e2025127eb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:17.520923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605f7a7-5e2d-4678-846d-e2025127eb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:17.525669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605f7a7-5e2d-4678-846d-e2025127eb51 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:17.553697 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1571/3142] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:08:17.560676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:17.564033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:17.564579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:17.565260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:17.570823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:17.591556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223fe07-6462-4452-8bbf-4f88458f4241 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:17.592490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:17.593995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:17.600117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:17.612896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aba35d-219f-49ba-92a5-e84ac4e1a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:17.613889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aba35d-219f-49ba-92a5-e84ac4e1a28b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:17.614165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aba35d-219f-49ba-92a5-e84ac4e1a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:17.614434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aba35d-219f-49ba-92a5-e84ac4e1a28b admin admin] PATH_INFO: `/v3/projects/a0f349f2feda450cbe24f0a17b186798/users/a3022aec60f643b2a66492ad8f8d7e96/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:17.667463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aba35d-219f-49ba-92a5-e84ac4e1a28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f349f2feda450cbe24f0a17b186798, user_id=a3022aec60f643b2a66492ad8f8d7e96, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:17.670211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aba35d-219f-49ba-92a5-e84ac4e1a28b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:17.707760 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1572/3143] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:08:17 2022] PUT /identity/v3/projects/a0f349f2feda450cbe24f0a17b186798/users/a3022aec60f643b2a66492ad8f8d7e96/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:08:17.713143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:17.713430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:17.713701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:17.725249 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1572/3144] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:08:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:08:17.741601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:17.743723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:17.761417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:17.762649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:17.939899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dcb13-ae19-41f4-98a3-0b49dc1aa5c0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:17.961097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1573/3145] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:08:17.971298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:17.973336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:18.054373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5518ac0-c9f5-459e-940f-930f07f7aec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:18.055392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5518ac0-c9f5-459e-940f-930f07f7aec9 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:18.055945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5518ac0-c9f5-459e-940f-930f07f7aec9 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:18.056393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5518ac0-c9f5-459e-940f-930f07f7aec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:18.117835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb4e65-b9d3-4cba-8ce1-b9c7721075f9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:18.122218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f04171-bb8b-4852-a7cf-960cd9e3ef33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:18.123128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f04171-bb8b-4852-a7cf-960cd9e3ef33 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:18.123573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f04171-bb8b-4852-a7cf-960cd9e3ef33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:18.124020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f04171-bb8b-4852-a7cf-960cd9e3ef33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:18.137769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5518ac0-c9f5-459e-940f-930f07f7aec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:18.139850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5518ac0-c9f5-459e-940f-930f07f7aec9 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:18.143696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f04171-bb8b-4852-a7cf-960cd9e3ef33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:18.147102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f04171-bb8b-4852-a7cf-960cd9e3ef33 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:18.152290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:18.169131 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1573/3146] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:08:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:08:18.176812 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1574/3147] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:08:25.971312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db34ae-49ef-40d1-9cd5-eaf37da4d398 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:25.971941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db34ae-49ef-40d1-9cd5-eaf37da4d398 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:25.971941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db34ae-49ef-40d1-9cd5-eaf37da4d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:26.002749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-69db34ae-49ef-40d1-9cd5-eaf37da4d398 None None] MFA Rules not processed for user `1b0598fbccf348148fda392a40bf0078`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:26.008393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69db34ae-49ef-40d1-9cd5-eaf37da4d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:26.157255 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1574/3148] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:26.160433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:26.160956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:26.161275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:26.205893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] MFA Rules not processed for user `1b0598fbccf348148fda392a40bf0078`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:26.208633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:26.229117 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1575/3149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:31.263601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387674bd-3e62-4779-b6f9-460a6a19cdd0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:31.264158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387674bd-3e62-4779-b6f9-460a6a19cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:31.264158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387674bd-3e62-4779-b6f9-460a6a19cdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:31.303327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-387674bd-3e62-4779-b6f9-460a6a19cdd0 None None] MFA Rules not processed for user `a3022aec60f643b2a66492ad8f8d7e96`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:31.304700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-387674bd-3e62-4779-b6f9-460a6a19cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:31.379387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1575/3150] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:33.121621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:33.124754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:33.254877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a85c1e-1fb1-4dfa-8176-315bc51156bc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:33.261879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53977d-c42e-4ab5-ad58-93742cfc97ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:33.263148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53977d-c42e-4ab5-ad58-93742cfc97ee service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:33.263842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53977d-c42e-4ab5-ad58-93742cfc97ee service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:33.264953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53977d-c42e-4ab5-ad58-93742cfc97ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:33.277396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53977d-c42e-4ab5-ad58-93742cfc97ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:33.279326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53977d-c42e-4ab5-ad58-93742cfc97ee service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:33.306257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:33.326711 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1576/3151] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:36.553428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1217f-ce47-49d1-87a4-8d81588ddf21 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:36.554023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1217f-ce47-49d1-87a4-8d81588ddf21 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:36.554132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1217f-ce47-49d1-87a4-8d81588ddf21 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:36.556255 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1576/3152] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:08:36.571136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00df05-0d4b-4f55-a602-edc23b915977 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:36.572341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00df05-0d4b-4f55-a602-edc23b915977 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:36.575266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00df05-0d4b-4f55-a602-edc23b915977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:36.617270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ae00df05-0d4b-4f55-a602-edc23b915977 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:36.620829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ae00df05-0d4b-4f55-a602-edc23b915977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:36.656431 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1577/3153] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:36.715333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1217f-ce47-49d1-87a4-8d81588ddf21 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:36.735415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1217f-ce47-49d1-87a4-8d81588ddf21 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:36.742099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421471-746d-4906-94bd-4521a5971594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:36.742779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421471-746d-4906-94bd-4521a5971594 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:36.743056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421471-746d-4906-94bd-4521a5971594 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:36.743327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421471-746d-4906-94bd-4521a5971594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:36.766777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58421471-746d-4906-94bd-4521a5971594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:36.781378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58421471-746d-4906-94bd-4521a5971594 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:36.810658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1577/3154] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:37.235129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b380f2-7fdf-44f4-b4c6-a6b0b18b70d1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:37.235724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b380f2-7fdf-44f4-b4c6-a6b0b18b70d1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:37.236184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b380f2-7fdf-44f4-b4c6-a6b0b18b70d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:37.292698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-88b380f2-7fdf-44f4-b4c6-a6b0b18b70d1 None None] MFA Rules not processed for user `a3022aec60f643b2a66492ad8f8d7e96`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:37.303384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-88b380f2-7fdf-44f4-b4c6-a6b0b18b70d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:37.340928 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1578/3155] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:45.190349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c562b6-992f-4ada-85d4-b46abcaec1a0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:45.190921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c562b6-992f-4ada-85d4-b46abcaec1a0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:45.191045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c562b6-992f-4ada-85d4-b46abcaec1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:45.253662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-13c562b6-992f-4ada-85d4-b46abcaec1a0 None None] MFA Rules not processed for user `86d98b6f30884d13a94ea2d4cabff826`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:45.257686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-13c562b6-992f-4ada-85d4-b46abcaec1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:45.420809 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1578/3156] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:08:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:45.817958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b380f2-7fdf-44f4-b4c6-a6b0b18b70d1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:45.832981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b380f2-7fdf-44f4-b4c6-a6b0b18b70d1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:45.838365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:45.840364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:45.840826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:45.841455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:45.845599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:45.862515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:45.864388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:45.887646 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1579/3157] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:08:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:08:47.989678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef782ab-ddbf-43cb-87fd-b94714f455a4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:47.991539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef782ab-ddbf-43cb-87fd-b94714f455a4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:47.992205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef782ab-ddbf-43cb-87fd-b94714f455a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:48.025140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4ef782ab-ddbf-43cb-87fd-b94714f455a4 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:48.030312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4ef782ab-ddbf-43cb-87fd-b94714f455a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:48.044099 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1579/3158] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:08:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:48.064185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:48.080491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012362d1-4a44-4f3d-bfbf-29ded663ee5c service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:48.086686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:48.087653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:48.087949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:48.088230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:48.100538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:48.102697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:48.130970 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1580/3159] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:08:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:08:50.428502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:50.429456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:50.430084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:50.443792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:50.470835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:08:50.473424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:08:50.488946 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1580/3160] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:08:50.526631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:08:50.566879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfb38d-3733-43f6-b0e7-1cb93bfb8023 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:08:50.582718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:08:50.583810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:08:50.584971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:08:50.586226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:08:50.613896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:08:50.616467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:08:50.630993 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1581/3161] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:08:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:00.457819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:00.624544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=24 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:07.250482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:07.252185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:07.330854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c54b8-7909-4bf7-9ff2-04c6fa669564 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:07.336421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf3b2-96c6-4e16-b220-09b742a1d7d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:07.337497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf3b2-96c6-4e16-b220-09b742a1d7d9 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:07.337777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf3b2-96c6-4e16-b220-09b742a1d7d9 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:07.338044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf3b2-96c6-4e16-b220-09b742a1d7d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:07.340812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7d5cf3b2-96c6-4e16-b220-09b742a1d7d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:07.354000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cf3b2-96c6-4e16-b220-09b742a1d7d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:07.355940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cf3b2-96c6-4e16-b220-09b742a1d7d9 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:07.370457 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1581/3162] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:11.036661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:11.059063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b368c8-2037-45c7-804e-8095100f94a6 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:11.081290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:11.081970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:11.082249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:11.082533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:11.089949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:11.118302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:11.123657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:11.168311 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1582/3163] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:11.493970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0003d-312e-4d25-a9b1-52dff2b95efc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:11.494593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0003d-312e-4d25-a9b1-52dff2b95efc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:11.494801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0003d-312e-4d25-a9b1-52dff2b95efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:11.533753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-58c0003d-312e-4d25-a9b1-52dff2b95efc None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:11.535101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-58c0003d-312e-4d25-a9b1-52dff2b95efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:11.545552 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1582/3164] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:09:11.564174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:11.581653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6936db6-9911-4bcb-b3af-6ee5738a6477 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:11.603688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:11.604648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:11.605291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:11.605817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:11.617819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:11.620633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:11.631365 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1583/3165] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:19.015910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ab95-0b2c-4f2f-b9a0-39d1edb9a2a1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:19.016540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ab95-0b2c-4f2f-b9a0-39d1edb9a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:19.016650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ab95-0b2c-4f2f-b9a0-39d1edb9a2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:19.063832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1875ab95-0b2c-4f2f-b9a0-39d1edb9a2a1 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:19.065095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1875ab95-0b2c-4f2f-b9a0-39d1edb9a2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:19.072576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1583/3166] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:09:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:19.093418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:19.112313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538d723-22ee-4f2b-a923-694304a620d9 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:19.119948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3180df-13e2-43a1-9450-ef22b150b946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:19.120639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3180df-13e2-43a1-9450-ef22b150b946 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:19.120924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3180df-13e2-43a1-9450-ef22b150b946 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:19.121230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3180df-13e2-43a1-9450-ef22b150b946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:19.133570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3180df-13e2-43a1-9450-ef22b150b946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:19.135252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3180df-13e2-43a1-9450-ef22b150b946 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:19.161707 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1584/3167] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:09:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:21.367905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360061aa-eb68-45f9-b273-b1fa497c78c6 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:21.368527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360061aa-eb68-45f9-b273-b1fa497c78c6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:21.368838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360061aa-eb68-45f9-b273-b1fa497c78c6 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:21.371157 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1584/3168] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:09:21.380763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d01906-aa4f-4e48-937a-e30aec438d58 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:21.381288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d01906-aa4f-4e48-937a-e30aec438d58 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:21.381403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d01906-aa4f-4e48-937a-e30aec438d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:21.406027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-39d01906-aa4f-4e48-937a-e30aec438d58 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:21.407616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-39d01906-aa4f-4e48-937a-e30aec438d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:21.436394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1585/3169] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:21.463508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360061aa-eb68-45f9-b273-b1fa497c78c6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:21.467667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-360061aa-eb68-45f9-b273-b1fa497c78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:21.508428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360061aa-eb68-45f9-b273-b1fa497c78c6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:21.523091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:21.524263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:21.524873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:21.525535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:21.543672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:21.546719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:21.559946 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1585/3170] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:21.962804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11711c5-b87d-4ed9-a0df-f73261de62cc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:21.963545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11711c5-b87d-4ed9-a0df-f73261de62cc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:21.963929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11711c5-b87d-4ed9-a0df-f73261de62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:22.011261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c11711c5-b87d-4ed9-a0df-f73261de62cc None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:22.012896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c11711c5-b87d-4ed9-a0df-f73261de62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:22.132662 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1586/3171] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:25.065742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:25.081633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fbe91-23c0-4ab0-84e7-6fdca0d5064d service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:25.094821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab4713-9322-4f82-a5cd-1a69ca243c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:25.098833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4713-9322-4f82-a5cd-1a69ca243c60 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:25.101412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4713-9322-4f82-a5cd-1a69ca243c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:25.101812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4713-9322-4f82-a5cd-1a69ca243c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:25.122419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-72ab4713-9322-4f82-a5cd-1a69ca243c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:25.167172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab4713-9322-4f82-a5cd-1a69ca243c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:25.172848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab4713-9322-4f82-a5cd-1a69ca243c60 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:25.223782 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1586/3172] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:29.225289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11711c5-b87d-4ed9-a0df-f73261de62cc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:29.249171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11711c5-b87d-4ed9-a0df-f73261de62cc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:29.260595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:29.261635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:29.262086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:29.262527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:29.266213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:29.300416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:29.302209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:29.333895 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1587/3173] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:31.813195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71b41-4d34-42f7-8bc2-371d595b57e3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:31.814161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71b41-4d34-42f7-8bc2-371d595b57e3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:31.814392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71b41-4d34-42f7-8bc2-371d595b57e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:31.821139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=51 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:31.854471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-71a71b41-4d34-42f7-8bc2-371d595b57e3 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:31.856088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71a71b41-4d34-42f7-8bc2-371d595b57e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:31.864773 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1587/3174] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:09:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:31.883494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:31.906812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb2e6-86b7-47df-ad28-7e8e68f52c00 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:31.915921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:31.917093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:31.917400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:31.917685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:31.928797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:31.931100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:31.942877 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1588/3175] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:09:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:32.803237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a71b41-4d34-42f7-8bc2-371d595b57e3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:32.838882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a71b41-4d34-42f7-8bc2-371d595b57e3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:32.847419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fa10d-a016-409b-b056-fac7e01536aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:32.848464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa10d-a016-409b-b056-fac7e01536aa service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:32.848993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa10d-a016-409b-b056-fac7e01536aa service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:32.849473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa10d-a016-409b-b056-fac7e01536aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:32.853017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-414fa10d-a016-409b-b056-fac7e01536aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:32.867503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fa10d-a016-409b-b056-fac7e01536aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:32.869678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fa10d-a016-409b-b056-fac7e01536aa service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:32.887503 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1588/3176] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:38.492809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:38.494511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:38.514716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621386d6-16e1-4c3f-b903-d6c10b515db2 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:38.521612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:38.523165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:38.523635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:38.524156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] PATH_INFO: `/v3/users/dd075f9744d644e38be2333789563d12` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:38.526258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd075f9744d644e38be2333789563d12)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:38.528770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:38.615579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd075f9744d644e38be2333789563d12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:38.616551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd075f9744d644e38be2333789563d12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:38.640640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd075f9744d644e38be2333789563d12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:38.642124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd075f9744d644e38be2333789563d12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:38.668299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd075f9744d644e38be2333789563d12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:38.694829 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1589/3177] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:38 2022] DELETE /identity/v3/users/dd075f9744d644e38be2333789563d12 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:38.699636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:38.700239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:38.700455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:38.731695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:38.735958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:38.877749 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1589/3178] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:38.894256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:38.895928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:38.904536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:39.040594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36256a-bbcc-4abd-8217-16a0bcec0884 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:39.045698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:39.046644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:39.046841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:39.047218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:39.070095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:39.079121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:39.095532 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1590/3179] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:09:39.523919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:39.523919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:39.543001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83697134-c96d-4541-9b4b-d43057f48096 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:39.548790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:39.552130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:39.552579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:39.553798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] PATH_INFO: `/v3/users/76897f7be7494bb589de747493240449` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:39.555403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76897f7be7494bb589de747493240449)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:39.558558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:39.622100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:39.625222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:39.642577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c8c0-37eb-401c-a79b-b02a4b6100d4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:39.645842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76897f7be7494bb589de747493240449'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.646666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76897f7be7494bb589de747493240449'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.654635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:39.656766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:39.658143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:39.659369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] PATH_INFO: `/v3/projects/0f681d806f354b8682bdae077a9ece40` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:39.661525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f681d806f354b8682bdae077a9ece40)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:39.667575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:39.673422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76897f7be7494bb589de747493240449'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.677473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76897f7be7494bb589de747493240449'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.688164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3185a63f-a546-4ca6-880b-438c28b0ec7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76897f7be7494bb589de747493240449'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.708867 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1590/3180] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:39 2022] DELETE /identity/v3/users/76897f7be7494bb589de747493240449 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:39.737236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f681d806f354b8682bdae077a9ece40', 'request_id': 'req-11e071d1-9126-4a64-bb00-60f14c240c06'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.744242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f681d806f354b8682bdae077a9ece40', 'request_id': 'req-11e071d1-9126-4a64-bb00-60f14c240c06'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.757156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f681d806f354b8682bdae077a9ece40', 'request_id': 'req-11e071d1-9126-4a64-bb00-60f14c240c06'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.780462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] The token cache is being invalidate because project 0f681d806f354b8682bdae077a9ece40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:39.780929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.781926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-11e071d1-9126-4a64-bb00-60f14c240c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:39.791699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1591/3181] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:39 2022] DELETE /identity/v3/projects/0f681d806f354b8682bdae077a9ece40 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:39.796376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1d661-c74a-484b-a16d-8f7ec1c73a9e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:39.797674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1d661-c74a-484b-a16d-8f7ec1c73a9e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:39.798252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1d661-c74a-484b-a16d-8f7ec1c73a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:39.821623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-66f1d661-c74a-484b-a16d-8f7ec1c73a9e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:39.824211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-66f1d661-c74a-484b-a16d-8f7ec1c73a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:39.900253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:39.920420 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1591/3182] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:09:39.929496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bfb79-c6ad-4636-924a-56b4655e8145 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:39.929496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bfb79-c6ad-4636-924a-56b4655e8145 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:39.929496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bfb79-c6ad-4636-924a-56b4655e8145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:39.963601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-649bfb79-c6ad-4636-924a-56b4655e8145 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:39.979304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-649bfb79-c6ad-4636-924a-56b4655e8145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:39.996861 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1592/3183] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:09:40.001700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1d661-c74a-484b-a16d-8f7ec1c73a9e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.013632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1d661-c74a-484b-a16d-8f7ec1c73a9e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.020458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.021186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.021573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.021914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.022945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:09:40.023419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.025295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.051771 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1592/3184] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:09:40.051864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bfb79-c6ad-4636-924a-56b4655e8145 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.078313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bfb79-c6ad-4636-924a-56b4655e8145 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.084893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.085716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.086068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.086433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.087792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.089365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.139999 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1593/3185] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:40 2022] POST /identity/v3/projects => generated 401 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:09:40.145734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.157534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d986-49ae-440a-9639-1f341353e6da admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.163704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.165444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:40.232001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.236143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.236617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.236998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.237913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.240836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.287304 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1593/3186] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:40 2022] POST /identity/v3/users => generated 301 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:09:40.289458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.318166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248e659-fa13-44d4-9b85-52a01f1ba4a2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.325830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.326775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.327060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.327491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.328756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.330937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.345763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1594/3187] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:40.349335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ed40-31ef-42bb-bdc2-f37a35897a1d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.349871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.356416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.357425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.357859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.358501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] PATH_INFO: `/v3/projects/9f0a0c26a5b846f0a657fa8810da9d71` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.359534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0a0c26a5b846f0a657fa8810da9d71)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.362938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.369743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:40.373266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac19d9-10e2-4242-9891-c702b0abc62a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.380605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.381302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.381636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.381919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.382827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.386528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.401571 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1595/3188] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:40.406414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.420905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced04f2-93b6-40c1-bc7f-028e6d15ea2d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.433844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0a0c26a5b846f0a657fa8810da9d71', 'request_id': 'req-abdc6e83-3b80-4261-a559-d52e33fafd0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.443198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0a0c26a5b846f0a657fa8810da9d71', 'request_id': 'req-abdc6e83-3b80-4261-a559-d52e33fafd0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.454831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0a0c26a5b846f0a657fa8810da9d71', 'request_id': 'req-abdc6e83-3b80-4261-a559-d52e33fafd0c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.469854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] The token cache is being invalidate because project 9f0a0c26a5b846f0a657fa8810da9d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:40.470349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.471430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.473858 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1594/3189] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:40 2022] DELETE /identity/v3/projects/9f0a0c26a5b846f0a657fa8810da9d71 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:40.477653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.479117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:40.523020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4052cf1-59a0-48a3-b81f-eebd21b56017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.525770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052cf1-59a0-48a3-b81f-eebd21b56017 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.526701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052cf1-59a0-48a3-b81f-eebd21b56017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.526701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4052cf1-59a0-48a3-b81f-eebd21b56017 admin admin] PATH_INFO: `/v3/projects/f0d6a4efa27946468a9a585f44337df0/users/91f0c72b0f3b4ce6b8e67bbc8d2da5bd/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.554751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4052cf1-59a0-48a3-b81f-eebd21b56017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d6a4efa27946468a9a585f44337df0, user_id=91f0c72b0f3b4ce6b8e67bbc8d2da5bd, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.558707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4052cf1-59a0-48a3-b81f-eebd21b56017 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.578128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc6e83-3b80-4261-a559-d52e33fafd0c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.587613 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1596/3190] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:40 2022] PUT /identity/v3/projects/f0d6a4efa27946468a9a585f44337df0/users/91f0c72b0f3b4ce6b8e67bbc8d2da5bd/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:40.589295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.589581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.590046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.626078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] MFA Rules not processed for user `91f0c72b0f3b4ce6b8e67bbc8d2da5bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:40.627527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:40.652269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:40.673241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.674802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.675292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.675736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] PATH_INFO: `/v3/users/94e008869afc498fa83c783b4c08a8eb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.677508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e008869afc498fa83c783b4c08a8eb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:40.679969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:40.712272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1597/3191] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:40.725982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:40.728089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:40.767757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:40.775496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e008869afc498fa83c783b4c08a8eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.776226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e008869afc498fa83c783b4c08a8eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.798591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e008869afc498fa83c783b4c08a8eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.800514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e008869afc498fa83c783b4c08a8eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.810697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e008869afc498fa83c783b4c08a8eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:40.834782 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1595/3192] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:40 2022] DELETE /identity/v3/users/94e008869afc498fa83c783b4c08a8eb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:40.842736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa341ab6-fbc3-48ab-b63a-fd815ee1ccd1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:40.936659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:40.937618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:40.938012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:40.938385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:40.940562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:41.012013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.013924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.018998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:41.037190 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1598/3193] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:41.078853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.081598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:41.196186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6456d4-510d-4b57-9aab-550b398f5175 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.202348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.206425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.207770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.208068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] PATH_INFO: `/v3/users/91f0c72b0f3b4ce6b8e67bbc8d2da5bd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.210331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f0c72b0f3b4ce6b8e67bbc8d2da5bd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.216175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.246143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.247600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:41.266968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45af3-711d-4478-87cb-33ea947379f2 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.274126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.275106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.275547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.275908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] PATH_INFO: `/v3/projects/1f4879f8999a4d71a4a30f3741f57dbd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.277507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4879f8999a4d71a4a30f3741f57dbd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.279622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.318725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f0c72b0f3b4ce6b8e67bbc8d2da5bd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.319445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f0c72b0f3b4ce6b8e67bbc8d2da5bd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.342968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f0c72b0f3b4ce6b8e67bbc8d2da5bd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.344307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f0c72b0f3b4ce6b8e67bbc8d2da5bd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.353336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf7d6036-74cd-453b-ae20-cc453bab2873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f0c72b0f3b4ce6b8e67bbc8d2da5bd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.375062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4879f8999a4d71a4a30f3741f57dbd', 'request_id': 'req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.385086 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1596/3194] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:41 2022] DELETE /identity/v3/users/91f0c72b0f3b4ce6b8e67bbc8d2da5bd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:41.386595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4879f8999a4d71a4a30f3741f57dbd', 'request_id': 'req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.387250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.387712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.388197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.397869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4879f8999a4d71a4a30f3741f57dbd', 'request_id': 'req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.410218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:41.411818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:41.417861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] The token cache is being invalidate because project 1f4879f8999a4d71a4a30f3741f57dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:41.418329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.419032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-61b15dcb-3fd7-4ba2-be5f-83fdc86137f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:41.420914 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1599/3195] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:41 2022] DELETE /identity/v3/projects/1f4879f8999a4d71a4a30f3741f57dbd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:41.426515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd313a-5650-4fac-9244-ca810a312c7b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.426855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd313a-5650-4fac-9244-ca810a312c7b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.427147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd313a-5650-4fac-9244-ca810a312c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.446872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0fcd313a-5650-4fac-9244-ca810a312c7b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:41.448161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0fcd313a-5650-4fac-9244-ca810a312c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:41.454588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:41.491212 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1597/3196] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:41.507849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.509443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:41.536626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1600/3197] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:41.541345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a633c-0294-4bf9-a33b-105d9e9c3750 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.541746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a633c-0294-4bf9-a33b-105d9e9c3750 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.545464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a633c-0294-4bf9-a33b-105d9e9c3750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.565822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-584a633c-0294-4bf9-a33b-105d9e9c3750 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:41.567201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-584a633c-0294-4bf9-a33b-105d9e9c3750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:41.577418 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1601/3198] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:41.582983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a633c-0294-4bf9-a33b-105d9e9c3750 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.593326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a633c-0294-4bf9-a33b-105d9e9c3750 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.595061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a2ea6-1df8-44d9-97e5-5161d1d00c7d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.598636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.599294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.599570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.599841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.603646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.604339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.604620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.604895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.605690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:09:41.606147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.607796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.611431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.612904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.625581 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1598/3199] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:09:41.629079 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1602/3200] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:09:41.631927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.642144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0193f9b-2a59-4906-8a64-d4082363b09e service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.648261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.648389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.648631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.648909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.649677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.651584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.687190 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1599/3201] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:41 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:09:41.689051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.702003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7877bc-c6c1-4fec-af61-9f1b86a38a96 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.762625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.763458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.763596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.763841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.764574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.766610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.774277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:41.793532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1603/3202] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:41 2022] POST /identity/v3/users => generated 279 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:41.797969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.813720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751be999-bd49-4ebe-bd58-54969ffc063c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.821128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.821881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.822173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.822452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.823347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.827896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.844054 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1600/3203] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:09:41.849856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.876481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b1e0-f4c7-4893-8b5a-69e0297a8426 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.882101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029888e-0655-46e8-9e27-eb25c2ab2e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.884635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029888e-0655-46e8-9e27-eb25c2ab2e3e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.884635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029888e-0655-46e8-9e27-eb25c2ab2e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.884635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029888e-0655-46e8-9e27-eb25c2ab2e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.884635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029888e-0655-46e8-9e27-eb25c2ab2e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.885880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029888e-0655-46e8-9e27-eb25c2ab2e3e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.903244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:41.903459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1604/3204] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:41.919608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565a432-e7d5-4e76-ba65-dd6bf860976e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:41.927175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:41.928922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:41.944600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:41.944898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] PATH_INFO: `/v3/projects/e685d472cb7348d587d5859196551df6/users/855ac83ef57348aabaef63355cbb21ba/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:41.964876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e685d472cb7348d587d5859196551df6, user_id=855ac83ef57348aabaef63355cbb21ba, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:41.967946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:41.994965 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1601/3205] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:41 2022] PUT /identity/v3/projects/e685d472cb7348d587d5859196551df6/users/855ac83ef57348aabaef63355cbb21ba/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:42.006472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172483bf-ae36-4763-8319-fe48357cbb96 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.006942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172483bf-ae36-4763-8319-fe48357cbb96 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.007327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172483bf-ae36-4763-8319-fe48357cbb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.060074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-172483bf-ae36-4763-8319-fe48357cbb96 None None] MFA Rules not processed for user `855ac83ef57348aabaef63355cbb21ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:42.061528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-172483bf-ae36-4763-8319-fe48357cbb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:42.125302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.127042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:42.175489 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1605/3206] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:42.180885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172483bf-ae36-4763-8319-fe48357cbb96 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.345779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0171b-538f-4ded-ae3f-130e96b5d65b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.352217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172483bf-ae36-4763-8319-fe48357cbb96 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.360497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:42.361714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.362726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.364631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] PATH_INFO: `/v3/projects/f0d6a4efa27946468a9a585f44337df0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.369380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:42.370549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.371940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.372145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d6a4efa27946468a9a585f44337df0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:42.374731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:42.375081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.376076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:42.378158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:42.430958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:42.468091 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1606/3207] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:42 2022] POST /identity/v3/projects => generated 359 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:42.471133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.485514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d6a4efa27946468a9a585f44337df0', 'request_id': 'req-f4ab91f3-8cf6-4633-9587-c497e111211c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.505181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d6a4efa27946468a9a585f44337df0', 'request_id': 'req-f4ab91f3-8cf6-4633-9587-c497e111211c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.529485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d6a4efa27946468a9a585f44337df0', 'request_id': 'req-f4ab91f3-8cf6-4633-9587-c497e111211c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.556267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] The token cache is being invalidate because project f0d6a4efa27946468a9a585f44337df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:42.556563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.558886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4ab91f3-8cf6-4633-9587-c497e111211c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.562490 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1602/3208] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:42 2022] DELETE /identity/v3/projects/f0d6a4efa27946468a9a585f44337df0 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:42.569014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3602-5c48-4a97-87b7-553f6f8bc091 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.569340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3602-5c48-4a97-87b7-553f6f8bc091 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.569620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3602-5c48-4a97-87b7-553f6f8bc091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.585359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:42.606439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf80c51-c3d5-4b4f-9696-3c54787f9565 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.637676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-70ce3602-5c48-4a97-87b7-553f6f8bc091 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:42.639117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-70ce3602-5c48-4a97-87b7-553f6f8bc091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:42.640972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:42.642453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.642738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.643081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.643834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:42.648113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:42.661827 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1603/3209] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:42.668895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed413-7e0b-4d0d-8c75-4be0dc69286a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.669407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed413-7e0b-4d0d-8c75-4be0dc69286a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.669832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed413-7e0b-4d0d-8c75-4be0dc69286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.690833 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1607/3210] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:42 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:42.691938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.693855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:42.698547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-62eed413-7e0b-4d0d-8c75-4be0dc69286a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:42.700199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-62eed413-7e0b-4d0d-8c75-4be0dc69286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:42.710764 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1604/3211] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:42.711948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be30c7-c887-4847-aae9-845fc0c604a6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.715759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed413-7e0b-4d0d-8c75-4be0dc69286a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.718426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:42.719566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.719969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.720363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.721585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:42.724551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:42.728134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed413-7e0b-4d0d-8c75-4be0dc69286a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.732878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:42.733938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.734238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.734612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.735503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:09:42.736148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:42.737238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1608/3212] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:42.738336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:42.741785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.743686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:42.760603 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1605/3213] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:09:42.762872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.773217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538cc84-70b8-4df5-b6a4-cf29f02766c1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.774485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5c255-27c1-4ba5-9839-65f96d98f3ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.779760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:42.780921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.781307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.781663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] PATH_INFO: `/v3/projects/b707a893a0a04b8c9f37c8dcc4305b11/users/6a3dc91807e34cb19bfa58328787edbc/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.786756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:42.787937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:42.788398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:42.789142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] PATH_INFO: `/v3/users/681cfb0e560145b4abef98dbd417f3e0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:42.790571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681cfb0e560145b4abef98dbd417f3e0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:42.793392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:42.800849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b707a893a0a04b8c9f37c8dcc4305b11, user_id=6a3dc91807e34cb19bfa58328787edbc, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:42.805558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:42.831304 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1606/3214] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:42 2022] PUT /identity/v3/projects/b707a893a0a04b8c9f37c8dcc4305b11/users/6a3dc91807e34cb19bfa58328787edbc/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:42.835508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.858858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681cfb0e560145b4abef98dbd417f3e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.859618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681cfb0e560145b4abef98dbd417f3e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.873414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681cfb0e560145b4abef98dbd417f3e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.874151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681cfb0e560145b4abef98dbd417f3e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.885971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681cfb0e560145b4abef98dbd417f3e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:42.916892 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1609/3215] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:42 2022] DELETE /identity/v3/users/681cfb0e560145b4abef98dbd417f3e0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:42.916892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:42.916892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:42.944068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437025f2-fc9a-48e2-b1fd-4877b998ffa5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:42.999966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71335f9a-d86f-4281-8c20-02440056e824 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.006924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.007693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.007975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.008255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.008982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.010941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.012762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.013536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.014572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.014572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.015341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.018152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.025239 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1610/3216] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:43.026339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.040103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:43.046190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e9564-85eb-4f0f-bcaf-a9e2d1848d71 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.054848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bf64c-1c0a-4d77-ad9b-80d4d1d65323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.056207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf64c-1c0a-4d77-ad9b-80d4d1d65323 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.056313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf64c-1c0a-4d77-ad9b-80d4d1d65323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.056580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf64c-1c0a-4d77-ad9b-80d4d1d65323 admin admin] PATH_INFO: `/v3/projects/b707a893a0a04b8c9f37c8dcc4305b11/users/6a3dc91807e34cb19bfa58328787edbc/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.058759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bf64c-1c0a-4d77-ad9b-80d4d1d65323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b707a893a0a04b8c9f37c8dcc4305b11, user_id=6a3dc91807e34cb19bfa58328787edbc, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.064440 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1607/3217] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:42 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:43.064615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bf64c-1c0a-4d77-ad9b-80d4d1d65323 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.065867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.069101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.078783 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1611/3218] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:43 2022] PUT /identity/v3/projects/b707a893a0a04b8c9f37c8dcc4305b11/users/6a3dc91807e34cb19bfa58328787edbc/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:43.090568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.091062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.091539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.129294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] MFA Rules not processed for user `6a3dc91807e34cb19bfa58328787edbc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:43.130731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.154969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:43.168475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9b18c-1289-4da2-97f3-1666cf0cd8c3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.217463 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1612/3219] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:09:43.218515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.220172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.250207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.250995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.251278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.252300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.253095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.255215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.285540 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1608/3220] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:43 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:43.286505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.296811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e77adc-7412-4fcd-be37-94949c0f6bc1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.301954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.302693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.302911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.303180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.303932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.305637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.306264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b86ec1-1b4f-4db2-8bb4-9734a851e059 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.312148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.313410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.313688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.313966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] PATH_INFO: `/v3/projects/5c35ef36a81442b69cd93edc50ecb5bf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.315319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c35ef36a81442b69cd93edc50ecb5bf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.316290 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1609/3221] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:09:43.317149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.317399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.320641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.368692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c35ef36a81442b69cd93edc50ecb5bf', 'request_id': 'req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.375368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c35ef36a81442b69cd93edc50ecb5bf', 'request_id': 'req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.383744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c35ef36a81442b69cd93edc50ecb5bf', 'request_id': 'req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.395484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] The token cache is being invalidate because project 5c35ef36a81442b69cd93edc50ecb5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:43.395768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.396440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.398089 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1613/3222] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:43 2022] DELETE /identity/v3/projects/5c35ef36a81442b69cd93edc50ecb5bf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:43.400933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9145956-2dda-4f09-916c-e6dc3ec4dff9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.402006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.403357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.422169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:43.454594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:43.476061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6a5a0-4dfd-4c60-a773-57fd6ed2958a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.476266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.476729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.477013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.477338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.479232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.480778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.481489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.481787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.482060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.482791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.484948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.496511 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1614/3223] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:43.497406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.499355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.513225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7061709-3d87-4ac4-8897-30e40bc60a1b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.518199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.519093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.519373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.519645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] PATH_INFO: `/v3/users/cab13553622243d7a8892a30cd85aa9a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.520950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab13553622243d7a8892a30cd85aa9a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.522996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.545576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.547388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.559447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1610/3224] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:43 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:43.570091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.572928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab13553622243d7a8892a30cd85aa9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.573722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab13553622243d7a8892a30cd85aa9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.584258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970a425-7eca-4068-acd4-e479da722e52 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.589395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.590419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.590739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.591056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] PATH_INFO: `/v3/projects/1e0874e149554f3188d708fcc3ae7702/users/57d545cdb9dc49279608a50f22d85c16/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.591913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab13553622243d7a8892a30cd85aa9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.593191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab13553622243d7a8892a30cd85aa9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.602156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25c12dda-f876-4938-9bc7-9ada614f23ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab13553622243d7a8892a30cd85aa9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.608350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0874e149554f3188d708fcc3ae7702, user_id=57d545cdb9dc49279608a50f22d85c16, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.611442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.618366 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1615/3225] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:43 2022] DELETE /identity/v3/users/cab13553622243d7a8892a30cd85aa9a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:43.628987 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1611/3226] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:43 2022] PUT /identity/v3/projects/1e0874e149554f3188d708fcc3ae7702/users/57d545cdb9dc49279608a50f22d85c16/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:43.634418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.634704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.635170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.658251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:43.659663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.746028 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1616/3227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:43.758607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.760609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.837186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d9f7f-8d61-4443-9dad-a1d3229f5073 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.845330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:43.845816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79ea5-c7d0-42db-b56e-9fcad81f2019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.846873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79ea5-c7d0-42db-b56e-9fcad81f2019 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.847095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:43.847797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79ea5-c7d0-42db-b56e-9fcad81f2019 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.848090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79ea5-c7d0-42db-b56e-9fcad81f2019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.866911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b8be-3e65-4219-91e1-9487421bb652 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:43.867363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79ea5-c7d0-42db-b56e-9fcad81f2019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.869210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79ea5-c7d0-42db-b56e-9fcad81f2019 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.881740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:43.882674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:43.882951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:43.883222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] PATH_INFO: `/v3/projects/e553785e5aaa4badba8b6ed9cd24a215` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:43.884562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e553785e5aaa4badba8b6ed9cd24a215)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:43.885216 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1612/3228] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:09:43.886570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:43.971375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:43.974579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e553785e5aaa4badba8b6ed9cd24a215', 'request_id': 'req-8c9b6f63-06df-461e-be24-a80642ca8768'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.985250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e553785e5aaa4badba8b6ed9cd24a215', 'request_id': 'req-8c9b6f63-06df-461e-be24-a80642ca8768'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:43.997369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e553785e5aaa4badba8b6ed9cd24a215', 'request_id': 'req-8c9b6f63-06df-461e-be24-a80642ca8768'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.013920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] The token cache is being invalidate because project e553785e5aaa4badba8b6ed9cd24a215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:44.014341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.015429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.017394 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1617/3229] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:43 2022] DELETE /identity/v3/projects/e553785e5aaa4badba8b6ed9cd24a215 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:44.022485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7536-5e82-4f95-aea8-e2f78996e9ac None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.022766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7536-5e82-4f95-aea8-e2f78996e9ac None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.030366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7536-5e82-4f95-aea8-e2f78996e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.049280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-768a7536-5e82-4f95-aea8-e2f78996e9ac None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:44.050816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-768a7536-5e82-4f95-aea8-e2f78996e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:44.084511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.086092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:44.089241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:44.176853 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1613/3230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:44.185160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187362a-1899-4008-8064-4a69b22e9433 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.185605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187362a-1899-4008-8064-4a69b22e9433 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.185773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187362a-1899-4008-8064-4a69b22e9433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.195400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b6f63-06df-461e-be24-a80642ca8768 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.206653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.207815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.208239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.208653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] PATH_INFO: `/v3/users/855ac83ef57348aabaef63355cbb21ba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.210109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855ac83ef57348aabaef63355cbb21ba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.213693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.222632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e187362a-1899-4008-8064-4a69b22e9433 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:44.224309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e187362a-1899-4008-8064-4a69b22e9433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:44.247936 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1614/3231] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:44.249191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187362a-1899-4008-8064-4a69b22e9433 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.269147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187362a-1899-4008-8064-4a69b22e9433 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.276399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.278666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.279173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.279690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.281070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:09:44.281070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.282655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.300021 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1615/3232] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:09:44.302474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855ac83ef57348aabaef63355cbb21ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.303249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855ac83ef57348aabaef63355cbb21ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.304486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.307411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:44.319868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855ac83ef57348aabaef63355cbb21ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.320638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855ac83ef57348aabaef63355cbb21ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.328920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1966cb2-98a0-4548-8a98-b080b76ef58d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.330552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-572bfe05-934e-4c5d-b7e6-c2a46a915693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855ac83ef57348aabaef63355cbb21ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:44.336172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.337699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.338568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.338987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.340334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.342804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.363870 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1618/3233] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:44 2022] DELETE /identity/v3/users/855ac83ef57348aabaef63355cbb21ba => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:44.370463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.370822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.371444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.383538 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1616/3234] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:44.387671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.393983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:44.395804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:44.467954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:44.468146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10dc58-18c1-4097-bb4c-5c54c4b1e6a4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.474587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.475376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.475731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.476082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.476855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.479618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.484278 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1619/3235] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:44.496540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.498094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:44.504364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1617/3236] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:09:44.505783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.518080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1837c-0785-4c55-948b-ace40e1418fc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.524805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.525758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.526172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.526556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.527410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.529146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.543659 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1618/3237] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:44.544762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.557385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad432a-d167-4365-8982-c73f4dd69a04 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.563388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.564043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.564317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.564619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.565345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.566952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.570806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8878c-fbba-4bac-9af3-c5e98f8495b3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.575742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd590b-59dc-4357-b56c-aad2cb5669ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.576415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd590b-59dc-4357-b56c-aad2cb5669ae service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.576727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd590b-59dc-4357-b56c-aad2cb5669ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.576976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd590b-59dc-4357-b56c-aad2cb5669ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.578330 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1619/3238] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:44.582323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.591380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd590b-59dc-4357-b56c-aad2cb5669ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.592569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30659e7-e5c9-4121-bd2c-5292dd003b63 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.592957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd590b-59dc-4357-b56c-aad2cb5669ae service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.597843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.599807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.600168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.600670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] PATH_INFO: `/v3/projects/ac774f9b327041a887378bd2725853c6/users/0e8a394c0a284416ac893321bd860e51/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.605086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1620/3239] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:09:44.619448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac774f9b327041a887378bd2725853c6, user_id=0e8a394c0a284416ac893321bd860e51, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.622662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.653260 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1620/3240] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:44 2022] PUT /identity/v3/projects/ac774f9b327041a887378bd2725853c6/users/0e8a394c0a284416ac893321bd860e51/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:44.656501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d59653-c2da-4b2c-ae6c-c196e4ec46a3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.656837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d59653-c2da-4b2c-ae6c-c196e4ec46a3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.657147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d59653-c2da-4b2c-ae6c-c196e4ec46a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.694060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f8d59653-c2da-4b2c-ae6c-c196e4ec46a3 None None] MFA Rules not processed for user `0e8a394c0a284416ac893321bd860e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:44.695450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f8d59653-c2da-4b2c-ae6c-c196e4ec46a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:44.781739 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1621/3241] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:44.786731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.847178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:44.878939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86056b27-5361-4dde-8061-eeb0bd6cf35a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:44.884528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:44.885242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:44.885530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:44.885893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:44.886509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:44.888676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:44.919872 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1621/3242] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:44.924500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d59653-c2da-4b2c-ae6c-c196e4ec46a3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:44.936512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d59653-c2da-4b2c-ae6c-c196e4ec46a3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.006501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.007287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.007639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.007981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.008742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:45.010808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:45.041761 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1622/3243] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:44 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:09:45.045389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:45.058427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c1e2-7733-4f1c-b015-cf8743455ff3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.063712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.065735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.066838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.066838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.067717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:45.069598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:45.082242 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1622/3244] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:09:45.086310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:45.098280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aaa9b-e0c6-4319-82df-283abdd3865c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.103813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.105643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.106167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.106540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] PATH_INFO: `/v3/projects/aa9654b224af4e6d9705c4a622c32a01/users/7fa98fb81589488fa53a6f07a208b7fa/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.126630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9654b224af4e6d9705c4a622c32a01, user_id=7fa98fb81589488fa53a6f07a208b7fa, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:45.129778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:45.132682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:45.148257 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1623/3245] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:45 2022] PUT /identity/v3/projects/aa9654b224af4e6d9705c4a622c32a01/users/7fa98fb81589488fa53a6f07a208b7fa/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:45.152575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:45.166111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb622-189c-4e9b-aae9-cbee32239a20 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.178404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:45.180801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:45.284039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ba4e4-666c-4fd0-9d14-0bb01c125e97 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.290799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.291873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.292159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.292487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] PATH_INFO: `/v3/projects/e685d472cb7348d587d5859196551df6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.293680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e685d472cb7348d587d5859196551df6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:45.294904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.295592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.295874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.296260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:45.296493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.297252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:45.300623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:45.326604 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1623/3246] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:45.330843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:45.346171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff70bac-d619-4735-bd83-ca3d695fdeb8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.354209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635223f5-faf7-471b-95e5-71c9fd1e5e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.355112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635223f5-faf7-471b-95e5-71c9fd1e5e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.355404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635223f5-faf7-471b-95e5-71c9fd1e5e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.355680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635223f5-faf7-471b-95e5-71c9fd1e5e00 admin admin] PATH_INFO: `/v3/projects/aa9654b224af4e6d9705c4a622c32a01/users/7fa98fb81589488fa53a6f07a208b7fa/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.358765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635223f5-faf7-471b-95e5-71c9fd1e5e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9654b224af4e6d9705c4a622c32a01, user_id=7fa98fb81589488fa53a6f07a208b7fa, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:45.361822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635223f5-faf7-471b-95e5-71c9fd1e5e00 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:45.378684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e685d472cb7348d587d5859196551df6', 'request_id': 'req-dbeefe86-a66b-41a2-b206-00fbcc1a070c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.379432 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1624/3247] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:45 2022] PUT /identity/v3/projects/aa9654b224af4e6d9705c4a622c32a01/users/7fa98fb81589488fa53a6f07a208b7fa/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:45.390918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b65ae-ce2a-45a0-adb2-93e6de806cdc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.391499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b65ae-ce2a-45a0-adb2-93e6de806cdc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.391791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b65ae-ce2a-45a0-adb2-93e6de806cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.394829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e685d472cb7348d587d5859196551df6', 'request_id': 'req-dbeefe86-a66b-41a2-b206-00fbcc1a070c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.415337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e685d472cb7348d587d5859196551df6', 'request_id': 'req-dbeefe86-a66b-41a2-b206-00fbcc1a070c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.433672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] The token cache is being invalidate because project e685d472cb7348d587d5859196551df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:45.433672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.434313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.436632 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1624/3248] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:45 2022] DELETE /identity/v3/projects/e685d472cb7348d587d5859196551df6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:45.440073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-198b65ae-ce2a-45a0-adb2-93e6de806cdc None None] MFA Rules not processed for user `7fa98fb81589488fa53a6f07a208b7fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:45.440755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:45.442260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:45.443467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-198b65ae-ce2a-45a0-adb2-93e6de806cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:45.562129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeefe86-a66b-41a2-b206-00fbcc1a070c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.584087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1625/3249] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:09:45.596189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.596490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.597144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.608076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:45.623510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] MFA Rules not processed for user `0e8a394c0a284416ac893321bd860e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:45.625353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:45.638231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:45.657246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.658473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.659053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.659753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] PATH_INFO: `/v3/users/6a3dc91807e34cb19bfa58328787edbc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.661632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3dc91807e34cb19bfa58328787edbc)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:45.664500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:45.709291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1626/3250] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:09:45.724568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:45.727045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:45.793989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3dc91807e34cb19bfa58328787edbc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.794813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3dc91807e34cb19bfa58328787edbc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.811384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3dc91807e34cb19bfa58328787edbc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.812357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3dc91807e34cb19bfa58328787edbc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.825051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3dc91807e34cb19bfa58328787edbc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:45.854661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa647e-771b-4242-9c0b-23214b3b5b9f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:45.862059 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1625/3251] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:09:45 2022] DELETE /identity/v3/users/6a3dc91807e34cb19bfa58328787edbc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:45.951471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2ce08-5351-4dc9-bfa2-2a2f7642747d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:45.952243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ce08-5351-4dc9-bfa2-2a2f7642747d service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:45.952938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ce08-5351-4dc9-bfa2-2a2f7642747d service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:45.953322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ce08-5351-4dc9-bfa2-2a2f7642747d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:45.956187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53e2ce08-5351-4dc9-bfa2-2a2f7642747d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:46.020934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:46.023479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2ce08-5351-4dc9-bfa2-2a2f7642747d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:46.025152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2ce08-5351-4dc9-bfa2-2a2f7642747d service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:46.037201 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1627/3252] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:46.702863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:46.704385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:46.790117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314913b-12f2-4c89-b0f0-82bc82553316 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:46.795255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:46.796472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:46.796783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:46.797133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] PATH_INFO: `/v3/projects/b707a893a0a04b8c9f37c8dcc4305b11` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:46.798544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b707a893a0a04b8c9f37c8dcc4305b11)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:46.800906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:46.866293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b707a893a0a04b8c9f37c8dcc4305b11', 'request_id': 'req-c8764b91-5620-4173-8737-5939a8964569'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:46.871109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:46.879567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b707a893a0a04b8c9f37c8dcc4305b11', 'request_id': 'req-c8764b91-5620-4173-8737-5939a8964569'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:46.890697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b707a893a0a04b8c9f37c8dcc4305b11', 'request_id': 'req-c8764b91-5620-4173-8737-5939a8964569'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:46.904495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] The token cache is being invalidate because project b707a893a0a04b8c9f37c8dcc4305b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:09:46.904790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:46.905523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c8764b91-5620-4173-8737-5939a8964569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:09:46.909240 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1626/3253] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:46 2022] DELETE /identity/v3/projects/b707a893a0a04b8c9f37c8dcc4305b11 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:46.914978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ed8b-797c-483d-bf32-dbb27fd0d364 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:46.915482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ed8b-797c-483d-bf32-dbb27fd0d364 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:46.915554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ed8b-797c-483d-bf32-dbb27fd0d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:46.936123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1f32ed8b-797c-483d-bf32-dbb27fd0d364 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:46.937583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f32ed8b-797c-483d-bf32-dbb27fd0d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:47.050888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050bcfb-cfc6-44da-8cf6-f84a901072c8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.051195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050bcfb-cfc6-44da-8cf6-f84a901072c8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.051586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050bcfb-cfc6-44da-8cf6-f84a901072c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.056208 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1628/3254] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:47.077353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f050bcfb-cfc6-44da-8cf6-f84a901072c8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:47.078886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f050bcfb-cfc6-44da-8cf6-f84a901072c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:47.101452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32ed8b-797c-483d-bf32-dbb27fd0d364 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.107865 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1627/3255] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:47.115238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32ed8b-797c-483d-bf32-dbb27fd0d364 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:47.122401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:47.123241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.129203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.129203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.129203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:09:47.129203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:47.129203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:47.167558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050bcfb-cfc6-44da-8cf6-f84a901072c8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.174448 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1629/3256] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:09:47.182413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050bcfb-cfc6-44da-8cf6-f84a901072c8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:47.191089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:47.192371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.192863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.193508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.194630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:47.197778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:47.270929 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1628/3257] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:47 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:09:47.275003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.286746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768e51c-aa48-4f02-987d-c5e74ee5a230 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:47.477284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:47.479147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.479147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.479147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.479795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:47.481779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:47.517070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1630/3258] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:47 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:47.521446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.533991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfb3fa-6d12-487b-bf2e-3bd2fce3d987 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:47.541223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:47.542475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.542815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.543154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.543841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:47.545696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:47.567577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.567710 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1629/3259] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:47.579614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90debce4-936f-4dd5-84b1-8b0fefdcd114 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:47.586530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d224e9-2302-4fc0-a1bc-92550a13b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:47.587223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d224e9-2302-4fc0-a1bc-92550a13b731 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.587907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d224e9-2302-4fc0-a1bc-92550a13b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.588306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d224e9-2302-4fc0-a1bc-92550a13b731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.589110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d224e9-2302-4fc0-a1bc-92550a13b731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:47.591163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d224e9-2302-4fc0-a1bc-92550a13b731 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:47.609868 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1631/3260] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:47.610639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.623608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966e141-e0bb-4fa3-9f89-d69d96f410b2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:47.628970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:47.629951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.630263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.630561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] PATH_INFO: `/v3/projects/d1ac36afdc84465caad8632e46fe3a96/users/64a676b449be43d9bc7fecb76178af16/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.648709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ac36afdc84465caad8632e46fe3a96, user_id=64a676b449be43d9bc7fecb76178af16, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:47.651725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:47.673402 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1630/3261] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:47 2022] PUT /identity/v3/projects/d1ac36afdc84465caad8632e46fe3a96/users/64a676b449be43d9bc7fecb76178af16/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:47.683738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7db16-a698-46ee-b411-fb17c9dca17e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.684124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7db16-a698-46ee-b411-fb17c9dca17e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.684298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7db16-a698-46ee-b411-fb17c9dca17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.727879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-91b7db16-a698-46ee-b411-fb17c9dca17e None None] MFA Rules not processed for user `64a676b449be43d9bc7fecb76178af16`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:47.729700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-91b7db16-a698-46ee-b411-fb17c9dca17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:47.787380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:47.807550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1632/3262] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:47.812621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.901207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664778e5-1f28-4f94-afb2-8745d0491fd6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:47.908501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:47.908940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:47.909323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:47.909674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:47.910470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:47.913833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:47.952141 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1631/3263] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:09:47 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:09:47.952752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7db16-a698-46ee-b411-fb17c9dca17e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:47.964950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7db16-a698-46ee-b411-fb17c9dca17e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:48.061019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:48.061758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:48.062096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:48.062374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:48.063205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:48.065143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:48.096096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1633/3264] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:09:47 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:09:48.099996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:48.111871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19debd2d-4852-4e7d-a683-97dd1c4be581 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:48.117155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:48.117912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:48.118423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:48.118704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:48.119676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:48.121075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:48.135729 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1632/3265] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:09:48.140705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:48.152933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1dd76-00e8-46ea-9201-4a72540a14d9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:48.159341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:48.160437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:48.160715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:48.160990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] PATH_INFO: `/v3/projects/46a5c6971f304f97bff7d75b6382b347/users/291fdae0de8644489803c4106f18f087/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:48.182227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a5c6971f304f97bff7d75b6382b347, user_id=291fdae0de8644489803c4106f18f087, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:48.185459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:48.221128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1634/3266] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:48 2022] PUT /identity/v3/projects/46a5c6971f304f97bff7d75b6382b347/users/291fdae0de8644489803c4106f18f087/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:09:48.225696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:48.239250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60426b37-dd91-4733-b5b1-717fc71b4370 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:48.333639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:48.362412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba773a-b8d9-48b4-8c26-25ce9cd4e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:48.365876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba773a-b8d9-48b4-8c26-25ce9cd4e033 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:48.366364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba773a-b8d9-48b4-8c26-25ce9cd4e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:48.366779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba773a-b8d9-48b4-8c26-25ce9cd4e033 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:48.367728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba773a-b8d9-48b4-8c26-25ce9cd4e033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:48.374872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba773a-b8d9-48b4-8c26-25ce9cd4e033 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:48.389403 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1633/3267] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:09:48.393730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:48.421871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbc053-f79a-4969-9275-1689b45423d6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:48.429288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f4e96-7708-4a9e-9dec-cdc64e282b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:48.430397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4e96-7708-4a9e-9dec-cdc64e282b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:48.430680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4e96-7708-4a9e-9dec-cdc64e282b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:48.430954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4e96-7708-4a9e-9dec-cdc64e282b57 admin admin] PATH_INFO: `/v3/projects/46a5c6971f304f97bff7d75b6382b347/users/291fdae0de8644489803c4106f18f087/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:48.433687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f4e96-7708-4a9e-9dec-cdc64e282b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a5c6971f304f97bff7d75b6382b347, user_id=291fdae0de8644489803c4106f18f087, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:48.436628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f4e96-7708-4a9e-9dec-cdc64e282b57 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:48.455008 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1635/3268] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:09:48 2022] PUT /identity/v3/projects/46a5c6971f304f97bff7d75b6382b347/users/291fdae0de8644489803c4106f18f087/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:09:48.467536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:48.468248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:48.468533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:48.534925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] MFA Rules not processed for user `291fdae0de8644489803c4106f18f087`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:48.536210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:48.630253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1634/3269] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:48.643199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f2879-0482-4774-aa07-01706db4486c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:48.643543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f2879-0482-4774-aa07-01706db4486c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:48.643819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f2879-0482-4774-aa07-01706db4486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:48.677737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a58f2879-0482-4774-aa07-01706db4486c None None] MFA Rules not processed for user `64a676b449be43d9bc7fecb76178af16`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:48.680391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a58f2879-0482-4774-aa07-01706db4486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:48.810360 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1636/3270] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:48.942567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:48.944948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:49.056906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac33c7-a78a-4b33-9ded-79d226275096 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:49.064283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:49.065540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:49.065903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:49.066544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:49.079990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:49.081736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:49.092033 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1635/3271] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:52.219325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad728b-7995-466c-993f-57b479ac3b63 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:52.219895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad728b-7995-466c-993f-57b479ac3b63 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:52.223367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad728b-7995-466c-993f-57b479ac3b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:52.275121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b4ad728b-7995-466c-993f-57b479ac3b63 None None] MFA Rules not processed for user `57d545cdb9dc49279608a50f22d85c16`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:52.276477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b4ad728b-7995-466c-993f-57b479ac3b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:52.340340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:52.438872 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1637/3272] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:09:52.554898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:52.571778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c975644-3c01-49b3-80ed-f37198f97461 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:52.582365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee65e9-68fa-4342-b218-8a7c77f3f6b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:52.583292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee65e9-68fa-4342-b218-8a7c77f3f6b0 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:52.583746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee65e9-68fa-4342-b218-8a7c77f3f6b0 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:52.584160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee65e9-68fa-4342-b218-8a7c77f3f6b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:52.594150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee65e9-68fa-4342-b218-8a7c77f3f6b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:52.601448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee65e9-68fa-4342-b218-8a7c77f3f6b0 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:52.623730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1636/3273] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:52.916857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad728b-7995-466c-993f-57b479ac3b63 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:09:52.932341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad728b-7995-466c-993f-57b479ac3b63 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:09:52.938873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:09:52.939749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:52.939859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:52.940084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:52.942035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:53.017195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:09:53.018951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:09:53.038529 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1638/3274] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:09:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:09:56.133800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4275-7b83-4aaa-a901-ee70785b7ec6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:09:56.134345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4275-7b83-4aaa-a901-ee70785b7ec6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:09:56.134508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4275-7b83-4aaa-a901-ee70785b7ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:09:56.159094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ad1e4275-7b83-4aaa-a901-ee70785b7ec6 None None] MFA Rules not processed for user `cf9fa8d3d2bc4f9fa12fab743b7090ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:09:56.160349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad1e4275-7b83-4aaa-a901-ee70785b7ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:09:56.210049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:56.235602 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1637/3275] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:09:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:03.033666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=40 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:03.703021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:03.715946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507a0d-1ef1-4b5f-bc78-0cde4c8b7134 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:03.723496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77601f-e83b-4598-91b6-46afea8c8d0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:03.723817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77601f-e83b-4598-91b6-46afea8c8d0d service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:03.724250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77601f-e83b-4598-91b6-46afea8c8d0d service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:03.724554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77601f-e83b-4598-91b6-46afea8c8d0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:03.726707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f77601f-e83b-4598-91b6-46afea8c8d0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:03.797702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77601f-e83b-4598-91b6-46afea8c8d0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:03.799502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77601f-e83b-4598-91b6-46afea8c8d0d service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:03.811467 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1639/3276] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:04.602792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952f57-67bd-4e9f-a1f0-f2daf8940640 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:04.603877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952f57-67bd-4e9f-a1f0-f2daf8940640 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:04.604063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4952f57-67bd-4e9f-a1f0-f2daf8940640 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:04.606684 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1638/3277] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:10:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:10:04.614532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:04.615074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:04.615074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:04.642181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:04.643414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:04.818068 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1640/3278] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:10:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:10:04.847381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952f57-67bd-4e9f-a1f0-f2daf8940640 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:04.849960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e4952f57-67bd-4e9f-a1f0-f2daf8940640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:04.883448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4952f57-67bd-4e9f-a1f0-f2daf8940640 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:04.890961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ce641-f42d-4cfc-a288-170632ff1c38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:04.891895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce641-f42d-4cfc-a288-170632ff1c38 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:04.892239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce641-f42d-4cfc-a288-170632ff1c38 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:04.892677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ce641-f42d-4cfc-a288-170632ff1c38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:04.906843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ce641-f42d-4cfc-a288-170632ff1c38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:04.908919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ce641-f42d-4cfc-a288-170632ff1c38 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:04.932399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1639/3279] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:05.254304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:05.255934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:05.401458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26e84b-ea10-458d-acb9-b25e998261a0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:05.407723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ead814-a9c0-4f93-9fc0-87a981d7cac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:05.408275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead814-a9c0-4f93-9fc0-87a981d7cac8 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:05.408561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead814-a9c0-4f93-9fc0-87a981d7cac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:05.408896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ead814-a9c0-4f93-9fc0-87a981d7cac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:05.411212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f3ead814-a9c0-4f93-9fc0-87a981d7cac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:05.428422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ead814-a9c0-4f93-9fc0-87a981d7cac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:05.430081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ead814-a9c0-4f93-9fc0-87a981d7cac8 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:05.445562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1641/3280] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:05.673868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13b1d-d485-49f8-bf48-ab0dc1e566d4 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:05.674550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13b1d-d485-49f8-bf48-ab0dc1e566d4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:05.674642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c13b1d-d485-49f8-bf48-ab0dc1e566d4 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:05.676215 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1640/3281] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:10:05.682712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67811-ab87-42f9-96d1-bc0957b825d1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:05.683182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67811-ab87-42f9-96d1-bc0957b825d1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:05.683255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67811-ab87-42f9-96d1-bc0957b825d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:05.715132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-68c67811-ab87-42f9-96d1-bc0957b825d1 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:05.716382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-68c67811-ab87-42f9-96d1-bc0957b825d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:05.740467 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1642/3282] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:10:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:10:05.789421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13b1d-d485-49f8-bf48-ab0dc1e566d4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:05.818377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c13b1d-d485-49f8-bf48-ab0dc1e566d4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:05.837608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105cedd-f2ed-496b-9be4-49df4db6e3c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:05.838331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105cedd-f2ed-496b-9be4-49df4db6e3c3 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:05.843495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105cedd-f2ed-496b-9be4-49df4db6e3c3 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:05.843836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105cedd-f2ed-496b-9be4-49df4db6e3c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:05.871997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105cedd-f2ed-496b-9be4-49df4db6e3c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:05.875494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105cedd-f2ed-496b-9be4-49df4db6e3c3 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:05.893143 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1641/3283] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:06.177438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac9a16-f39e-4490-9105-42441ec82da4 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:06.178052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac9a16-f39e-4490-9105-42441ec82da4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:06.178387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac9a16-f39e-4490-9105-42441ec82da4 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:06.180958 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1643/3284] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:10:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:10:06.187725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:06.188455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:06.188970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:06.221335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:06.223358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:06.255366 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1642/3285] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:10:06.309259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac9a16-f39e-4490-9105-42441ec82da4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:06.311836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b6ac9a16-f39e-4490-9105-42441ec82da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:06.347863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac9a16-f39e-4490-9105-42441ec82da4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:06.355188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:06.356195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:06.356575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:06.357384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:06.384742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:06.389318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:06.436881 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1644/3286] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:07.198246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:07.200504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:07.306422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24315257-671e-4d25-921c-c72b4e7ed89d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:07.311542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:07.312934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:07.313273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:07.313586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] PATH_INFO: `/v3/users/57d545cdb9dc49279608a50f22d85c16` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:07.314865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d545cdb9dc49279608a50f22d85c16)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:07.316839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:07.390553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d545cdb9dc49279608a50f22d85c16'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.391273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d545cdb9dc49279608a50f22d85c16'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.407643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d545cdb9dc49279608a50f22d85c16'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.408556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d545cdb9dc49279608a50f22d85c16'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.416702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d3cccf2-453b-44f7-9574-6a9dde77dfdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d545cdb9dc49279608a50f22d85c16'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.434732 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1643/3287] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:10:07 2022] DELETE /identity/v3/users/57d545cdb9dc49279608a50f22d85c16 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:07.639239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:07.659753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bef16-7682-4bb6-a1fd-0e9c0388acad service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:07.669974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:07.746658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:07.747816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:07.748171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:07.748524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] PATH_INFO: `/v3/projects/1e0874e149554f3188d708fcc3ae7702` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:07.750766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0874e149554f3188d708fcc3ae7702)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:07.755029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:07.877963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0874e149554f3188d708fcc3ae7702', 'request_id': 'req-97009238-8187-4695-b21d-5bf1a7281bf7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.897841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0874e149554f3188d708fcc3ae7702', 'request_id': 'req-97009238-8187-4695-b21d-5bf1a7281bf7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.914755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0874e149554f3188d708fcc3ae7702', 'request_id': 'req-97009238-8187-4695-b21d-5bf1a7281bf7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.938012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] The token cache is being invalidate because project 1e0874e149554f3188d708fcc3ae7702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:10:07.938738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.940070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97009238-8187-4695-b21d-5bf1a7281bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:07.943518 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1645/3288] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:07 2022] DELETE /identity/v3/projects/1e0874e149554f3188d708fcc3ae7702 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:07.952441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb4010-7403-4946-be85-64209495f3d4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:07.955402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb4010-7403-4946-be85-64209495f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:07.955994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb4010-7403-4946-be85-64209495f3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:07.985623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7fbb4010-7403-4946-be85-64209495f3d4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:07.989916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7fbb4010-7403-4946-be85-64209495f3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:08.075515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:08.125334 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1644/3289] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:10:08.133955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e9db-24eb-4dbf-9bd7-c82ce53ec050 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.134482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e9db-24eb-4dbf-9bd7-c82ce53ec050 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.134833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e9db-24eb-4dbf-9bd7-c82ce53ec050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.157929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7ac0e9db-24eb-4dbf-9bd7-c82ce53ec050 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:08.159437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7ac0e9db-24eb-4dbf-9bd7-c82ce53ec050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:08.173275 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1646/3290] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:08.174778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb4010-7403-4946-be85-64209495f3d4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:08.185192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb4010-7403-4946-be85-64209495f3d4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:08.189984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:08.190666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.190944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.191216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.191958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:10:08.192249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:08.193889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:08.215346 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1645/3291] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:10:08.219629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0e9db-24eb-4dbf-9bd7-c82ce53ec050 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:08.232078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0e9db-24eb-4dbf-9bd7-c82ce53ec050 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:08.237699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:08.238737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.239478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.239478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.240224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:08.242259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:08.276743 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1647/3292] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:10:08 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:10:08.280982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:08.293165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c29a-ebf8-46b5-ab9a-d807defc1b5b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:08.377364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:08.378113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.378400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.378671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.379423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:08.387932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:08.450230 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1646/3293] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:10:08 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:10:08.451745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:08.467969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e40a1-177b-45ef-9f12-19eef8e01638 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:08.475373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:08.476496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.476872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.477292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.478110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:08.480762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:08.498883 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1648/3294] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:10:08.500205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:08.512241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d794e2-2ba2-475f-8357-ce2b5c8bb390 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:08.517460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27930621-515a-47d7-af38-62ade75edd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:08.518170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930621-515a-47d7-af38-62ade75edd3f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.519125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930621-515a-47d7-af38-62ade75edd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.519757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930621-515a-47d7-af38-62ade75edd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.520250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27930621-515a-47d7-af38-62ade75edd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:08.522000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27930621-515a-47d7-af38-62ade75edd3f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:08.540478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1647/3295] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:10:08.545614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:08.561486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67bfe9-3121-4339-a6b6-bff00f92691c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:08.569622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:08.570713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.571187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.571468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] PATH_INFO: `/v3/projects/fd97846dc159425d83b5b7fe99db3549/users/9da453849f944743a866ca88f988d67b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.597485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd97846dc159425d83b5b7fe99db3549, user_id=9da453849f944743a866ca88f988d67b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:08.600394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:08.617824 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1649/3296] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:10:08 2022] PUT /identity/v3/projects/fd97846dc159425d83b5b7fe99db3549/users/9da453849f944743a866ca88f988d67b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:10:08.623163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59ad95-45d8-46f5-81ac-03017d85268d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.623302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59ad95-45d8-46f5-81ac-03017d85268d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.623575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59ad95-45d8-46f5-81ac-03017d85268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.646004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ff59ad95-45d8-46f5-81ac-03017d85268d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:08.647269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ff59ad95-45d8-46f5-81ac-03017d85268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:08.732300 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1648/3297] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:08.742514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:08.744411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:08.799004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:08.827659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97442f-c262-4943-9dc7-0c343a3b5f7c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:08.832549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65c51-2409-4d3b-8422-de5794c7a120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:08.833334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65c51-2409-4d3b-8422-de5794c7a120 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.833614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65c51-2409-4d3b-8422-de5794c7a120 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.833885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65c51-2409-4d3b-8422-de5794c7a120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.843393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65c51-2409-4d3b-8422-de5794c7a120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:08.844831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65c51-2409-4d3b-8422-de5794c7a120 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:08.854814 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1650/3298] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:08.972048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f0d2-0e2b-4d16-bcf4-885e12010b1a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:08.972297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f0d2-0e2b-4d16-bcf4-885e12010b1a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:08.972597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f0d2-0e2b-4d16-bcf4-885e12010b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:08.994747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f089f0d2-0e2b-4d16-bcf4-885e12010b1a None None] MFA Rules not processed for user `86d98b6f30884d13a94ea2d4cabff826`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:08.996484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f089f0d2-0e2b-4d16-bcf4-885e12010b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:09.052971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:09.076491 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1649/3299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:15.586916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:15.587693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:15.587821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:15.613705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] MFA Rules not processed for user `8ede0902f6cf47fc8bbcec812fd9615b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:15.617294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:15.704796 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1651/3300] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:17.215066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:17.216089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:17.216426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:17.278789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] MFA Rules not processed for user `9da453849f944743a866ca88f988d67b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:17.281595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:17.438238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1650/3301] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:17.452887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:17.454898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:17.630174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e773983-9fed-4ae1-a054-78ca51560ef3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:17.640325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:17.641438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:17.641999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:17.642414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:17.656198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:17.658101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:17.671082 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1652/3302] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:25.305790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:25.307261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:25.347564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3661f-a9b1-4bdd-b15c-be5a40511acd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:25.361748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:25.362503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:25.362786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:25.363061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:25.367366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:25.386996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:25.388941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:25.403698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1651/3303] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:27.068579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:27.071135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:27.191229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:27.208458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae62ae-86da-4742-96fd-d5163ae7c75b service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:27.219135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf2092-08b6-47c1-ab9f-cd41a0f886ef service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:27.220710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:27.221867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:27.223057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:27.223548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] PATH_INFO: `/v3/users/9da453849f944743a866ca88f988d67b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:27.226430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da453849f944743a866ca88f988d67b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:27.229723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:27.231822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:27.232549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:27.233347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:27.234166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:27.238547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:27.258041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:27.260227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:27.276843 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1653/3304] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:27.302043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da453849f944743a866ca88f988d67b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.302824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da453849f944743a866ca88f988d67b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.337511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da453849f944743a866ca88f988d67b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.338397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da453849f944743a866ca88f988d67b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.351571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cdbd806f-4ba0-45b0-9594-501599d06ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da453849f944743a866ca88f988d67b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.371319 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1652/3305] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:10:27 2022] DELETE /identity/v3/users/9da453849f944743a866ca88f988d67b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:27.618725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:27.629752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:27.641161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12160c-4d96-4cfa-a68d-4f2567315c97 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:27.724364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:27.725548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:27.725837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:27.726268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] PATH_INFO: `/v3/projects/fd97846dc159425d83b5b7fe99db3549` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:27.727669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd97846dc159425d83b5b7fe99db3549)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:27.729909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:27.804318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd97846dc159425d83b5b7fe99db3549', 'request_id': 'req-2e49f1eb-ffc4-4626-88ec-3695d59b4038'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.813938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd97846dc159425d83b5b7fe99db3549', 'request_id': 'req-2e49f1eb-ffc4-4626-88ec-3695d59b4038'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.825719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd97846dc159425d83b5b7fe99db3549', 'request_id': 'req-2e49f1eb-ffc4-4626-88ec-3695d59b4038'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.844497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] The token cache is being invalidate because project fd97846dc159425d83b5b7fe99db3549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:10:27.844994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.845869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49f1eb-ffc4-4626-88ec-3695d59b4038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:27.847776 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1654/3306] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:27 2022] DELETE /identity/v3/projects/fd97846dc159425d83b5b7fe99db3549 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:27.853583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49fb7-8b36-43d9-b1cb-9b7ea218c741 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:27.854786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49fb7-8b36-43d9-b1cb-9b7ea218c741 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:27.855202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49fb7-8b36-43d9-b1cb-9b7ea218c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:27.877963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-60b49fb7-8b36-43d9-b1cb-9b7ea218c741 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:27.879245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-60b49fb7-8b36-43d9-b1cb-9b7ea218c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:27.921731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:27.973642 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1653/3307] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:27.982069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ee35-2d11-419a-9d12-98dd5da8d465 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:27.982523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ee35-2d11-419a-9d12-98dd5da8d465 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:27.983035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ee35-2d11-419a-9d12-98dd5da8d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.006908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c5f6ee35-2d11-419a-9d12-98dd5da8d465 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:28.008368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c5f6ee35-2d11-419a-9d12-98dd5da8d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:28.018621 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1655/3308] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:28.023614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49fb7-8b36-43d9-b1cb-9b7ea218c741 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.036019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49fb7-8b36-43d9-b1cb-9b7ea218c741 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.041992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.042722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.043008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.043422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.044469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:10:28.044781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:28.046541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:28.064949 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1654/3309] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:10:28.069877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6ee35-2d11-419a-9d12-98dd5da8d465 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.082085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6ee35-2d11-419a-9d12-98dd5da8d465 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.088140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.089710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.090042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.090301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.091098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:28.093226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:28.121756 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1656/3310] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:10:28 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:10:28.126502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.140022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde538a-fe8c-4947-8f1a-fbef7919924d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.208418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.209289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.210019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.210019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.210862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:28.213008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:28.242145 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1655/3311] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:10:28 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:10:28.247452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.261763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6443a2-cff1-40b3-8050-4272eed0baa2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.267435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.268180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.268471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.268732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.269556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:28.271327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:28.283431 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1657/3312] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:10:28.287998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.300828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16da85-68c4-4034-986b-42db3d7685b0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.306489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd44b1-745e-40fb-b195-ca33b07dd3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.307356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd44b1-745e-40fb-b195-ca33b07dd3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.307740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd44b1-745e-40fb-b195-ca33b07dd3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.308068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd44b1-745e-40fb-b195-ca33b07dd3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.308907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd44b1-745e-40fb-b195-ca33b07dd3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:28.310588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd44b1-745e-40fb-b195-ca33b07dd3a0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:28.322636 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1656/3313] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:10:28.328044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.342197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786835b-c159-424f-8cf4-cc1c07e6a590 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.347910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.348958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.349379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.349610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] PATH_INFO: `/v3/projects/965efce4648a472eb15b6d1c0f8c6615/users/48b167cdb1054ef5bfadd851be67e8aa/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.366354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965efce4648a472eb15b6d1c0f8c6615, user_id=48b167cdb1054ef5bfadd851be67e8aa, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:28.369076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:28.393946 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1658/3314] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:10:28 2022] PUT /identity/v3/projects/965efce4648a472eb15b6d1c0f8c6615/users/48b167cdb1054ef5bfadd851be67e8aa/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:28.399928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.400330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.400713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.424192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:28.425527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:28.505105 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1657/3315] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:28.516244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.518266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:28.561437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:28.598445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872f70-c97a-4281-b7d2-6153b93926b6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.603593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5680e-f436-48e4-ae27-2f187b30691a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.604411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5680e-f436-48e4-ae27-2f187b30691a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.604742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5680e-f436-48e4-ae27-2f187b30691a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.605125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5680e-f436-48e4-ae27-2f187b30691a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.617044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5680e-f436-48e4-ae27-2f187b30691a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:28.619534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5680e-f436-48e4-ae27-2f187b30691a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:28.640378 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1659/3316] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:28.873958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:28.875883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:28.930699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:28.970115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d7846-457c-4cf0-b0bf-2a6e7468934c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:28.977479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:28.978252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:28.978558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:28.978835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:28.982352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:29.093779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:29.095653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:29.113723 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1658/3317] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:37.078621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749611c6-951a-49d3-a5f1-91e3af63eba7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:37.079160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749611c6-951a-49d3-a5f1-91e3af63eba7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:37.079160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749611c6-951a-49d3-a5f1-91e3af63eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:37.142768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-749611c6-951a-49d3-a5f1-91e3af63eba7 None None] MFA Rules not processed for user `48b167cdb1054ef5bfadd851be67e8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:37.144205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-749611c6-951a-49d3-a5f1-91e3af63eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:37.279252 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1660/3318] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:38.049079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:38.052433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:38.101185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916c87-bdd7-422d-bc5c-22ccf1a9a183 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:38.117716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01030de2-931a-4c50-bc95-4842db5fbd59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:38.119024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01030de2-931a-4c50-bc95-4842db5fbd59 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:38.119513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01030de2-931a-4c50-bc95-4842db5fbd59 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:38.119980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01030de2-931a-4c50-bc95-4842db5fbd59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:38.135104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01030de2-931a-4c50-bc95-4842db5fbd59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:38.137440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01030de2-931a-4c50-bc95-4842db5fbd59 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:38.152470 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1659/3319] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:41.814739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121afa-699a-4414-92ef-350937f7925f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:41.815386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121afa-699a-4414-92ef-350937f7925f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:41.815636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121afa-699a-4414-92ef-350937f7925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:41.865546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7b121afa-699a-4414-92ef-350937f7925f None None] MFA Rules not processed for user `48b167cdb1054ef5bfadd851be67e8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:41.868996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7b121afa-699a-4414-92ef-350937f7925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:41.897394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1661/3320] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:46.293436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c552d1e-a444-437a-9b3b-6dcfb15d0656 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:46.294888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c552d1e-a444-437a-9b3b-6dcfb15d0656 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:46.295657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c552d1e-a444-437a-9b3b-6dcfb15d0656 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:46.297743 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1660/3321] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:10:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:10:46.303915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:46.304584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:46.304584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:46.335032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:46.336255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:46.347470 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1662/3322] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:46.451594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c552d1e-a444-437a-9b3b-6dcfb15d0656 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:46.453997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6c552d1e-a444-437a-9b3b-6dcfb15d0656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:46.522849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c552d1e-a444-437a-9b3b-6dcfb15d0656 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:46.540252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:46.543390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:46.543794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:46.544089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:46.565223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:46.567455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:46.579575 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1661/3323] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:47.486879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:47.488960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:47.517330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77711349-e4a6-47cf-b0db-31822ee3e9f8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:47.527756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:47.528864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:47.529206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:47.529536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] PATH_INFO: `/v3/users/cf9fa8d3d2bc4f9fa12fab743b7090ad` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:47.530894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9fa8d3d2bc4f9fa12fab743b7090ad)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:47.533634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:47.612475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9fa8d3d2bc4f9fa12fab743b7090ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:47.613797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9fa8d3d2bc4f9fa12fab743b7090ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:47.631989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9fa8d3d2bc4f9fa12fab743b7090ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:47.633929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9fa8d3d2bc4f9fa12fab743b7090ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:47.655937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9fa8d3d2bc4f9fa12fab743b7090ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:47.676885 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1663/3324] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:10:47 2022] DELETE /identity/v3/users/cf9fa8d3d2bc4f9fa12fab743b7090ad => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:48.806693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:48.826817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43da14f-81e7-478f-9f1b-0a31f182ac0c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:48.913664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:48.915435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:48.915864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:48.916277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] PATH_INFO: `/v3/projects/4643e24233bd4af1a0c020e4d9a474fb` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:48.918226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4643e24233bd4af1a0c020e4d9a474fb)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:48.920933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:49.001279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4643e24233bd4af1a0c020e4d9a474fb', 'request_id': 'req-e854d647-3513-43da-8e87-8103ec72d0fb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.003365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:49.014139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4643e24233bd4af1a0c020e4d9a474fb', 'request_id': 'req-e854d647-3513-43da-8e87-8103ec72d0fb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.034167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4643e24233bd4af1a0c020e4d9a474fb', 'request_id': 'req-e854d647-3513-43da-8e87-8103ec72d0fb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.058188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] The token cache is being invalidate because project 4643e24233bd4af1a0c020e4d9a474fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:10:49.058188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.058188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.064826 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1662/3325] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:48 2022] DELETE /identity/v3/projects/4643e24233bd4af1a0c020e4d9a474fb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:49.065057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:49.066354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:49.089127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db6169-8ebb-4bc8-b0a8-8142066778b4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:49.120039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:49.171409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:49.174462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:49.175045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:49.175349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] PATH_INFO: `/v3/users/df66b9f0141a45a58b9a312c4c8a50f6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:49.177077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df66b9f0141a45a58b9a312c4c8a50f6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:49.179525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:49.269502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df66b9f0141a45a58b9a312c4c8a50f6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.270296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df66b9f0141a45a58b9a312c4c8a50f6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.314966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df66b9f0141a45a58b9a312c4c8a50f6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.315941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df66b9f0141a45a58b9a312c4c8a50f6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.334014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df66b9f0141a45a58b9a312c4c8a50f6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.364827 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1664/3326] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:10:49 2022] DELETE /identity/v3/users/df66b9f0141a45a58b9a312c4c8a50f6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:49.641384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:49.642983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:49.643118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:49.645471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:49.674724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d647-3513-43da-8e87-8103ec72d0fb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:49.824114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56337-19f7-4436-a2e4-e011f3d03006 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:49.831875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:49.833548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:49.833882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:49.834171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] PATH_INFO: `/v3/projects/fed1a319a984482eabb1873973e84b83` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:49.836258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:49.837364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed1a319a984482eabb1873973e84b83)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:49.840402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:49.840656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:49.842067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:49.843344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] PATH_INFO: `/v3/users/86d98b6f30884d13a94ea2d4cabff826` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:49.848338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d98b6f30884d13a94ea2d4cabff826)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:49.857715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:49.964940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:49.981835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed1a319a984482eabb1873973e84b83', 'request_id': 'req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:49.999284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed1a319a984482eabb1873973e84b83', 'request_id': 'req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.002603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d98b6f30884d13a94ea2d4cabff826'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.003744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d98b6f30884d13a94ea2d4cabff826'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.019796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed1a319a984482eabb1873973e84b83', 'request_id': 'req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.050339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] The token cache is being invalidate because project fed1a319a984482eabb1873973e84b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:10:50.050838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.052059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d5560a3-5c44-41b6-8868-db8dab9b3ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.054285 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1665/3327] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:49 2022] DELETE /identity/v3/projects/fed1a319a984482eabb1873973e84b83 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:50.058854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d98b6f30884d13a94ea2d4cabff826'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.060987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebc02-ffe1-464d-88cc-f207944d3a08 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:50.061328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebc02-ffe1-464d-88cc-f207944d3a08 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:50.061680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebc02-ffe1-464d-88cc-f207944d3a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:50.072969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d98b6f30884d13a94ea2d4cabff826'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.097424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a9705126-f0c0-437a-8c03-4c93402e209b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d98b6f30884d13a94ea2d4cabff826'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:50.106919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-269ebc02-ffe1-464d-88cc-f207944d3a08 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:50.112988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-269ebc02-ffe1-464d-88cc-f207944d3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:50.125790 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1663/3328] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:10:49 2022] DELETE /identity/v3/users/86d98b6f30884d13a94ea2d4cabff826 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:50.251203 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1666/3329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:10:50.252484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d538f-ae50-427d-bfe4-e1c126f69a13 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:50.252804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d538f-ae50-427d-bfe4-e1c126f69a13 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:50.253135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d538f-ae50-427d-bfe4-e1c126f69a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:50.309707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1f3d538f-ae50-427d-bfe4-e1c126f69a13 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:50.309707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1f3d538f-ae50-427d-bfe4-e1c126f69a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:50.504902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:50.519851 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1664/3330] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:10:50.525947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ebc02-ffe1-464d-88cc-f207944d3a08 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:50.543130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ebc02-ffe1-464d-88cc-f207944d3a08 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:50.557121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:50.558197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:50.558778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:50.559839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:50.561272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:10:50.563039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:50.572347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:50.602209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1667/3331] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:10:50.606679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d538f-ae50-427d-bfe4-e1c126f69a13 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:50.623756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d538f-ae50-427d-bfe4-e1c126f69a13 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:50.638549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26d199-df8c-4b2a-ba26-18c100a89048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:50.640248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d199-df8c-4b2a-ba26-18c100a89048 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:50.640535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d199-df8c-4b2a-ba26-18c100a89048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:50.640808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26d199-df8c-4b2a-ba26-18c100a89048 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:50.641563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26d199-df8c-4b2a-ba26-18c100a89048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:50.644534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26d199-df8c-4b2a-ba26-18c100a89048 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:50.719529 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1665/3332] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:10:50 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:10:50.722912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:50.757938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec78f39-22b8-4dcc-becf-1fde6cd17348 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:50.783878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1303aa-94db-4979-b12e-450fde6045e2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:50.784246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1303aa-94db-4979-b12e-450fde6045e2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:50.784902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1303aa-94db-4979-b12e-450fde6045e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:50.838845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fc1303aa-94db-4979-b12e-450fde6045e2 None None] MFA Rules not processed for user `0e8a394c0a284416ac893321bd860e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:50.845761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fc1303aa-94db-4979-b12e-450fde6045e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:50.872333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:50.873411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:50.873899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:50.874295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:50.880965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:50.883064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:50.923793 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1668/3333] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:10:50 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:10:50.924893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:50.927682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:50.956883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c681b-651c-4b5e-8808-82558ee4ffcf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:50.986589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:50.987496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:50.987862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:50.988073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] PATH_INFO: `/v3/projects/e25c9a06b279434b8c8f262a3c0a968b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:50.990615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25c9a06b279434b8c8f262a3c0a968b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:50.992755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:51.018682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1666/3334] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:51.038291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1303aa-94db-4979-b12e-450fde6045e2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:51.057398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1303aa-94db-4979-b12e-450fde6045e2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:51.070390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:51.071226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.071498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.071957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.073317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:51.075661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:51.106753 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1667/3335] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:10:51.112374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:51.125492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:51.140198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e5b05-a416-4246-b160-243ae6ca386d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:51.147732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25c9a06b279434b8c8f262a3c0a968b', 'request_id': 'req-4cb390a0-bf70-48be-bac6-5eeacec8b583'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:51.168012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25c9a06b279434b8c8f262a3c0a968b', 'request_id': 'req-4cb390a0-bf70-48be-bac6-5eeacec8b583'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:51.188138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25c9a06b279434b8c8f262a3c0a968b', 'request_id': 'req-4cb390a0-bf70-48be-bac6-5eeacec8b583'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:51.227776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] The token cache is being invalidate because project e25c9a06b279434b8c8f262a3c0a968b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:10:51.228185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:51.229396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4cb390a0-bf70-48be-bac6-5eeacec8b583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:10:51.234689 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1669/3336] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:50 2022] DELETE /identity/v3/projects/e25c9a06b279434b8c8f262a3c0a968b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:51.240109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80669c45-01c5-4257-a208-9b6a0553d3a9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.240409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80669c45-01c5-4257-a208-9b6a0553d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.240689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80669c45-01c5-4257-a208-9b6a0553d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.266957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-80669c45-01c5-4257-a208-9b6a0553d3a9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:51.270157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-80669c45-01c5-4257-a208-9b6a0553d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:51.326403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:51.328956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.329359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.330184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.332347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:51.339678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:51.372059 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1668/3337] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:10:51.379522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:51.384166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:51.433060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4cef-1818-4fb3-8104-7d2609e50b39 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:51.445835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52f12f-0320-4a0f-b2e5-d057008f69f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:51.447968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f12f-0320-4a0f-b2e5-d057008f69f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.453926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f12f-0320-4a0f-b2e5-d057008f69f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.454304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f12f-0320-4a0f-b2e5-d057008f69f4 admin admin] PATH_INFO: `/v3/projects/e29bd993bde443a7ae41414b603e05d5/users/c121277893cc4640a85bc96dcef6aef7/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.475833 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1670/3338] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:51.488234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae30d6-a969-462e-a06f-4af2c48573d5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.489813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae30d6-a969-462e-a06f-4af2c48573d5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.490276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae30d6-a969-462e-a06f-4af2c48573d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.516620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52f12f-0320-4a0f-b2e5-d057008f69f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29bd993bde443a7ae41414b603e05d5, user_id=c121277893cc4640a85bc96dcef6aef7, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:51.519909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52f12f-0320-4a0f-b2e5-d057008f69f4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:51.542990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7eae30d6-a969-462e-a06f-4af2c48573d5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:51.545065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7eae30d6-a969-462e-a06f-4af2c48573d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:51.549069 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1669/3339] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:10:51 2022] PUT /identity/v3/projects/e29bd993bde443a7ae41414b603e05d5/users/c121277893cc4640a85bc96dcef6aef7/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:51.558886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.558886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.559290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.636044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] MFA Rules not processed for user `c121277893cc4640a85bc96dcef6aef7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:51.641387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:51.708654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:51.725736 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1671/3340] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:51.729941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae30d6-a969-462e-a06f-4af2c48573d5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:51.748769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae30d6-a969-462e-a06f-4af2c48573d5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:51.758776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:51.759790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.761148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.761768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.762913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:10:51.763430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:51.765480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:51.784065 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1670/3341] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:51.795401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:51.797586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:51.798325 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1672/3342] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:10:51.804228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:51.823728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9a2b7-3b39-49e9-b275-f0d4870eb20a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:51.831131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:51.832282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.832951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.834011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.834802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:51.838772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:51.895947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d090a-abc5-4761-b4fd-983c3450dc18 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:51.896690 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1673/3343] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:10:51 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:10:51.900319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:51.973528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:51.974480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:51.974960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:51.975598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:51.999286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:52.066065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ee74d-cc84-426f-90e8-a021d97728b3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:52.071190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:52.071931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:52.072220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:52.072560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:52.073280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:52.075654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:52.105379 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1674/3344] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:10:51 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:10:52.106356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:52.123374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:52.125079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:52.128634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b96a-82f6-4563-84b9-6a7595c64e35 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:52.140570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:52.142024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:52.142315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:52.142598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:52.144599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:52.149274 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1671/3345] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:10:52.150565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:52.177612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:52.181596 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1675/3346] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:10:52.199310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad288bd-cacd-4d67-9491-b81095674032 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:52.232404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e1526-7339-42be-be56-716b6ecd5a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:52.234285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e1526-7339-42be-be56-716b6ecd5a87 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:52.242422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e1526-7339-42be-be56-716b6ecd5a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:52.253343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e1526-7339-42be-be56-716b6ecd5a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:52.256245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e1526-7339-42be-be56-716b6ecd5a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:52.260603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e1526-7339-42be-be56-716b6ecd5a87 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:52.290869 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1672/3347] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:10:52.291996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:52.303592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804a8ad-5e29-4d47-b5af-a37137bd5130 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:52.320709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:52.321616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:52.321983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:52.322264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] PATH_INFO: `/v3/projects/be82e54d6aa74bb09a543b6b225b9676/users/fef0c44eb8be4d1fbf6caeedacf7ac21/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:52.354436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be82e54d6aa74bb09a543b6b225b9676, user_id=fef0c44eb8be4d1fbf6caeedacf7ac21, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:52.364956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:52.391412 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1676/3348] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:10:52 2022] PUT /identity/v3/projects/be82e54d6aa74bb09a543b6b225b9676/users/fef0c44eb8be4d1fbf6caeedacf7ac21/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:10:52.396481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a078-49e2-4618-a9b9-af73ec8c691d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:52.396930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a078-49e2-4618-a9b9-af73ec8c691d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:52.397463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a078-49e2-4618-a9b9-af73ec8c691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:52.433534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:52.435204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0529a078-49e2-4618-a9b9-af73ec8c691d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:52.435997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:52.436625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0529a078-49e2-4618-a9b9-af73ec8c691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:52.478827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:52.539666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d17fd-d9e9-4552-91b8-c9657a8a201c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:52.543572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e629f24-72eb-4989-944b-5e372b4ac889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:52.547205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629f24-72eb-4989-944b-5e372b4ac889 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:52.547377 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1673/3349] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:52.547470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629f24-72eb-4989-944b-5e372b4ac889 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:52.547470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629f24-72eb-4989-944b-5e372b4ac889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:52.547470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9e629f24-72eb-4989-944b-5e372b4ac889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:52.556193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a078-49e2-4618-a9b9-af73ec8c691d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:52.561379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e629f24-72eb-4989-944b-5e372b4ac889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:52.563760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e629f24-72eb-4989-944b-5e372b4ac889 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:52.570544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a078-49e2-4618-a9b9-af73ec8c691d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:52.576244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:52.577019 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1677/3350] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:10:52.579303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:52.579616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:52.579899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:52.593065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:52.596050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:52.608209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1674/3351] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:10:53.373180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a845faa-3ed4-4a4a-8bed-9797fe6030c0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:53.374192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a845faa-3ed4-4a4a-8bed-9797fe6030c0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:53.374858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a845faa-3ed4-4a4a-8bed-9797fe6030c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:53.394193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0a845faa-3ed4-4a4a-8bed-9797fe6030c0 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:53.395595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0a845faa-3ed4-4a4a-8bed-9797fe6030c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:53.484029 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1678/3352] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:10:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:53.549185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:53.551590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:53.690045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1864-f81d-4d3b-bf8a-e4e614e85c33 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:53.695659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:53.696261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:53.696552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:53.696812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:53.708216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:53.710136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:53.720773 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1675/3353] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:10:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:55.255515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101865bc-15ff-468b-800f-7e127d6404dc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:55.256474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101865bc-15ff-468b-800f-7e127d6404dc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:55.256900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101865bc-15ff-468b-800f-7e127d6404dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:55.283495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-101865bc-15ff-468b-800f-7e127d6404dc None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:55.284973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-101865bc-15ff-468b-800f-7e127d6404dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:55.295068 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1679/3354] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:55.319846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:55.338251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc61a6a-70a3-48b4-accf-9a3139537738 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:55.348650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:55.349656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:55.350229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:55.350649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:55.362615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:55.365519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:55.400162 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1676/3355] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:56.966381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd0ec-b44f-41d3-b7d9-ae09d6f213b3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:56.967202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd0ec-b44f-41d3-b7d9-ae09d6f213b3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:56.967495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcd0ec-b44f-41d3-b7d9-ae09d6f213b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:56.995952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6dbcd0ec-b44f-41d3-b7d9-ae09d6f213b3 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:56.997411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6dbcd0ec-b44f-41d3-b7d9-ae09d6f213b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:57.017048 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1680/3356] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:10:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:57.041494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:10:57.058704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c45f18-be97-454e-b850-68327a30ddd2 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:10:57.068447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71163ba0-4561-4f4b-bb9a-fbd437bef054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:10:57.069875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71163ba0-4561-4f4b-bb9a-fbd437bef054 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:57.070370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71163ba0-4561-4f4b-bb9a-fbd437bef054 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:57.071165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71163ba0-4561-4f4b-bb9a-fbd437bef054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:57.085451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71163ba0-4561-4f4b-bb9a-fbd437bef054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:10:57.088896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71163ba0-4561-4f4b-bb9a-fbd437bef054 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:10:57.102645 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1677/3357] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:10:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:57.419971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:57.420265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:57.420546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:57.449835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] MFA Rules not processed for user `c121277893cc4640a85bc96dcef6aef7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:57.451794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:57.484285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:57.595896 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1681/3358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:10:58.438119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f5780-9db5-4355-9130-7b608d13d2e0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:10:58.439252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f5780-9db5-4355-9130-7b608d13d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:10:58.439752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f5780-9db5-4355-9130-7b608d13d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:10:58.469649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-931f5780-9db5-4355-9130-7b608d13d2e0 None None] MFA Rules not processed for user `c121277893cc4640a85bc96dcef6aef7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:10:58.471527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-931f5780-9db5-4355-9130-7b608d13d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:10:58.487153 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1678/3359] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:10:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:01.335799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:01.340489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:01.376186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baa94d-b460-4dfc-8782-9f55ff1ef59c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:01.386343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:01.388140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:01.388909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:01.389373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] PATH_INFO: `/v3/users/8ede0902f6cf47fc8bbcec812fd9615b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:01.392862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ede0902f6cf47fc8bbcec812fd9615b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:01.396052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:01.485992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ede0902f6cf47fc8bbcec812fd9615b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:01.487028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ede0902f6cf47fc8bbcec812fd9615b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:01.500890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ede0902f6cf47fc8bbcec812fd9615b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:01.501856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ede0902f6cf47fc8bbcec812fd9615b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:01.511924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-147b9db0-3fe6-45a8-a4a7-97601f57c5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ede0902f6cf47fc8bbcec812fd9615b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:01.528465 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1682/3360] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:11:01 2022] DELETE /identity/v3/users/8ede0902f6cf47fc8bbcec812fd9615b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:02.272063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f5780-9db5-4355-9130-7b608d13d2e0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:02.293165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f5780-9db5-4355-9130-7b608d13d2e0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:02.430835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:02.431988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:02.432422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:02.432883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] PATH_INFO: `/v3/projects/b9a85ed67a4b4908b724c49a9754d312` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:02.435339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a85ed67a4b4908b724c49a9754d312)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:02.440319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:02.486079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:02.541728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a85ed67a4b4908b724c49a9754d312', 'request_id': 'req-3bd6f860-993b-44ca-90e4-d3451c6a7328'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:02.551614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a85ed67a4b4908b724c49a9754d312', 'request_id': 'req-3bd6f860-993b-44ca-90e4-d3451c6a7328'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:02.569301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a85ed67a4b4908b724c49a9754d312', 'request_id': 'req-3bd6f860-993b-44ca-90e4-d3451c6a7328'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:02.588126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] The token cache is being invalidate because project b9a85ed67a4b4908b724c49a9754d312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:11:02.590286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:02.592454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bd6f860-993b-44ca-90e4-d3451c6a7328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:02.594698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1679/3361] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:02 2022] DELETE /identity/v3/projects/b9a85ed67a4b4908b724c49a9754d312 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:02.600475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a836b95-7174-4283-8179-2f3bcc5e6433 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:02.601001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a836b95-7174-4283-8179-2f3bcc5e6433 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:02.601156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a836b95-7174-4283-8179-2f3bcc5e6433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:02.627480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9a836b95-7174-4283-8179-2f3bcc5e6433 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:02.629615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a836b95-7174-4283-8179-2f3bcc5e6433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:02.795569 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1683/3362] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:02.805602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ec68c-6c5b-4bbf-bba1-bafad0a460b7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:02.806493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ec68c-6c5b-4bbf-bba1-bafad0a460b7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:02.807672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ec68c-6c5b-4bbf-bba1-bafad0a460b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:02.842371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dd6ec68c-6c5b-4bbf-bba1-bafad0a460b7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:02.844035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dd6ec68c-6c5b-4bbf-bba1-bafad0a460b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:02.857392 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1680/3363] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:02.861944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a836b95-7174-4283-8179-2f3bcc5e6433 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:02.872421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a836b95-7174-4283-8179-2f3bcc5e6433 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:02.877823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:02.878698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:02.879123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:02.879596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:02.880478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:11:02.880936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:02.882723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:02.900668 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1684/3364] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:11:02.902640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ec68c-6c5b-4bbf-bba1-bafad0a460b7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:02.918095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ec68c-6c5b-4bbf-bba1-bafad0a460b7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:02.934973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:02.936662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:02.936963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:02.937474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:02.938576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:02.942761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:02.995636 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1681/3365] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:11:02 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:02.999765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:03.014774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c117d-832c-4ebf-b06b-57cb12b0ca3c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:03.063659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:03.127117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:03.127463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:03.127738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:03.128015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:03.129357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:03.131502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:03.163589 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1685/3366] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:11:02 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:03.168509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:03.183758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44817a3b-8033-4668-9be7-c350fba327b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:03.195329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:03.196041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:03.196368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:03.198477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:03.199267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:03.203124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:03.236958 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1682/3367] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:03.241580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:03.257516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bca7-33d1-4c82-8aa4-6610e55873a5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:03.267141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acb059-c632-4b3e-95b3-60b97e492c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:03.268064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb059-c632-4b3e-95b3-60b97e492c69 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:03.270297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb059-c632-4b3e-95b3-60b97e492c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:03.271234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb059-c632-4b3e-95b3-60b97e492c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:03.272143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acb059-c632-4b3e-95b3-60b97e492c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:03.280924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acb059-c632-4b3e-95b3-60b97e492c69 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:03.305068 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1686/3368] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:11:03.309520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:03.324014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4898fc-6637-4327-8dfa-83244d153807 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:03.330069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:03.331206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:03.331630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:03.332439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] PATH_INFO: `/v3/projects/b8ddaa6fbcdf4368a8e9be0d07596178/users/a8eb1a760d644f97bf3aae882e905b85/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:03.364677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ddaa6fbcdf4368a8e9be0d07596178, user_id=a8eb1a760d644f97bf3aae882e905b85, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:03.368976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:03.401904 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1683/3369] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:03 2022] PUT /identity/v3/projects/b8ddaa6fbcdf4368a8e9be0d07596178/users/a8eb1a760d644f97bf3aae882e905b85/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:03.403535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051cbfc-14ed-41b3-89a6-c2263cdb5329 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:03.404037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051cbfc-14ed-41b3-89a6-c2263cdb5329 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:03.404928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051cbfc-14ed-41b3-89a6-c2263cdb5329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:03.435423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3051cbfc-14ed-41b3-89a6-c2263cdb5329 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:03.437206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3051cbfc-14ed-41b3-89a6-c2263cdb5329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:03.681641 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1687/3370] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:03.708272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:03.710137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:03.834855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d665-3e4d-4662-a093-11cd1f873197 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:03.838670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557a1c6-687d-4852-9371-147cb458d10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:03.839350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a1c6-687d-4852-9371-147cb458d10a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:03.839630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a1c6-687d-4852-9371-147cb458d10a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:03.840497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a1c6-687d-4852-9371-147cb458d10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:03.855425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557a1c6-687d-4852-9371-147cb458d10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:03.856915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557a1c6-687d-4852-9371-147cb458d10a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:03.870488 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1684/3371] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:05.937525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:05.938010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:05.938010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:05.996204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] MFA Rules not processed for user `fef0c44eb8be4d1fbf6caeedacf7ac21`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:05.998060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:06.173878 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1688/3372] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:06.184044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:06.184579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:06.184579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:06.222231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] MFA Rules not processed for user `fef0c44eb8be4d1fbf6caeedacf7ac21`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:06.223785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:06.247018 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1685/3373] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:06.259222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:06.260685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:06.373918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:06.437726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4f16-0335-46b4-9730-019fae439dc3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:06.444431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:06.445217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:06.445506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:06.445788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:06.459958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:06.461700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:06.486252 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1689/3374] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:06.706918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:06.710282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:06.735290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca70d1-858e-4ec9-a94e-d83a334d0e81 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:06.755294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:06.756301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:06.756660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:06.757011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] PATH_INFO: `/v3/users/a3022aec60f643b2a66492ad8f8d7e96` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:06.758384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3022aec60f643b2a66492ad8f8d7e96)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:06.760541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:06.860312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:06.898973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3022aec60f643b2a66492ad8f8d7e96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:06.900171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3022aec60f643b2a66492ad8f8d7e96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:06.929546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3022aec60f643b2a66492ad8f8d7e96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:06.930829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3022aec60f643b2a66492ad8f8d7e96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:06.952499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71ee7cac-8f89-4062-aeec-3a80c5ad3378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3022aec60f643b2a66492ad8f8d7e96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:06.973329 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1686/3375] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:11:06 2022] DELETE /identity/v3/users/a3022aec60f643b2a66492ad8f8d7e96 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:08.874665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:08.891598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ab9e7-0071-40b1-9d1a-b7326dcd5a70 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:09.332926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:09.339095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:09.339512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:09.339797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] PATH_INFO: `/v3/projects/a0f349f2feda450cbe24f0a17b186798` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:09.343398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f349f2feda450cbe24f0a17b186798)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:09.350040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:09.474852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f349f2feda450cbe24f0a17b186798', 'request_id': 'req-41661af5-f39d-4a7c-b881-9672cbe23f05'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:09.507924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f349f2feda450cbe24f0a17b186798', 'request_id': 'req-41661af5-f39d-4a7c-b881-9672cbe23f05'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:09.527714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f349f2feda450cbe24f0a17b186798', 'request_id': 'req-41661af5-f39d-4a7c-b881-9672cbe23f05'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:09.633977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] The token cache is being invalidate because project a0f349f2feda450cbe24f0a17b186798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:11:09.634296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:09.634956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:09.637066 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1690/3376] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:08 2022] DELETE /identity/v3/projects/a0f349f2feda450cbe24f0a17b186798 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:09.643516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814edb9-7a1e-4dab-8c8a-bb6a08dbe907 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:09.644099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814edb9-7a1e-4dab-8c8a-bb6a08dbe907 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:09.644189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814edb9-7a1e-4dab-8c8a-bb6a08dbe907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:09.858941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7814edb9-7a1e-4dab-8c8a-bb6a08dbe907 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:09.860341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7814edb9-7a1e-4dab-8c8a-bb6a08dbe907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:10.008844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.010622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:10.016992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:10.057002 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1687/3377] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:10.065331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7d02-df6e-41a8-b430-1d23e631eb8a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.065519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7d02-df6e-41a8-b430-1d23e631eb8a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.065914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c7d02-df6e-41a8-b430-1d23e631eb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.127276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9b9c7d02-df6e-41a8-b430-1d23e631eb8a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:10.148430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9b9c7d02-df6e-41a8-b430-1d23e631eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:10.173796 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1688/3378] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:11:10.175371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c7d02-df6e-41a8-b430-1d23e631eb8a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.198134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c7d02-df6e-41a8-b430-1d23e631eb8a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.216980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661af5-f39d-4a7c-b881-9672cbe23f05 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.218020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.218939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.221546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.221998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.223798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:11:10.226732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.229150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:10.238114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.240143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.241413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.243312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] PATH_INFO: `/v3/users/64a676b449be43d9bc7fecb76178af16` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.245451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a676b449be43d9bc7fecb76178af16)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.254033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:10.291871 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1689/3379] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:11:10.298331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.320655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ea16-146d-4745-acbe-e41f24b3c381 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.336846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.337881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.338308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.338733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.338905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a676b449be43d9bc7fecb76178af16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:10.339602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a676b449be43d9bc7fecb76178af16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:10.340011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.342146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:10.362630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a676b449be43d9bc7fecb76178af16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:10.369791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a676b449be43d9bc7fecb76178af16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:10.386697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bae30b91-86a7-48d7-aafc-bbdb14a0730d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a676b449be43d9bc7fecb76178af16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:10.427801 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1691/3380] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:11:10 2022] DELETE /identity/v3/users/64a676b449be43d9bc7fecb76178af16 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:10.433101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cefbf-283c-4103-b778-532f0648481a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.433405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cefbf-283c-4103-b778-532f0648481a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.433690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cefbf-283c-4103-b778-532f0648481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.466994 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1690/3381] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:11:10 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:10.471558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.473349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:10.479113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a21cefbf-283c-4103-b778-532f0648481a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:10.483080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a21cefbf-283c-4103-b778-532f0648481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:10.578704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:10.647937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c414ee8-af5a-4de5-bd45-6dbc6ece9582 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.665926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.666645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.666932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.667210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.667989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.670106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:10.711947 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1691/3382] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:11:10 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:10.718521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.742275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122cec-ead9-431c-933b-27c853a17997 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.748277 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1692/3383] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:10.758858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.760138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.760681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.762752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.764175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.766369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:10.789423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cefbf-283c-4103-b778-532f0648481a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.790987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a21cefbf-283c-4103-b778-532f0648481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:10.804873 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1692/3384] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:10.806657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.827989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7186d72-7088-40a2-8cf0-79bb2391a638 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.836808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.838610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.839213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.839696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.840705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.846010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:10.852743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:10.877369 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1693/3385] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:10.882829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:10.905624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f3f81-852c-4e5c-a97c-a2f7354a03a8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.928978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.929982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.930426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.930848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] PATH_INFO: `/v3/projects/a9a765e6391f4d36bd54b8119d4c84eb/users/65fa96c0dcf948d185e7d5fdcf280fa4/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.947959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cefbf-283c-4103-b778-532f0648481a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:10.956426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d294d2-3672-40be-963b-4a88307c17f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:10.958632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d294d2-3672-40be-963b-4a88307c17f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:10.959221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d294d2-3672-40be-963b-4a88307c17f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:10.959514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d294d2-3672-40be-963b-4a88307c17f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:10.976379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a765e6391f4d36bd54b8119d4c84eb, user_id=65fa96c0dcf948d185e7d5fdcf280fa4, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.977947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d294d2-3672-40be-963b-4a88307c17f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:10.979281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:10.980221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d294d2-3672-40be-963b-4a88307c17f2 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:11.006147 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1693/3386] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:11:11.020870 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1694/3387] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:10 2022] PUT /identity/v3/projects/a9a765e6391f4d36bd54b8119d4c84eb/users/65fa96c0dcf948d185e7d5fdcf280fa4/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:11:11.026321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:11.027790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:11.028224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:11.051907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:11.053440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:11.129305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1694/3388] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:11.155273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:11.286146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954d3fa-56e8-4097-9c9b-3e1db56f99bf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:11.292752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:11.301096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:11.302967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:11.304159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:11.319621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:11.322033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:11.351611 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1695/3389] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:12.579430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:12.581215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:12.597921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823ce30-6eb1-41ea-a760-7a80864e30c2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:12.624856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:12.625817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:12.626098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:12.626387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] PATH_INFO: `/v3/projects/d1ac36afdc84465caad8632e46fe3a96` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:12.627658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ac36afdc84465caad8632e46fe3a96)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:12.629705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:12.738487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ac36afdc84465caad8632e46fe3a96', 'request_id': 'req-92aa8ba8-341e-400d-96b3-689630a19d7b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:12.752349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ac36afdc84465caad8632e46fe3a96', 'request_id': 'req-92aa8ba8-341e-400d-96b3-689630a19d7b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:12.776551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ac36afdc84465caad8632e46fe3a96', 'request_id': 'req-92aa8ba8-341e-400d-96b3-689630a19d7b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:12.793015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] The token cache is being invalidate because project d1ac36afdc84465caad8632e46fe3a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:11:12.793684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:12.794571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92aa8ba8-341e-400d-96b3-689630a19d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:12.797138 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1695/3390] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:12 2022] DELETE /identity/v3/projects/d1ac36afdc84465caad8632e46fe3a96 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:12.801143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:12.816797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3afffa-d6ab-4b48-95b9-6ab131de1215 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:12.933814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:12.934978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:12.935415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:12.935844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] PATH_INFO: `/v3/users/291fdae0de8644489803c4106f18f087` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:12.937752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] RBAC: Authorizing `identity:delete_user(user_id=291fdae0de8644489803c4106f18f087)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:12.939900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:13.012941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:13.051163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291fdae0de8644489803c4106f18f087'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:13.054106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291fdae0de8644489803c4106f18f087'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:13.100176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291fdae0de8644489803c4106f18f087'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:13.103660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291fdae0de8644489803c4106f18f087'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:13.116862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ddcea7a6-568b-4e22-8aff-a5f277ac882d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291fdae0de8644489803c4106f18f087'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:13.149741 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1696/3391] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:11:12 2022] DELETE /identity/v3/users/291fdae0de8644489803c4106f18f087 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:11:14.576323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6e0b-8f50-420d-b2f9-73ce9545919d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:14.577328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6e0b-8f50-420d-b2f9-73ce9545919d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:14.577801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6e0b-8f50-420d-b2f9-73ce9545919d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:14.579918 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1696/3392] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:11:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:11:14.587633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:14.588101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:14.588456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:14.613120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:14.614532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:14.717988 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1697/3393] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:11:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:14.742277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6e0b-8f50-420d-b2f9-73ce9545919d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:14.744295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f3ac6e0b-8f50-420d-b2f9-73ce9545919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:14.763979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6e0b-8f50-420d-b2f9-73ce9545919d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:14.769477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac5088-0223-4a74-81e6-991e2054ef45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:14.770322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5088-0223-4a74-81e6-991e2054ef45 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:14.770780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5088-0223-4a74-81e6-991e2054ef45 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:14.771205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac5088-0223-4a74-81e6-991e2054ef45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:14.782979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac5088-0223-4a74-81e6-991e2054ef45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:14.784814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac5088-0223-4a74-81e6-991e2054ef45 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:14.796358 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1697/3394] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:15.230638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:15.234225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:15.352913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45334599-5c65-41cf-b386-f4793816a1bc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:15.357601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:15.358580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:15.358859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:15.359133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] PATH_INFO: `/v3/projects/46a5c6971f304f97bff7d75b6382b347` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:15.360361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a5c6971f304f97bff7d75b6382b347)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:15.362477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:15.418713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:15.448647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a5c6971f304f97bff7d75b6382b347', 'request_id': 'req-1617479f-393b-4249-ae02-5c267ae43a51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:15.455935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a5c6971f304f97bff7d75b6382b347', 'request_id': 'req-1617479f-393b-4249-ae02-5c267ae43a51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:15.475415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a5c6971f304f97bff7d75b6382b347', 'request_id': 'req-1617479f-393b-4249-ae02-5c267ae43a51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:15.520078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] The token cache is being invalidate because project 46a5c6971f304f97bff7d75b6382b347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:11:15.520445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:15.521448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1617479f-393b-4249-ae02-5c267ae43a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:15.524168 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1698/3395] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:15 2022] DELETE /identity/v3/projects/46a5c6971f304f97bff7d75b6382b347 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:15.529064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46bc62-1eb8-41fa-a706-9bbafe518c7e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:15.529363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46bc62-1eb8-41fa-a706-9bbafe518c7e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:15.529672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46bc62-1eb8-41fa-a706-9bbafe518c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:15.570887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1b46bc62-1eb8-41fa-a706-9bbafe518c7e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:15.572906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1b46bc62-1eb8-41fa-a706-9bbafe518c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:15.605374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:15.701481 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1698/3396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:15.709836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510c4c-bbb1-4ebf-bd0f-393a449c676e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:15.710978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510c4c-bbb1-4ebf-bd0f-393a449c676e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:15.711263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510c4c-bbb1-4ebf-bd0f-393a449c676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:15.738858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6f510c4c-bbb1-4ebf-bd0f-393a449c676e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:15.741267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6f510c4c-bbb1-4ebf-bd0f-393a449c676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:15.760286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1699/3397] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:15.764958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46bc62-1eb8-41fa-a706-9bbafe518c7e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:15.777611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46bc62-1eb8-41fa-a706-9bbafe518c7e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:15.783147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:15.783831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:15.784106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:15.785407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:15.786780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:11:15.787254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:15.789079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:15.806013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1699/3398] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:11:15.810512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f510c4c-bbb1-4ebf-bd0f-393a449c676e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:15.828135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f510c4c-bbb1-4ebf-bd0f-393a449c676e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:15.839635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:15.840342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:15.840621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:15.841288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:15.842365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:15.844613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:15.880183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1700/3399] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:11:15 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:15.884513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:15.897443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b7171-a772-4d29-a3b7-cb39eac03b1f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:16.004386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:16.005804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:16.006317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:16.006888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:16.008617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:16.011681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:16.079974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1700/3400] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:11:15 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:16.084337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:16.101729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30198ec6-9565-4e5d-96c4-aac62e2b1b80 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:16.116501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:16.120868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:16.121634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:16.122035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:16.123599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:16.128513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:16.165103 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1701/3401] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:16.176946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:16.198171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5309fc7-65e2-4661-864f-57cca9a5ebed admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:16.213931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:16.215037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:16.215491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:16.215914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:16.217511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:16.224252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:16.242227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:16.246538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:16.247111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1701/3402] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:11:16.248203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:16.261551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a2def-aba7-4f2b-bb0b-eef982db290e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:16.268131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f3abe-a93a-4800-b2b6-e9253686ff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:16.269897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3abe-a93a-4800-b2b6-e9253686ff2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:16.271652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3abe-a93a-4800-b2b6-e9253686ff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:16.271964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3abe-a93a-4800-b2b6-e9253686ff2b admin admin] PATH_INFO: `/v3/projects/a6f7a17dc15d45b4b333bade888c180d/users/841d1a7d74af4d6c9a55ef0a8dcc5033/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:16.305024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f3abe-a93a-4800-b2b6-e9253686ff2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f7a17dc15d45b4b333bade888c180d, user_id=841d1a7d74af4d6c9a55ef0a8dcc5033, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:16.308353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f3abe-a93a-4800-b2b6-e9253686ff2b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:16.346967 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1702/3403] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:16 2022] PUT /identity/v3/projects/a6f7a17dc15d45b4b333bade888c180d/users/841d1a7d74af4d6c9a55ef0a8dcc5033/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:16.350128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58abb-5623-4978-a6b2-28e75924071c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:16.350732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58abb-5623-4978-a6b2-28e75924071c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:16.351190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58abb-5623-4978-a6b2-28e75924071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:16.387460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-21c58abb-5623-4978-a6b2-28e75924071c None None] MFA Rules not processed for user `841d1a7d74af4d6c9a55ef0a8dcc5033`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:16.389388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-21c58abb-5623-4978-a6b2-28e75924071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:16.436936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d76b-51db-4df8-8348-52d91346a328 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:16.539284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:16.571824 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1703/3404] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:16.578531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c58abb-5623-4978-a6b2-28e75924071c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:16.599614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:16.599976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:16.600412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:16.600606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:16.626083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:16.685659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:16.775368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:16.778693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:16.780797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c58abb-5623-4978-a6b2-28e75924071c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:16.795818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:16.798070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:16.798508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:16.799161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:16.800223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:16.802208 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1702/3405] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:11:16.802965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:16.863078 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1704/3406] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:11:16 2022] POST /identity/v3/projects => generated 393 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:16.867978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:16.884008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c343c2f-c62f-4fbc-9700-20e669739eca service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:17.002456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:17.003488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:17.003955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:17.004383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:17.005805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:17.007951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:17.047240 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1703/3407] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:11:16 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:17.047894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:17.070787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38591780-9a33-4c8f-89cf-0ee1b90ea77f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:17.078764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:17.079932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:17.080210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:17.080484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:17.083229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:17.085151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:17.110818 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1705/3408] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:17.112098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:17.148086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51fd83-4469-412e-bc75-9e4a7850a7cb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:17.170846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:17.171794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:17.172076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:17.172356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] PATH_INFO: `/v3/projects/f745c203dc7b48f3b3ae291e2c1b44ce/users/f6c8c2591af048d78048a5cadd5c3cd9/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:17.209450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f745c203dc7b48f3b3ae291e2c1b44ce, user_id=f6c8c2591af048d78048a5cadd5c3cd9, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:17.218403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:17.281675 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1704/3409] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:17 2022] PUT /identity/v3/projects/f745c203dc7b48f3b3ae291e2c1b44ce/users/f6c8c2591af048d78048a5cadd5c3cd9/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:17.284988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:17.306206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87cb6e-8a89-48c5-83c4-a72bac0295b2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:17.462580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4b024-c187-4006-a52a-4fba6c7d60e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:17.463364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b024-c187-4006-a52a-4fba6c7d60e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:17.463626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b024-c187-4006-a52a-4fba6c7d60e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:17.463914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b024-c187-4006-a52a-4fba6c7d60e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:17.464914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b024-c187-4006-a52a-4fba6c7d60e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:17.471918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b024-c187-4006-a52a-4fba6c7d60e7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:17.507681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1706/3410] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:17.509832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:17.530918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b714f83-1ab2-40fb-9874-aff9dac95d94 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:17.548727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:17.550118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:17.550118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:17.550554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] PATH_INFO: `/v3/projects/f745c203dc7b48f3b3ae291e2c1b44ce/users/f6c8c2591af048d78048a5cadd5c3cd9/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:17.554427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f745c203dc7b48f3b3ae291e2c1b44ce, user_id=f6c8c2591af048d78048a5cadd5c3cd9, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:17.557501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:17.602846 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1705/3411] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:17 2022] PUT /identity/v3/projects/f745c203dc7b48f3b3ae291e2c1b44ce/users/f6c8c2591af048d78048a5cadd5c3cd9/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:17.605213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ebbe0-59b6-470a-8351-2497ca3c9ff6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:17.605509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ebbe0-59b6-470a-8351-2497ca3c9ff6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:17.608778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ebbe0-59b6-470a-8351-2497ca3c9ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:17.695248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7b7ebbe0-59b6-470a-8351-2497ca3c9ff6 None None] MFA Rules not processed for user `f6c8c2591af048d78048a5cadd5c3cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:17.696549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7b7ebbe0-59b6-470a-8351-2497ca3c9ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:17.852873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:17.880783 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1707/3412] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:17.889342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:17.892365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:17.999582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:18.011982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e37830-ba98-4a3c-a4df-b58d20a8bf3a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:18.026656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:18.028271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:18.028963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:18.029595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:18.051592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:18.054120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:18.068963 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1706/3413] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:18.540821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ebbe0-59b6-470a-8351-2497ca3c9ff6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:18.558081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ebbe0-59b6-470a-8351-2497ca3c9ff6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:18.565629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd277eb-2b14-497a-a394-634640369663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:18.566686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd277eb-2b14-497a-a394-634640369663 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:18.567154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd277eb-2b14-497a-a394-634640369663 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:18.567587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd277eb-2b14-497a-a394-634640369663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:18.671826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd277eb-2b14-497a-a394-634640369663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:18.673919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd277eb-2b14-497a-a394-634640369663 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:18.688061 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1708/3414] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:18.714436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:18.872909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ce894-cbfe-40ab-8cd8-1df653237f23 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:18.887912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:18.889071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:18.889530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:18.890145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] PATH_INFO: `/v3/users/841d1a7d74af4d6c9a55ef0a8dcc5033` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:18.893220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=841d1a7d74af4d6c9a55ef0a8dcc5033)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:18.896491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:19.000934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841d1a7d74af4d6c9a55ef0a8dcc5033'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:19.002101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841d1a7d74af4d6c9a55ef0a8dcc5033'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:19.020887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841d1a7d74af4d6c9a55ef0a8dcc5033'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:19.022139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841d1a7d74af4d6c9a55ef0a8dcc5033'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:19.037422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841d1a7d74af4d6c9a55ef0a8dcc5033'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:19.065354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:19.066357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:19.066803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:19.068605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1707/3415] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:11:18 2022] DELETE /identity/v3/users/841d1a7d74af4d6c9a55ef0a8dcc5033 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:19.093624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:19.095903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:19.117954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:19.119771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:19.260436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1709/3416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:19.289333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26192d-9bda-4141-beeb-cc730e245d5f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:19.299310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:19.299836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:19.300112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:19.300551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:19.305805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:19.306439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:19.310255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:19.356169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d32c-207a-4654-ae72-d15e3504a7ff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:19.363351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:19.364334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:19.364782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:19.365345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:19.365599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:19.409518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:19.419796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:19.455911 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1710/3417] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:19.527903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:19.536010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:19.576130 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1708/3418] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:11:20.583854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:20.586035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:20.599750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada3fb-7523-4319-8675-6a5116d5aab1 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:20.606145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:20.607904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:20.608429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:20.608861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] PATH_INFO: `/v3/projects/a6f7a17dc15d45b4b333bade888c180d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:20.610665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f7a17dc15d45b4b333bade888c180d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:20.612751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:20.673239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f7a17dc15d45b4b333bade888c180d', 'request_id': 'req-de5e1d04-d718-49c7-9984-b626f84e853b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:20.680220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f7a17dc15d45b4b333bade888c180d', 'request_id': 'req-de5e1d04-d718-49c7-9984-b626f84e853b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:20.689756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f7a17dc15d45b4b333bade888c180d', 'request_id': 'req-de5e1d04-d718-49c7-9984-b626f84e853b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:20.704033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] The token cache is being invalidate because project a6f7a17dc15d45b4b333bade888c180d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:11:20.704237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:20.704883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:20.707225 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1711/3419] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:20 2022] DELETE /identity/v3/projects/a6f7a17dc15d45b4b333bade888c180d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:20.712321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:20.730309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8129c3-a11b-4499-8255-85007a1a9014 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:20.877442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:20.878833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:20.880156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:20.880648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] PATH_INFO: `/v3/users/f6c8c2591af048d78048a5cadd5c3cd9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:20.882260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c8c2591af048d78048a5cadd5c3cd9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:20.884369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:20.974382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c8c2591af048d78048a5cadd5c3cd9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:20.975913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c8c2591af048d78048a5cadd5c3cd9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:21.000214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c8c2591af048d78048a5cadd5c3cd9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:21.001507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c8c2591af048d78048a5cadd5c3cd9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:21.012720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1313b309-4bd2-4813-ac0f-ec9dc29a0d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c8c2591af048d78048a5cadd5c3cd9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:21.047332 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1709/3420] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:11:20 2022] DELETE /identity/v3/users/f6c8c2591af048d78048a5cadd5c3cd9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:21.888272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:21.890630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:21.904880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:21.939681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e1d04-d718-49c7-9984-b626f84e853b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:22.066464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:22.067470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:22.067844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:22.068313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] PATH_INFO: `/v3/projects/f745c203dc7b48f3b3ae291e2c1b44ce` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:22.069738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f745c203dc7b48f3b3ae291e2c1b44ce)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:22.071696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:22.176035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f745c203dc7b48f3b3ae291e2c1b44ce', 'request_id': 'req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:22.192162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f745c203dc7b48f3b3ae291e2c1b44ce', 'request_id': 'req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:22.208631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f745c203dc7b48f3b3ae291e2c1b44ce', 'request_id': 'req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:22.238076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] The token cache is being invalidate because project f745c203dc7b48f3b3ae291e2c1b44ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:11:22.238375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:22.239470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7ed0153b-cdbb-4f9d-b4b6-f1c85f54bcfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:11:22.245950 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1712/3421] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:21 2022] DELETE /identity/v3/projects/f745c203dc7b48f3b3ae291e2c1b44ce => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:22.248036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c009-5f1b-4f86-8486-27c3e0a99e6a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:22.248531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c009-5f1b-4f86-8486-27c3e0a99e6a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:22.248643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c009-5f1b-4f86-8486-27c3e0a99e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:22.283926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8702c009-5f1b-4f86-8486-27c3e0a99e6a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:22.285244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8702c009-5f1b-4f86-8486-27c3e0a99e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:22.371229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:22.473126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1710/3422] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:11:22.478933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6180e5e-77e9-4cec-b8d3-2c5025cb0c11 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:22.479513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6180e5e-77e9-4cec-b8d3-2c5025cb0c11 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:22.480008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6180e5e-77e9-4cec-b8d3-2c5025cb0c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:22.501342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e6180e5e-77e9-4cec-b8d3-2c5025cb0c11 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:22.503009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e6180e5e-77e9-4cec-b8d3-2c5025cb0c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:22.513083 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1713/3423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:11:22.516585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702c009-5f1b-4f86-8486-27c3e0a99e6a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:22.528882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702c009-5f1b-4f86-8486-27c3e0a99e6a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:22.539837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:22.540788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:22.541168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:22.542497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:22.543415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:11:22.543866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:22.545714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:22.567915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1711/3424] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:11:22.568679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6180e5e-77e9-4cec-b8d3-2c5025cb0c11 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:22.583682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6180e5e-77e9-4cec-b8d3-2c5025cb0c11 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:22.600032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:22.600740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:22.601022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:22.601323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:22.602036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:22.603948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:22.679619 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1714/3425] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:11:22 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:22.681896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:22.707307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241288ba-618e-4e86-9523-536ef068657c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:22.936568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:22.938404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:22.938981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:22.939457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:22.940466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:22.944167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:22.985750 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1712/3426] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:11:22 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:22.990220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:23.011501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457482-d4be-4602-9c8b-57a388f30a7b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:23.033350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:23.034064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:23.034350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:23.034628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:23.035378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:23.037052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:23.067345 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1715/3427] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:23.068581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:23.083456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba90bc-8a09-4964-8dec-d03b130c4d96 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:23.103515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f31b4-f306-4c55-ace0-a75a3f469630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:23.104227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f31b4-f306-4c55-ace0-a75a3f469630 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:23.104508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f31b4-f306-4c55-ace0-a75a3f469630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:23.104786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f31b4-f306-4c55-ace0-a75a3f469630 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:23.105568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f31b4-f306-4c55-ace0-a75a3f469630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:23.107214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f31b4-f306-4c55-ace0-a75a3f469630 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:23.135960 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1713/3428] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:23.140222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:23.156112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92e04-7632-4336-bd79-d50d02faee96 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:23.172789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:23.173749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:23.174031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:23.174307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] PATH_INFO: `/v3/projects/07a129b1f88f4c4f97cc3a9f76ef47f1/users/27c40405bf7547b4b1b896b142ea4156/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:23.206902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a129b1f88f4c4f97cc3a9f76ef47f1, user_id=27c40405bf7547b4b1b896b142ea4156, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:23.217456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:23.239120 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1716/3429] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:23 2022] PUT /identity/v3/projects/07a129b1f88f4c4f97cc3a9f76ef47f1/users/27c40405bf7547b4b1b896b142ea4156/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:23.245681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d917-5a5d-4b47-a203-cc4db2782e90 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:23.246464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d917-5a5d-4b47-a203-cc4db2782e90 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:23.247202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d917-5a5d-4b47-a203-cc4db2782e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:23.280482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cca2d917-5a5d-4b47-a203-cc4db2782e90 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:23.286492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cca2d917-5a5d-4b47-a203-cc4db2782e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:23.472633 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1714/3430] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:11:23.530966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:23.532731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:23.585734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:23.620720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9175341-0290-493a-b9bb-a84a1286cf46 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:23.625018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb877f69-165d-4049-9b51-737c80dba29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:23.625731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb877f69-165d-4049-9b51-737c80dba29e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:23.626014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb877f69-165d-4049-9b51-737c80dba29e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:23.626293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb877f69-165d-4049-9b51-737c80dba29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:23.639029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb877f69-165d-4049-9b51-737c80dba29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:23.640856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb877f69-165d-4049-9b51-737c80dba29e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:23.654633 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1717/3431] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:24.534995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:24.535758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:24.535758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:24.606046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] MFA Rules not processed for user `a8eb1a760d644f97bf3aae882e905b85`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:24.607312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:24.644505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450fd6-2da2-461b-9dc6-b520a78a6e7b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:24.645123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450fd6-2da2-461b-9dc6-b520a78a6e7b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:24.645123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450fd6-2da2-461b-9dc6-b520a78a6e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:24.700177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:24.714347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-20450fd6-2da2-461b-9dc6-b520a78a6e7b None None] MFA Rules not processed for user `65fa96c0dcf948d185e7d5fdcf280fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:24.717078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-20450fd6-2da2-461b-9dc6-b520a78a6e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:24.833616 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1715/3432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:24.840310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:24.840540 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1718/3433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:24.841839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:24.845921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:24.846333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:24.846715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:24.866889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293876e7-3e8c-4e10-8b6c-90a02b4b7af2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:24.874309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:24.875711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:24.876268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:24.876713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:24.877496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] MFA Rules not processed for user `65fa96c0dcf948d185e7d5fdcf280fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:24.879612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:24.881164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:24.883718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:24.891426 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1719/3434] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:24.903299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:24.905481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:24.936913 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1716/3435] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:11:24 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:24.941556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:25.033717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aeeaf-8533-4964-a8f5-47b9c36dce33 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:25.040918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eec01-db90-4d9e-9df8-7b5c44ab4e27 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:25.048395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:25.049524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:25.049816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:25.050266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:25.051686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:25.054296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:25.086145 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1717/3436] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:11:24 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:25.092033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:25.113707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b81bf-06ab-48ba-86c7-9b65bc8e1b5e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:25.120997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:25.122372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:25.123027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:25.123518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:25.124565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:25.126228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:25.129739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:25.146225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:25.147692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:25.148137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:25.148508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:25.151313 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1718/3437] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:25.155695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:25.236026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:25.237986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:25.260933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967581c3-3913-4985-9646-d3ff43a1020f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:25.261542 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1720/3438] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:25.262691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:25.267294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:25.268676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:25.270096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:25.270385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:25.272781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:25.312640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed77820-d0c0-4ca0-b6f4-ddefc8a5fe08 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:25.312774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:25.317110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:25.332672 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1719/3439] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:25.352280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:25.353386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:25.353739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:25.354078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] PATH_INFO: `/v3/projects/8ec9cc48ad274c40992a64efc76dac39/users/a515052b9fa24db68d9878c44dac8be6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:25.372023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec9cc48ad274c40992a64efc76dac39, user_id=a515052b9fa24db68d9878c44dac8be6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:25.374979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:25.414589 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1721/3440] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:25 2022] PUT /identity/v3/projects/8ec9cc48ad274c40992a64efc76dac39/users/a515052b9fa24db68d9878c44dac8be6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:25.418230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:25.437350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94103-c341-4331-92bf-9b1c7f8c9831 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:25.468160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:25.514112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:25.514838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:25.515269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:25.515580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:25.516381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:25.518368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:25.535051 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1720/3441] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:25.536359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:25.551245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f76ce7-e36f-4c50-a1a3-9cdfae5c089d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:25.556981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9eb6e-4055-4cb9-91f8-69b871c74c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:25.558775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9eb6e-4055-4cb9-91f8-69b871c74c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:25.558964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9eb6e-4055-4cb9-91f8-69b871c74c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:25.559246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9eb6e-4055-4cb9-91f8-69b871c74c3a admin admin] PATH_INFO: `/v3/projects/8ec9cc48ad274c40992a64efc76dac39/users/a515052b9fa24db68d9878c44dac8be6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:25.561721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9eb6e-4055-4cb9-91f8-69b871c74c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec9cc48ad274c40992a64efc76dac39, user_id=a515052b9fa24db68d9878c44dac8be6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:25.564318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9eb6e-4055-4cb9-91f8-69b871c74c3a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:25.587125 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1722/3442] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:25 2022] PUT /identity/v3/projects/8ec9cc48ad274c40992a64efc76dac39/users/a515052b9fa24db68d9878c44dac8be6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:26.402735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:26.406447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:26.672186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17776c5-a492-4d9c-82fe-9484c7fef18e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:26.826645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28dbcd-3aa2-486f-904f-b62e1a2cc01a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:26.827566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28dbcd-3aa2-486f-904f-b62e1a2cc01a service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:26.828012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28dbcd-3aa2-486f-904f-b62e1a2cc01a service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:26.828437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28dbcd-3aa2-486f-904f-b62e1a2cc01a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:26.831331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9a28dbcd-3aa2-486f-904f-b62e1a2cc01a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:26.881501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28dbcd-3aa2-486f-904f-b62e1a2cc01a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:26.883219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28dbcd-3aa2-486f-904f-b62e1a2cc01a service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:26.949903 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1721/3443] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:26.952760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:26.954144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:26.954635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:27.025610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] MFA Rules not processed for user `65fa96c0dcf948d185e7d5fdcf280fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:27.038127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:27.188987 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1723/3444] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:36.899342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:37.179140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:37.941456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41537-99e3-4d62-a4d9-e1af1cbefd10 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:37.941456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41537-99e3-4d62-a4d9-e1af1cbefd10 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:37.942945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41537-99e3-4d62-a4d9-e1af1cbefd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:38.054349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-40c41537-99e3-4d62-a4d9-e1af1cbefd10 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:38.076407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40c41537-99e3-4d62-a4d9-e1af1cbefd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:38.363866 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1722/3445] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:11:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:38.383953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:38.386754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:38.584970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf66496-d92e-4a17-87fe-5fa344a511eb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:38.604613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:38.605947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:38.606264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:38.606596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:38.626054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:38.627974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:38.643731 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1724/3446] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:11:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:11:38.859576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4641a6-bd52-4f3f-aafe-a22017d93155 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:38.859873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4641a6-bd52-4f3f-aafe-a22017d93155 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:38.860155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4641a6-bd52-4f3f-aafe-a22017d93155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:38.942843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2f4641a6-bd52-4f3f-aafe-a22017d93155 None None] MFA Rules not processed for user `a515052b9fa24db68d9878c44dac8be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:38.945022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2f4641a6-bd52-4f3f-aafe-a22017d93155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:39.150232 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1723/3447] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:39.160601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:39.162830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:39.432728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f6d1e-f53c-47ec-b08b-d12e1e9bfa7b service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:39.443767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd865eb-aef1-431e-8088-9d2a64207f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:39.444554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd865eb-aef1-431e-8088-9d2a64207f69 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:39.445078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd865eb-aef1-431e-8088-9d2a64207f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:39.445451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd865eb-aef1-431e-8088-9d2a64207f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:39.643055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd865eb-aef1-431e-8088-9d2a64207f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:39.644885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd865eb-aef1-431e-8088-9d2a64207f69 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:39.679194 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1725/3448] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:40.425475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4641a6-bd52-4f3f-aafe-a22017d93155 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:40.654466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:40.660667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4641a6-bd52-4f3f-aafe-a22017d93155 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:40.673882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:40.683145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:40.683360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:40.683727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:40.693748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:40.767487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:40.772318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:40.802370 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1724/3449] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:42.412301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb77f0-9dc8-464f-9ae1-cb19498ddae0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:42.412915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb77f0-9dc8-464f-9ae1-cb19498ddae0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:42.412915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb77f0-9dc8-464f-9ae1-cb19498ddae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:42.511459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8ecb77f0-9dc8-464f-9ae1-cb19498ddae0 None None] MFA Rules not processed for user `27c40405bf7547b4b1b896b142ea4156`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:11:42.513800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8ecb77f0-9dc8-464f-9ae1-cb19498ddae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:42.619936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:42.701103 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1726/3450] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:11:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:11:42.702316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:42.826786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810daec-512b-44b9-b176-8f7ebedaefc3 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:42.832376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:42.833354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:42.833742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:42.834627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:42.835359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:42.837578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:42.911897 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1725/3451] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:11:42 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:42.913911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb77f0-9dc8-464f-9ae1-cb19498ddae0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:42.927137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb77f0-9dc8-464f-9ae1-cb19498ddae0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:43.021253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:43.022588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:43.023629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:43.024115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:43.026289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:43.028681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:43.072941 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1727/3452] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:11:42 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:11:43.074228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:43.094371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94797796-6940-438d-8679-97fd11cd56a8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:43.107620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:43.108808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:43.109236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:43.109640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:43.113293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:43.116099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:43.145249 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1726/3453] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:43.152944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:43.170390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a534734-c183-4f8c-858c-efa1a594afda admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:43.177884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:43.178842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:43.179126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:43.179403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] PATH_INFO: `/v3/projects/0a127c872bca439da95648029d28bef2/users/fb5c8b75df134bb2ab746367194ba966/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:43.199927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a127c872bca439da95648029d28bef2, user_id=fb5c8b75df134bb2ab746367194ba966, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:43.208959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:43.233838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:43.245533 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1728/3454] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:43 2022] PUT /identity/v3/projects/0a127c872bca439da95648029d28bef2/users/fb5c8b75df134bb2ab746367194ba966/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:43.247851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90971-237e-499f-856d-33cd10f9f0af admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:43.358637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:43.359342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:43.359622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:43.359897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:43.361159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:43.362831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:43.381667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:43.398170 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1727/3455] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:11:43.401621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c317ee-d6b2-4566-97c7-d1ab49f64394 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:43.406881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:43.408805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:43.409215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:43.409492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] PATH_INFO: `/v3/projects/0a127c872bca439da95648029d28bef2/users/fb5c8b75df134bb2ab746367194ba966/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:43.412544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a127c872bca439da95648029d28bef2, user_id=fb5c8b75df134bb2ab746367194ba966, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:43.415408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:43.430098 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1729/3456] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:11:43 2022] PUT /identity/v3/projects/0a127c872bca439da95648029d28bef2/users/fb5c8b75df134bb2ab746367194ba966/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:11:53.372978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:53.424780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:56.701540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:56.707451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:57.035597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4343f81-ecbc-480b-b812-cd9276ae025f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:57.361701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:57.367239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:57.367239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:57.370700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:57.376263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:57.429428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:57.439595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:57.480301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1728/3457] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:58.108486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:58.110605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:58.261253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebc50-84c7-48cc-a4ae-999b9dda235b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:58.270550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c5ff-aff4-4560-95cf-6becfc73ca80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:58.273728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c5ff-aff4-4560-95cf-6becfc73ca80 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:58.274432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c5ff-aff4-4560-95cf-6becfc73ca80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:58.274947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c5ff-aff4-4560-95cf-6becfc73ca80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:58.282183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-efd8c5ff-aff4-4560-95cf-6becfc73ca80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:11:58.301602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c5ff-aff4-4560-95cf-6becfc73ca80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:58.304596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c5ff-aff4-4560-95cf-6becfc73ca80 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:58.323143 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1730/3458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:11:58.418205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:11:58.453600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0edf3-7b0c-43a5-95f7-ace87e15b46f service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:11:58.467029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:11:58.468166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:11:58.468609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:11:58.469080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:11:58.496090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:11:58.502736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:11:58.535884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1729/3459] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:11:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:12:00.483319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:00.484326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:00.484852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:00.547091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] MFA Rules not processed for user `fb5c8b75df134bb2ab746367194ba966`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:00.554128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:00.819392 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1731/3460] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:00.820613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:00.822997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:01.040913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d576b-2f34-48ca-9aa1-093cc671a1b2 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:01.060365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:01.066823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:01.067731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:01.067969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:01.113346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:01.117712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:01.151337 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1730/3461] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:12:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:12:02.324027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:02.326789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:03.005676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1b66d-27f0-455a-b407-0a74aeed206c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:03.066271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:03.078018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:03.078309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:03.078778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] PATH_INFO: `/v3/users/fef0c44eb8be4d1fbf6caeedacf7ac21` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:03.087885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef0c44eb8be4d1fbf6caeedacf7ac21)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:03.098766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:03.312248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:03.518293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef0c44eb8be4d1fbf6caeedacf7ac21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:03.524288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef0c44eb8be4d1fbf6caeedacf7ac21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:03.631705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef0c44eb8be4d1fbf6caeedacf7ac21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:03.640770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef0c44eb8be4d1fbf6caeedacf7ac21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:03.675307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ec75f28-9ae5-48c4-8841-e22a0979650c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef0c44eb8be4d1fbf6caeedacf7ac21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:03.718340 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1732/3462] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:12:02 2022] DELETE /identity/v3/users/fef0c44eb8be4d1fbf6caeedacf7ac21 => generated 0 bytes in 1395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:12:06.142404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:06.181952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc7845-ed1f-460d-be57-aaa7669771cf service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:06.244846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:06.525535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:06.527855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:06.528912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:06.529351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] PATH_INFO: `/v3/projects/be82e54d6aa74bb09a543b6b225b9676` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:06.535242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be82e54d6aa74bb09a543b6b225b9676)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:06.541071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:06.661851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be82e54d6aa74bb09a543b6b225b9676', 'request_id': 'req-453412f9-32d8-4c58-bc08-37065233fa5d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:06.711107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be82e54d6aa74bb09a543b6b225b9676', 'request_id': 'req-453412f9-32d8-4c58-bc08-37065233fa5d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:06.763778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be82e54d6aa74bb09a543b6b225b9676', 'request_id': 'req-453412f9-32d8-4c58-bc08-37065233fa5d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:06.830183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] The token cache is being invalidate because project be82e54d6aa74bb09a543b6b225b9676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:12:06.830616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:06.833481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-453412f9-32d8-4c58-bc08-37065233fa5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:06.846737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1731/3463] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:06 2022] DELETE /identity/v3/projects/be82e54d6aa74bb09a543b6b225b9676 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:12:06.853048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e996d84-cecb-4bbc-8c61-b9e5d27b2ae1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:06.853698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e996d84-cecb-4bbc-8c61-b9e5d27b2ae1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:06.853698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e996d84-cecb-4bbc-8c61-b9e5d27b2ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:06.926937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5e996d84-cecb-4bbc-8c61-b9e5d27b2ae1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:06.936911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5e996d84-cecb-4bbc-8c61-b9e5d27b2ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:07.299813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1733/3464] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:07.307096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb71e-3d68-46cd-a835-133ac206851f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:07.308019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb71e-3d68-46cd-a835-133ac206851f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:07.308019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb71e-3d68-46cd-a835-133ac206851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:07.356159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-265eb71e-3d68-46cd-a835-133ac206851f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:07.362056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-265eb71e-3d68-46cd-a835-133ac206851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:07.403478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1732/3465] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:07.404602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e996d84-cecb-4bbc-8c61-b9e5d27b2ae1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:07.463536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e996d84-cecb-4bbc-8c61-b9e5d27b2ae1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:07.485492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:07.492115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:07.492598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:07.494071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:07.495874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:12:07.500343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:07.506051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:07.554802 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1734/3466] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:12:07.555410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eb71e-3d68-46cd-a835-133ac206851f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:07.569833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eb71e-3d68-46cd-a835-133ac206851f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:07.617825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:07.618701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:07.619106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:07.621751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:07.629274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:07.629274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:07.752586 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1733/3467] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:12:07 2022] POST /identity/v3/projects => generated 395 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:12:07.754446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:07.778073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5f00b-4631-489f-b424-e59adda45a13 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:07.920616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:07.921388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:07.921617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:07.922055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:07.923053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:07.926097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:07.968288 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1735/3468] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:12:07 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:12:07.972883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:07.988087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7688f2-e82d-473b-9ee9-dc06b6ee625b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:07.994441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:07.995260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:07.995540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:07.995853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:07.997341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:07.999028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:08.017077 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1734/3469] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:12:08.019119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:08.052213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c187-0f04-4871-a93a-06d38a0d045f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:08.068550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9235455-c62e-4215-b7f9-4ac1aae0f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:08.072104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9235455-c62e-4215-b7f9-4ac1aae0f70b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:08.072552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9235455-c62e-4215-b7f9-4ac1aae0f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:08.074412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9235455-c62e-4215-b7f9-4ac1aae0f70b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:08.077184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9235455-c62e-4215-b7f9-4ac1aae0f70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:08.081212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9235455-c62e-4215-b7f9-4ac1aae0f70b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:08.136931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1736/3470] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:12:08.141667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:08.158762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975e76-2a41-4a15-a4f2-71656b4509ad admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:08.182441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:08.188186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:08.188830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:08.189161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] PATH_INFO: `/v3/projects/c66aab4ab90e4ee1be5a36496447d1a2/users/519822988db142fba7e027f3dd1109a7/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:08.262287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66aab4ab90e4ee1be5a36496447d1a2, user_id=519822988db142fba7e027f3dd1109a7, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:08.273500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:08.298553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1735/3471] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:12:08 2022] PUT /identity/v3/projects/c66aab4ab90e4ee1be5a36496447d1a2/users/519822988db142fba7e027f3dd1109a7/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:12:08.303863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa565-fa8e-42d8-951c-7822ff173e82 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:08.304280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa565-fa8e-42d8-951c-7822ff173e82 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:08.304715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa565-fa8e-42d8-951c-7822ff173e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:08.335756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-64ffa565-fa8e-42d8-951c-7822ff173e82 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:08.347282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64ffa565-fa8e-42d8-951c-7822ff173e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:08.360775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:08.490119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1737/3472] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:08.500344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:08.502362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:08.711238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:08.751092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6d354-d47f-46d9-a312-40c046f07c55 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:08.764483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0cc2e-8fab-43b1-9eea-6430d34f3853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:08.765711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0cc2e-8fab-43b1-9eea-6430d34f3853 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:08.766302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0cc2e-8fab-43b1-9eea-6430d34f3853 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:08.766787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0cc2e-8fab-43b1-9eea-6430d34f3853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:08.784887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0cc2e-8fab-43b1-9eea-6430d34f3853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:08.786844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0cc2e-8fab-43b1-9eea-6430d34f3853 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:08.801264 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1736/3473] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:12:12.045645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f313-fda8-44f6-ab2f-ba7bc8da13e6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:12.046222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f313-fda8-44f6-ab2f-ba7bc8da13e6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:12.046604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2f313-fda8-44f6-ab2f-ba7bc8da13e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:12.083653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-80c2f313-fda8-44f6-ab2f-ba7bc8da13e6 None None] MFA Rules not processed for user `a8eb1a760d644f97bf3aae882e905b85`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:12.085799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-80c2f313-fda8-44f6-ab2f-ba7bc8da13e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:12.289813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1738/3474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:12.318490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af3dd7-92bf-4bf9-935d-171638ccbc7d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:12.318490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af3dd7-92bf-4bf9-935d-171638ccbc7d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:12.318490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af3dd7-92bf-4bf9-935d-171638ccbc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:12.333484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-59af3dd7-92bf-4bf9-935d-171638ccbc7d None None] MFA Rules not processed for user `a8eb1a760d644f97bf3aae882e905b85`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:12.334944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-59af3dd7-92bf-4bf9-935d-171638ccbc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:12.351813 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1737/3475] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:14.442910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f313-fda8-44f6-ab2f-ba7bc8da13e6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:14.454791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2f313-fda8-44f6-ab2f-ba7bc8da13e6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:14.459664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fb892-981d-4926-8c09-b60b66249198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:14.460662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fb892-981d-4926-8c09-b60b66249198 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:14.461819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fb892-981d-4926-8c09-b60b66249198 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:14.462198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fb892-981d-4926-8c09-b60b66249198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:14.468668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fc5fb892-981d-4926-8c09-b60b66249198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:14.482066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fb892-981d-4926-8c09-b60b66249198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:14.483639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fb892-981d-4926-8c09-b60b66249198 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:14.502904 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1739/3476] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:12:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:12:14.908216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:14.909369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:14.909885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:14.936368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] MFA Rules not processed for user `0e8a394c0a284416ac893321bd860e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:14.938569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:15.081243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1738/3477] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:15.828679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0adb9-a8c2-4201-aced-f81638b19c95 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:15.829289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0adb9-a8c2-4201-aced-f81638b19c95 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:15.829289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0adb9-a8c2-4201-aced-f81638b19c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:15.851240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0dc0adb9-a8c2-4201-aced-f81638b19c95 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:15.852636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0dc0adb9-a8c2-4201-aced-f81638b19c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:15.919114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1740/3478] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:12:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:15.932392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:15.934029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:16.029144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edd5b2-32cd-464b-aa6b-6ac9a723b0bf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:16.036436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984ca55-bd12-43fa-bf7f-d5f811822236 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:16.037240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ca55-bd12-43fa-bf7f-d5f811822236 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:16.037618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ca55-bd12-43fa-bf7f-d5f811822236 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:16.037938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ca55-bd12-43fa-bf7f-d5f811822236 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:16.048538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984ca55-bd12-43fa-bf7f-d5f811822236 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:16.050642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984ca55-bd12-43fa-bf7f-d5f811822236 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:16.061724 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1739/3479] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:12:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:12:20.968617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:20.969227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:20.969227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:21.039308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] MFA Rules not processed for user `519822988db142fba7e027f3dd1109a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:21.042245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:21.143597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:21.239737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e4a9-4bd0-47e7-8e5d-9f4de9b5a954 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:21.240839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e4a9-4bd0-47e7-8e5d-9f4de9b5a954 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:21.241500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e4a9-4bd0-47e7-8e5d-9f4de9b5a954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:21.242521 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1741/3480] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:21.278154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2a58e4a9-4bd0-47e7-8e5d-9f4de9b5a954 None None] MFA Rules not processed for user `519822988db142fba7e027f3dd1109a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:21.279857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2a58e4a9-4bd0-47e7-8e5d-9f4de9b5a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:21.288915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1740/3481] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:12:22.180500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:22.182323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:22.350706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975a760-c77d-4086-91ed-1909667843c7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:22.368683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:22.370172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:22.373009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:22.373509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:22.387896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:22.390301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:22.403645 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1742/3482] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:12:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:12:26.775671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:26.776580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:26.777173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:26.845727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:26.856709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:26.893128 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1741/3483] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:12:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:26.922376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:26.944062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbd6e7-81d7-415d-a90d-a6be2f0921a0 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:26.997018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5591cd-45d9-4ae8-90ed-7e370f1f91b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:27.002641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5591cd-45d9-4ae8-90ed-7e370f1f91b6 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:27.004229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5591cd-45d9-4ae8-90ed-7e370f1f91b6 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:27.004667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5591cd-45d9-4ae8-90ed-7e370f1f91b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:27.060283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5591cd-45d9-4ae8-90ed-7e370f1f91b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:27.065292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5591cd-45d9-4ae8-90ed-7e370f1f91b6 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:27.097703 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1743/3484] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:12:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:12:36.800883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=74 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:37.080574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=49 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:37.313493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:37.315250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:37.332978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facb494-6e7b-406f-8b18-3a71c6e50b68 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:37.339249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29a35a-83af-42dd-9f5a-1a58bdc73b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:37.340239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29a35a-83af-42dd-9f5a-1a58bdc73b77 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:37.340658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29a35a-83af-42dd-9f5a-1a58bdc73b77 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:37.341123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29a35a-83af-42dd-9f5a-1a58bdc73b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:37.343268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5e29a35a-83af-42dd-9f5a-1a58bdc73b77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:37.417219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29a35a-83af-42dd-9f5a-1a58bdc73b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:37.420210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29a35a-83af-42dd-9f5a-1a58bdc73b77 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:37.431658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1742/3485] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:12:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:12:39.883738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3fd1-8090-4bde-8e91-56a8bf1efad6 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:39.887766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3fd1-8090-4bde-8e91-56a8bf1efad6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:39.887766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3fd1-8090-4bde-8e91-56a8bf1efad6 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:39.887766 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1744/3486] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:12:39.902187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5840c-be45-4f0e-89d2-ebcdcf427c86 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:39.902650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5840c-be45-4f0e-89d2-ebcdcf427c86 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:39.902729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5840c-be45-4f0e-89d2-ebcdcf427c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:39.953468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-59f5840c-be45-4f0e-89d2-ebcdcf427c86 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:39.954614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-59f5840c-be45-4f0e-89d2-ebcdcf427c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:40.068295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1743/3487] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:12:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:12:40.089695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da3fd1-8090-4bde-8e91-56a8bf1efad6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:40.092308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-67da3fd1-8090-4bde-8e91-56a8bf1efad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:40.125247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da3fd1-8090-4bde-8e91-56a8bf1efad6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:40.144544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d20ac-017e-45ce-8620-d458bd4a303d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:40.145964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d20ac-017e-45ce-8620-d458bd4a303d service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:40.146402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d20ac-017e-45ce-8620-d458bd4a303d service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:40.146879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d20ac-017e-45ce-8620-d458bd4a303d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:40.172945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d20ac-017e-45ce-8620-d458bd4a303d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:40.175068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d20ac-017e-45ce-8620-d458bd4a303d service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:40.200216 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1745/3488] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:12:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:12:41.002292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc982a-e8d6-4375-b8c9-e897ba5b984e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:41.002753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc982a-e8d6-4375-b8c9-e897ba5b984e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:41.002832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc982a-e8d6-4375-b8c9-e897ba5b984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:41.071338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3ecc982a-e8d6-4375-b8c9-e897ba5b984e None None] MFA Rules not processed for user `27c40405bf7547b4b1b896b142ea4156`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:41.072629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3ecc982a-e8d6-4375-b8c9-e897ba5b984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:41.092413 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1744/3489] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:46.280828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:46.281697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:46.283860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:46.399579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:46.401562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:46.442022 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1746/3490] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:12:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:12:46.451864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc982a-e8d6-4375-b8c9-e897ba5b984e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:46.543461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc982a-e8d6-4375-b8c9-e897ba5b984e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:46.602388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:46.605567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:46.606029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:46.606480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:46.648760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:46.655400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:46.685151 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1745/3491] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:12:48.270737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:48.279241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:48.354132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdc951-bb21-47b6-a104-27caff798561 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:48.370162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:48.371537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:48.376659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:48.377139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] PATH_INFO: `/v3/users/48b167cdb1054ef5bfadd851be67e8aa` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:48.378828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b167cdb1054ef5bfadd851be67e8aa)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:48.381435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:48.610806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b167cdb1054ef5bfadd851be67e8aa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:48.616246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b167cdb1054ef5bfadd851be67e8aa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:48.678292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b167cdb1054ef5bfadd851be67e8aa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:48.680015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b167cdb1054ef5bfadd851be67e8aa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:48.717819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4253053a-5813-4625-8736-0a76234ffd35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b167cdb1054ef5bfadd851be67e8aa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:48.771704 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1747/3492] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:12:48 2022] DELETE /identity/v3/users/48b167cdb1054ef5bfadd851be67e8aa => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:12:49.618557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:49.672007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192dc7f-a574-4ac7-8094-544ea2260f0d service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:49.766486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:49.789249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:49.790558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:49.791044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:49.793447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] PATH_INFO: `/v3/projects/965efce4648a472eb15b6d1c0f8c6615` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:49.795113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965efce4648a472eb15b6d1c0f8c6615)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:49.801231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:49.919765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965efce4648a472eb15b6d1c0f8c6615', 'request_id': 'req-b09c618c-5124-4c89-a91b-22e5076c0358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:49.929249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965efce4648a472eb15b6d1c0f8c6615', 'request_id': 'req-b09c618c-5124-4c89-a91b-22e5076c0358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:49.947188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965efce4648a472eb15b6d1c0f8c6615', 'request_id': 'req-b09c618c-5124-4c89-a91b-22e5076c0358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:49.997666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] The token cache is being invalidate because project 965efce4648a472eb15b6d1c0f8c6615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:12:49.997968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:50.004959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b09c618c-5124-4c89-a91b-22e5076c0358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:12:50.024401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8760dc-73e6-4543-bff0-f81a8dce1d15 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.025393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8760dc-73e6-4543-bff0-f81a8dce1d15 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.025873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8760dc-73e6-4543-bff0-f81a8dce1d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.027470 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1746/3493] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:49 2022] DELETE /identity/v3/projects/965efce4648a472eb15b6d1c0f8c6615 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:12:50.061696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cc8760dc-73e6-4543-bff0-f81a8dce1d15 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:50.063243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cc8760dc-73e6-4543-bff0-f81a8dce1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:50.186656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcbc13-4479-49eb-9dd0-f66112eea796 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.187241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcbc13-4479-49eb-9dd0-f66112eea796 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.187696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcbc13-4479-49eb-9dd0-f66112eea796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.197218 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1748/3494] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:50.217639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c9fcbc13-4479-49eb-9dd0-f66112eea796 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:50.219686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c9fcbc13-4479-49eb-9dd0-f66112eea796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:50.233684 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1747/3495] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:12:50.238996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8760dc-73e6-4543-bff0-f81a8dce1d15 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:50.257437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8760dc-73e6-4543-bff0-f81a8dce1d15 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:50.264373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:50.265167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.265370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.265721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.266639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:12:50.266945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:50.268559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:50.285822 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1749/3496] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:12:50.287370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcbc13-4479-49eb-9dd0-f66112eea796 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:50.321992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcbc13-4479-49eb-9dd0-f66112eea796 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:50.330850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:50.332793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.332957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.333414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.334323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:50.337263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:50.378260 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1748/3497] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:12:50 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:12:50.379021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:50.392806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd34f7-4aba-4154-8b2c-c0139d013ed3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:50.397561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:50.477003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:50.478061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.478589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.479078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.480261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:50.483975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:50.535380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:50.536480 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1750/3498] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:12:50 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:12:50.551837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f09fee-7499-4305-b0cb-10b66cc07f88 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:50.575891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:50.577098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.577763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.578219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.579167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:50.581983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:50.601676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:50.608939 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1749/3499] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:12:50.613780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6ac7a-792b-4bae-a36a-0a005c0eaab5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:50.619262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6debdd6-a8ab-4aa3-a4f1-88343960c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:50.620249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6debdd6-a8ab-4aa3-a4f1-88343960c783 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.620753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6debdd6-a8ab-4aa3-a4f1-88343960c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.621295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6debdd6-a8ab-4aa3-a4f1-88343960c783 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.622266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6debdd6-a8ab-4aa3-a4f1-88343960c783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:50.624608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6debdd6-a8ab-4aa3-a4f1-88343960c783 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:50.648794 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1751/3500] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:12:50.650300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:50.662707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101a94e-9528-496a-8582-56bd5a6fc57c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:50.667814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a87a92-d222-423a-9621-070328db588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:50.668720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a87a92-d222-423a-9621-070328db588c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.669275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a87a92-d222-423a-9621-070328db588c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.669725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a87a92-d222-423a-9621-070328db588c admin admin] PATH_INFO: `/v3/projects/f4f6c403962a44408ce491f377e5ab11/users/2a7f3b25d8234bf881b76473dbfd8fc7/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.689548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a87a92-d222-423a-9621-070328db588c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f6c403962a44408ce491f377e5ab11, user_id=2a7f3b25d8234bf881b76473dbfd8fc7, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:50.693342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a87a92-d222-423a-9621-070328db588c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:50.713609 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1750/3501] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:12:50 2022] PUT /identity/v3/projects/f4f6c403962a44408ce491f377e5ab11/users/2a7f3b25d8234bf881b76473dbfd8fc7/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:12:50.717403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.718012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.718299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:50.744698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:12:50.745950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:50.823931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1752/3502] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:12:50.849849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a87a92-d222-423a-9621-070328db588c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:12:50.853610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05a87a92-d222-423a-9621-070328db588c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:12:50.975640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a87a92-d222-423a-9621-070328db588c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:12:50.982540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180d9e2-91c4-47b9-a4d6-e378201b25c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:12:50.983232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180d9e2-91c4-47b9-a4d6-e378201b25c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:12:50.983517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180d9e2-91c4-47b9-a4d6-e378201b25c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:12:50.984564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180d9e2-91c4-47b9-a4d6-e378201b25c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:12:51.000632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180d9e2-91c4-47b9-a4d6-e378201b25c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:12:51.002149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180d9e2-91c4-47b9-a4d6-e378201b25c1 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:12:51.015810 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1751/3503] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:00.811527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:01.010107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:03.905691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:03.908567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:04.102000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b0ff6-8262-40af-a6bb-06c84630efe9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:04.108913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:04.109889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:04.110582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:04.110961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:04.120390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:04.121993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72ec9-ccaa-4bcd-b189-c6484c7aac54 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:04.122870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72ec9-ccaa-4bcd-b189-c6484c7aac54 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:04.123300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a72ec9-ccaa-4bcd-b189-c6484c7aac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:04.185373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-04a72ec9-ccaa-4bcd-b189-c6484c7aac54 None None] MFA Rules not processed for user `2a7f3b25d8234bf881b76473dbfd8fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:04.187471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-04a72ec9-ccaa-4bcd-b189-c6484c7aac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:04.196932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:04.198889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:04.211652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1753/3504] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:04.321269 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1752/3505] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:04.366407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:04.367881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:04.387838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b53011-c1f9-444c-921c-05f7a71924bf service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:04.393370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:04.394202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:04.394482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:04.394756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:04.404102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:04.405824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:04.428762 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1754/3506] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:04.806227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0580ef-8bea-44d6-97c4-838805ffc1ef None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:04.806823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0580ef-8bea-44d6-97c4-838805ffc1ef None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:04.807312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0580ef-8bea-44d6-97c4-838805ffc1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:04.834092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7a0580ef-8bea-44d6-97c4-838805ffc1ef None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:04.836742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7a0580ef-8bea-44d6-97c4-838805ffc1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:05.140679 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1753/3507] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:05.145366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:05.147410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:05.311264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b47d7e-4410-407a-a2b9-8d0823d64bdc service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:05.322133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:05.323430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:05.323721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:05.324000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:05.352329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:05.354026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:05.386264 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1755/3508] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:13:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:11.249653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb141d-8df0-49b2-a9fc-265ce6c83916 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:11.250224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb141d-8df0-49b2-a9fc-265ce6c83916 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:11.250995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb141d-8df0-49b2-a9fc-265ce6c83916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:11.302353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-43bb141d-8df0-49b2-a9fc-265ce6c83916 None None] MFA Rules not processed for user `2a7f3b25d8234bf881b76473dbfd8fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:11.306471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-43bb141d-8df0-49b2-a9fc-265ce6c83916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:11.325655 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1754/3509] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:15.366229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:19.899526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:19.917806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482a7dc-fb03-4ac7-9205-5adbce39bcda service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:19.929889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360798-85c9-4da3-ad6e-5132901f83e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:19.932439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360798-85c9-4da3-ad6e-5132901f83e2 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:19.932739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360798-85c9-4da3-ad6e-5132901f83e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:19.933020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360798-85c9-4da3-ad6e-5132901f83e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:19.943584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b0360798-85c9-4da3-ad6e-5132901f83e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:19.968858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360798-85c9-4da3-ad6e-5132901f83e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:19.973727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360798-85c9-4da3-ad6e-5132901f83e2 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:20.005255 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1756/3510] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:21.284108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=60 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:24.150420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb34f7-4c29-4ad0-be3d-a5a19c74de6a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:24.151283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb34f7-4c29-4ad0-be3d-a5a19c74de6a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:24.151602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb34f7-4c29-4ad0-be3d-a5a19c74de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:24.197372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4bbb34f7-4c29-4ad0-be3d-a5a19c74de6a None None] MFA Rules not processed for user `65fa96c0dcf948d185e7d5fdcf280fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:24.203546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4bbb34f7-4c29-4ad0-be3d-a5a19c74de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:24.309835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a5c98-8428-4a24-b187-e92994f5bcfa None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:24.310379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a5c98-8428-4a24-b187-e92994f5bcfa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:24.310379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a5c98-8428-4a24-b187-e92994f5bcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:24.353590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-039a5c98-8428-4a24-b187-e92994f5bcfa None None] MFA Rules not processed for user `0e8a394c0a284416ac893321bd860e51`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:24.363349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-039a5c98-8428-4a24-b187-e92994f5bcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:24.398988 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1755/3511] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:24.477914 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1757/3512] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:13:31.405233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb34f7-4c29-4ad0-be3d-a5a19c74de6a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:31.417190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb34f7-4c29-4ad0-be3d-a5a19c74de6a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:31.422070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:31.422973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:31.423415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:31.424050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:31.426343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:31.440320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:31.442123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:31.460763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1756/3513] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:34.462188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=31 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:39.230236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded2f7-1cd1-4654-abd6-98bd18c593ed None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:39.230931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded2f7-1cd1-4654-abd6-98bd18c593ed None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:39.230931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ded2f7-1cd1-4654-abd6-98bd18c593ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:39.251128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-00ded2f7-1cd1-4654-abd6-98bd18c593ed None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:39.252382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-00ded2f7-1cd1-4654-abd6-98bd18c593ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:39.260151 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1758/3514] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:13:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:39.277023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:39.289897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f2012-f620-4142-a76f-babe64884b27 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:39.295533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:39.296286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:39.296644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:39.298352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:39.308216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:39.309976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:39.319773 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1757/3515] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:40.223724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9de0-5819-4b33-9d0b-03e0fd54adfe None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:40.224290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9de0-5819-4b33-9d0b-03e0fd54adfe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:40.224757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf9de0-5819-4b33-9d0b-03e0fd54adfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:40.244705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dcdf9de0-5819-4b33-9d0b-03e0fd54adfe None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:40.247108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dcdf9de0-5819-4b33-9d0b-03e0fd54adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:40.256087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1759/3516] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:13:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:40.272980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:40.286052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c0427-5c7f-49e0-8978-487d0dbec46d service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:40.292772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:40.294217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:40.294698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:40.295691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:40.306757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:40.310629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:40.326528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1758/3517] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:13:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:41.461969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:41.462857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:41.463580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:41.504546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:41.506171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:41.515222 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1760/3518] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:13:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:13:41.530943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:41.543820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94ebf-b59e-4733-b030-23f2d2352ee6 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:41.555845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:41.556682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:41.557136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:41.557426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:41.570207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:41.572260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:41.594398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1759/3519] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:13:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:44.011089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:44.017162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:44.054545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99ad79-e2e2-4239-8ea9-fbab4abb24ec None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:44.060543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:44.061489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:44.061769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:44.062048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] PATH_INFO: `/v3/users/1b0598fbccf348148fda392a40bf0078` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:44.063301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0598fbccf348148fda392a40bf0078)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:44.065316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:44.144513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0598fbccf348148fda392a40bf0078'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.146261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0598fbccf348148fda392a40bf0078'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.160828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0598fbccf348148fda392a40bf0078'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.161612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0598fbccf348148fda392a40bf0078'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.173328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e10548db-da58-4da3-9a57-296282bbf2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0598fbccf348148fda392a40bf0078'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.192794 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1761/3520] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:13:44 2022] DELETE /identity/v3/users/1b0598fbccf348148fda392a40bf0078 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:13:44.713941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:44.728391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8070193-087e-4042-86b5-cf56f5ef897f service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:44.754653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147a9ae-5e57-43d4-a33f-54d46aea4d77 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:44.755204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147a9ae-5e57-43d4-a33f-54d46aea4d77 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:44.755728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147a9ae-5e57-43d4-a33f-54d46aea4d77 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:44.758145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1762/3521] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:13:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:13:44.762861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:44.763214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:44.763556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:44.785258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:44.786587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:44.805742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:44.807168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:44.807640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:44.807916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] PATH_INFO: `/v3/projects/637c113ab85b43cb815b1e6e2d868a29` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:44.809524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=637c113ab85b43cb815b1e6e2d868a29)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:44.812766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:44.856813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1763/3522] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:13:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:44.874591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637c113ab85b43cb815b1e6e2d868a29', 'request_id': 'req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.882661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637c113ab85b43cb815b1e6e2d868a29', 'request_id': 'req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.884574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:44.887061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:44.889087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:44.897990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637c113ab85b43cb815b1e6e2d868a29', 'request_id': 'req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.904744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47018d8-7f76-4c12-8158-2666f702ce03 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:44.911675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] The token cache is being invalidate because project 637c113ab85b43cb815b1e6e2d868a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:13:44.912014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.913822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:44.921139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1760/3523] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:44 2022] DELETE /identity/v3/projects/637c113ab85b43cb815b1e6e2d868a29 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:13:44.922339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:44.923767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:44.958188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:44.979326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c19066-45b6-43dd-94ce-dc09fca8cd7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:44.979992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19066-45b6-43dd-94ce-dc09fca8cd7e service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:44.980274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19066-45b6-43dd-94ce-dc09fca8cd7e service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:44.980551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19066-45b6-43dd-94ce-dc09fca8cd7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:44.982888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40c19066-45b6-43dd-94ce-dc09fca8cd7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:44.996520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c19066-45b6-43dd-94ce-dc09fca8cd7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:44.998421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c19066-45b6-43dd-94ce-dc09fca8cd7e service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:45.011213 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1764/3524] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:13:45.016426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950cbd-cac5-4f9d-8cf7-bbbf638f2bbd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:45.021548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:45.023460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.023979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.024457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] PATH_INFO: `/v3/users/b7f0f1fe26f546969d9f33194f8ed81f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.026176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f0f1fe26f546969d9f33194f8ed81f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:45.028818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:45.086142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f0f1fe26f546969d9f33194f8ed81f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.087201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f0f1fe26f546969d9f33194f8ed81f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.105962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f0f1fe26f546969d9f33194f8ed81f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.106799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f0f1fe26f546969d9f33194f8ed81f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.114100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-640f17c4-0b6d-4a49-852f-79a9c403a2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f0f1fe26f546969d9f33194f8ed81f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.129852 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1761/3525] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:13:44 2022] DELETE /identity/v3/users/b7f0f1fe26f546969d9f33194f8ed81f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:13:45.344364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9494d-7bd9-4cd3-a00d-90a4598804db None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.344660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9494d-7bd9-4cd3-a00d-90a4598804db None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.344940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9494d-7bd9-4cd3-a00d-90a4598804db None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.346510 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1765/3526] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:13:45.352175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.352554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.352908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.372900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:45.374360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:45.426083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9494d-7bd9-4cd3-a00d-90a4598804db None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:45.428505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-10c9494d-7bd9-4cd3-a00d-90a4598804db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:45.455973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:45.484617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1762/3527] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:13:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:45.528655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:45.530233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:45.530421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9494d-7bd9-4cd3-a00d-90a4598804db None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:45.535501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:45.536540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.536821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.537205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] PATH_INFO: `/v3/projects/3e33efced4864cb4926d277d8addb0d6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.538464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e33efced4864cb4926d277d8addb0d6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:45.540657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:45.553254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ddcd4-22cb-43ab-855f-fcefff56d873 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:45.570438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6c330-b81e-4eb5-aef3-00a213279d80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:45.571229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c330-b81e-4eb5-aef3-00a213279d80 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.571584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c330-b81e-4eb5-aef3-00a213279d80 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.571926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6c330-b81e-4eb5-aef3-00a213279d80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.594284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c330-b81e-4eb5-aef3-00a213279d80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:45.596251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6c330-b81e-4eb5-aef3-00a213279d80 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:45.610059 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1763/3528] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:45.643968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e33efced4864cb4926d277d8addb0d6', 'request_id': 'req-d5cf2be7-9961-493b-b33c-f6612867e0d7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.651802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e33efced4864cb4926d277d8addb0d6', 'request_id': 'req-d5cf2be7-9961-493b-b33c-f6612867e0d7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.663211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e33efced4864cb4926d277d8addb0d6', 'request_id': 'req-d5cf2be7-9961-493b-b33c-f6612867e0d7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.682963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] The token cache is being invalidate because project 3e33efced4864cb4926d277d8addb0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:13:45.683258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.684093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d5cf2be7-9961-493b-b33c-f6612867e0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:45.686157 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1766/3529] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:45 2022] DELETE /identity/v3/projects/3e33efced4864cb4926d277d8addb0d6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:13:45.692009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a612-5173-42d5-9cea-3fc113ac630f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.692326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a612-5173-42d5-9cea-3fc113ac630f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.693247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a612-5173-42d5-9cea-3fc113ac630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.714125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7db8a612-5173-42d5-9cea-3fc113ac630f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:45.715589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7db8a612-5173-42d5-9cea-3fc113ac630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:45.809218 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1764/3530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:45.813179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.813468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.813884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.841623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:45.842865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:45.852655 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1767/3531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:45.856786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8a612-5173-42d5-9cea-3fc113ac630f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:45.864267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:45.866290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:45.877134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8a612-5173-42d5-9cea-3fc113ac630f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:45.885530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:45.887271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.887556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.887833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.888698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:13:45.889122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:45.891968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:45.908111 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1765/3532] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:13:45.913218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:45.928401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaaab7-3c6c-47d2-b0d0-e28db9efb67f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:45.944123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:45.944806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.945126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.945409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.946171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:45.949435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:45.953239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b2bef-f161-449b-a9c3-6f9b899e0057 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:45.957016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:45.957831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:45.958699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:45.958699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:45.960244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:45.979247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:45.984191 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1766/3533] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:13:45 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:13:45.989544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:46.058993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:46.060587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:46.069702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15554a-dd28-4ea9-a7ca-93d111489ac2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:46.073234 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1768/3534] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:46.079567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:46.080265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:46.080551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:46.080826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:46.081713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:46.084231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:46.115454 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1767/3535] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:13:45 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:13:46.116739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:46.127707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599230f-729b-4f5f-9c3f-d0025b243b85 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:46.132512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:46.133234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:46.133662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:46.134070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:46.134821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:46.136449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:46.147346 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1769/3536] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:13:46.151440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:46.161756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f400f-a8fc-4a80-a021-7534233ed564 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:46.167045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735157a-8b31-4308-a4c0-89b20dee608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:46.167767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735157a-8b31-4308-a4c0-89b20dee608f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:46.168238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735157a-8b31-4308-a4c0-89b20dee608f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:46.168515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735157a-8b31-4308-a4c0-89b20dee608f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:46.169280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735157a-8b31-4308-a4c0-89b20dee608f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:46.170929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735157a-8b31-4308-a4c0-89b20dee608f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:46.182281 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1768/3537] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:13:46.186639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:46.197588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2595af-61bd-4469-80a7-6e160ccdd886 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:46.204140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:46.205342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:46.205651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:46.205931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] PATH_INFO: `/v3/projects/deaa53169cbd4a83aa39a825ee4a3a70/users/556851fde980466c99cb1873cdb30dea/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:46.224755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deaa53169cbd4a83aa39a825ee4a3a70, user_id=556851fde980466c99cb1873cdb30dea, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:46.228080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:46.257260 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1770/3538] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:13:46 2022] PUT /identity/v3/projects/deaa53169cbd4a83aa39a825ee4a3a70/users/556851fde980466c99cb1873cdb30dea/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:13:46.261693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37071f7-0c07-4df3-b7fd-b4cfdd611213 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:46.262227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37071f7-0c07-4df3-b7fd-b4cfdd611213 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:46.262722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37071f7-0c07-4df3-b7fd-b4cfdd611213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:46.283233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d37071f7-0c07-4df3-b7fd-b4cfdd611213 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:46.284730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d37071f7-0c07-4df3-b7fd-b4cfdd611213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:46.331472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:46.390099 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1769/3539] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:46.398376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:46.403257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:46.476084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4117-fdd6-4a46-9f0c-6dd001899b89 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:46.483965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e06efd-cb64-41ab-9e8e-a19196b2097a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:46.484645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e06efd-cb64-41ab-9e8e-a19196b2097a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:46.484921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e06efd-cb64-41ab-9e8e-a19196b2097a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:46.485281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e06efd-cb64-41ab-9e8e-a19196b2097a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:46.498306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e06efd-cb64-41ab-9e8e-a19196b2097a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:46.499838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e06efd-cb64-41ab-9e8e-a19196b2097a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:46.510870 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1771/3540] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:53.388738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:53.389261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:53.389358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:53.439997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] MFA Rules not processed for user `556851fde980466c99cb1873cdb30dea`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:53.441273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:53.544149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1770/3541] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:53.545752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f77a9-adbd-4414-96de-b87fc305796d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:53.546239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f77a9-adbd-4414-96de-b87fc305796d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:53.546323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f77a9-adbd-4414-96de-b87fc305796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:53.568501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-309f77a9-adbd-4414-96de-b87fc305796d None None] MFA Rules not processed for user `556851fde980466c99cb1873cdb30dea`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:53.569937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-309f77a9-adbd-4414-96de-b87fc305796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:53.580856 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1772/3542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:53.596822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:53.598583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:53.795090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251c53-89d6-4b7d-b9b3-dab563363c66 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:53.813578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67437805-2ca5-48ab-8486-88a535919bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:53.817472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437805-2ca5-48ab-8486-88a535919bc1 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:53.817901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437805-2ca5-48ab-8486-88a535919bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:53.818309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67437805-2ca5-48ab-8486-88a535919bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:53.836389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437805-2ca5-48ab-8486-88a535919bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:53.839054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67437805-2ca5-48ab-8486-88a535919bc1 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:53.876924 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1771/3543] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:54.441107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f77a9-adbd-4414-96de-b87fc305796d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:54.462274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f77a9-adbd-4414-96de-b87fc305796d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:54.467335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:54.468073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:54.468411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:54.468883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:54.487390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:54.506593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:54.508407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:54.519678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2989a78-ef68-4bc1-ab72-69b9467e1259 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:54.520183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2989a78-ef68-4bc1-ab72-69b9467e1259 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:54.520583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2989a78-ef68-4bc1-ab72-69b9467e1259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:54.532685 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1773/3544] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:54.571080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b2989a78-ef68-4bc1-ab72-69b9467e1259 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:54.572918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2989a78-ef68-4bc1-ab72-69b9467e1259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:54.639951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:54.678522 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1772/3545] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:54.686792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:54.688615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:54.781350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:54.812718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7c473-2e00-4a34-8e8c-e1fc5ea4ed37 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:54.821009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:54.821856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:54.822526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:54.822906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:54.837118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:54.839195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:54.854692 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1774/3546] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:55.294179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1456c-733f-4b63-b2aa-02188695747f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:55.295397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1456c-733f-4b63-b2aa-02188695747f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:55.295870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1456c-733f-4b63-b2aa-02188695747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:55.329468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-98a1456c-733f-4b63-b2aa-02188695747f None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:55.331475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-98a1456c-733f-4b63-b2aa-02188695747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:55.347581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1773/3547] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:13:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:13:55.355704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:55.370026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299eb71-103c-4357-ba17-5ddd84c7a91d service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:55.382668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:55.383637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:55.384294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:55.384843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:55.396876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:55.400276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:55.416411 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1775/3548] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:55.910433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:55.911340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:55.911835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:55.987548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:55.992251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:56.002969 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1774/3549] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:13:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:56.020696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:56.053387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d956-7caa-42ec-b7c3-5c36c169ca7c service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:56.082088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ab9d5-56c3-4428-98c2-eb1232ca347e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:56.083043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab9d5-56c3-4428-98c2-eb1232ca347e service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:56.083705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab9d5-56c3-4428-98c2-eb1232ca347e service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:56.084263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab9d5-56c3-4428-98c2-eb1232ca347e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:56.100198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ab9d5-56c3-4428-98c2-eb1232ca347e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:56.104490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ab9d5-56c3-4428-98c2-eb1232ca347e service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:56.136523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1776/3550] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:13:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:56.327306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:56.329393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:56.364674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61fd52-4d43-4e66-ac3f-f291f50d2d9c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:56.389321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:56.391757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:56.393279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:56.393731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] PATH_INFO: `/v3/users/c121277893cc4640a85bc96dcef6aef7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:56.395328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c121277893cc4640a85bc96dcef6aef7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:56.402016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:56.601638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c121277893cc4640a85bc96dcef6aef7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:56.606127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c121277893cc4640a85bc96dcef6aef7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:56.635360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c121277893cc4640a85bc96dcef6aef7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:56.636360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c121277893cc4640a85bc96dcef6aef7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:56.653782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c121277893cc4640a85bc96dcef6aef7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:56.682884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1775/3551] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:13:56 2022] DELETE /identity/v3/users/c121277893cc4640a85bc96dcef6aef7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:13:56.687496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:56.688020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:56.688511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:56.729506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:56.731046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:56.904623 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1777/3552] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:56.916933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:56.918674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:57.150240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a813c-940b-4075-9a5d-65a9a815a110 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:57.206781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ba175-b4f9-49de-855a-1a398bf3d45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:57.210370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba175-b4f9-49de-855a-1a398bf3d45f service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:57.210842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba175-b4f9-49de-855a-1a398bf3d45f service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:57.213457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba175-b4f9-49de-855a-1a398bf3d45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:57.250538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ba175-b4f9-49de-855a-1a398bf3d45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:57.256401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ba175-b4f9-49de-855a-1a398bf3d45f service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:57.287258 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1776/3553] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:57.735947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:57.737700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:57.780548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188bcfd-3204-48a2-a50f-04ea76a5a569 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:57.804051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:57.808643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:57.810766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:57.811083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] PATH_INFO: `/v3/projects/e29bd993bde443a7ae41414b603e05d5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:57.817308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29bd993bde443a7ae41414b603e05d5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:57.825570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:57.979126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29bd993bde443a7ae41414b603e05d5', 'request_id': 'req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:58.015230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29bd993bde443a7ae41414b603e05d5', 'request_id': 'req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:58.043131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29bd993bde443a7ae41414b603e05d5', 'request_id': 'req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:58.062541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] The token cache is being invalidate because project e29bd993bde443a7ae41414b603e05d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:13:58.063262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:58.064277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8fe4897b-1f05-4f10-8e36-14f294eb7dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:58.066186 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1778/3554] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:57 2022] DELETE /identity/v3/projects/e29bd993bde443a7ae41414b603e05d5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:13:58.071520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb694f-308c-44d4-ac0a-83e0137ccd6f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:58.072132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb694f-308c-44d4-ac0a-83e0137ccd6f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:58.072304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb694f-308c-44d4-ac0a-83e0137ccd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:58.101774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-22eb694f-308c-44d4-ac0a-83e0137ccd6f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:58.110856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22eb694f-308c-44d4-ac0a-83e0137ccd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:58.235004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:58.277289 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1777/3555] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:58.279510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581c89f-a47f-4c78-9630-f635ecc7f4ec None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:58.279864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581c89f-a47f-4c78-9630-f635ecc7f4ec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:58.280235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581c89f-a47f-4c78-9630-f635ecc7f4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:58.318982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d581c89f-a47f-4c78-9630-f635ecc7f4ec None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:58.322792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d581c89f-a47f-4c78-9630-f635ecc7f4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:58.358240 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1779/3556] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:58.362742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb694f-308c-44d4-ac0a-83e0137ccd6f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:58.380929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb694f-308c-44d4-ac0a-83e0137ccd6f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:58.399292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:58.400348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:58.400863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:58.401479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:58.402760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:13:58.403310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:58.405364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:58.453971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1778/3557] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:13:58.455259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581c89f-a47f-4c78-9630-f635ecc7f4ec None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:58.477470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581c89f-a47f-4c78-9630-f635ecc7f4ec None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:58.515130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:58.516004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:58.516296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:58.516567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:58.519807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:58.526717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:58.624409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:58.642212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ded1-6e66-4dee-8cc7-5d369f4b91b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:58.642760 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1780/3558] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:13:58 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:13:58.862944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:58.863747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:58.864272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:58.864598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:58.866681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:58.869286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:58.902763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1779/3559] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:13:58 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:13:58.907163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:58.935599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e173-dcc7-4893-9b3e-7b1975b92798 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:58.948386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:58.949202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:58.949459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:58.949818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:58.950685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:58.952970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:58.956519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:58.971392 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1781/3560] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:13:58.976593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:58.998115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d19b92-aa5c-4c6e-a37a-fe0835be4472 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:59.009718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06566a8-4aea-4cee-b26a-8e328891d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:59.010414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06566a8-4aea-4cee-b26a-8e328891d664 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:59.010815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06566a8-4aea-4cee-b26a-8e328891d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:59.011089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06566a8-4aea-4cee-b26a-8e328891d664 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:59.012558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06566a8-4aea-4cee-b26a-8e328891d664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:59.014101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06566a8-4aea-4cee-b26a-8e328891d664 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:59.029933 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1780/3561] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:13:59.032271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:59.061239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309c0ae-03fe-4717-88fa-c640acfeb92a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:59.082099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:59.083042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:59.083561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:59.084013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] PATH_INFO: `/v3/projects/bf239e913efa4a988fa15d81190ef460/users/7540d0c986e24129946197b3edf9560f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:59.121400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf239e913efa4a988fa15d81190ef460, user_id=7540d0c986e24129946197b3edf9560f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:59.135634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:59.167519 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1782/3562] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:13:59 2022] PUT /identity/v3/projects/bf239e913efa4a988fa15d81190ef460/users/7540d0c986e24129946197b3edf9560f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:13:59.179296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26d0c-5452-4361-84a1-692dc73bbf25 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:59.179756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26d0c-5452-4361-84a1-692dc73bbf25 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:59.180216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26d0c-5452-4361-84a1-692dc73bbf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:59.256004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dbd26d0c-5452-4361-84a1-692dc73bbf25 None None] MFA Rules not processed for user `7540d0c986e24129946197b3edf9560f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:13:59.258255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dbd26d0c-5452-4361-84a1-692dc73bbf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:59.407706 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1781/3563] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:13:59.421957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:59.430415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:13:59.548124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3f81f-ef74-47ad-8bca-3187c09d23cb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:59.555179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01822ab-f9b3-4d2a-873c-2d7411364a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:59.556025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01822ab-f9b3-4d2a-873c-2d7411364a7f service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:59.556308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01822ab-f9b3-4d2a-873c-2d7411364a7f service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:59.556586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01822ab-f9b3-4d2a-873c-2d7411364a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:59.573866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01822ab-f9b3-4d2a-873c-2d7411364a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:59.575952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01822ab-f9b3-4d2a-873c-2d7411364a7f service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:59.588162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1783/3564] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:13:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:13:59.687382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd26d0c-5452-4361-84a1-692dc73bbf25 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:13:59.800063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:59.827619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd26d0c-5452-4361-84a1-692dc73bbf25 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:13:59.835161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:13:59.836504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:13:59.836982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:13:59.837363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] PATH_INFO: `/v3/users/7540d0c986e24129946197b3edf9560f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:13:59.838929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7540d0c986e24129946197b3edf9560f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:13:59.843552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:13:59.924412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7540d0c986e24129946197b3edf9560f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:59.925346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7540d0c986e24129946197b3edf9560f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:59.958644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7540d0c986e24129946197b3edf9560f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:59.959639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7540d0c986e24129946197b3edf9560f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:59.971169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7540d0c986e24129946197b3edf9560f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:13:59.995122 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1782/3565] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:13:59 2022] DELETE /identity/v3/users/7540d0c986e24129946197b3edf9560f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:00.001396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:00.002003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:00.002259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:00.028357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:00.030093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:00.117276 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1784/3566] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:00.131993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:00.133615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:00.242742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22d733-637e-49db-bf18-c7a3a60d7dde admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:00.254829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c1b39-17ec-41ee-ac2c-15a03f481125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:00.256242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1b39-17ec-41ee-ac2c-15a03f481125 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:00.257789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1b39-17ec-41ee-ac2c-15a03f481125 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:00.258237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1b39-17ec-41ee-ac2c-15a03f481125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:00.275661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c1b39-17ec-41ee-ac2c-15a03f481125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:00.277604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c1b39-17ec-41ee-ac2c-15a03f481125 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:00.295137 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1783/3567] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:00.769852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:00.771520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:00.793678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7a4b-0715-4148-8990-6acc027d8345 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:00.800477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:00.801614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:00.801850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:00.802110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] PATH_INFO: `/v3/projects/bf239e913efa4a988fa15d81190ef460` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:00.803713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf239e913efa4a988fa15d81190ef460)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:00.806174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:00.883332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf239e913efa4a988fa15d81190ef460', 'request_id': 'req-496b96ec-8b61-4cf0-903e-6d6e4268ff10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:00.894281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf239e913efa4a988fa15d81190ef460', 'request_id': 'req-496b96ec-8b61-4cf0-903e-6d6e4268ff10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:00.896650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:00.905862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf239e913efa4a988fa15d81190ef460', 'request_id': 'req-496b96ec-8b61-4cf0-903e-6d6e4268ff10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:00.925950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] The token cache is being invalidate because project bf239e913efa4a988fa15d81190ef460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:00.926608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:00.928345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-496b96ec-8b61-4cf0-903e-6d6e4268ff10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:00.936180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1785/3568] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:00 2022] DELETE /identity/v3/projects/bf239e913efa4a988fa15d81190ef460 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:00.937989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e97b9-13de-4aeb-8628-1a54e065182e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:00.938314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e97b9-13de-4aeb-8628-1a54e065182e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:00.938804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e97b9-13de-4aeb-8628-1a54e065182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:00.962161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9d3e97b9-13de-4aeb-8628-1a54e065182e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:00.963610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9d3e97b9-13de-4aeb-8628-1a54e065182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:01.066689 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1784/3569] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:01.075292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635d7a-c7aa-4797-8062-94ea8278fee0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.075801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635d7a-c7aa-4797-8062-94ea8278fee0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.076005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18635d7a-c7aa-4797-8062-94ea8278fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.109413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-18635d7a-c7aa-4797-8062-94ea8278fee0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:01.112915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-18635d7a-c7aa-4797-8062-94ea8278fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:01.146718 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1786/3570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:01.151101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e97b9-13de-4aeb-8628-1a54e065182e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.164505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e97b9-13de-4aeb-8628-1a54e065182e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:01.174417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:01.175121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.175547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.176216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.177461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:01.177770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:01.180631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:01.184482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:01.199541 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1785/3571] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:01.204320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635d7a-c7aa-4797-8062-94ea8278fee0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.224691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.228816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18635d7a-c7aa-4797-8062-94ea8278fee0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:01.231372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:01.240237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:01.242488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.243309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.243785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.244784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:01.251844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:01.258921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9467-4e8c-42db-945d-4cdca88f3ac1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:01.300073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:01.302357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.303054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.303653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] PATH_INFO: `/v3/users/519822988db142fba7e027f3dd1109a7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.306293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519822988db142fba7e027f3dd1109a7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:01.309964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:01.323875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1787/3572] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:01 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:01.325090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.432706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519822988db142fba7e027f3dd1109a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:01.432706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519822988db142fba7e027f3dd1109a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:01.460737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519822988db142fba7e027f3dd1109a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:01.461634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519822988db142fba7e027f3dd1109a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:01.471645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519822988db142fba7e027f3dd1109a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:01.472189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440842fd-126c-4759-beef-e3ed3fcd97da admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:01.483880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:01.485153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.485659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.486315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.494747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:01.500863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:01.504686 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1786/3573] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:01 2022] DELETE /identity/v3/users/519822988db142fba7e027f3dd1109a7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:01.568377 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1788/3574] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:01 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:01.573600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.575224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:01.677255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134adbbd-aa29-4b3f-a3cb-147adccf78d1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:01.682559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:01.683255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.683708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.684076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.685100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:01.686819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:01.702389 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1787/3575] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:01.706817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.717958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293a2d9-d9ba-4cc5-adbe-fbbd6a71866b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:01.726332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5e939-0c3c-468a-9225-8af0c2dbcad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:01.727617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e939-0c3c-468a-9225-8af0c2dbcad6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.727916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e939-0c3c-468a-9225-8af0c2dbcad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.728200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5e939-0c3c-468a-9225-8af0c2dbcad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.728960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5e939-0c3c-468a-9225-8af0c2dbcad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:01.730735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5e939-0c3c-468a-9225-8af0c2dbcad6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:01.744947 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1789/3576] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:01.746279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.757868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95923120-ad3f-43f1-b59a-0c64e7b903ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:01.764966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:01.766782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.766782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.766782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] PATH_INFO: `/v3/projects/6269e5969c6a4957b3bb1816d93cebd0/users/ab975e8ffd0448939b2105aed58003fe/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.786119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6269e5969c6a4957b3bb1816d93cebd0, user_id=ab975e8ffd0448939b2105aed58003fe, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:01.789296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:01.810124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1788/3577] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:01 2022] PUT /identity/v3/projects/6269e5969c6a4957b3bb1816d93cebd0/users/ab975e8ffd0448939b2105aed58003fe/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:01.816548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:01.817358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:01.817851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:01.851420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:01.852988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:01.970314 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1790/3578] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:01.988345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:01.990729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:02.093634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:02.097739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:02.117273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf838a7d-2efd-4e77-8847-3458d5bd612c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:02.127347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:02.130470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:02.131346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:02.132029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] PATH_INFO: `/v3/projects/c66aab4ab90e4ee1be5a36496447d1a2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:02.149221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:02.154139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66aab4ab90e4ee1be5a36496447d1a2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:02.166451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:02.199089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2ec5d-42ec-4fcc-a068-910cebd7a2b7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:02.211054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90191c95-310d-4188-9c8b-754e35e072ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:02.214294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191c95-310d-4188-9c8b-754e35e072ba service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:02.214640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191c95-310d-4188-9c8b-754e35e072ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:02.216054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191c95-310d-4188-9c8b-754e35e072ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:02.256845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90191c95-310d-4188-9c8b-754e35e072ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:02.257485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=5,keystone:DELETE=5,keystone:SELECT=90 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:02.258543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90191c95-310d-4188-9c8b-754e35e072ba service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:02.279214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1789/3579] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:02.297872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66aab4ab90e4ee1be5a36496447d1a2', 'request_id': 'req-881eca1d-9648-4030-99db-d914b29affc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:02.312172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66aab4ab90e4ee1be5a36496447d1a2', 'request_id': 'req-881eca1d-9648-4030-99db-d914b29affc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:02.323316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66aab4ab90e4ee1be5a36496447d1a2', 'request_id': 'req-881eca1d-9648-4030-99db-d914b29affc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:02.348422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] The token cache is being invalidate because project c66aab4ab90e4ee1be5a36496447d1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:02.348771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:02.351823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-881eca1d-9648-4030-99db-d914b29affc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:02.360696 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1791/3580] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:02 2022] DELETE /identity/v3/projects/c66aab4ab90e4ee1be5a36496447d1a2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:02.362524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d5f2-b7e7-4e48-9940-72ee50d5abfc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:02.362916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d5f2-b7e7-4e48-9940-72ee50d5abfc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:02.363292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d5f2-b7e7-4e48-9940-72ee50d5abfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:02.411557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0aa4d5f2-b7e7-4e48-9940-72ee50d5abfc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:02.415242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0aa4d5f2-b7e7-4e48-9940-72ee50d5abfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:02.553877 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1790/3581] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:02.563382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4755d-2ac1-451a-8868-2fc7f81504a6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:02.564026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4755d-2ac1-451a-8868-2fc7f81504a6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:02.564482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4755d-2ac1-451a-8868-2fc7f81504a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:02.590390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6ab4755d-2ac1-451a-8868-2fc7f81504a6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:02.591910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6ab4755d-2ac1-451a-8868-2fc7f81504a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:02.613970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d5f2-b7e7-4e48-9940-72ee50d5abfc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:02.614150 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1792/3582] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:02.630660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d5f2-b7e7-4e48-9940-72ee50d5abfc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:02.648200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:02.649314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:02.649615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:02.650554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:02.651623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:02.652176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:02.655520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:02.682926 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1791/3583] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:02.688235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4755d-2ac1-451a-8868-2fc7f81504a6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:02.699369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4755d-2ac1-451a-8868-2fc7f81504a6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:02.708473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:02.709508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:02.710136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:02.711015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:02.712185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:02.717473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:02.763066 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1793/3584] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:02 2022] POST /identity/v3/projects => generated 403 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:02.774673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:02.802576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f3f39-9b85-40a5-b56c-ecff28a4fefb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:02.935096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:02.937192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:02.938448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:02.938946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:02.940160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:02.945858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:03.011496 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1792/3585] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:02 2022] POST /identity/v3/users => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:03.015782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:03.033887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f11a4-f4d7-45f0-bfc0-c0ac1b6a020b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:03.047790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:03.051558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:03.051907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:03.052305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:03.053404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:03.062785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:03.080610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1794/3586] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:03.086699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:03.141196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd59ea9-a855-43c6-9e09-7c5905948395 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:03.148851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e423fd8-5f41-4858-bc00-84d5e29adade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:03.150101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423fd8-5f41-4858-bc00-84d5e29adade admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:03.150760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423fd8-5f41-4858-bc00-84d5e29adade admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:03.151263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423fd8-5f41-4858-bc00-84d5e29adade admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:03.152363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e423fd8-5f41-4858-bc00-84d5e29adade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:03.154670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e423fd8-5f41-4858-bc00-84d5e29adade admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:03.172431 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1793/3587] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:03.176641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:03.189647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d966a-c534-40eb-a228-f3a215c61175 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:03.195915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:03.197327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:03.197835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:03.198377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] PATH_INFO: `/v3/projects/af49ce1c50cc4b9bab11e0d85f69b9ec/users/3ed1c9c56fe94b7cb562b3034df2f3b8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:03.220623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af49ce1c50cc4b9bab11e0d85f69b9ec, user_id=3ed1c9c56fe94b7cb562b3034df2f3b8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:03.224149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:03.246841 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1795/3588] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:03 2022] PUT /identity/v3/projects/af49ce1c50cc4b9bab11e0d85f69b9ec/users/3ed1c9c56fe94b7cb562b3034df2f3b8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:03.257880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4270c-f8f6-4482-8001-92a4e140cf4c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:03.258168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4270c-f8f6-4482-8001-92a4e140cf4c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:03.258927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4270c-f8f6-4482-8001-92a4e140cf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:03.319137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ae4270c-f8f6-4482-8001-92a4e140cf4c None None] MFA Rules not processed for user `3ed1c9c56fe94b7cb562b3034df2f3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:03.322546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ae4270c-f8f6-4482-8001-92a4e140cf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:03.376634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:03.412408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1794/3589] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:03.574678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:03.746943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b31a5-9f1b-4944-b3ee-b4fea527a262 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:03.756599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:03.757657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:03.758012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:03.758364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] PATH_INFO: `/v3/users/3ed1c9c56fe94b7cb562b3034df2f3b8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:03.764364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed1c9c56fe94b7cb562b3034df2f3b8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:03.767750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:03.918535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed1c9c56fe94b7cb562b3034df2f3b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:03.919592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed1c9c56fe94b7cb562b3034df2f3b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:03.933196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:03.952922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed1c9c56fe94b7cb562b3034df2f3b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:03.954111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed1c9c56fe94b7cb562b3034df2f3b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:03.965330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed1c9c56fe94b7cb562b3034df2f3b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:04.008244 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1796/3590] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:03 2022] DELETE /identity/v3/users/3ed1c9c56fe94b7cb562b3034df2f3b8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:04.017751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:04.018377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:04.018846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:04.048909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:04.050891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:04.161748 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1795/3591] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:04.208274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:04.209729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:04.343009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5257982-16dd-46a1-9cb0-dc8f8f59a913 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:04.352200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf3908-75c2-45f5-a7b7-3f504628905b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:04.353827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3908-75c2-45f5-a7b7-3f504628905b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:04.356979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3908-75c2-45f5-a7b7-3f504628905b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:04.357558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3908-75c2-45f5-a7b7-3f504628905b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:04.373200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf3908-75c2-45f5-a7b7-3f504628905b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:04.381227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf3908-75c2-45f5-a7b7-3f504628905b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:04.397473 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1797/3592] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:05.605961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:05.608542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:05.628169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3fd9-03d8-40a7-8c3d-d7b43690d8a6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:05.642371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:05.643775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:05.644385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:05.644926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] PATH_INFO: `/v3/projects/af49ce1c50cc4b9bab11e0d85f69b9ec` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:05.646855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af49ce1c50cc4b9bab11e0d85f69b9ec)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:05.650224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:05.723091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af49ce1c50cc4b9bab11e0d85f69b9ec', 'request_id': 'req-8b6c1b82-d87c-41be-b419-4530496dd8d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:05.730578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af49ce1c50cc4b9bab11e0d85f69b9ec', 'request_id': 'req-8b6c1b82-d87c-41be-b419-4530496dd8d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:05.742073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af49ce1c50cc4b9bab11e0d85f69b9ec', 'request_id': 'req-8b6c1b82-d87c-41be-b419-4530496dd8d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:05.759023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] The token cache is being invalidate because project af49ce1c50cc4b9bab11e0d85f69b9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:05.759604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:05.761051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8b6c1b82-d87c-41be-b419-4530496dd8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:05.763247 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1796/3593] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:05 2022] DELETE /identity/v3/projects/af49ce1c50cc4b9bab11e0d85f69b9ec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:05.771992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f70bd9-cda7-4626-8d8a-eb6223fe7a90 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:05.774421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f70bd9-cda7-4626-8d8a-eb6223fe7a90 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:05.774856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f70bd9-cda7-4626-8d8a-eb6223fe7a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:05.806142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-44f70bd9-cda7-4626-8d8a-eb6223fe7a90 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:05.809866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-44f70bd9-cda7-4626-8d8a-eb6223fe7a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:05.939203 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1798/3594] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:05.941923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26208-1b13-4f08-a487-a8ee1a4bd1f6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:05.942484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26208-1b13-4f08-a487-a8ee1a4bd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:05.942782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26208-1b13-4f08-a487-a8ee1a4bd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:05.975775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5ec26208-1b13-4f08-a487-a8ee1a4bd1f6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:05.977415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5ec26208-1b13-4f08-a487-a8ee1a4bd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:05.991585 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1797/3595] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:05.997470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f70bd9-cda7-4626-8d8a-eb6223fe7a90 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:06.012786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f70bd9-cda7-4626-8d8a-eb6223fe7a90 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:06.019326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:06.019739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:06.020291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:06.020469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:06.021305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:06.021674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:06.023875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:06.042966 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1799/3596] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:06.047145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26208-1b13-4f08-a487-a8ee1a4bd1f6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:06.063687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26208-1b13-4f08-a487-a8ee1a4bd1f6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:06.077480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:06.078167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:06.078448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:06.078723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:06.079575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:06.081624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:06.173183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1798/3597] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:06 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:06.174325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:06.190716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd885b0-6779-4e75-a4e2-fdebf554a474 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:06.330434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:06.331369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:06.331692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:06.332318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:06.335031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:06.340623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:06.375372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:06.441730 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1800/3598] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:06 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:06.455409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:06.504148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41936-be0b-44e1-9e1c-191569015113 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:06.530383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:06.533426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:06.534350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:06.535748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:06.538607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:06.545060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:06.618552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:06.621142 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1799/3599] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:06.661355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095be8e7-b27c-46ac-b88b-ed415791a199 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:06.670353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec5c73-2c93-4573-82da-f27660314351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:06.671235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5c73-2c93-4573-82da-f27660314351 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:06.671764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5c73-2c93-4573-82da-f27660314351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:06.672404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5c73-2c93-4573-82da-f27660314351 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:06.673892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec5c73-2c93-4573-82da-f27660314351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:06.676071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec5c73-2c93-4573-82da-f27660314351 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:06.691686 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1801/3600] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:06.696049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:06.723011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd156e-74bd-4f4b-a8bb-0ac91405f4e8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:06.738223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:06.738876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:06.740084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:06.741392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] PATH_INFO: `/v3/projects/81f6cb0aa71b40978ca938e7de497579/users/5b3112d37b7c4af8962f757151644be8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:06.786664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f6cb0aa71b40978ca938e7de497579, user_id=5b3112d37b7c4af8962f757151644be8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:06.796876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:06.823098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:06.852051 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1800/3601] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:06 2022] PUT /identity/v3/projects/81f6cb0aa71b40978ca938e7de497579/users/5b3112d37b7c4af8962f757151644be8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:06.856559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e107c50-c050-4b49-8aeb-fa8086bb9264 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:06.857456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e107c50-c050-4b49-8aeb-fa8086bb9264 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:06.857902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e107c50-c050-4b49-8aeb-fa8086bb9264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:06.910877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6e107c50-c050-4b49-8aeb-fa8086bb9264 None None] MFA Rules not processed for user `5b3112d37b7c4af8962f757151644be8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:06.915090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6e107c50-c050-4b49-8aeb-fa8086bb9264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:07.188761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:07.190550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1802/3602] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:07.384505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4725e1-16c1-475c-9eac-050e681b98d6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:07.396693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:07.397884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:07.398177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:07.398719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:07.399741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:07.403695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:07.469551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e107c50-c050-4b49-8aeb-fa8086bb9264 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:07.483283 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1801/3603] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:07 2022] POST /identity/v3/projects => generated 375 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:07.493155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e107c50-c050-4b49-8aeb-fa8086bb9264 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:07.607271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:07.608152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:07.608563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:07.608945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:07.609846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:07.612151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:07.648110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1803/3604] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:07 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:07.652681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:07.675085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc7663-5388-470e-9ecd-8ef86bf874f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:07.695908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:07.697264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:07.697650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:07.700396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:07.701875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:07.704610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:07.735864 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1802/3605] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:07.741233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:07.760606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46416e44-cc7d-4231-9ec2-7324bdfdf7de admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:07.787409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:07.788898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:07.792221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:07.792978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] PATH_INFO: `/v3/projects/41abede1da9d4b468e6efd6ab337bb94/users/c0f8b5d0d489431cb0ec2b221f339d74/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:07.835272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41abede1da9d4b468e6efd6ab337bb94, user_id=c0f8b5d0d489431cb0ec2b221f339d74, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:07.835272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:07.867264 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1804/3606] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:07 2022] PUT /identity/v3/projects/41abede1da9d4b468e6efd6ab337bb94/users/c0f8b5d0d489431cb0ec2b221f339d74/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:07.871442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:07.897391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d022ca5-e5e1-435d-a8e8-7f3e6e64c976 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:08.065970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d4038-5848-422b-9623-11336568f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:08.066666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4038-5848-422b-9623-11336568f841 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.066951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4038-5848-422b-9623-11336568f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.067258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d4038-5848-422b-9623-11336568f841 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.067970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d4038-5848-422b-9623-11336568f841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.069723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d4038-5848-422b-9623-11336568f841 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.098587 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1803/3607] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:08.104364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:08.122829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601da88-327a-43f0-bf5f-01c56ca92b71 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:08.132073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:08.133139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.133426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.134853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] PATH_INFO: `/v3/projects/41abede1da9d4b468e6efd6ab337bb94/users/c0f8b5d0d489431cb0ec2b221f339d74/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.137498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41abede1da9d4b468e6efd6ab337bb94, user_id=c0f8b5d0d489431cb0ec2b221f339d74, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.144763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.162441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1805/3608] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:08 2022] PUT /identity/v3/projects/41abede1da9d4b468e6efd6ab337bb94/users/c0f8b5d0d489431cb0ec2b221f339d74/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:08.173136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca528f7-1782-4b0c-a201-c6df3c08a5cf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.173414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca528f7-1782-4b0c-a201-c6df3c08a5cf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.173653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca528f7-1782-4b0c-a201-c6df3c08a5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.242142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5ca528f7-1782-4b0c-a201-c6df3c08a5cf None None] MFA Rules not processed for user `c0f8b5d0d489431cb0ec2b221f339d74`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:08.245786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5ca528f7-1782-4b0c-a201-c6df3c08a5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:08.403271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:08.420885 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1804/3609] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:08.424966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:08.442137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072db5e-b62e-4477-a25c-ed7fcc58f748 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:08.449264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:08.450290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.450811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.461429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.462409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.465935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.509304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:08.534058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca528f7-1782-4b0c-a201-c6df3c08a5cf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:08.541138 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1806/3610] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:14:08 2022] POST /identity/v3/projects => generated 349 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:08.550986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca528f7-1782-4b0c-a201-c6df3c08a5cf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:08.640198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:08.641273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.642069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.642358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.643758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.646098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.722414 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1805/3611] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:08 2022] POST /identity/v3/projects => generated 350 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:08.727122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:08.746017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4160483-5201-4d43-bb27-2e5f7201f873 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:08.837820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:08.838736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.839179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.839609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/users/5b3112d37b7c4af8962f757151644be8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.841549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:get_user(user_id=5b3112d37b7c4af8962f757151644be8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.844373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.850600 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1807/3612] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:14:08 2022] GET /identity/v3/users/5b3112d37b7c4af8962f757151644be8 => generated 288 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:08.851245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:08.863065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2fea9-9a64-4346-b1d1-db85d09738a3 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:08.868885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:08.869714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.870160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.870445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.871236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.873503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.919288 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1806/3613] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Jun 18 22:14:08 2022] POST /identity/v3/credentials => generated 429 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:08.924069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:08.937272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53131a2e-ae05-4be7-a563-2eadf79b81ca tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:08.944363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:08.946362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:08.946866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:08.947294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials/2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:08.950518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.953825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.956777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:08.959415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:08.982968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1808/3614] 10.222.0.30 () {60 vars in 1357 bytes} [Sat Jun 18 22:14:08 2022] PATCH /identity/v3/credentials/2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a => generated 437 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:08.987052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.002181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf5fcf-8c1f-45d2-9eb5-e38825ca881c tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.010262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.011208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.011544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.011823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials/2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.014736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.016934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.025121 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1807/3615] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Jun 18 22:14:08 2022] GET /identity/v3/credentials/2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a => generated 437 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:09.025322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.036357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74655ab-6f32-4ae8-861a-0222e8648966 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.042275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.043107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.043390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.044235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials/2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.046639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.048398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.074899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1809/3616] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Jun 18 22:14:09 2022] DELETE /identity/v3/credentials/2f44f6ffa0e8fafa8163fd7d8f3f8b4ccaadba2a04314331517ea4bb1a4e0b0a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:09.080969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.093847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51830d04-a4d6-4f46-a27c-db0ad2a01efd tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.099716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.100597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.100880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.101266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.102173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.104225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.124671 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1808/3617] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Jun 18 22:14:09 2022] POST /identity/v3/credentials => generated 430 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:09.126113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.139870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249c20-dc13-409f-a96f-7d71f7baa843 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.146114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.146884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.147208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.147602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.148322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.150210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.173154 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1810/3618] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Jun 18 22:14:09 2022] POST /identity/v3/credentials => generated 431 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:09.174892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.187498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca1060-b498-4ec8-9e36-451a12f652e4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.196768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.197630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.197747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.199376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.200838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.203951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.216456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.218369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.220776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.222896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.229109 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1809/3619] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Jun 18 22:14:09 2022] GET /identity/v3/credentials => generated 946 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:09.231736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.247231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72070562-8273-4a78-84f8-62fc610086d4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.253309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.254670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.255141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.255525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials/4a357cd0dfb65af31012cdfe32ecd462b71aa3d7d488078a1639a8e96d67fd01` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.258181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=4a357cd0dfb65af31012cdfe32ecd462b71aa3d7d488078a1639a8e96d67fd01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.260054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.288798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.289254 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1811/3620] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Jun 18 22:14:09 2022] DELETE /identity/v3/credentials/4a357cd0dfb65af31012cdfe32ecd462b71aa3d7d488078a1639a8e96d67fd01 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:09.299842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7667f-be09-4240-a451-691a2df04b39 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.304977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.306031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.306261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.306502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/credentials/70a9680fc53f597f349e019fedbcd83d4a48119267c2975873c2ecaf7ab4798f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.308720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=70a9680fc53f597f349e019fedbcd83d4a48119267c2975873c2ecaf7ab4798f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.310548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.335808 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1810/3621] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Jun 18 22:14:09 2022] DELETE /identity/v3/credentials/70a9680fc53f597f349e019fedbcd83d4a48119267c2975873c2ecaf7ab4798f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:09.341715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.357403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8f77e-b70a-4901-bd8b-ca27ebf27bf4 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.366155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.367047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.367313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.367605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/projects/dd1a1c29a3824a1c853e2fa198f64308` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.369791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd1a1c29a3824a1c853e2fa198f64308)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.372080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.450293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1a1c29a3824a1c853e2fa198f64308', 'request_id': 'req-f5593bfb-49bc-40a6-872d-aa725b7e6133'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.464067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1a1c29a3824a1c853e2fa198f64308', 'request_id': 'req-f5593bfb-49bc-40a6-872d-aa725b7e6133'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.476194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1a1c29a3824a1c853e2fa198f64308', 'request_id': 'req-f5593bfb-49bc-40a6-872d-aa725b7e6133'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.499253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] The token cache is being invalidate because project dd1a1c29a3824a1c853e2fa198f64308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:09.500540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.505009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5593bfb-49bc-40a6-872d-aa725b7e6133 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.514383 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1812/3622] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:09 2022] DELETE /identity/v3/projects/dd1a1c29a3824a1c853e2fa198f64308 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:09.515096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.520473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:09.533105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.533457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.533690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.552458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6050d4-829c-4f70-93a6-b879927a08fe tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.582973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:09.584592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:09.647127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0f8b5d0d489431cb0ec2b221f339d74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41abede1da9d4b468e6efd6ab337bb94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:09.648141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:09.648637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:09.648761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] PATH_INFO: `/v3/projects/065eacbcb9444450a815bd3dbea6da55` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:09.650249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorizing `identity:delete_project(project_id=065eacbcb9444450a815bd3dbea6da55)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:09.652611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:09.656356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:09.713692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:09.727042 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1813/3623] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:14:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:09.759086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.761553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:09.780506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065eacbcb9444450a815bd3dbea6da55', 'request_id': 'req-df576aed-dff8-4012-8fb8-b2dff5ea48c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.805713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065eacbcb9444450a815bd3dbea6da55', 'request_id': 'req-df576aed-dff8-4012-8fb8-b2dff5ea48c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.835152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065eacbcb9444450a815bd3dbea6da55', 'request_id': 'req-df576aed-dff8-4012-8fb8-b2dff5ea48c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.852856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] The token cache is being invalidate because project 065eacbcb9444450a815bd3dbea6da55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:09.853202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.853978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:09.859282 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1811/3624] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:09 2022] DELETE /identity/v3/projects/065eacbcb9444450a815bd3dbea6da55 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:09.863360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:09.869999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:09.940289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c359-2151-4136-b0d7-10575018fb06 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:09.998759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df576aed-dff8-4012-8fb8-b2dff5ea48c0 tempest-CredentialsTestJSON-1432223005 tempest-CredentialsTestJSON-1432223005-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:10.010327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:10.012972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:10.014700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:10.015521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] PATH_INFO: `/v3/users/5b3112d37b7c4af8962f757151644be8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:10.018150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3112d37b7c4af8962f757151644be8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:10.023875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:10.097218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:10.097966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:10.098251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:10.098545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:10.103384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:10.135551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3112d37b7c4af8962f757151644be8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:10.137256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3112d37b7c4af8962f757151644be8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:10.168228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3112d37b7c4af8962f757151644be8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:10.169780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3112d37b7c4af8962f757151644be8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:10.184015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9717e53c-d0d3-4d91-a57b-0123d67edc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3112d37b7c4af8962f757151644be8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:10.215715 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1812/3625] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:09 2022] DELETE /identity/v3/users/5b3112d37b7c4af8962f757151644be8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:10.222849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:10.223563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:10.224586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:10.261162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:10.264832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:10.267583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:10.270034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:10.295210 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1814/3626] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:14:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:14:10.374890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:10.450117 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1813/3627] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:10.464620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:10.466715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:10.512195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:10.604686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07eb7b4-b888-4859-9efd-35d9cbd3b4b5 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:10.775328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:10.776014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:10.776314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:10.776581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:10.798172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:10.799872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:10.822382 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1815/3628] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:11.489671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:11.491412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:11.685703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85aede-a0e7-4a66-825b-fd578fc7020b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:11.702422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:11.713890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:11.717734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:11.718821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:11.727911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:11.757513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:11.764245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:11.812408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1814/3629] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:12.897180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:12.899446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:12.938759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fc4bd-403c-4023-9b95-086fc1f32832 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:12.957532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:12.960803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:12.961950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:12.962395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] PATH_INFO: `/v3/projects/81f6cb0aa71b40978ca938e7de497579` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:12.966873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f6cb0aa71b40978ca938e7de497579)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:12.971669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:13.087609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f6cb0aa71b40978ca938e7de497579', 'request_id': 'req-6efc5437-def2-4d80-b604-5c4cacac5362'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.106793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f6cb0aa71b40978ca938e7de497579', 'request_id': 'req-6efc5437-def2-4d80-b604-5c4cacac5362'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.117968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f6cb0aa71b40978ca938e7de497579', 'request_id': 'req-6efc5437-def2-4d80-b604-5c4cacac5362'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.135681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] The token cache is being invalidate because project 81f6cb0aa71b40978ca938e7de497579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:13.135979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.136879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.139946 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1816/3630] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:12 2022] DELETE /identity/v3/projects/81f6cb0aa71b40978ca938e7de497579 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:13.144242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:13.165267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb0d37-ca2f-42ac-92d6-8c2f21f37a65 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:13.304219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:13.305900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:13.306587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:13.307011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] PATH_INFO: `/v3/users/c0f8b5d0d489431cb0ec2b221f339d74` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:13.308803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f8b5d0d489431cb0ec2b221f339d74)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:13.311010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:13.417258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f8b5d0d489431cb0ec2b221f339d74'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.418956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f8b5d0d489431cb0ec2b221f339d74'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.438834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f8b5d0d489431cb0ec2b221f339d74'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.439536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f8b5d0d489431cb0ec2b221f339d74'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.441260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:13.455137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4df54fb-b75e-49eb-82da-f9f54682e45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f8b5d0d489431cb0ec2b221f339d74'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:13.477388 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1815/3631] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:13 2022] DELETE /identity/v3/users/c0f8b5d0d489431cb0ec2b221f339d74 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:14.205653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:14.207889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:14.341376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:14.342662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:14.343017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:14.388176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:14.399246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] MFA Rules not processed for user `ab975e8ffd0448939b2105aed58003fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:14.400738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:14.406009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc5437-def2-4d80-b604-5c4cacac5362 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:14.519156 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1816/3632] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:14.521277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:14.524814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:14.618902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:14.619777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:14.620058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:14.620550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:14.624369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:14.643958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:14.657954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:14.658664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e5b1-cec5-406f-9e85-1fbcfe6670cc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:14.663944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:14.665121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:14.665521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:14.665882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] PATH_INFO: `/v3/projects/41abede1da9d4b468e6efd6ab337bb94` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:14.667239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41abede1da9d4b468e6efd6ab337bb94)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:14.669777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:14.675103 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1817/3633] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:14.677778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:14.679401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:14.746911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41abede1da9d4b468e6efd6ab337bb94', 'request_id': 'req-281a39f0-d64b-4f63-bcce-f84335da80b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:14.756055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41abede1da9d4b468e6efd6ab337bb94', 'request_id': 'req-281a39f0-d64b-4f63-bcce-f84335da80b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:14.767462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41abede1da9d4b468e6efd6ab337bb94', 'request_id': 'req-281a39f0-d64b-4f63-bcce-f84335da80b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:14.791913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] The token cache is being invalidate because project 41abede1da9d4b468e6efd6ab337bb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:14.792322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:14.795314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-281a39f0-d64b-4f63-bcce-f84335da80b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:14.798218 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1817/3634] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:14 2022] DELETE /identity/v3/projects/41abede1da9d4b468e6efd6ab337bb94 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:14.813007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73c29c-2bca-4a26-ab61-49e7384bf9ba None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:14.813668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73c29c-2bca-4a26-ab61-49e7384bf9ba None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:14.814131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73c29c-2bca-4a26-ab61-49e7384bf9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:14.824232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:14.835996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d874c1-2190-4d6d-b3f1-b41e20801d30 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:14.846714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-be73c29c-2bca-4a26-ab61-49e7384bf9ba None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:14.849415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-be73c29c-2bca-4a26-ab61-49e7384bf9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:14.982542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:14.983694 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1818/3635] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:14.990754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:14.991026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:14.991317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:14.993476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:15.002143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd599-fd6f-4e0a-b0d7-db857122f2d3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.004390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd599-fd6f-4e0a-b0d7-db857122f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.004714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd599-fd6f-4e0a-b0d7-db857122f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.037553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:15.040741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f04cd599-fd6f-4e0a-b0d7-db857122f2d3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:15.043018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f04cd599-fd6f-4e0a-b0d7-db857122f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:15.060341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1819/3636] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:15.065355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd599-fd6f-4e0a-b0d7-db857122f2d3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:15.082054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:15.084210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:15.087952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd599-fd6f-4e0a-b0d7-db857122f2d3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:15.105091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:15.105794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.106076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.106351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.106482 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1818/3637] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:15.107105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:15.107472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:15.109130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:15.133083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1820/3638] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:15.137686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:15.152895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b55d6-3db8-4c8e-9dc1-5063e76ea293 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:15.166000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:15.166966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.167363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.167959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.168668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:15.173004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:15.226819 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1819/3639] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:15 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:15.231361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:15.251597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344c42c-e6b5-4c55-a946-7954d59e0ea4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:15.366411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:15.366994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.367360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.367731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.368556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:15.371179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:15.414431 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1821/3640] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:15 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:15.415974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:15.440689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604af76b-2a10-4ba8-937e-cc6225eabe99 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:15.450968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:15.453000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.453730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.453730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.454369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:15.456120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:15.499625 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1820/3641] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:15.504137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:15.523350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0083cc-4779-44b8-9a32-81ee38230fbf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:15.533866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f35f44-5da3-4948-95d6-a5967393a35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:15.534983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f35f44-5da3-4948-95d6-a5967393a35e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.535475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f35f44-5da3-4948-95d6-a5967393a35e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.535862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f35f44-5da3-4948-95d6-a5967393a35e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.537852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f35f44-5da3-4948-95d6-a5967393a35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:15.541131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f35f44-5da3-4948-95d6-a5967393a35e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:15.642475 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1822/3642] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:15.644193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:15.657221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df955-ea23-40e6-b3ce-13e301277f5d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:15.665519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:15.667009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.667534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.668035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] PATH_INFO: `/v3/projects/6b221dd145ae47b385c2fa654c40aebc/users/eb53512af5bb489abee44430747ad183/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.693281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b221dd145ae47b385c2fa654c40aebc, user_id=eb53512af5bb489abee44430747ad183, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:15.697918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:15.740122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1821/3643] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:15 2022] PUT /identity/v3/projects/6b221dd145ae47b385c2fa654c40aebc/users/eb53512af5bb489abee44430747ad183/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:15.742755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d02f0c-d881-431a-ab84-299be9c54adf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:15.743087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d02f0c-d881-431a-ab84-299be9c54adf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:15.743557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d02f0c-d881-431a-ab84-299be9c54adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:15.802624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-27d02f0c-d881-431a-ab84-299be9c54adf None None] MFA Rules not processed for user `eb53512af5bb489abee44430747ad183`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:15.803860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-27d02f0c-d881-431a-ab84-299be9c54adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:15.867418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:15.896881 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1823/3644] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:15.899384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:16.013734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034b6d8-ebc9-40b4-ab6f-81ab4981f747 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:16.039731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:16.041381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:16.041992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:16.043509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:16.045529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:16.049279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:16.096583 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1822/3645] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:15 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:16.101508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d02f0c-d881-431a-ab84-299be9c54adf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:16.119834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d02f0c-d881-431a-ab84-299be9c54adf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:16.320998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:16.321994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:16.322465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:16.322819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:16.323831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:16.328036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:16.361756 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1824/3646] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:16 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:16.366912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:16.383277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a8e1-24f1-4758-95fa-cee16b309d23 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:16.390201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:16.391033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:16.392128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:16.392513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:16.393477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:16.395342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:16.414818 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1823/3647] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:16.416446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:16.432006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc3bab-a79c-473c-850e-aba30c4b06d7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:16.447460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:16.448890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:16.449231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:16.449641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] PATH_INFO: `/v3/projects/1ed42b311e9341358c72a67046c36100/users/c9524070a5b64d84a556bfd0b3af71ca/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:16.522825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed42b311e9341358c72a67046c36100, user_id=c9524070a5b64d84a556bfd0b3af71ca, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:16.532538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:16.583209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1825/3648] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:16 2022] PUT /identity/v3/projects/1ed42b311e9341358c72a67046c36100/users/c9524070a5b64d84a556bfd0b3af71ca/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:16.587464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:16.603944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147411-0bd2-4ba7-a615-9c7127e9a9b8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:16.744196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:16.769672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353c36-5654-4a0b-a39b-c79ca3aac23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:16.771894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353c36-5654-4a0b-a39b-c79ca3aac23b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:16.772187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353c36-5654-4a0b-a39b-c79ca3aac23b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:16.772431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353c36-5654-4a0b-a39b-c79ca3aac23b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:16.773356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353c36-5654-4a0b-a39b-c79ca3aac23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:16.775764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353c36-5654-4a0b-a39b-c79ca3aac23b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:16.818275 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1824/3649] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:16.820647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:16.836545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105aa5-1168-45b5-9c63-8fa063125504 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:16.854845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:16.856567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:16.857102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:16.857626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] PATH_INFO: `/v3/projects/1ed42b311e9341358c72a67046c36100/users/c9524070a5b64d84a556bfd0b3af71ca/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:16.860649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed42b311e9341358c72a67046c36100, user_id=c9524070a5b64d84a556bfd0b3af71ca, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:16.863795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:16.892355 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1826/3650] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:16 2022] PUT /identity/v3/projects/1ed42b311e9341358c72a67046c36100/users/c9524070a5b64d84a556bfd0b3af71ca/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:16.892724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089243a-e9ec-4a8f-97a7-6f4f9913844a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:16.893054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089243a-e9ec-4a8f-97a7-6f4f9913844a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:16.893560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089243a-e9ec-4a8f-97a7-6f4f9913844a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:16.938792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7089243a-e9ec-4a8f-97a7-6f4f9913844a None None] MFA Rules not processed for user `c9524070a5b64d84a556bfd0b3af71ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:16.941883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7089243a-e9ec-4a8f-97a7-6f4f9913844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:17.183836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:17.184633 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1825/3651] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:17.202631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782ed94-a6ab-45b1-aa5a-29b386aa5b4d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:17.232068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:17.232068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:17.232068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:17.232919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:17.232919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:17.234038 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:17.234038 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:17.234038 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:17.234975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:17.284379 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1827/3652] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:14:17 2022] POST /identity/v3/domains => generated 246 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:17.288638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089243a-e9ec-4a8f-97a7-6f4f9913844a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:17.302287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089243a-e9ec-4a8f-97a7-6f4f9913844a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:17.485136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:17.485793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:17.486581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:17.486581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:17.488473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:17.494691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:17.604135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1826/3653] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:17 2022] POST /identity/v3/projects => generated 409 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:17.608385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:17.626284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991969d-f6cd-4e2d-b75a-8440a9e132db tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:17.766024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:17.766734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:17.767024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:17.768198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:17.769182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:17.771274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:17.824180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:17.824539 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1828/3654] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:17 2022] POST /identity/v3/users => generated 348 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:17.838742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a748d1-2a08-41f0-8c41-f1581ce3ee39 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:17.845947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af9a2-aa69-4499-add1-8268e900ce23 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:17.847039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af9a2-aa69-4499-add1-8268e900ce23 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:17.847703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af9a2-aa69-4499-add1-8268e900ce23 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:17.848190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af9a2-aa69-4499-add1-8268e900ce23 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:17.849242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af9a2-aa69-4499-add1-8268e900ce23 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:17.851160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af9a2-aa69-4499-add1-8268e900ce23 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:17.866584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1827/3655] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:17.873319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:17.892914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcfb68-587e-4b2c-b5aa-4f4c99df257c tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:17.901426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef41b8d-e83a-475a-8649-bfc8bdd86928 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:17.903347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef41b8d-e83a-475a-8649-bfc8bdd86928 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:17.904115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef41b8d-e83a-475a-8649-bfc8bdd86928 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:17.904250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef41b8d-e83a-475a-8649-bfc8bdd86928 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/projects/2538c9dbd9a14df4878dd20969525ef6/users/e11e59af1abd4535b3cfa8998a214d37/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:17.930687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef41b8d-e83a-475a-8649-bfc8bdd86928 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2538c9dbd9a14df4878dd20969525ef6, user_id=e11e59af1abd4535b3cfa8998a214d37, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:17.936731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef41b8d-e83a-475a-8649-bfc8bdd86928 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:17.943948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:17.968343 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1829/3656] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:17 2022] PUT /identity/v3/projects/2538c9dbd9a14df4878dd20969525ef6/users/e11e59af1abd4535b3cfa8998a214d37/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:17.968765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e74c0-363d-48e7-9cf4-fc0a959fb7ec None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:17.969241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e74c0-363d-48e7-9cf4-fc0a959fb7ec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:17.969673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e74c0-363d-48e7-9cf4-fc0a959fb7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:18.154298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:18.305393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d68e74c0-363d-48e7-9cf4-fc0a959fb7ec None None] MFA Rules not processed for user `e11e59af1abd4535b3cfa8998a214d37`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:18.307034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d68e74c0-363d-48e7-9cf4-fc0a959fb7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:18.361691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e87f4-9a81-402d-8e86-c125a0f9415b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:18.361971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e87f4-9a81-402d-8e86-c125a0f9415b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:18.362249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e87f4-9a81-402d-8e86-c125a0f9415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:18.371800 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1828/3657] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:17 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:18.412782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-763e87f4-9a81-402d-8e86-c125a0f9415b None None] MFA Rules not processed for user `e11e59af1abd4535b3cfa8998a214d37`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:18.417679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-763e87f4-9a81-402d-8e86-c125a0f9415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:18.437658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1830/3658] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:18 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:18.442190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e74c0-363d-48e7-9cf4-fc0a959fb7ec None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:18.471625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e74c0-363d-48e7-9cf4-fc0a959fb7ec None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:18.504357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e11e59af1abd4535b3cfa8998a214d37', 'user_domain_id': '56ac2e198fdb4ac4b4216a8770c6105e', 'system_scope': None, 'project_id': '2538c9dbd9a14df4878dd20969525ef6', 'project_domain_id': '56ac2e198fdb4ac4b4216a8770c6105e', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:18.507691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:18.508269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:18.509055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:18.544806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:18.552790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:18.585363 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1829/3659] 10.222.0.30 () {56 vars in 1283 bytes} [Sat Jun 18 22:14:18 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:18.585995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e87f4-9a81-402d-8e86-c125a0f9415b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:18.779794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e87f4-9a81-402d-8e86-c125a0f9415b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:18.790880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:18.791969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:18.792354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:18.798848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/users/e11e59af1abd4535b3cfa8998a214d37` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:18.801230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e11e59af1abd4535b3cfa8998a214d37)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:18.808423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:18.981687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11e59af1abd4535b3cfa8998a214d37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:18.982982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11e59af1abd4535b3cfa8998a214d37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.052431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11e59af1abd4535b3cfa8998a214d37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.053271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11e59af1abd4535b3cfa8998a214d37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.074331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11e59af1abd4535b3cfa8998a214d37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.099528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1831/3660] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:18 2022] DELETE /identity/v3/users/e11e59af1abd4535b3cfa8998a214d37 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:19.103686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:19.135725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84ba7-0ac2-41fa-a6e1-7492c4c775f4 tempest-test_project-1580826201 tempest-user-1976110961] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:19.339966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:19.340881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:19.345320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:19.345647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/projects/2538c9dbd9a14df4878dd20969525ef6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:19.350138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2538c9dbd9a14df4878dd20969525ef6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:19.357340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:19.503471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2538c9dbd9a14df4878dd20969525ef6', 'request_id': 'req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.511384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2538c9dbd9a14df4878dd20969525ef6', 'request_id': 'req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.524558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2538c9dbd9a14df4878dd20969525ef6', 'request_id': 'req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.550212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] The token cache is being invalidate because project 2538c9dbd9a14df4878dd20969525ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:19.550212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.550925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.556976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:19.558025 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1830/3661] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:19 2022] DELETE /identity/v3/projects/2538c9dbd9a14df4878dd20969525ef6 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:19.558729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:19.599734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be85d4-8be5-41a5-bafd-21fcce090695 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:19.778727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:19.779734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:19.780117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:19.780659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/domains/56ac2e198fdb4ac4b4216a8770c6105e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:19.782200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=56ac2e198fdb4ac4b4216a8770c6105e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:19.783903 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:19.783903 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:19.783903 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:19.786385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:19.820433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:19.837494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.838818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.922463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.923911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:19.930992 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1832/3662] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:14:19 2022] PATCH /identity/v3/domains/56ac2e198fdb4ac4b4216a8770c6105e => generated 247 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:19.934709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:19.936602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:19.959574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041a81-64c9-4d9c-99f4-118feb4b1b3f tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:19.982145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:20.059056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9524070a5b64d84a556bfd0b3af71ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ed42b311e9341358c72a67046c36100', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:20.060247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:20.060588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:20.061377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] PATH_INFO: `/v3/domains/56ac2e198fdb4ac4b4216a8770c6105e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:20.078910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=56ac2e198fdb4ac4b4216a8770c6105e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:20.093870 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:20.093870 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:20.093870 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:20.094931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:20.199415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.212232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.397123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e', 'request_id': 'req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.410292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e', 'request_id': 'req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.424777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e', 'request_id': 'req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.450369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] The token cache is being invalidate because project 56ac2e198fdb4ac4b4216a8770c6105e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:20.450863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.453551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.503242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e', 'request_id': 'req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.503987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e', 'request_id': 'req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.504596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '56ac2e198fdb4ac4b4216a8770c6105e', 'request_id': 'req-bfee0847-09c1-4db6-8cf9-2c4ccf70622b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.535050 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1831/3663] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:19 2022] DELETE /identity/v3/domains/56ac2e198fdb4ac4b4216a8770c6105e => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:20.544071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:20.545737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:20.674114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a306d-f889-47c9-a29f-7d186c7838f1 tempest-TestDefaultProjectId-1082373821 tempest-TestDefaultProjectId-1082373821-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:20.798961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:20.801127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:20.801738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:20.802233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] PATH_INFO: `/v3/users/eb53512af5bb489abee44430747ad183` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:20.804428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb53512af5bb489abee44430747ad183)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:20.807308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:20.908051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb53512af5bb489abee44430747ad183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.909313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb53512af5bb489abee44430747ad183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.946790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb53512af5bb489abee44430747ad183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.948978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb53512af5bb489abee44430747ad183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.967489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb53512af5bb489abee44430747ad183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:20.982464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:20.990179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1833/3664] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:20 2022] DELETE /identity/v3/users/eb53512af5bb489abee44430747ad183 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:20.995560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60344aa-26e5-47ce-8dc6-4c25f7afbf34 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:20.996027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60344aa-26e5-47ce-8dc6-4c25f7afbf34 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:20.996191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60344aa-26e5-47ce-8dc6-4c25f7afbf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:21.027516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b60344aa-26e5-47ce-8dc6-4c25f7afbf34 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:21.028767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b60344aa-26e5-47ce-8dc6-4c25f7afbf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:21.093047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:21.108287 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1832/3665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:21.140217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:21.141906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:21.256212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d1ca4-8c38-4418-b298-c1cef74e2c40 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:21.262799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:21.263740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:21.264020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:21.264590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:21.279792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:21.281872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:21.298339 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1834/3666] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:21.484496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9bbb1-d29d-41fb-b204-56a6a7cc6188 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:21.485212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9bbb1-d29d-41fb-b204-56a6a7cc6188 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:21.485671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9bbb1-d29d-41fb-b204-56a6a7cc6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:21.512107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-87a9bbb1-d29d-41fb-b204-56a6a7cc6188 None None] MFA Rules not processed for user `ab975e8ffd0448939b2105aed58003fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:21.515704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-87a9bbb1-d29d-41fb-b204-56a6a7cc6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:21.657404 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1833/3667] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:22.436670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:22.439441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:22.486120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79ce0-d90f-45e9-810c-f1fb2cbff503 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:22.504185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:22.505564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:22.505878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:22.506552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] PATH_INFO: `/v3/projects/6b221dd145ae47b385c2fa654c40aebc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:22.509764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b221dd145ae47b385c2fa654c40aebc)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:22.511772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:22.635980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b221dd145ae47b385c2fa654c40aebc', 'request_id': 'req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.645737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b221dd145ae47b385c2fa654c40aebc', 'request_id': 'req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.660880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b221dd145ae47b385c2fa654c40aebc', 'request_id': 'req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.678897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] The token cache is being invalidate because project 6b221dd145ae47b385c2fa654c40aebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:22.679352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.680520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.685783 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1835/3668] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:22 2022] DELETE /identity/v3/projects/6b221dd145ae47b385c2fa654c40aebc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:22.688524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9bbb1-d29d-41fb-b204-56a6a7cc6188 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:22.707346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9bbb1-d29d-41fb-b204-56a6a7cc6188 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:22.804601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:22.806089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:22.806464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:22.807562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] PATH_INFO: `/v3/users/c9524070a5b64d84a556bfd0b3af71ca` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:22.809831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9524070a5b64d84a556bfd0b3af71ca)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:22.813065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:22.897570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9524070a5b64d84a556bfd0b3af71ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.898516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9524070a5b64d84a556bfd0b3af71ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.919437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9524070a5b64d84a556bfd0b3af71ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.920510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9524070a5b64d84a556bfd0b3af71ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.932057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6af2b653-86bd-4a93-9f61-05d2c1e02d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9524070a5b64d84a556bfd0b3af71ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:22.960809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1834/3669] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:22 2022] DELETE /identity/v3/users/c9524070a5b64d84a556bfd0b3af71ca => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:23.415037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:23.421000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:23.473478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d2d3d-72b6-4130-94f8-96adcdea6f0c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:23.577778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:23.579439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:23.579877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:23.581021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] PATH_INFO: `/v3/projects/1ed42b311e9341358c72a67046c36100` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:23.582841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed42b311e9341358c72a67046c36100)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:23.586547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:23.636215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:23.663300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed42b311e9341358c72a67046c36100', 'request_id': 'req-a506e82b-ad98-4fb9-b9f2-32679d140734'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:23.674509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed42b311e9341358c72a67046c36100', 'request_id': 'req-a506e82b-ad98-4fb9-b9f2-32679d140734'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:23.698401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed42b311e9341358c72a67046c36100', 'request_id': 'req-a506e82b-ad98-4fb9-b9f2-32679d140734'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:23.727239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] The token cache is being invalidate because project 1ed42b311e9341358c72a67046c36100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:23.727846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:23.728681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a506e82b-ad98-4fb9-b9f2-32679d140734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:23.731575 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1836/3670] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:23 2022] DELETE /identity/v3/projects/1ed42b311e9341358c72a67046c36100 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:23.738069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01b01-8d6f-47ef-be5e-4f4b752460eb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:23.739278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01b01-8d6f-47ef-be5e-4f4b752460eb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:23.740557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da01b01-8d6f-47ef-be5e-4f4b752460eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:23.787037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6da01b01-8d6f-47ef-be5e-4f4b752460eb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:23.788351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6da01b01-8d6f-47ef-be5e-4f4b752460eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:23.822673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:23.915186 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1835/3671] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:23.926204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701674e-8642-453d-a83e-44af6b50ca97 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:23.926564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701674e-8642-453d-a83e-44af6b50ca97 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:23.926942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701674e-8642-453d-a83e-44af6b50ca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:23.963896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f701674e-8642-453d-a83e-44af6b50ca97 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:23.974592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f701674e-8642-453d-a83e-44af6b50ca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:23.987980 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1837/3672] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:23.993089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01b01-8d6f-47ef-be5e-4f4b752460eb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:24.006174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da01b01-8d6f-47ef-be5e-4f4b752460eb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:24.014588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:24.015320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:24.015602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:24.015962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:24.016681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:24.016994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:24.018935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:24.054738 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1836/3673] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:24.059570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701674e-8642-453d-a83e-44af6b50ca97 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:24.072093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701674e-8642-453d-a83e-44af6b50ca97 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:24.081008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:24.082243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:24.082732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:24.083518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:24.084313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:24.087240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:24.143971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1838/3674] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:24 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:24.148188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:24.161286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d0fcc-d9c7-4a57-aab7-391c9bb921b8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:24.261757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:24.262551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:24.262835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:24.263480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:24.263845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:24.266264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:24.308388 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1837/3675] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:24 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:24.313008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:24.330414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170874-4c3b-4b6b-84a3-82f821b3bc3a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:24.339726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:24.340434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:24.340713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:24.340986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:24.342416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:24.344612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:24.371825 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1839/3676] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:24.376719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:24.403845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd451-2759-433f-8db1-9703369691b0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:24.417907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1ce17-927b-4e4d-a764-06ec2218a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:24.418612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1ce17-927b-4e4d-a764-06ec2218a192 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:24.418895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1ce17-927b-4e4d-a764-06ec2218a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:24.419172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1ce17-927b-4e4d-a764-06ec2218a192 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:24.419917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1ce17-927b-4e4d-a764-06ec2218a192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:24.421567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1ce17-927b-4e4d-a764-06ec2218a192 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:24.454965 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1838/3677] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:24.458358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:24.524714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a2e1-bb7b-40f5-84a9-f38ea742dbc6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:24.544721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:24.548449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:24.548935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:24.549385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] PATH_INFO: `/v3/projects/1762755b935f494aa345b5b47622e418/users/f882ced65b2e4214b210fc7f256da85c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:24.630890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1762755b935f494aa345b5b47622e418, user_id=f882ced65b2e4214b210fc7f256da85c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:24.637809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:24.661997 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1840/3678] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:24 2022] PUT /identity/v3/projects/1762755b935f494aa345b5b47622e418/users/f882ced65b2e4214b210fc7f256da85c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:24.762522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21497c-0286-4ade-a33d-39a21629f251 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:24.763111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21497c-0286-4ade-a33d-39a21629f251 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:24.763111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21497c-0286-4ade-a33d-39a21629f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:24.804423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2f21497c-0286-4ade-a33d-39a21629f251 None None] MFA Rules not processed for user `f882ced65b2e4214b210fc7f256da85c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:24.805897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f21497c-0286-4ade-a33d-39a21629f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:24.977605 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1839/3679] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:24.982874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:25.105700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb20d7a-e336-4b05-92a7-625e842c72d5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:25.112846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:25.114695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:25.115242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:25.115654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:25.116807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:25.121983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:25.180468 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1841/3680] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:24 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:25.184054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21497c-0286-4ade-a33d-39a21629f251 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:25.215700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21497c-0286-4ade-a33d-39a21629f251 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:25.234964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:25.309491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:25.310446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:25.310748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:25.311161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:25.311873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:25.314748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:25.367529 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1840/3681] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:25 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:25.369842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:25.392464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b03c11-147a-4ca4-96b9-1c8f4ff4536a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:25.402787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:25.405555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:25.405555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:25.405555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:25.405555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:25.409123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:25.427067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1842/3682] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:25.430458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:25.451053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335a6d-cebd-47e5-9c92-375d62e595f9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:25.461297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:25.462233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:25.462495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:25.462838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] PATH_INFO: `/v3/projects/74b7655063754ba79d6bd122b45361a6/users/8403a33ed86b42b6b0674d7e2e256683/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:25.538812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b7655063754ba79d6bd122b45361a6, user_id=8403a33ed86b42b6b0674d7e2e256683, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:25.559770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:25.638006 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1841/3683] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:25 2022] PUT /identity/v3/projects/74b7655063754ba79d6bd122b45361a6/users/8403a33ed86b42b6b0674d7e2e256683/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:25.642226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:25.665973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ff6a-01fc-46f0-875a-835303cf6ef3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:25.747016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:25.865762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87131056-9e58-44a5-b495-5af88e6dbf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:25.866469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131056-9e58-44a5-b495-5af88e6dbf72 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:25.866751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131056-9e58-44a5-b495-5af88e6dbf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:25.867025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131056-9e58-44a5-b495-5af88e6dbf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:25.868548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87131056-9e58-44a5-b495-5af88e6dbf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:25.870667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87131056-9e58-44a5-b495-5af88e6dbf72 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:25.900932 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1843/3684] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:25.902201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:25.953414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc390f04-e3ba-4108-a121-2d0498ad7403 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:25.963670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:25.964781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:25.965242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:25.965633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] PATH_INFO: `/v3/projects/74b7655063754ba79d6bd122b45361a6/users/8403a33ed86b42b6b0674d7e2e256683/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:25.970197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b7655063754ba79d6bd122b45361a6, user_id=8403a33ed86b42b6b0674d7e2e256683, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:25.973333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:26.027261 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1842/3685] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:25 2022] PUT /identity/v3/projects/74b7655063754ba79d6bd122b45361a6/users/8403a33ed86b42b6b0674d7e2e256683/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:26.038939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ae67e-92f5-4f22-955e-de4c9869c882 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:26.039312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ae67e-92f5-4f22-955e-de4c9869c882 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:26.039546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ae67e-92f5-4f22-955e-de4c9869c882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:26.102500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6b2ae67e-92f5-4f22-955e-de4c9869c882 None None] MFA Rules not processed for user `8403a33ed86b42b6b0674d7e2e256683`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:26.105189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6b2ae67e-92f5-4f22-955e-de4c9869c882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:26.300406 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1844/3686] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:26.302013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:26.333198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3a578-93f3-475c-83d5-56f27eb25c0f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:26.358289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:26.363880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:26.364196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:26.364497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:26.365420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:26.380412 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:26.380412 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:26.380412 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:26.382676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:26.455443 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1843/3687] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:14:26 2022] POST /identity/v3/domains => generated 274 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:26.456797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ae67e-92f5-4f22-955e-de4c9869c882 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:26.493904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ae67e-92f5-4f22-955e-de4c9869c882 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:26.689744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:26.692652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:26.693182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:26.694197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:26.695481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:26.696962 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:26.696962 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:26.696962 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:26.698737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:26.750482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:26.751155 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1845/3688] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:26 2022] POST /identity/v3/groups => generated 280 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:26.767170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218bed-0d2e-41ee-b6f1-17970caf7d9b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:26.772836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:26.774153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:26.774688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:26.775280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/5955a2e816284b18b9f3eeb53e13018f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:26.786659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:update_group(group_id=5955a2e816284b18b9f3eeb53e13018f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:26.790064 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:26.790064 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:26.790064 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:26.800112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:26.829767 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1844/3689] 10.222.0.30 () {60 vars in 1246 bytes} [Sat Jun 18 22:14:26 2022] PATCH /identity/v3/groups/5955a2e816284b18b9f3eeb53e13018f => generated 292 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:14:26.834130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:26.850386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92edead-47e1-41fa-9d56-5f220f8b1084 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:26.856493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:26.857853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:26.858409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:26.858868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/5955a2e816284b18b9f3eeb53e13018f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:26.867714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:get_group(group_id=5955a2e816284b18b9f3eeb53e13018f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:26.869163 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:26.869163 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:26.869163 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:26.871233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:26.873385 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1846/3690] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:26 2022] GET /identity/v3/groups/5955a2e816284b18b9f3eeb53e13018f => generated 292 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:26.877782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:26.902353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab167b-d17b-4a2f-8a66-556ad16e187c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:26.916865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:26.918029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:26.918364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:26.918739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/5955a2e816284b18b9f3eeb53e13018f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:26.926460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:update_group(group_id=5955a2e816284b18b9f3eeb53e13018f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:26.930956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:26.964669 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1845/3691] 10.222.0.30 () {60 vars in 1245 bytes} [Sat Jun 18 22:14:26 2022] PATCH /identity/v3/groups/5955a2e816284b18b9f3eeb53e13018f => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:26.969172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:26.982516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae481c-ffcb-4b1d-9612-b6cd791f5638 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:26.991522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:26.992471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:26.992793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:26.993151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/5955a2e816284b18b9f3eeb53e13018f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:27.003384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5955a2e816284b18b9f3eeb53e13018f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:27.004896 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:27.004896 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:27.004896 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:27.005825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:27.046363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:27.116925 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1847/3692] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:14:26 2022] DELETE /identity/v3/groups/5955a2e816284b18b9f3eeb53e13018f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:27.117157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:27.131472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a200b-843e-48a8-9423-612c734b986e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:27.266271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:27.266980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:27.267261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:27.267535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:27.268386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:27.269522 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:27.269522 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:27.269522 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:27.270724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:27.299406 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1846/3693] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:27 2022] POST /identity/v3/groups => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:27.304745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:27.325835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4f5-15a2-481c-9bdd-7be25d176f8a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:27.361127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:27.361930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:27.362203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:27.362599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:27.363287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:27.365239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:27.430263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1848/3694] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:27 2022] POST /identity/v3/users => generated 323 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:27.430669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:27.442692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d9d8-1301-4d73-8de3-42a8f2046d14 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:27.450179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:27.451736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:27.452194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:27.452617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/011a35ded0e7472fac40d738885dc743` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:27.479030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:UPDATE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:27.489270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=011a35ded0e7472fac40d738885dc743)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:27.494216 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:27.494216 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:27.494216 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:27.497203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:27.572945 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1847/3695] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:14:27 2022] PUT /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/011a35ded0e7472fac40d738885dc743 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:27.578303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:27.606127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeabc90-693f-4483-beb8-8c16a4ab4772 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:27.768160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:27.769023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:27.769331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:27.769728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:27.772560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:27.778867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:27.848157 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1849/3696] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:27 2022] POST /identity/v3/users => generated 323 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:27.849545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:27.869456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a93903-4485-47f7-9846-b7785f03c670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:27.885855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:27.887205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:27.887752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:27.888026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/baaf19091174458ea9b264b23b94c91c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:27.928658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=baaf19091174458ea9b264b23b94c91c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:27.930680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:27.994816 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1848/3697] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:14:27 2022] PUT /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/baaf19091174458ea9b264b23b94c91c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:27.999483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:28.055130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f280-5487-40bd-ae1b-56ca54858d05 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:28.284380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:28.285515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:28.285917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:28.286404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:28.288379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:28.290812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:28.359657 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1850/3698] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:27 2022] POST /identity/v3/users => generated 321 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:28.364242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:28.384198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e17e25-b604-49f0-8061-405603428d1e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:28.399803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:28.401513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:28.402847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:28.403473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/d409fa1e72bc41bca5f231bff96a54e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:28.431304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=d409fa1e72bc41bca5f231bff96a54e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:28.434459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:28.496908 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1849/3699] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:14:28 2022] PUT /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/d409fa1e72bc41bca5f231bff96a54e4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:28.502323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:28.525568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6937ac-5bb1-4be0-8e0c-fc6460f4fcc5 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:28.607205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=4,keystone:INSERT=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:28.749081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:28.750872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:28.755453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:28.756060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:28.759507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=6d5b924c292f46cc85cbc4d1430738b8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:28.761715 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:28.761715 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:28.761715 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:28.764185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:28.792545 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1851/3700] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:14:28 2022] GET /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users => generated 1083 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:28.796662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:28.810721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40970c7-5aee-4ab0-b271-ff8fdbb93a58 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:28.842319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:28.844152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:28.846841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:28.848356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/011a35ded0e7472fac40d738885dc743` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:28.868914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=011a35ded0e7472fac40d738885dc743)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:28.881592 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:28.881592 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:28.881592 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:28.884125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:28.950844 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1850/3701] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Jun 18 22:14:28 2022] HEAD /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/011a35ded0e7472fac40d738885dc743 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:28.955946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:28.974980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cde52-ddd3-41f2-9f57-3544a2d63f96 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:28.989810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:28.993381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:28.993844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:28.995948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/011a35ded0e7472fac40d738885dc743` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:29.000598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=011a35ded0e7472fac40d738885dc743)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:29.004772 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:29.004772 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:29.004772 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:29.006596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:29.033159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '011a35ded0e7472fac40d738885dc743'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:29.084347 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1852/3702] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:14:28 2022] DELETE /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/011a35ded0e7472fac40d738885dc743 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:29.088558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:29.105764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e4522-fefb-4190-a8dc-1598bf92605e tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:29.214420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:29.216081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:29.216519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:29.216943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/baaf19091174458ea9b264b23b94c91c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:29.219358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=baaf19091174458ea9b264b23b94c91c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:29.222721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:29.275206 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1851/3703] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Jun 18 22:14:29 2022] HEAD /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/baaf19091174458ea9b264b23b94c91c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:29.279350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:29.298932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d67be-2859-48b8-bb38-db1f95b5209d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:29.314794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:29.316077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:29.316898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:29.317362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/baaf19091174458ea9b264b23b94c91c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:29.320018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=baaf19091174458ea9b264b23b94c91c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:29.323806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:29.336836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'baaf19091174458ea9b264b23b94c91c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:29.356099 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1853/3704] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:14:29 2022] DELETE /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/baaf19091174458ea9b264b23b94c91c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:29.360608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:29.376660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e208-b84c-43b7-9074-4192634a23a1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:29.475134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:29.498775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:29.500648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:29.500869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:29.501889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/d409fa1e72bc41bca5f231bff96a54e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:29.504749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=d409fa1e72bc41bca5f231bff96a54e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:29.508093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:29.532231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1852/3705] 10.222.0.30 () {58 vars in 1341 bytes} [Sat Jun 18 22:14:29 2022] HEAD /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/d409fa1e72bc41bca5f231bff96a54e4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:29.538756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:29.552320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7837152-8f48-435c-94b0-c01e62641670 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:29.564361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:29.565460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:29.565817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:29.566212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/d409fa1e72bc41bca5f231bff96a54e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:29.575541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6d5b924c292f46cc85cbc4d1430738b8, user_id=d409fa1e72bc41bca5f231bff96a54e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:29.578206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:29.594273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd409fa1e72bc41bca5f231bff96a54e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:29.626626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1854/3706] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:14:29 2022] DELETE /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users/d409fa1e72bc41bca5f231bff96a54e4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:29.628594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:29.658501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c650f85-917f-474c-b437-0618155fa809 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:29.772910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:29.773887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:29.774085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:29.774524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:29.781883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=6d5b924c292f46cc85cbc4d1430738b8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:29.784363 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:29.784363 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:29.784363 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:29.786536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:29.842741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:29.843917 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1853/3707] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:14:29 2022] GET /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8/users => generated 145 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:29.858970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156c4a4-e0f3-4638-bfc0-87431f92cced tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:29.888467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:29.890372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:29.891228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:29.891737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users/d409fa1e72bc41bca5f231bff96a54e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:29.893781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d409fa1e72bc41bca5f231bff96a54e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:29.897432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:29.972167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd409fa1e72bc41bca5f231bff96a54e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:29.973212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd409fa1e72bc41bca5f231bff96a54e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.015072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd409fa1e72bc41bca5f231bff96a54e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.016336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd409fa1e72bc41bca5f231bff96a54e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.033060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd409fa1e72bc41bca5f231bff96a54e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.055299 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1855/3708] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:29 2022] DELETE /identity/v3/users/d409fa1e72bc41bca5f231bff96a54e4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:30.056532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:30.059133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:30.093301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40bd1e-c137-43dd-9548-49dbd01345a4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:30.239506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:30.242359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:30.242999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:30.244128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users/baaf19091174458ea9b264b23b94c91c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:30.246730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_user(user_id=baaf19091174458ea9b264b23b94c91c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:30.248779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:30.329426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaf19091174458ea9b264b23b94c91c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.332758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaf19091174458ea9b264b23b94c91c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.358939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaf19091174458ea9b264b23b94c91c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.359900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaf19091174458ea9b264b23b94c91c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.367950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaf19091174458ea9b264b23b94c91c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.372973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:30.394665 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1854/3709] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:30 2022] DELETE /identity/v3/users/baaf19091174458ea9b264b23b94c91c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:30.399042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:30.411443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca1bcd-b6fa-43fd-807f-c87f3905bb59 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:30.474587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:30.541586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:30.542951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:30.543299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:30.543681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users/011a35ded0e7472fac40d738885dc743` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:30.545270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_user(user_id=011a35ded0e7472fac40d738885dc743)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:30.547140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:30.672362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011a35ded0e7472fac40d738885dc743'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.673346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011a35ded0e7472fac40d738885dc743'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.692979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011a35ded0e7472fac40d738885dc743'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.694051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011a35ded0e7472fac40d738885dc743'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.707429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011a35ded0e7472fac40d738885dc743'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:30.731965 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1856/3710] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:30 2022] DELETE /identity/v3/users/011a35ded0e7472fac40d738885dc743 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:30.736965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:30.739474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:30.758125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb0d8-bbc9-4453-abad-fb3b0d45fb31 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:30.852988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:30.852988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:30.852988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:30.853450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/6d5b924c292f46cc85cbc4d1430738b8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:30.855609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6d5b924c292f46cc85cbc4d1430738b8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:30.856576 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:30.856576 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:30.856576 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:30.858403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:30.949290 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1855/3711] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:14:30 2022] DELETE /identity/v3/groups/6d5b924c292f46cc85cbc4d1430738b8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:30.955791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:30.958123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:30.973799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551d6aa-f4b4-43ae-aaae-13a759fa2187 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.054301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.055305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.055749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.056025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.056930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.059612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.077444 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1857/3712] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:30 2022] POST /identity/v3/groups => generated 326 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:31.081343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.094793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb67b6-0e29-4338-9088-d200f13fa687 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.100745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.101581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.102090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.102311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.103317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.105719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.122916 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1856/3713] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:31 2022] POST /identity/v3/groups => generated 325 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:31.127347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.143099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd76ab-3139-4b25-a7bf-2237e75e778b tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.150651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.151327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.151664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.152056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.153359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.154966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.172416 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1858/3714] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:31 2022] POST /identity/v3/groups => generated 327 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:31.177205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.188463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d233b-eace-4bec-8253-c42486c55bb0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.196419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.197406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.197842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.198506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.199741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.202677 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:31.202677 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:31.202677 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:31.204378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.213847 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1857/3715] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:14:31 2022] GET /identity/v3/groups => generated 1488 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:31.218843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.233207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a16786-9590-4b3e-9f02-9d4f2463931d tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.239057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.240271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.240568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.240880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/9ad4a6e824574511aa8e0f0def79cc45` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.249465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9ad4a6e824574511aa8e0f0def79cc45)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.252149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.279513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:31.322024 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1859/3716] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:14:31 2022] DELETE /identity/v3/groups/9ad4a6e824574511aa8e0f0def79cc45 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:31.326639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.338378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2ae0e-2502-4cfa-9bf1-419f8c0dcf3c tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.462692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.464282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.464906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.465332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/a7194d87a0994d0ebea930da4c5251f2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.478788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a7194d87a0994d0ebea930da4c5251f2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.481723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.525834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:31.550775 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1858/3717] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:14:31 2022] DELETE /identity/v3/groups/a7194d87a0994d0ebea930da4c5251f2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:31.555638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.568155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b19d6-40b6-4944-b4c2-61ae5878a51f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.652564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.653684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.654199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.655248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/366a33be2b5f48aca3a314e72d0c48b5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.662000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_group(group_id=366a33be2b5f48aca3a314e72d0c48b5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.664486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.726271 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1860/3718] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:14:31 2022] DELETE /identity/v3/groups/366a33be2b5f48aca3a314e72d0c48b5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:31.731911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.745480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616350ad-fc21-4a77-8c30-a1e4316c27e4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.859034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.859951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.860362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.860714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.861592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.864082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.902450 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1859/3719] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:31 2022] POST /identity/v3/users => generated 321 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:31.907390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.919705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d696-8ed4-482c-87f1-cb6cf061108a tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.928823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.929608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.929906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.930186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:31.931821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:31.933600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:31.957591 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1861/3720] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:31 2022] POST /identity/v3/groups => generated 326 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:31.962333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:31.977432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975aba-293a-4021-a29d-ee70f3caba0f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:31.983721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:31.986650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:31.986991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:31.987309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/a3e5dd47c35442d8810dfa666f859a53/users/1646469fc9814e8cb3ecb9431aeb061d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:32.016808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a3e5dd47c35442d8810dfa666f859a53, user_id=1646469fc9814e8cb3ecb9431aeb061d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:32.019444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:32.053088 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1860/3721] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:14:31 2022] PUT /identity/v3/groups/a3e5dd47c35442d8810dfa666f859a53/users/1646469fc9814e8cb3ecb9431aeb061d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:32.056771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:32.069764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe6c87-5212-4e14-aa25-74061489c3ce tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:32.154568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:32.155371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:32.155802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:32.156548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:32.157706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:32.160151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:32.192905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1862/3722] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:32 2022] POST /identity/v3/groups => generated 326 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:32.196601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:32.215139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78086879-0575-445f-af6a-7e0913423865 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:32.221719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:32.223122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:32.225286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:32.225631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/3fe83087cb19443783f6a4015f4e9d22/users/1646469fc9814e8cb3ecb9431aeb061d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:32.241985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3fe83087cb19443783f6a4015f4e9d22, user_id=1646469fc9814e8cb3ecb9431aeb061d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:32.244902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:32.299071 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1861/3723] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:14:32 2022] PUT /identity/v3/groups/3fe83087cb19443783f6a4015f4e9d22/users/1646469fc9814e8cb3ecb9431aeb061d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:32.304877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:32.320025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aba10-e135-47bc-a0a8-8accac001abd tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:32.348564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:32.351305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:32.352833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:32.535502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:32.539839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:32.551812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:32.552503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users/1646469fc9814e8cb3ecb9431aeb061d/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:32.574137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8d9fc-a82c-4bc4-bf17-f014e4c457d0 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:32.577276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=1646469fc9814e8cb3ecb9431aeb061d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:32.598662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:32.602116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:32.604368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:32.604634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:32.604932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] PATH_INFO: `/v3/users/27c40405bf7547b4b1b896b142ea4156` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:32.608339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c40405bf7547b4b1b896b142ea4156)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:32.618870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:32.635215 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1863/3724] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:14:32 2022] GET /identity/v3/users/1646469fc9814e8cb3ecb9431aeb061d/groups => generated 838 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:32.636439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:32.652537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd1ba-0126-45ba-ac11-b90ba704991f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:32.663964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:32.666524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:32.666914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:32.667264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/3fe83087cb19443783f6a4015f4e9d22` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:32.669150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3fe83087cb19443783f6a4015f4e9d22)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:32.673477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:32.715933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:32.813569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c40405bf7547b4b1b896b142ea4156'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:32.816586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c40405bf7547b4b1b896b142ea4156'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:32.899573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c40405bf7547b4b1b896b142ea4156'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:32.900581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c40405bf7547b4b1b896b142ea4156'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:32.914880 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1864/3725] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:14:32 2022] DELETE /identity/v3/groups/3fe83087cb19443783f6a4015f4e9d22 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:32.919167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:32.922107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:32.936545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c40405bf7547b4b1b896b142ea4156'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:32.998791 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1862/3726] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:32 2022] DELETE /identity/v3/users/27c40405bf7547b4b1b896b142ea4156 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:33.157234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7931f3b-8af3-45a4-a92b-f493acb031c1 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:33.408781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:33.411218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:33.411621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:33.412341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/groups/a3e5dd47c35442d8810dfa666f859a53` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:33.416468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a3e5dd47c35442d8810dfa666f859a53)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:33.420575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:33.437165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:33.507064 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1865/3727] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:14:32 2022] DELETE /identity/v3/groups/a3e5dd47c35442d8810dfa666f859a53 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:33.511293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:33.529271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e3341-baf5-4647-87ce-0092418af026 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:33.632703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:33.633966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:33.634107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:33.634797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/users/1646469fc9814e8cb3ecb9431aeb061d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:33.636752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1646469fc9814e8cb3ecb9431aeb061d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:33.639044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:33.691113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1646469fc9814e8cb3ecb9431aeb061d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.691578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1646469fc9814e8cb3ecb9431aeb061d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.706716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1646469fc9814e8cb3ecb9431aeb061d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.707545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1646469fc9814e8cb3ecb9431aeb061d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.715950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1646469fc9814e8cb3ecb9431aeb061d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.730332 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1863/3728] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:33 2022] DELETE /identity/v3/users/1646469fc9814e8cb3ecb9431aeb061d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:33.735577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:33.741598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:33.753411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55727d8b-38c8-4058-8923-babb39a5d2d4 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:33.818143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:33.819318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:33.819592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:33.819896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/domains/722670d13abf48bc89b61249945ffa0a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:33.821587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=722670d13abf48bc89b61249945ffa0a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:33.823771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:33.849927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '722670d13abf48bc89b61249945ffa0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.850727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '722670d13abf48bc89b61249945ffa0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.883614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '722670d13abf48bc89b61249945ffa0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.884378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '722670d13abf48bc89b61249945ffa0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:33.887396 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1866/3729] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:14:33 2022] PATCH /identity/v3/domains/722670d13abf48bc89b61249945ffa0a => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:33.891565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:33.903354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3bd9b-d5e5-47d9-9ac8-1cbb789d74fe tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:33.915867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:33.977006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8403a33ed86b42b6b0674d7e2e256683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74b7655063754ba79d6bd122b45361a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:33.978842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:33.979132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:33.979422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] PATH_INFO: `/v3/domains/722670d13abf48bc89b61249945ffa0a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:33.998600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=722670d13abf48bc89b61249945ffa0a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:34.000234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:34.027296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '722670d13abf48bc89b61249945ffa0a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.032880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '722670d13abf48bc89b61249945ffa0a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.093421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722670d13abf48bc89b61249945ffa0a', 'request_id': 'req-b717f8f6-9b2e-42ca-b426-059a3ffd601f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.101174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722670d13abf48bc89b61249945ffa0a', 'request_id': 'req-b717f8f6-9b2e-42ca-b426-059a3ffd601f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.111715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722670d13abf48bc89b61249945ffa0a', 'request_id': 'req-b717f8f6-9b2e-42ca-b426-059a3ffd601f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.124330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] The token cache is being invalidate because project 722670d13abf48bc89b61249945ffa0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:34.124625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.125349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.135766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '722670d13abf48bc89b61249945ffa0a', 'request_id': 'req-b717f8f6-9b2e-42ca-b426-059a3ffd601f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.136678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '722670d13abf48bc89b61249945ffa0a', 'request_id': 'req-b717f8f6-9b2e-42ca-b426-059a3ffd601f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.137346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '722670d13abf48bc89b61249945ffa0a', 'request_id': 'req-b717f8f6-9b2e-42ca-b426-059a3ffd601f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.146938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1864/3730] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:33 2022] DELETE /identity/v3/domains/722670d13abf48bc89b61249945ffa0a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:34.151240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:34.152857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:34.250745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef175-3847-4b0b-a319-30b840206990 tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:34.285146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:34.287046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:34.329304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:34.388030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:34.389423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:34.391509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:34.392100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:34.392669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] PATH_INFO: `/v3/users/f882ced65b2e4214b210fc7f256da85c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:34.395485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f882ced65b2e4214b210fc7f256da85c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:34.398748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:34.421559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717f8f6-9b2e-42ca-b426-059a3ffd601f tempest-GroupsV3TestJSON-658983985 tempest-GroupsV3TestJSON-658983985-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:34.431812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:34.433513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:34.433912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:34.434314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] PATH_INFO: `/v3/projects/07a129b1f88f4c4f97cc3a9f76ef47f1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:34.436757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a129b1f88f4c4f97cc3a9f76ef47f1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:34.441630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:34.487723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f882ced65b2e4214b210fc7f256da85c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.489813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f882ced65b2e4214b210fc7f256da85c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.520853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f882ced65b2e4214b210fc7f256da85c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.522872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f882ced65b2e4214b210fc7f256da85c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.529449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'request_id': 'req-400255d6-03f3-48a2-9ef9-5ab1e044544e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.538414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'request_id': 'req-400255d6-03f3-48a2-9ef9-5ab1e044544e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.549442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0324e040-e40a-4f79-89ef-fa528874c6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f882ced65b2e4214b210fc7f256da85c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.552034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'request_id': 'req-400255d6-03f3-48a2-9ef9-5ab1e044544e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.589561 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1867/3731] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:34 2022] DELETE /identity/v3/users/f882ced65b2e4214b210fc7f256da85c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:34.598463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] The token cache is being invalidate because project 07a129b1f88f4c4f97cc3a9f76ef47f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:34.599037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.599772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:34.600362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.601013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:34.601386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:34.609534 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1865/3732] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:34 2022] DELETE /identity/v3/projects/07a129b1f88f4c4f97cc3a9f76ef47f1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:34.611553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:34.614447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:34.641959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:34.643675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:34.751787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400255d6-03f3-48a2-9ef9-5ab1e044544e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:34.770513 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1868/3733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:34.788286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:34.790566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:34.842562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:34.843863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:34.844348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:34.844884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] PATH_INFO: `/v3/users/fb5c8b75df134bb2ab746367194ba966` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:34.846840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5c8b75df134bb2ab746367194ba966)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:34.849994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:34.912000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:34.913123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172d1e6-ad52-47b3-b4ac-609ac704b0ee None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:34.917738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:34.919820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:34.920098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:34.920554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:34.931489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:34.937007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:34.939711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:34.949679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5c8b75df134bb2ab746367194ba966'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.952250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5c8b75df134bb2ab746367194ba966'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.956781 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1869/3734] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:14:34.975425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5c8b75df134bb2ab746367194ba966'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.976348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5c8b75df134bb2ab746367194ba966'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:34.985575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5c8b75df134bb2ab746367194ba966'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.013356 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1866/3735] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:34 2022] DELETE /identity/v3/users/fb5c8b75df134bb2ab746367194ba966 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:35.369794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:35.388227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16406c-8745-45eb-973a-b02df50fd530 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:35.421065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:35.422534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:35.516953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:35.517885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:35.518165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:35.518440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] PATH_INFO: `/v3/projects/0a127c872bca439da95648029d28bef2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:35.520030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a127c872bca439da95648029d28bef2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:35.521794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:35.557618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba014-d6eb-4c41-9476-2233fba3f6e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:35.563839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:35.565073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:35.565244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:35.565483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] PATH_INFO: `/v3/projects/1762755b935f494aa345b5b47622e418` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:35.570391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1762755b935f494aa345b5b47622e418)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:35.574344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:35.579363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a127c872bca439da95648029d28bef2', 'request_id': 'req-565986e7-2918-4488-b17b-1a58714041bd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.586771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a127c872bca439da95648029d28bef2', 'request_id': 'req-565986e7-2918-4488-b17b-1a58714041bd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.601684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a127c872bca439da95648029d28bef2', 'request_id': 'req-565986e7-2918-4488-b17b-1a58714041bd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.617211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] The token cache is being invalidate because project 0a127c872bca439da95648029d28bef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:35.617765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.618855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-565986e7-2918-4488-b17b-1a58714041bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.621077 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1870/3736] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:35 2022] DELETE /identity/v3/projects/0a127c872bca439da95648029d28bef2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:35.630261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0e1cc-c3b3-4d5c-a0a9-ab820c0c8897 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:35.630889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0e1cc-c3b3-4d5c-a0a9-ab820c0c8897 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:35.631006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0e1cc-c3b3-4d5c-a0a9-ab820c0c8897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:35.656494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f4b0e1cc-c3b3-4d5c-a0a9-ab820c0c8897 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:35.658173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f4b0e1cc-c3b3-4d5c-a0a9-ab820c0c8897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:35.721973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1762755b935f494aa345b5b47622e418', 'request_id': 'req-0030d375-d58e-417a-8ce0-c80d9b962b11'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.735438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1762755b935f494aa345b5b47622e418', 'request_id': 'req-0030d375-d58e-417a-8ce0-c80d9b962b11'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.749424 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1871/3737] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:35.759408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a9856-f8d5-49cf-af92-76e6c5e4544b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:35.759851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a9856-f8d5-49cf-af92-76e6c5e4544b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:35.760153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a9856-f8d5-49cf-af92-76e6c5e4544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:35.762529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1762755b935f494aa345b5b47622e418', 'request_id': 'req-0030d375-d58e-417a-8ce0-c80d9b962b11'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.792187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d74a9856-f8d5-49cf-af92-76e6c5e4544b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:35.794458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] The token cache is being invalidate because project 1762755b935f494aa345b5b47622e418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:35.794613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d74a9856-f8d5-49cf-af92-76e6c5e4544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:35.795195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.796249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:35.798892 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1867/3738] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:35 2022] DELETE /identity/v3/projects/1762755b935f494aa345b5b47622e418 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:35.804509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:35.806301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:35.905610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:35.926797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:35.971903 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1872/3739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:35.977741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a9856-f8d5-49cf-af92-76e6c5e4544b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:35.995238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d375-d58e-417a-8ce0-c80d9b962b11 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.001726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a9856-f8d5-49cf-af92-76e6c5e4544b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.007574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.008517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.010011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.010011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.010426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:36.010733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.012358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.012837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.016332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.017151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.017309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] PATH_INFO: `/v3/users/8403a33ed86b42b6b0674d7e2e256683` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.021168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8403a33ed86b42b6b0674d7e2e256683)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.023431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.037146 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1873/3740] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:14:36.040192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:36.063716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d236c-e252-42e5-94e8-e9f68554969e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.069947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.071310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.071899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.072799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.073390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.077105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.092380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8403a33ed86b42b6b0674d7e2e256683'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:36.093712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8403a33ed86b42b6b0674d7e2e256683'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:36.113508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8403a33ed86b42b6b0674d7e2e256683'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:36.114893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8403a33ed86b42b6b0674d7e2e256683'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:36.117543 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1874/3741] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:36 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:36.122473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:36.124478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8403a33ed86b42b6b0674d7e2e256683'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:36.124750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:36.145222 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1868/3742] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:35 2022] DELETE /identity/v3/users/8403a33ed86b42b6b0674d7e2e256683 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:36.235894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c791146-3331-471c-a0a2-7b1b694a46f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.336696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.337954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.338371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.338932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.340062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.344713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.383090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1875/3743] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:36 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:36.388361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:36.399730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc54ce-62f6-4c8d-bb67-fed26471f1dc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.404813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.405766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.406056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.406426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.407247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.408891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.421938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1869/3744] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:36.426645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:36.438678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796ee8-f93f-4e67-bd9b-4adf91a62574 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.444550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a6018-6fe4-4add-8a07-d201736c5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.445462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6018-6fe4-4add-8a07-d201736c5a8c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.445974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6018-6fe4-4add-8a07-d201736c5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.446313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6018-6fe4-4add-8a07-d201736c5a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.447355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a6018-6fe4-4add-8a07-d201736c5a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.449468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a6018-6fe4-4add-8a07-d201736c5a8c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.465327 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1876/3745] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:36.480817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:36.500630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a93a0-55f8-4626-9a87-dabb0da1c10f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.513682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.516187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.516729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.517237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] PATH_INFO: `/v3/projects/e2081fc5f4c6409398efe4fab6ee56a4/users/bc000376129246968d4bed35176afb29/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.544441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2081fc5f4c6409398efe4fab6ee56a4, user_id=bc000376129246968d4bed35176afb29, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.555353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.603080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1870/3746] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:36 2022] PUT /identity/v3/projects/e2081fc5f4c6409398efe4fab6ee56a4/users/bc000376129246968d4bed35176afb29/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:36.615014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.615785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.615942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.631798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:36.635547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:36.693772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] MFA Rules not processed for user `bc000376129246968d4bed35176afb29`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:36.695075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:36.719321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:36.839254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fe8d2-3cd3-470d-b532-d233dca32003 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:36.845580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:36.847118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:36.847566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:36.848002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] PATH_INFO: `/v3/projects/74b7655063754ba79d6bd122b45361a6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:36.849667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b7655063754ba79d6bd122b45361a6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:36.852804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:36.898013 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1877/3747] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:36.915139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:36.924995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:36.927163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:36.975217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b7655063754ba79d6bd122b45361a6', 'request_id': 'req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:36.998887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b7655063754ba79d6bd122b45361a6', 'request_id': 'req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.016327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b7655063754ba79d6bd122b45361a6', 'request_id': 'req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.043379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] The token cache is being invalidate because project 74b7655063754ba79d6bd122b45361a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:37.044070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.045810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5df0d0a9-ff4e-494d-b21f-b05ca62bad1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.051666 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1871/3748] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:36 2022] DELETE /identity/v3/projects/74b7655063754ba79d6bd122b45361a6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:37.059029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f4f4-05ed-4371-a1b7-137a53ba590d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.060227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d67d1-243e-4dd7-8eab-036fab22971c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.060946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d67d1-243e-4dd7-8eab-036fab22971c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.061469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d67d1-243e-4dd7-8eab-036fab22971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.093070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4c5d67d1-243e-4dd7-8eab-036fab22971c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:37.094550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c5d67d1-243e-4dd7-8eab-036fab22971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.210458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.211131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.211409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.211683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.219317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.243523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1872/3749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:37.248772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b8a9-649c-4fc6-bc2e-f258b5a4f120 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.249677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b8a9-649c-4fc6-bc2e-f258b5a4f120 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.249962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03b8a9-649c-4fc6-bc2e-f258b5a4f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.302864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2e03b8a9-649c-4fc6-bc2e-f258b5a4f120 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:37.306708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2e03b8a9-649c-4fc6-bc2e-f258b5a4f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.329307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:37.334611 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1873/3750] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:37.339370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03b8a9-649c-4fc6-bc2e-f258b5a4f120 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.351159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03b8a9-649c-4fc6-bc2e-f258b5a4f120 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.358282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.359301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.359427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.359786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.360492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.361183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:37.361627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.362606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.364333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.379465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1878/3751] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:14:37.385507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1874/3752] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:37.391913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.420768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e1d8-e9e9-4679-8424-7cb8327ed706 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.434477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.436629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.438334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.438334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.440220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.446182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.485968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.488502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.522926 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1879/3753] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:37 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:37.526941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.624915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7407b5a-293e-45fa-9023-6f3960d5f391 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.631933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.632762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.633136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.633463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.634319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.639237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.686382 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1880/3754] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:37 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:37.688085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.696177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2c9a-4599-4c60-a9fb-5a3e5e94900b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.712755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6f09-fb8f-4572-8e6e-51ca911f2de2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.720418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.731929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.731929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.731929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.731929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.731929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.752971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1881/3755] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:37.754010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.769761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.778853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81639dcb-9055-4df3-b8c1-f1a364da518a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.786382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.787426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.788665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.788997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] PATH_INFO: `/v3/users/2a7f3b25d8234bf881b76473dbfd8fc7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.789625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:37.790563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7f3b25d8234bf881b76473dbfd8fc7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.793734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.849356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.850125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.850443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.850768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.853612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.869957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.870519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.875410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7f3b25d8234bf881b76473dbfd8fc7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.876697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7f3b25d8234bf881b76473dbfd8fc7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.883590 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1875/3756] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:14:37.884692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.897967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7f3b25d8234bf881b76473dbfd8fc7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.899325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7f3b25d8234bf881b76473dbfd8fc7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.901946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996bf13-d971-4845-9df1-6f0f20866c92 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.906859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:37.907545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:37.908017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:37.908298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:37.909065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:37.910952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:37.924172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7f3b25d8234bf881b76473dbfd8fc7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:37.931537 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1876/3757] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:37.931537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.931792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.948386 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1882/3758] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:37 2022] DELETE /identity/v3/users/2a7f3b25d8234bf881b76473dbfd8fc7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:37.948386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:37.948386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:37.964389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdae11-e820-4d9c-9ca4-92b8272d11ad admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:37.974996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:38.055804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e1ea5-3cd2-43ba-b591-307081bfed30 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:38.062246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060487d-55b2-4059-bdd4-18e39f0dea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.063411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060487d-55b2-4059-bdd4-18e39f0dea8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.063689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060487d-55b2-4059-bdd4-18e39f0dea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.063970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060487d-55b2-4059-bdd4-18e39f0dea8e admin admin] PATH_INFO: `/v3/projects/c09acef7debd4290b43bcd2243dc2d15/users/c5a2202aa194483faa91eb6d140a80cb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.075722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.077709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.078085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.078452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] PATH_INFO: `/v3/users/bc000376129246968d4bed35176afb29` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.080331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc000376129246968d4bed35176afb29)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.083001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.083876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060487d-55b2-4059-bdd4-18e39f0dea8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09acef7debd4290b43bcd2243dc2d15, user_id=c5a2202aa194483faa91eb6d140a80cb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.087449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060487d-55b2-4059-bdd4-18e39f0dea8e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.109573 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1883/3759] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:37 2022] PUT /identity/v3/projects/c09acef7debd4290b43bcd2243dc2d15/users/c5a2202aa194483faa91eb6d140a80cb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:38.122301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99879742-3546-45c2-819e-33e846aac251 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.122621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99879742-3546-45c2-819e-33e846aac251 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.122896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99879742-3546-45c2-819e-33e846aac251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.162171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc000376129246968d4bed35176afb29'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.163308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc000376129246968d4bed35176afb29'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.168503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-99879742-3546-45c2-819e-33e846aac251 None None] MFA Rules not processed for user `c5a2202aa194483faa91eb6d140a80cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:38.169949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-99879742-3546-45c2-819e-33e846aac251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.188978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc000376129246968d4bed35176afb29'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.189791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc000376129246968d4bed35176afb29'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.199593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc000376129246968d4bed35176afb29'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.227246 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1877/3760] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:37 2022] DELETE /identity/v3/users/bc000376129246968d4bed35176afb29 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:38.228501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:38.233922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.271872 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1884/3761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:38.273586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.273917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.274202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.298307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:38.305740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:38.307956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.353127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfbc51-9855-469a-a3a1-0cc7a2084717 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:38.358322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.359269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.359531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.359811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] PATH_INFO: `/v3/projects/f4f6c403962a44408ce491f377e5ab11` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.361059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f6c403962a44408ce491f377e5ab11)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.363837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.398909 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1885/3762] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:38.404208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:38.406019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.427692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f6c403962a44408ce491f377e5ab11', 'request_id': 'req-5ecdef24-b484-45d6-bf5d-44b6e2769a13'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.435044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb02eb9-fee1-4334-b00a-bfdc2598d4fd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:38.438357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f6c403962a44408ce491f377e5ab11', 'request_id': 'req-5ecdef24-b484-45d6-bf5d-44b6e2769a13'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.453024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f6c403962a44408ce491f377e5ab11', 'request_id': 'req-5ecdef24-b484-45d6-bf5d-44b6e2769a13'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.470358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] The token cache is being invalidate because project f4f6c403962a44408ce491f377e5ab11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:38.470931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.472340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:38.473231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:38.475827 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1878/3763] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:38 2022] DELETE /identity/v3/projects/f4f6c403962a44408ce491f377e5ab11 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:38.477327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:38.479259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.581408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdef24-b484-45d6-bf5d-44b6e2769a13 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:38.582602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.586122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.586422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80189add-8a34-4068-a1b0-5cf429dd4ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.586817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.587100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189add-8a34-4068-a1b0-5cf429dd4ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.587405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189add-8a34-4068-a1b0-5cf429dd4ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.587717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189add-8a34-4068-a1b0-5cf429dd4ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.589121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.590151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.590668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-80189add-8a34-4068-a1b0-5cf429dd4ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.597720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.607495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80189add-8a34-4068-a1b0-5cf429dd4ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.609292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80189add-8a34-4068-a1b0-5cf429dd4ed2 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.631812 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1879/3764] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:38.633474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5443944-a3fa-414f-8a22-86d92addd0f6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.633880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5443944-a3fa-414f-8a22-86d92addd0f6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.634183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5443944-a3fa-414f-8a22-86d92addd0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.657148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1886/3765] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:38 2022] POST /identity/v3/projects => generated 389 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:38.661393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:38.665862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c5443944-a3fa-414f-8a22-86d92addd0f6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:38.667778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c5443944-a3fa-414f-8a22-86d92addd0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.669630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.795588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1628a-ea3b-492d-a4ab-0f44b00a041e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:38.809871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.811568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.812098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.812383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.814934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.819567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.829772 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1880/3766] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:38.832740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027eb1b-7568-4bac-adbc-5fa18ddd1959 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.833580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027eb1b-7568-4bac-adbc-5fa18ddd1959 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.834033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027eb1b-7568-4bac-adbc-5fa18ddd1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.844465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:38.858141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3027eb1b-7568-4bac-adbc-5fa18ddd1959 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:38.859736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3027eb1b-7568-4bac-adbc-5fa18ddd1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:38.885255 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1881/3767] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:38.888307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027eb1b-7568-4bac-adbc-5fa18ddd1959 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:38.896310 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1887/3768] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:38 2022] POST /identity/v3/users => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:38.901556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:38.911439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027eb1b-7568-4bac-adbc-5fa18ddd1959 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:38.923417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.924113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.926098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e5d9e-5881-460b-af7a-5f75cba21c89 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:38.926339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.926643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.927724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:38.928136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.933296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.945953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:38.946654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:38.946935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:38.947646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:38.948117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:38.965446 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1882/3769] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:38.965839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:38.974899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:38.994295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1888/3770] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:38.999203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.002399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e0d8-421e-44d3-b994-69a8f5367220 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.008775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.009763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.010175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.010577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.011679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.014280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.032068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b628f9-26d1-41e9-a4d9-a2ae87c38d7d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.047480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.049262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.050697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.051151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] PATH_INFO: `/v3/projects/c93718e8c0534d5bb8694f53199516bc/users/29ee6e6768e643edb4f2586b683c1aa6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.074630 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1883/3771] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:38 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:39.075933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.131289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93718e8c0534d5bb8694f53199516bc, user_id=29ee6e6768e643edb4f2586b683c1aa6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.134383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.165959 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1889/3772] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:38 2022] PUT /identity/v3/projects/c93718e8c0534d5bb8694f53199516bc/users/29ee6e6768e643edb4f2586b683c1aa6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:39.169729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.216978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90ac59-db4e-4dd7-952e-6f6dd3703760 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.334248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e7e7a-861c-4237-b5e9-ff7d4ccf095a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.344205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.345780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.346646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.347075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.347629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.348069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.348523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.349780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.350327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.351210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.352852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.359348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.362406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:39.380873 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1890/3773] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:39.382698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.402949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef148f-6ff0-498c-a6c6-90c87aa1b1d8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.415754 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1884/3774] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:39 2022] POST /identity/v3/users => generated 283 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:39.420831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.427059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b58a3d-2bfa-4ab6-9e89-33ec58907a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.428285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58a3d-2bfa-4ab6-9e89-33ec58907a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.428771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58a3d-2bfa-4ab6-9e89-33ec58907a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.429247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b58a3d-2bfa-4ab6-9e89-33ec58907a04 admin admin] PATH_INFO: `/v3/projects/c93718e8c0534d5bb8694f53199516bc/users/29ee6e6768e643edb4f2586b683c1aa6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.432543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58a3d-2bfa-4ab6-9e89-33ec58907a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93718e8c0534d5bb8694f53199516bc, user_id=29ee6e6768e643edb4f2586b683c1aa6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.437308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b58a3d-2bfa-4ab6-9e89-33ec58907a04 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.442184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7b11-0843-4456-84fd-e3fa2a6fa7f7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.448962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.450312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.450605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.451732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.452487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.453343 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1891/3775] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:39 2022] PUT /identity/v3/projects/c93718e8c0534d5bb8694f53199516bc/users/29ee6e6768e643edb4f2586b683c1aa6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:39.457185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.467901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.468186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.468465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.490721 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1885/3776] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:39.498833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.535363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab5157-568b-4fbe-8ff1-a861b6c3bef2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.564797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] MFA Rules not processed for user `29ee6e6768e643edb4f2586b683c1aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:39.567605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:39.677010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:39.704755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.706966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.707393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.707917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.708766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.711119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.736300 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1886/3777] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:39.737465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.752446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5405-0cf9-426a-b1b3-72143441050d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.762201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.768752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.769069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.769363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] PATH_INFO: `/v3/projects/be43b4b4305647cfb63bdcaa91331b55/users/79eddf3b96304e86a213d7238783e960/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.795602 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1892/3778] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:39.802360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.804987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:39.817805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be43b4b4305647cfb63bdcaa91331b55, user_id=79eddf3b96304e86a213d7238783e960, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.832853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:39.852025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8c33-90c4-4fe4-b146-2b7b5a2b0d0d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:39.870968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1887/3779] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:39 2022] PUT /identity/v3/projects/be43b4b4305647cfb63bdcaa91331b55/users/79eddf3b96304e86a213d7238783e960/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:39.872452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:39.874777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:39.875218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:39.875504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:39.876308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] PATH_INFO: `/v3/projects/e2081fc5f4c6409398efe4fab6ee56a4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:39.878571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2081fc5f4c6409398efe4fab6ee56a4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:39.884475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:40.025357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2081fc5f4c6409398efe4fab6ee56a4', 'request_id': 'req-fb52d095-8621-4b94-98eb-570a69b5647c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:40.039124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2081fc5f4c6409398efe4fab6ee56a4', 'request_id': 'req-fb52d095-8621-4b94-98eb-570a69b5647c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:40.055310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65b7e-58b3-4eef-973f-9380541a7680 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:40.055815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2081fc5f4c6409398efe4fab6ee56a4', 'request_id': 'req-fb52d095-8621-4b94-98eb-570a69b5647c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:40.078855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] The token cache is being invalidate because project e2081fc5f4c6409398efe4fab6ee56a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:40.079241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:40.080558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fb52d095-8621-4b94-98eb-570a69b5647c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:40.083617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1893/3780] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:39 2022] DELETE /identity/v3/projects/e2081fc5f4c6409398efe4fab6ee56a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:40.090967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb9a7-f108-4549-9e55-5f1ddffd285e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.091319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb9a7-f108-4549-9e55-5f1ddffd285e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.092048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb9a7-f108-4549-9e55-5f1ddffd285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.155203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7811d0-0c9e-41ec-bdf8-b059250a0221 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:40.157641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7811d0-0c9e-41ec-bdf8-b059250a0221 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.158445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7811d0-0c9e-41ec-bdf8-b059250a0221 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.158848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7811d0-0c9e-41ec-bdf8-b059250a0221 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects/c09acef7debd4290b43bcd2243dc2d15` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.160640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7811d0-0c9e-41ec-bdf8-b059250a0221 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:get_project(project_id=c09acef7debd4290b43bcd2243dc2d15)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:40.163880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7811d0-0c9e-41ec-bdf8-b059250a0221 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:40.169243 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1888/3781] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:39 2022] GET /identity/v3/projects/c09acef7debd4290b43bcd2243dc2d15 => generated 387 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:40.169243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.169243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.169243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.194425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:40.196138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:40.204159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-338eb9a7-f108-4549-9e55-5f1ddffd285e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:40.206352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-338eb9a7-f108-4549-9e55-5f1ddffd285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:40.325128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1889/3782] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:40.325128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:40.325128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:40.366190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea19c1-971c-4067-92f1-f9efc0bdea79 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:40.379321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:40.380124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.381651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.382052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.383608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:40.387299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:40.389360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:40.407505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:40.424012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1894/3783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:40.426567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c0332-a9a5-4614-bf00-0d1c05fd8af6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.426969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c0332-a9a5-4614-bf00-0d1c05fd8af6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.431220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c0332-a9a5-4614-bf00-0d1c05fd8af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.458813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1890/3784] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:14:40 2022] POST /identity/v3/projects => generated 339 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:40.459497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:40.467036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:40.474412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c61c0332-a9a5-4614-bf00-0d1c05fd8af6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:40.477076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c61c0332-a9a5-4614-bf00-0d1c05fd8af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:40.619302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017237ad-c02e-4a3b-b0ce-72e2d4780cea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:40.627554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:40.629711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.629711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.630007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.635759 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1895/3785] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:40.639064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c0332-a9a5-4614-bf00-0d1c05fd8af6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:40.653790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:40.657956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:40.684422 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1891/3786] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:40.689197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:40.715344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e23afd-41f7-4078-9d19-bd9d8ad6ffe7 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:40.725448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:40.726130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.730410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.730698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.731467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:40.731773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:40.735833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:40.767240 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1892/3787] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:40.768805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:40.794057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adcfb2-393c-4916-a7c2-e6e68f0a538d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:40.799099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:40.799734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.799863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.801231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.801967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:40.803862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:40.809890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c0332-a9a5-4614-bf00-0d1c05fd8af6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:40.823887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:40.824591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:40.828852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:40.828852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:40.828852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:40.843984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:40.853244 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1893/3788] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:40 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:40.860041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:40.888662 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1896/3789] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:14:40 2022] GET /identity/v3/projects => generated 6949 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:40.890190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:40.912962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0573be1-89ba-435b-aac2-37734f340d33 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.005247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369701f1-32d5-4966-a9f8-664d935a6114 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.014843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.015550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.015826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.016196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.017743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.022100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.057737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.060607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.060909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.061293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects/c09acef7debd4290b43bcd2243dc2d15` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.064485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:get_project(project_id=c09acef7debd4290b43bcd2243dc2d15)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.067976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.070466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1897/3790] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:40 2022] GET /identity/v3/projects/c09acef7debd4290b43bcd2243dc2d15 => generated 387 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:41.082847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.089720 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1894/3791] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:40 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:41.093318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.107297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e3798-d096-4393-9b1c-1dbda4d8a40b tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.116028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0257f7-5a13-4b6d-93aa-e2f0cd3a4b23 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.118736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.119629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.120498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.120808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects/43c804f081a2412c9e6ca1201b7c3492` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.122355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:get_project(project_id=43c804f081a2412c9e6ca1201b7c3492)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.126415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.130091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.130891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.131185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.131979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.132283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.134868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.135925 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1898/3792] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/projects/43c804f081a2412c9e6ca1201b7c3492 => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:41.136848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.154678 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1895/3793] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:41.157504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74855bbd-31af-40c8-b0da-4a5dc2b5c2ea tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.159036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.173762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.174035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb29e8-9380-43fc-81fc-312bcf8cdcf4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.174491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.174743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.175140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.175904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.177828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.179750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.181017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.181339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.181697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.182963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.186610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.203075 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1896/3794] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:41.213580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.224846 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1899/3795] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/projects => generated 6949 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:41.228176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.228772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4fcb-c2f6-40f3-8d21-0ad2943ca8e8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.236161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81b9bd-683e-4a02-b55f-e23ee2358699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.237797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81b9bd-683e-4a02-b55f-e23ee2358699 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.238243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81b9bd-683e-4a02-b55f-e23ee2358699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.239290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81b9bd-683e-4a02-b55f-e23ee2358699 admin admin] PATH_INFO: `/v3/projects/635aa1d3d9b24f59a1b25f107438855e/users/cc3d993686bc4416a4015ac3e96b029c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.253577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d46c5-c7c2-40f3-a726-11134eb4a5ac tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.261505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81b9bd-683e-4a02-b55f-e23ee2358699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635aa1d3d9b24f59a1b25f107438855e, user_id=cc3d993686bc4416a4015ac3e96b029c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.264550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81b9bd-683e-4a02-b55f-e23ee2358699 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.266762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.267655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.268053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.269261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.270274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:41.271882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.275911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.280017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:41.286219 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1897/3796] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:41 2022] PUT /identity/v3/projects/635aa1d3d9b24f59a1b25f107438855e/users/cc3d993686bc4416a4015ac3e96b029c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:41.294704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7acd5-aa4a-45fe-8053-ebd67eeb9314 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.295252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7acd5-aa4a-45fe-8053-ebd67eeb9314 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.295506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7acd5-aa4a-45fe-8053-ebd67eeb9314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.313428 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1900/3797] 10.222.0.30 () {58 vars in 1165 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/projects?domain_id=default => generated 6618 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:41.319048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.319225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cdc7acd5-aa4a-45fe-8053-ebd67eeb9314 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:41.321384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cdc7acd5-aa4a-45fe-8053-ebd67eeb9314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:41.329296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:41.338623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e628b6-e270-4fd9-8915-046e37c12a11 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.412670 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1898/3798] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:41.415235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.415941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.416279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.416567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.417468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.419959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.420220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7acd5-aa4a-45fe-8053-ebd67eeb9314 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.450209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1901/3799] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/projects => generated 6949 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:41.450861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.462923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5e9b8-6c3a-461c-83d3-7eeb195e8765 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.468417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.469267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.471270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.471270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.471270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:41.471270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.473082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.499380 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1902/3800] 10.222.0.30 () {58 vars in 1165 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/projects?domain_id=default => generated 6618 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:41.499509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7acd5-aa4a-45fe-8053-ebd67eeb9314 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.501511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.502173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.502916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.503265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.503609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.513109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ad8c-dabb-406a-98f2-8eb8cc1cc1a4 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.515760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.517645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.518246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.518989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.519341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.519690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.520508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.522481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.529318 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1899/3801] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:14:41.547788 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1903/3802] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/projects => generated 6949 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:41.552389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.565087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032964f-013c-4ebd-812f-a2e43809824b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.576836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.577605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.577894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.578174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.579133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-472844861) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:41.579461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.580521 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:41.580521 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:41.580521 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:41.581730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.606468 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1900/3803] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:41 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-472844861 => generated 534 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:41.612047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.626165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89569c93-2304-4929-952d-db5bb74a38ce tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.632601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29ee6e6768e643edb4f2586b683c1aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c93718e8c0534d5bb8694f53199516bc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.634375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.634864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.635944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] PATH_INFO: `/v3/projects/43c804f081a2412c9e6ca1201b7c3492` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.637596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorizing `identity:delete_project(project_id=43c804f081a2412c9e6ca1201b7c3492)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.640190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.709467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c804f081a2412c9e6ca1201b7c3492', 'request_id': 'req-b3e4a419-fb06-4333-929f-14f903b196da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.719442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c804f081a2412c9e6ca1201b7c3492', 'request_id': 'req-b3e4a419-fb06-4333-929f-14f903b196da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.730749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c804f081a2412c9e6ca1201b7c3492', 'request_id': 'req-b3e4a419-fb06-4333-929f-14f903b196da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.761010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] The token cache is being invalidate because project 43c804f081a2412c9e6ca1201b7c3492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:41.761390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.762091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b3e4a419-fb06-4333-929f-14f903b196da tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.767632 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1904/3804] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:41 2022] DELETE /identity/v3/projects/43c804f081a2412c9e6ca1201b7c3492 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:41.770389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:41.773658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:41.795868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f889e0-0829-40ba-8046-89c8e6257909 tempest-ListProjectsStaticTestJSON-1382144842 tempest-ListProjectsStaticTestJSON-1382144842-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:41.870163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:41.871275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:41.871661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:41.872042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] PATH_INFO: `/v3/users/c5a2202aa194483faa91eb6d140a80cb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:41.873549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a2202aa194483faa91eb6d140a80cb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:41.876254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:41.925313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:41.952444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a2202aa194483faa91eb6d140a80cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.953195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a2202aa194483faa91eb6d140a80cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.968492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a2202aa194483faa91eb6d140a80cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.969265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a2202aa194483faa91eb6d140a80cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.976981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a2202aa194483faa91eb6d140a80cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:41.997684 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1901/3805] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:41 2022] DELETE /identity/v3/users/c5a2202aa194483faa91eb6d140a80cb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:42.003256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:42.003553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:42.004209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:42.035958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:42.037781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:42.137086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:42.163359 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1905/3806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:42.191520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:42.193645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:42.288319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f59bf-606b-4f64-9d44-dc7d07294002 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:42.294686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:42.295519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:42.296682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:42.297128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:42.310365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:42.312321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:42.328018 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1902/3807] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:43.211976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:43.213730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:43.251828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65be06-818b-44a3-9cad-7670c4c05812 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:43.260084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:43.261385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:43.261762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:43.263400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] PATH_INFO: `/v3/projects/c09acef7debd4290b43bcd2243dc2d15` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:43.266128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09acef7debd4290b43bcd2243dc2d15)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:43.268282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:43.354173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09acef7debd4290b43bcd2243dc2d15', 'request_id': 'req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.362835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09acef7debd4290b43bcd2243dc2d15', 'request_id': 'req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.376560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09acef7debd4290b43bcd2243dc2d15', 'request_id': 'req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.441328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] The token cache is being invalidate because project c09acef7debd4290b43bcd2243dc2d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:43.447524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.448512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.450934 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1906/3808] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:43 2022] DELETE /identity/v3/projects/c09acef7debd4290b43bcd2243dc2d15 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:43.455152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:43.467616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb340-037b-4de9-83b0-040b4e542fee service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:43.593759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:43.594875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:43.595229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:43.595513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] PATH_INFO: `/v3/users/29ee6e6768e643edb4f2586b683c1aa6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:43.597585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ee6e6768e643edb4f2586b683c1aa6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:43.599556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:43.687310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ee6e6768e643edb4f2586b683c1aa6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.688184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ee6e6768e643edb4f2586b683c1aa6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.702510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:43.724894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ee6e6768e643edb4f2586b683c1aa6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.727005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ee6e6768e643edb4f2586b683c1aa6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.744329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ee6e6768e643edb4f2586b683c1aa6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:43.767804 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1903/3809] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:43 2022] DELETE /identity/v3/users/29ee6e6768e643edb4f2586b683c1aa6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:44.226061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:44.228220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:44.248269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bd4af-cdb1-4ec6-beec-6fc691e4630a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:44.367825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:44.369054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:44.369582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:44.370841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] PATH_INFO: `/v3/users/556851fde980466c99cb1873cdb30dea` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:44.372467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=556851fde980466c99cb1873cdb30dea)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:44.375313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:44.472020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556851fde980466c99cb1873cdb30dea'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:44.473259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556851fde980466c99cb1873cdb30dea'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:44.496366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556851fde980466c99cb1873cdb30dea'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:44.499368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556851fde980466c99cb1873cdb30dea'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:44.510487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556851fde980466c99cb1873cdb30dea'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:44.520148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:44.552553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1907/3810] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:44 2022] DELETE /identity/v3/users/556851fde980466c99cb1873cdb30dea => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:45.013150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:45.015538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:45.241206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0cefa-5350-457e-888d-f0fca9190c5a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:45.410277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:45.411928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:45.480301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a5eee-a605-4d83-a070-44ed779e9b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:45.481205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5eee-a605-4d83-a070-44ed779e9b88 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:45.481534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5eee-a605-4d83-a070-44ed779e9b88 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:45.481811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5eee-a605-4d83-a070-44ed779e9b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:45.484764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-374a5eee-a605-4d83-a070-44ed779e9b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:45.614971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301a25-2dd2-41aa-921d-9b4aa70af8dc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:45.636946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:45.638048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:45.638465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:45.639343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] PATH_INFO: `/v3/projects/deaa53169cbd4a83aa39a825ee4a3a70` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:45.641435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=deaa53169cbd4a83aa39a825ee4a3a70)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:45.650671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:45.710605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a5eee-a605-4d83-a070-44ed779e9b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:45.722995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a5eee-a605-4d83-a070-44ed779e9b88 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:45.739573 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1904/3811] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:45.783796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deaa53169cbd4a83aa39a825ee4a3a70', 'request_id': 'req-e9451feb-aaf4-4457-bc3e-3696740522aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:45.794293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deaa53169cbd4a83aa39a825ee4a3a70', 'request_id': 'req-e9451feb-aaf4-4457-bc3e-3696740522aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:45.819687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deaa53169cbd4a83aa39a825ee4a3a70', 'request_id': 'req-e9451feb-aaf4-4457-bc3e-3696740522aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:45.864700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] The token cache is being invalidate because project deaa53169cbd4a83aa39a825ee4a3a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:45.865136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:45.866271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9451feb-aaf4-4457-bc3e-3696740522aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:45.871954 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1908/3812] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:45 2022] DELETE /identity/v3/projects/deaa53169cbd4a83aa39a825ee4a3a70 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:45.875562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eca9e-b2d5-4f88-949a-bed11a14418c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:45.875562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eca9e-b2d5-4f88-949a-bed11a14418c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:45.875562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eca9e-b2d5-4f88-949a-bed11a14418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:45.906663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:45.917732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2f4eca9e-b2d5-4f88-949a-bed11a14418c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:45.920547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f4eca9e-b2d5-4f88-949a-bed11a14418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:46.073927 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1905/3813] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:46.080284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.081405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.081995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.128986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:46.131168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:46.144144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1909/3814] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:46.148395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eca9e-b2d5-4f88-949a-bed11a14418c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.165257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eca9e-b2d5-4f88-949a-bed11a14418c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.177073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.178295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.178759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.179214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.180299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:46.180773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.183206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.204183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.205757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:46.224115 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1906/3815] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:46.225243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.228828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ec91b-2e5b-4797-aa6f-74a178cb5653 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.241542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.242442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.242734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.249864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eb14a-7d83-41f3-aae4-d72c66a8a9ff admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.250078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] PATH_INFO: `/v3/projects/c93718e8c0534d5bb8694f53199516bc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.251576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93718e8c0534d5bb8694f53199516bc)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.256002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.262478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.264269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.264529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.267431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.268195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.272802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.359491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1907/3816] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:46 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:46.360532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.371017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93718e8c0534d5bb8694f53199516bc', 'request_id': 'req-491292ed-208d-4afb-b62b-5bd7927aca59'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:46.378437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93718e8c0534d5bb8694f53199516bc', 'request_id': 'req-491292ed-208d-4afb-b62b-5bd7927aca59'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:46.392209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93718e8c0534d5bb8694f53199516bc', 'request_id': 'req-491292ed-208d-4afb-b62b-5bd7927aca59'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:46.420252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] The token cache is being invalidate because project c93718e8c0534d5bb8694f53199516bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:46.421019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:46.423664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491292ed-208d-4afb-b62b-5bd7927aca59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:46.429874 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1910/3817] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:46 2022] DELETE /identity/v3/projects/c93718e8c0534d5bb8694f53199516bc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:46.432213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b4db1-74e5-44d6-8e5a-b0b702d8dfe1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.432850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b4db1-74e5-44d6-8e5a-b0b702d8dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.433383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b4db1-74e5-44d6-8e5a-b0b702d8dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.447945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:46.488662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-943b4db1-74e5-44d6-8e5a-b0b702d8dfe1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:46.492057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-943b4db1-74e5-44d6-8e5a-b0b702d8dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:46.603656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a630e12-0fa9-4baf-b76e-4823efa1e3ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.709459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1911/3818] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:46.719571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33dae4-f638-45db-ba5d-f4bdea66aab7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.719900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33dae4-f638-45db-ba5d-f4bdea66aab7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.720314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33dae4-f638-45db-ba5d-f4bdea66aab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.739471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.746519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.747680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.748857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.749858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.751877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.781223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4b33dae4-f638-45db-ba5d-f4bdea66aab7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:46.782475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b33dae4-f638-45db-ba5d-f4bdea66aab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:46.814426 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1908/3819] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:46 2022] POST /identity/v3/users => generated 290 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:46.815730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1912/3820] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:46.821880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.822171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33dae4-f638-45db-ba5d-f4bdea66aab7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.824605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:46.848892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e844a-9bd0-42de-8aa4-666b24b4f01b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.851950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33dae4-f638-45db-ba5d-f4bdea66aab7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.858685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.860660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.861255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.863089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.865315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.865896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.866603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.866889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.867166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.867576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.867925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:46.868236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.869974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.874254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:46.891914 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1913/3821] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:46.894271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.905097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1909/3822] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:46.909372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:46.914946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab202c-2702-4b67-9c18-54daae2f64d4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.929642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.931414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.931414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.931833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.932346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.934540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.942387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1ae62-7dc4-4bd2-acd1-b030ec158425 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:46.964220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:46.964220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:46.964220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:46.964220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:46.966441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:46.971808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:46.992473 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1914/3823] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:46 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:46.995984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:47.021301 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1910/3824] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:47.025280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:47.058719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd881a2-70e3-4b9c-94fa-a4143f0a2547 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:47.143864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388fd61-a5ce-4382-bde9-23220f45c762 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:47.169007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:47.169822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.170105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.170804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.171550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:47.174850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:47.219292 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1915/3825] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:46 2022] POST /identity/v3/users => generated 284 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:47.220559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:47.238141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145de19-35f5-4e1c-b35a-1bd5bc73022c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:47.247746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc196a-3dd2-4530-a88b-24a7c60bc09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:47.251016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:47.251016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.251016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.251457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc196a-3dd2-4530-a88b-24a7c60bc09f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.251595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.251729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc196a-3dd2-4530-a88b-24a7c60bc09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.251729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc196a-3dd2-4530-a88b-24a7c60bc09f admin admin] PATH_INFO: `/v3/projects/ae3925ea552446688a7a1aacff545c10/users/da2c009d56ae402f90518199c3e5c171/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.252106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:47.254179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:47.283444 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1916/3826] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:47.287747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:47.309506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc196a-3dd2-4530-a88b-24a7c60bc09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3925ea552446688a7a1aacff545c10, user_id=da2c009d56ae402f90518199c3e5c171, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:47.316299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd28d2-bba8-4d63-b900-6e8469f2205c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:47.316456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc196a-3dd2-4530-a88b-24a7c60bc09f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:47.324461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:47.325211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.325496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.325776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.326838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:47.335037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:47.355877 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1917/3827] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:47.362197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:47.372394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1911/3828] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:47 2022] PUT /identity/v3/projects/ae3925ea552446688a7a1aacff545c10/users/da2c009d56ae402f90518199c3e5c171/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:47.389860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4cad0-5468-456b-93f0-9c49275b0702 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.390187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4cad0-5468-456b-93f0-9c49275b0702 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.390427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4cad0-5468-456b-93f0-9c49275b0702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.392153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc465e-876c-44a7-a789-cbb34ceab8ca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:47.460681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:47.477758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7ef4cad0-5468-456b-93f0-9c49275b0702 None None] MFA Rules not processed for user `da2c009d56ae402f90518199c3e5c171`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:47.479963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7ef4cad0-5468-456b-93f0-9c49275b0702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:47.537820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70683489-e479-40dc-ae02-204bcaa4f9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:47.538883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683489-e479-40dc-ae02-204bcaa4f9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.539408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683489-e479-40dc-ae02-204bcaa4f9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.539708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70683489-e479-40dc-ae02-204bcaa4f9a3 admin admin] PATH_INFO: `/v3/projects/61406311584a47abaffa6b74d5559c50/users/e88cf5ecc77742bb94d8325a04351a24/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.583633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683489-e479-40dc-ae02-204bcaa4f9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61406311584a47abaffa6b74d5559c50, user_id=e88cf5ecc77742bb94d8325a04351a24, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:47.587692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70683489-e479-40dc-ae02-204bcaa4f9a3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:47.625689 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1918/3829] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:47 2022] PUT /identity/v3/projects/61406311584a47abaffa6b74d5559c50/users/e88cf5ecc77742bb94d8325a04351a24/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:47.638559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4b559-c73e-4ef7-b640-334c620f4721 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.638872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4b559-c73e-4ef7-b640-334c620f4721 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.639151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4b559-c73e-4ef7-b640-334c620f4721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.672009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1912/3830] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:47.686658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:47.686945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:47.687224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:47.722017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-50e4b559-c73e-4ef7-b640-334c620f4721 None None] MFA Rules not processed for user `e88cf5ecc77742bb94d8325a04351a24`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:47.723247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-50e4b559-c73e-4ef7-b640-334c620f4721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:47.725856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] MFA Rules not processed for user `da2c009d56ae402f90518199c3e5c171`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:47.727844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:47.902485 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1913/3831] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:47.914360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:47.916095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:47.923398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1919/3832] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:47.925354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:47.925823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4b559-c73e-4ef7-b640-334c620f4721 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:48.109282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4b559-c73e-4ef7-b640-334c620f4721 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:48.132062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:48.132764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.133060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.133341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:48.134046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:48.135912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b51e-46e2-4093-8dd5-a49e94c9c3ed None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:48.138357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:48.152786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:48.153489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.153766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.154036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:48.187005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:48.189244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:48.216188 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1920/3833] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:47 2022] POST /identity/v3/projects => generated 367 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:48.217015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1914/3834] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:14:48.219990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:48.306125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:48.386844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7ecc8-39ec-4eaf-a62a-8553d5414945 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:48.394215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:48.395396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.396120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.396624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:48.397945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:48.400233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:48.438919 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1921/3835] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:48 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:48.443326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:48.467180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade78f-abd7-46e3-899e-9f52fc91329a service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:48.476773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:48.478067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.478400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.478813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:48.480420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:48.484308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:48.508501 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1915/3836] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:48.512645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:48.528971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa8c28-5c2c-4890-9eb0-8a014c806ba5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:48.544990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:48.548317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.549792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.551404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] PATH_INFO: `/v3/projects/85231e0f16414be1b60ad06bbd986cdb/users/ae79deacdcc54b84bbf26133668fd9c1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:48.601736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85231e0f16414be1b60ad06bbd986cdb, user_id=ae79deacdcc54b84bbf26133668fd9c1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:48.608833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:48.638450 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1922/3837] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:48 2022] PUT /identity/v3/projects/85231e0f16414be1b60ad06bbd986cdb/users/ae79deacdcc54b84bbf26133668fd9c1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:48.642532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:48.660724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605bc9a-d753-4125-ab5f-912665bef855 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:48.815872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec4e7e-2089-464a-b2d7-8d23498a2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:48.816209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4e7e-2089-464a-b2d7-8d23498a2de3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.816621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4e7e-2089-464a-b2d7-8d23498a2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.816987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4e7e-2089-464a-b2d7-8d23498a2de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:48.818437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4e7e-2089-464a-b2d7-8d23498a2de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:48.823389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4e7e-2089-464a-b2d7-8d23498a2de3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:48.854080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1916/3838] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:14:48.855665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:48.872304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7bb7-4b01-43c9-a501-c7bcb146057e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:48.879662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:48.881796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.883553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.885370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] PATH_INFO: `/v3/projects/85231e0f16414be1b60ad06bbd986cdb/users/ae79deacdcc54b84bbf26133668fd9c1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:48.890363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85231e0f16414be1b60ad06bbd986cdb, user_id=ae79deacdcc54b84bbf26133668fd9c1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:48.897671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:48.943124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1923/3839] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:48 2022] PUT /identity/v3/projects/85231e0f16414be1b60ad06bbd986cdb/users/ae79deacdcc54b84bbf26133668fd9c1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:48.944535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a0fb-5bf6-479a-afd5-432e5a587b9a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:48.944535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a0fb-5bf6-479a-afd5-432e5a587b9a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:48.944535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45a0fb-5bf6-479a-afd5-432e5a587b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:49.012304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1f45a0fb-5bf6-479a-afd5-432e5a587b9a None None] MFA Rules not processed for user `ae79deacdcc54b84bbf26133668fd9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:49.017570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f45a0fb-5bf6-479a-afd5-432e5a587b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:49.194464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:49.211915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:49.213200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1917/3840] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:49.229110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5a0cb-3058-407c-b3a0-c8d30b962a45 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:49.245244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:49.246263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:49.247168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:49.247537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:49.248807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:49.250611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:49.286299 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1924/3841] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:14:49 2022] POST /identity/v3/domains => generated 276 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:14:49.290374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45a0fb-5bf6-479a-afd5-432e5a587b9a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:49.307060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45a0fb-5bf6-479a-afd5-432e5a587b9a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:49.478222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:49.479266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:49.479560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:49.479841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:49.480722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:49.485007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:49.593472 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1918/3842] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:49 2022] POST /identity/v3/users => generated 348 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:49.600427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:49.619470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858498c-76d8-41ab-81f9-e7ecc1fbd8d2 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:49.634072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:49.634782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:49.636615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:49.637468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:49.638010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:49.642877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:49.717214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1925/3843] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:49 2022] POST /identity/v3/users => generated 324 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:49.721981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:49.737253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea6f55-ced5-43b6-9ca2-805dcb7561c3 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:49.752460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:49.766446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:49.767372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:49.767949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users/d69fcf03fe034b7285d746ea6fdd4e6f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:49.791853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:get_user(user_id=d69fcf03fe034b7285d746ea6fdd4e6f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:49.794647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:49.799006 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1919/3844] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:14:49 2022] GET /identity/v3/users/d69fcf03fe034b7285d746ea6fdd4e6f => generated 348 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:49.804265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:49.833183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c631a-ba5e-4194-952f-0a4ad6c68ad5 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:49.850223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:49.853249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:49.856235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:49.856790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:49.857956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Adding query filter params (domain_id=a5a6c1293dc947e49ab611435fc7ff86) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:49.861757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:49.864723 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:49.864723 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:14:49.864723 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:14:49.867949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:49.935626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1926/3845] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Jun 18 22:14:49 2022] GET /identity/v3/users?domain_id=a5a6c1293dc947e49ab611435fc7ff86 => generated 485 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:49.939339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:49.970147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e165a9-c733-4b47-9d44-27c605390bbd tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:49.987395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:49.988497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:49.989627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:49.992961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:49.994201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:49.998791 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:14:49.998791 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:14:49.998791 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:14:50.005270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:50.140139 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1920/3846] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:49 2022] GET /identity/v3/users => generated 8869 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:50.145611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:50.163278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07673c7-bf26-4c0f-ad6f-8e8c3b9f27f6 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:50.171288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:50.172434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:50.173008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:50.173545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:50.175645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1466625867) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:50.176689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:50.179654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:50.244341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1927/3847] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Jun 18 22:14:50 2022] GET /identity/v3/users?name=tempest-test_user-1466625867 => generated 476 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:50.249747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:50.277164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44ab3-50a0-47d2-8148-688fd02b2f49 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:50.283895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:50.284868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:50.285180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:50.289512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:50.291683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:50.291683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:50.295110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:50.390946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:50.391796 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1921/3848] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:14:50 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:50.437318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7afcf-e300-4af0-acfd-a76863e0d294 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:50.458222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:50.460590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:50.461743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:50.462037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users/e5a5175416294870beee3587cabfe8a1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:50.534289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e5a5175416294870beee3587cabfe8a1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:50.541326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:50.739003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a5175416294870beee3587cabfe8a1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:50.740911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a5175416294870beee3587cabfe8a1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:50.791199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a5175416294870beee3587cabfe8a1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:50.805832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a5175416294870beee3587cabfe8a1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:50.809619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=82,keystone:INSERT=9,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:50.843061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a5175416294870beee3587cabfe8a1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:50.872224 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1928/3849] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:50 2022] DELETE /identity/v3/users/e5a5175416294870beee3587cabfe8a1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:50.876424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:50.878748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:50.919024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e361bc-12fa-46e7-bec2-c8325c5abed7 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:51.149524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:51.150038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:51.150343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:51.150619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/users/d69fcf03fe034b7285d746ea6fdd4e6f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:51.152352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d69fcf03fe034b7285d746ea6fdd4e6f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:51.159934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:51.303794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:51.320876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69fcf03fe034b7285d746ea6fdd4e6f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.324934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69fcf03fe034b7285d746ea6fdd4e6f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.388034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69fcf03fe034b7285d746ea6fdd4e6f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.393747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69fcf03fe034b7285d746ea6fdd4e6f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.418900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69fcf03fe034b7285d746ea6fdd4e6f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.469681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1922/3850] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:50 2022] DELETE /identity/v3/users/d69fcf03fe034b7285d746ea6fdd4e6f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:51.473570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:51.488594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249473f1-4b90-417b-99b3-0f703ef72185 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:51.717952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:51.720393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:51.721413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:51.722075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/domains/a5a6c1293dc947e49ab611435fc7ff86` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:51.724051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a5a6c1293dc947e49ab611435fc7ff86)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:51.728466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:51.772149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.775081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.826537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.829917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:51.838377 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1929/3851] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:14:51 2022] PATCH /identity/v3/domains/a5a6c1293dc947e49ab611435fc7ff86 => generated 277 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:51.842766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:51.845427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:51.870491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc10f-ef84-4468-8a35-8ae573c1d569 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:51.987260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae79deacdcc54b84bbf26133668fd9c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85231e0f16414be1b60ad06bbd986cdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:51.988220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:51.988502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:51.988818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] PATH_INFO: `/v3/domains/a5a6c1293dc947e49ab611435fc7ff86` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:52.018145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a5a6c1293dc947e49ab611435fc7ff86)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:52.019789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:52.049612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.053628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.192656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86', 'request_id': 'req-93e06272-9ea2-4942-b0e9-c6c5d483193e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.211719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86', 'request_id': 'req-93e06272-9ea2-4942-b0e9-c6c5d483193e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.224561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86', 'request_id': 'req-93e06272-9ea2-4942-b0e9-c6c5d483193e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.248687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] The token cache is being invalidate because project a5a6c1293dc947e49ab611435fc7ff86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:52.250011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.253720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.272251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86', 'request_id': 'req-93e06272-9ea2-4942-b0e9-c6c5d483193e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.276676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86', 'request_id': 'req-93e06272-9ea2-4942-b0e9-c6c5d483193e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.282567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-93e06272-9ea2-4942-b0e9-c6c5d483193e tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a5a6c1293dc947e49ab611435fc7ff86', 'request_id': 'req-93e06272-9ea2-4942-b0e9-c6c5d483193e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.316495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:52.331056 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1923/3852] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:51 2022] DELETE /identity/v3/domains/a5a6c1293dc947e49ab611435fc7ff86 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:52.332268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:52.334114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:52.531488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21839bd2-6748-4a23-a4b0-ef4e362d2264 tempest-UsersV3TestJSON-2009402498 tempest-UsersV3TestJSON-2009402498-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:52.719410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:52.738920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:52.745399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:52.745921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:52.746358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] PATH_INFO: `/v3/users/e88cf5ecc77742bb94d8325a04351a24` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:52.747928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88cf5ecc77742bb94d8325a04351a24)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:52.750876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:52.864344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88cf5ecc77742bb94d8325a04351a24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.869005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88cf5ecc77742bb94d8325a04351a24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.903703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88cf5ecc77742bb94d8325a04351a24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.906371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88cf5ecc77742bb94d8325a04351a24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.926595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88cf5ecc77742bb94d8325a04351a24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:52.960651 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1930/3853] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:52 2022] DELETE /identity/v3/users/e88cf5ecc77742bb94d8325a04351a24 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:52.962809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9312301-d782-49c6-8554-50e8a56e7e2d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:52.963011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9312301-d782-49c6-8554-50e8a56e7e2d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:52.963352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9312301-d782-49c6-8554-50e8a56e7e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:52.999155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d9312301-d782-49c6-8554-50e8a56e7e2d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:53.004789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d9312301-d782-49c6-8554-50e8a56e7e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:53.202796 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1924/3854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:53.264008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:53.265726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:53.329414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52586db-be47-406f-860b-e608d9f6f18e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:53.329716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52586db-be47-406f-860b-e608d9f6f18e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:53.329974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52586db-be47-406f-860b-e608d9f6f18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:53.402058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a52586db-be47-406f-860b-e608d9f6f18e None None] MFA Rules not processed for user `cc3d993686bc4416a4015ac3e96b029c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:53.404141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a52586db-be47-406f-860b-e608d9f6f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:53.458149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ed666-796e-434d-b916-77f6dff5d3a9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:53.484886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:53.488457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:53.488909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:53.494263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:53.522639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:53.525873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:53.546130 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1931/3855] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:53.563073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1925/3856] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:53.575612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:53.578257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:53.598592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af79ef-fd5f-4390-8af7-c63a6a473275 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:53.608765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3b6b-a8d2-45e2-9242-1114e412328f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:53.609742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3b6b-a8d2-45e2-9242-1114e412328f service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:53.610190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3b6b-a8d2-45e2-9242-1114e412328f service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:53.610544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3b6b-a8d2-45e2-9242-1114e412328f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:53.629928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3b6b-a8d2-45e2-9242-1114e412328f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:53.631582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3b6b-a8d2-45e2-9242-1114e412328f service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:53.647233 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1932/3857] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:54.419794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308b75-ddbc-4aaf-9beb-5cf4ffade510 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:54.420950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308b75-ddbc-4aaf-9beb-5cf4ffade510 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:54.421395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308b75-ddbc-4aaf-9beb-5cf4ffade510 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:54.423442 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1926/3858] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:14:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:14:54.440274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e5c8-754a-4b79-a285-1f4b0abf5f30 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:54.441604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e5c8-754a-4b79-a285-1f4b0abf5f30 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:54.442565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e5c8-754a-4b79-a285-1f4b0abf5f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:54.476894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:54.477275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:54.477634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:54.617781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] MFA Rules not processed for user `79eddf3b96304e86a213d7238783e960`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:54.620654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:54.666942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-48a3e5c8-754a-4b79-a285-1f4b0abf5f30 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:54.668197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-48a3e5c8-754a-4b79-a285-1f4b0abf5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:54.693530 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1933/3859] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:14:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:54.748249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3e5c8-754a-4b79-a285-1f4b0abf5f30 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:54.796576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3e5c8-754a-4b79-a285-1f4b0abf5f30 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:54.810645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:54.812281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:54.813003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:54.813464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:54.836400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:54.837906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:54.862307 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1927/3860] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:54.864074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:54.873606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:54.881774 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1934/3861] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:14:54.916571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b938e0-00b3-4aab-8e69-231a7eeade61 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:54.934987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:54.941463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:54.943578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:54.944051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] PATH_INFO: `/v3/projects/61406311584a47abaffa6b74d5559c50` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:54.947437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61406311584a47abaffa6b74d5559c50)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:54.953156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:55.042574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:55.149601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:55.151158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:55.180476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61406311584a47abaffa6b74d5559c50', 'request_id': 'req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.196886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61406311584a47abaffa6b74d5559c50', 'request_id': 'req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.212226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61406311584a47abaffa6b74d5559c50', 'request_id': 'req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.232842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] The token cache is being invalidate because project 61406311584a47abaffa6b74d5559c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:55.233411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.234312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.236402 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1928/3862] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:54 2022] DELETE /identity/v3/projects/61406311584a47abaffa6b74d5559c50 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:55.240464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:55.242353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:55.271221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:55.368695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5253-a6bb-46a8-8044-613dfedf51bf service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:55.418864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d9f7-4dbb-4c5d-8b61-9ccc1766b992 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:55.435038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:55.435946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:55.436402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:55.436828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] PATH_INFO: `/v3/users/ae79deacdcc54b84bbf26133668fd9c1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:55.438398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae79deacdcc54b84bbf26133668fd9c1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:55.440510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:55.528797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407fb22-c026-4b29-9e97-97d1abd0d001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:55.529603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407fb22-c026-4b29-9e97-97d1abd0d001 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:55.532557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407fb22-c026-4b29-9e97-97d1abd0d001 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:55.533218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407fb22-c026-4b29-9e97-97d1abd0d001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:55.536104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b407fb22-c026-4b29-9e97-97d1abd0d001 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:55.551542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae79deacdcc54b84bbf26133668fd9c1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.555334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae79deacdcc54b84bbf26133668fd9c1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.581308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae79deacdcc54b84bbf26133668fd9c1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.582079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae79deacdcc54b84bbf26133668fd9c1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.610405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae79deacdcc54b84bbf26133668fd9c1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:55.636076 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1929/3863] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:14:55 2022] DELETE /identity/v3/users/ae79deacdcc54b84bbf26133668fd9c1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:14:55.703845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407fb22-c026-4b29-9e97-97d1abd0d001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:55.705817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407fb22-c026-4b29-9e97-97d1abd0d001 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:55.724972 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1935/3864] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:14:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:14:58.076731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:58.079105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:58.121089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:58.241756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f923af0-2cf1-452c-b705-a6eb0623a845 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:58.254695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:58.255792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:58.256071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:58.256388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] PATH_INFO: `/v3/projects/85231e0f16414be1b60ad06bbd986cdb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:58.259758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85231e0f16414be1b60ad06bbd986cdb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:58.265876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:58.279800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a5b4-2a32-4b80-9859-d34cbead1ee7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:58.280231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a5b4-2a32-4b80-9859-d34cbead1ee7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:58.280426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a5b4-2a32-4b80-9859-d34cbead1ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:58.324011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c196a5b4-2a32-4b80-9859-d34cbead1ee7 None None] MFA Rules not processed for user `cc3d993686bc4416a4015ac3e96b029c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:58.325303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c196a5b4-2a32-4b80-9859-d34cbead1ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:58.346343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85231e0f16414be1b60ad06bbd986cdb', 'request_id': 'req-69dcc015-653c-4448-b818-452e91ee937c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:58.355067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85231e0f16414be1b60ad06bbd986cdb', 'request_id': 'req-69dcc015-653c-4448-b818-452e91ee937c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:58.372457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85231e0f16414be1b60ad06bbd986cdb', 'request_id': 'req-69dcc015-653c-4448-b818-452e91ee937c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:58.390695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] The token cache is being invalidate because project 85231e0f16414be1b60ad06bbd986cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:14:58.392960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:58.394790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-69dcc015-653c-4448-b818-452e91ee937c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:14:58.402437 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1930/3865] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:14:58 2022] DELETE /identity/v3/projects/85231e0f16414be1b60ad06bbd986cdb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:58.405656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecd80b-752b-4825-ba3c-a6c342dc0b2d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:58.407629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecd80b-752b-4825-ba3c-a6c342dc0b2d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:58.407629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecd80b-752b-4825-ba3c-a6c342dc0b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:58.432767 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1936/3866] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:14:58.456409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-00ecd80b-752b-4825-ba3c-a6c342dc0b2d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:58.458444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-00ecd80b-752b-4825-ba3c-a6c342dc0b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:58.577060 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1931/3867] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:58.587115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b356c-b0c6-4c04-b03d-3d5967b3443b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:58.587490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b356c-b0c6-4c04-b03d-3d5967b3443b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:58.587841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b356c-b0c6-4c04-b03d-3d5967b3443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:58.650861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6e3b356c-b0c6-4c04-b03d-3d5967b3443b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:58.652320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e3b356c-b0c6-4c04-b03d-3d5967b3443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:58.683096 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1937/3868] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:58.687864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecd80b-752b-4825-ba3c-a6c342dc0b2d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:58.710239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ecd80b-752b-4825-ba3c-a6c342dc0b2d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:58.731821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:58.732565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:58.732885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:58.733753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:58.734609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:14:58.734945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:58.738923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:58.772258 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1932/3869] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:14:58.776666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b356c-b0c6-4c04-b03d-3d5967b3443b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:58.783339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:58.789147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b356c-b0c6-4c04-b03d-3d5967b3443b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:58.802989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:58.804138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:58.804628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:58.805127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:58.806250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:58.808683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:58.858772 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1938/3870] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:14:58 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:58.865379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:58.881826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec5ee0-0eea-495c-b34d-f38a0c0313c8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:58.955292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:59.019513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:59.027594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:59.027594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:59.027594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:59.027594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:59.037300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:59.106860 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1933/3871] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:14:58 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:59.110109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:59.130110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69756298-8ce3-4d5c-b26b-05caace5ed35 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:59.151374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:59.152100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:59.152391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:59.152682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:59.156663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:59.160454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:59.192156 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1939/3872] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:59.195982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:59.216842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb19d05-30cc-4df0-84d1-9fe13d404730 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:59.224072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85a1b1-65ed-4d50-938d-a817b8b78612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:59.224889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85a1b1-65ed-4d50-938d-a817b8b78612 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:59.225710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85a1b1-65ed-4d50-938d-a817b8b78612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:59.226093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85a1b1-65ed-4d50-938d-a817b8b78612 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:59.226948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85a1b1-65ed-4d50-938d-a817b8b78612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:59.228678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85a1b1-65ed-4d50-938d-a817b8b78612 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:59.245511 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1934/3873] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:14:59.249544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:59.263852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aabcc6-f931-4bbc-b7f3-dc6fb6d83cda admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:59.270702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:59.272025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:59.273010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:59.273549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] PATH_INFO: `/v3/projects/0fb7ccc1d73c4dff9a1e15f8919481ad/users/0f3b6edfe27c442095978a6d40518ee9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:59.298332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb7ccc1d73c4dff9a1e15f8919481ad, user_id=0f3b6edfe27c442095978a6d40518ee9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:59.303521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:59.364758 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1940/3874] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:14:59 2022] PUT /identity/v3/projects/0fb7ccc1d73c4dff9a1e15f8919481ad/users/0f3b6edfe27c442095978a6d40518ee9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:14:59.375980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42c8d-a5f4-4e50-a3ef-5fe8672b516b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:59.376487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42c8d-a5f4-4e50-a3ef-5fe8672b516b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:59.376617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42c8d-a5f4-4e50-a3ef-5fe8672b516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:59.451372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-32a42c8d-a5f4-4e50-a3ef-5fe8672b516b None None] MFA Rules not processed for user `0f3b6edfe27c442095978a6d40518ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:14:59.452631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-32a42c8d-a5f4-4e50-a3ef-5fe8672b516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:14:59.604807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1935/3875] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:14:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:14:59.606406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:59.622887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183cdca-afc2-4d30-bf9c-44f33399fb33 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:59.642290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:59.644127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:59.644639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:59.644933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:59.645876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f3b6edfe27c442095978a6d40518ee9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:59.647070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:59.785589 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1941/3876] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Jun 18 22:14:59 2022] POST /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials => generated 921 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:14:59.789186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a42c8d-a5f4-4e50-a3ef-5fe8672b516b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:59.803183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a42c8d-a5f4-4e50-a3ef-5fe8672b516b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:14:59.818023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:14:59.821211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:14:59.821499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:14:59.821778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules/842ce3b5994149c089f4415695c9682b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:14:59.830134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:delete_access_rule(user_id=0f3b6edfe27c442095978a6d40518ee9, access_rule_id=842ce3b5994149c089f4415695c9682b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:14:59.831946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application session.delete(ref) Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application yield resource Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:14:59.950303 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise self.value Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application session.commit() Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.flush() Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 22:14:59.951874 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application compat.raise_( Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._synchronize( Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise AssertionError( Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jun 18 22:14:59.952805 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:14:59.953804 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:14:59.954827 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jun 18 22:14:59.954827 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jun 18 22:14:59.954827 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jun 18 22:14:59.954827 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jun 18 22:14:59.954827 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jun 18 22:14:59.954827 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:14:59.956849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:14:59.957339 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1936/3877] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Jun 18 22:14:59 2022] DELETE /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules/842ce3b5994149c089f4415695c9682b => generated 89 bytes in 168 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:14:59.972824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4d103-ca8b-4b24-bb06-91393f17369c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.000670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.004460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.004779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.005113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials/59de48b843a2414591c65fc66e5a9126` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.057130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0f3b6edfe27c442095978a6d40518ee9, application_credential_id=59de48b843a2414591c65fc66e5a9126)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.064630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.098067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1942/3878] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:14:59 2022] DELETE /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials/59de48b843a2414591c65fc66e5a9126 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:00.101954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.115414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f58c8-7403-4c80-a76c-004b95115724 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.119904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.121136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.121656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.121939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.123359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:list_access_rules(user_id=0f3b6edfe27c442095978a6d40518ee9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.125860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.131813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1937/3879] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:15:00 2022] GET /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules => generated 369 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:00.136077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.153009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79a61-759d-4e84-82ec-a790854091c6 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.163112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.164358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.164649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.165085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules/842ce3b5994149c089f4415695c9682b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.166802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:delete_access_rule(user_id=0f3b6edfe27c442095978a6d40518ee9, access_rule_id=842ce3b5994149c089f4415695c9682b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.168543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.201496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.201846 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1943/3880] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Jun 18 22:15:00 2022] DELETE /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules/842ce3b5994149c089f4415695c9682b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:00.220429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5b8b1-0f5b-4124-acc3-f610af4d926f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.225723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.226965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.227457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.228147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.229970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:list_access_rules(user_id=0f3b6edfe27c442095978a6d40518ee9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.232880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.239241 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1938/3881] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:15:00 2022] GET /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules => generated 158 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:15:00.244571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.254827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646cf6-4b22-426f-b00e-980edc08f781 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.261832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.263064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.263864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.264291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.265329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f3b6edfe27c442095978a6d40518ee9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.267204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.326356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:00.390788 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1944/3882] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Jun 18 22:15:00 2022] POST /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials => generated 921 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:00.394555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.411313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33310d3c-6309-4d71-8321-1222376b514f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.426822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.428024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.428406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.429634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.431665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:list_access_rules(user_id=0f3b6edfe27c442095978a6d40518ee9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.434386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.443201 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1939/3883] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:15:00 2022] GET /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:00.448234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.464435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0011836-15f1-4a8f-9391-4dd936841901 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.470243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.471155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.471433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.471705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.472637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:create_application_credential(user_id=0f3b6edfe27c442095978a6d40518ee9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.473912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.631432 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1945/3884] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Jun 18 22:15:00 2022] POST /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/application_credentials => generated 920 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:00.634468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.651770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b21241-d326-417a-be7e-3e4ebfc8364c tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.663113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1372575-63f0-4643-962c-d3d65956b18f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f3b6edfe27c442095978a6d40518ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.664080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372575-63f0-4643-962c-d3d65956b18f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.664365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372575-63f0-4643-962c-d3d65956b18f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.664643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1372575-63f0-4643-962c-d3d65956b18f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules/88e2b3d3aead4978ab3291b31723fce8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.666058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1372575-63f0-4643-962c-d3d65956b18f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorizing `identity:get_access_rule(user_id=0f3b6edfe27c442095978a6d40518ee9, access_rule_id=88e2b3d3aead4978ab3291b31723fce8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.667691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1372575-63f0-4643-962c-d3d65956b18f tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.690807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1940/3885] 10.222.0.30 () {58 vars in 1358 bytes} [Sat Jun 18 22:15:00 2022] GET /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9/access_rules/88e2b3d3aead4978ab3291b31723fce8 => generated 229 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:00.692243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:00.838390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6dce-480c-4865-ba6f-84c0beaa4810 tempest-AccessRulesV3Test-1893047872 tempest-AccessRulesV3Test-1893047872-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:00.844645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:00.845931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:00.846216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:00.846540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] PATH_INFO: `/v3/users/0f3b6edfe27c442095978a6d40518ee9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:00.861516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3b6edfe27c442095978a6d40518ee9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:00.864678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:00.934987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3b6edfe27c442095978a6d40518ee9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:00.935836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3b6edfe27c442095978a6d40518ee9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:00.942748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:00.993430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3b6edfe27c442095978a6d40518ee9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:00.994827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3b6edfe27c442095978a6d40518ee9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:01.005137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3b6edfe27c442095978a6d40518ee9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:01.025199 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1946/3886] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:00 2022] DELETE /identity/v3/users/0f3b6edfe27c442095978a6d40518ee9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:01.029563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:01.029863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:01.030149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:01.050444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:01.051809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:01.132951 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1941/3887] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:01.145899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:01.148345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:01.265515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed725d9-6995-41f2-a0a4-d01d24a98f70 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:01.271918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d378f-b3ab-4ee8-8d30-1e4907f11547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:01.272571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d378f-b3ab-4ee8-8d30-1e4907f11547 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:01.272852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d378f-b3ab-4ee8-8d30-1e4907f11547 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:01.273167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d378f-b3ab-4ee8-8d30-1e4907f11547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:01.287583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d378f-b3ab-4ee8-8d30-1e4907f11547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:01.289948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d378f-b3ab-4ee8-8d30-1e4907f11547 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:01.301714 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1947/3888] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:15:01.448782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:01.450298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:01.458569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:01.470456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3dcff-bda2-49d0-ada6-ba944bdd5e4e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:01.488684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:01.492405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:01.492692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:01.492973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] PATH_INFO: `/v3/users/da2c009d56ae402f90518199c3e5c171` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:01.497645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2c009d56ae402f90518199c3e5c171)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:01.523854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:01.674895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2c009d56ae402f90518199c3e5c171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:01.676078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2c009d56ae402f90518199c3e5c171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:01.715250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2c009d56ae402f90518199c3e5c171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:01.716661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2c009d56ae402f90518199c3e5c171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:01.728526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2c009d56ae402f90518199c3e5c171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:01.765235 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1942/3889] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:01 2022] DELETE /identity/v3/users/da2c009d56ae402f90518199c3e5c171 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:01.772400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75a53-f3c9-42f9-9243-ab6c6a634c1d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:01.772881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75a53-f3c9-42f9-9243-ab6c6a634c1d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:01.772986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75a53-f3c9-42f9-9243-ab6c6a634c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:01.804029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-69b75a53-f3c9-42f9-9243-ab6c6a634c1d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:01.805327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69b75a53-f3c9-42f9-9243-ab6c6a634c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:01.989247 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1948/3890] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:02.002093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:02.007819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:02.091529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:02.094844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:02.095271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:02.137609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] MFA Rules not processed for user `79eddf3b96304e86a213d7238783e960`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:02.138949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:02.218880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d6880-eff2-4a2f-ac32-2f8ccbb61c9c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:02.226751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b5dc-3193-46f6-b111-0c33b5f70dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:02.228010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b5dc-3193-46f6-b111-0c33b5f70dae service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:02.228626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b5dc-3193-46f6-b111-0c33b5f70dae service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:02.229163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b5dc-3193-46f6-b111-0c33b5f70dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:02.238926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:02.273668 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1949/3891] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:02.274699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998b5dc-3193-46f6-b111-0c33b5f70dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:02.275253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:02.276607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998b5dc-3193-46f6-b111-0c33b5f70dae service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:02.281100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:02.308821 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1943/3892] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:02.319082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf74ea-6dac-49ea-a995-91f19631beb0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:02.325439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:02.327175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:02.327850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:02.328345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] PATH_INFO: `/v3/projects/0fb7ccc1d73c4dff9a1e15f8919481ad` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:02.329929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb7ccc1d73c4dff9a1e15f8919481ad)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:02.332581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:02.459883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'request_id': 'req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:02.487671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'request_id': 'req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:02.509679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb7ccc1d73c4dff9a1e15f8919481ad', 'request_id': 'req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:02.527773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] The token cache is being invalidate because project 0fb7ccc1d73c4dff9a1e15f8919481ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:02.528506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:02.529540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b826ea2-ed1b-4b85-92af-2c5ab6fc723e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:02.542169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8af8fd-b51c-4b03-8a6c-465d2f03fe68 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:02.542169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8af8fd-b51c-4b03-8a6c-465d2f03fe68 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:02.542169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8af8fd-b51c-4b03-8a6c-465d2f03fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:02.543080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1950/3893] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:02 2022] DELETE /identity/v3/projects/0fb7ccc1d73c4dff9a1e15f8919481ad => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:02.569270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0d8af8fd-b51c-4b03-8a6c-465d2f03fe68 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:02.570784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0d8af8fd-b51c-4b03-8a6c-465d2f03fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:02.754419 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1944/3894] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:02.763518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95377b35-873b-48d3-8d40-feec77161a27 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:02.763977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95377b35-873b-48d3-8d40-feec77161a27 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:02.764338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95377b35-873b-48d3-8d40-feec77161a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:02.805878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-95377b35-873b-48d3-8d40-feec77161a27 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:02.807332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-95377b35-873b-48d3-8d40-feec77161a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:02.830519 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1951/3895] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:02.831773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8af8fd-b51c-4b03-8a6c-465d2f03fe68 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:02.852493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8af8fd-b51c-4b03-8a6c-465d2f03fe68 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:02.864503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:02.866416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:02.866930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:02.867380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:02.868328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:02.868882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:02.873834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:02.906708 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1945/3896] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:02.912836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95377b35-873b-48d3-8d40-feec77161a27 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:02.930869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95377b35-873b-48d3-8d40-feec77161a27 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:02.943405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:02.944432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:02.944731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:02.945015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:02.948805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:02.955204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.037295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1952/3897] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:02 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:03.040173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.054957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:03.069747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082121d6-ca44-46c5-b6b3-68955acfac47 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:03.172454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:03.174240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.174861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.175767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.177135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:03.180746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.191898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.193753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:03.221958 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1946/3898] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:03 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:03.225485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30d0d-66dd-4fd7-baf5-42a417129318 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:03.226451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.246900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:03.247856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.248143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.248445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] PATH_INFO: `/v3/projects/ae3925ea552446688a7a1aacff545c10` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.251582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3925ea552446688a7a1aacff545c10)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:03.255842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.257784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83b523-39c9-4756-b078-343bf3dfb5af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:03.270193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:03.272496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.273530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.275729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.277823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:03.279723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.321013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1947/3899] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:03.325943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.351703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69ab72-2013-4b44-bc94-cfee1493728e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:03.361900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3925ea552446688a7a1aacff545c10', 'request_id': 'req-2f28d04b-a81b-4a4e-9215-c749674d1f0e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:03.384937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3925ea552446688a7a1aacff545c10', 'request_id': 'req-2f28d04b-a81b-4a4e-9215-c749674d1f0e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:03.404478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3925ea552446688a7a1aacff545c10', 'request_id': 'req-2f28d04b-a81b-4a4e-9215-c749674d1f0e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:03.420508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] The token cache is being invalidate because project ae3925ea552446688a7a1aacff545c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:03.420878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:03.423557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2f28d04b-a81b-4a4e-9215-c749674d1f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:03.425840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1953/3900] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:03 2022] DELETE /identity/v3/projects/ae3925ea552446688a7a1aacff545c10 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:03.430479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36635-dd35-46ac-991e-f773cfa61bb8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.430770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36635-dd35-46ac-991e-f773cfa61bb8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.431055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a36635-dd35-46ac-991e-f773cfa61bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.475567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-85a36635-dd35-46ac-991e-f773cfa61bb8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:03.477424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-85a36635-dd35-46ac-991e-f773cfa61bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:03.527889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:03.530032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.531535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.534336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.535701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:03.540302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.546913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:03.578688 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1948/3901] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:15:03.583702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.589538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:03.597838 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1954/3902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:03.606364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492fd2d-5b1a-44c1-b80d-d145425526ea None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.608311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492fd2d-5b1a-44c1-b80d-d145425526ea None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.608678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492fd2d-5b1a-44c1-b80d-d145425526ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.624524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f442-fedb-4e32-8481-f69bd072cfbe admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:03.634232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290433ce-6032-44a1-be4a-957ae34d86e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:03.635810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290433ce-6032-44a1-be4a-957ae34d86e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.636047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290433ce-6032-44a1-be4a-957ae34d86e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.636315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290433ce-6032-44a1-be4a-957ae34d86e2 admin admin] PATH_INFO: `/v3/projects/d63064183d224222b64d25d55fff5b78/users/42650d2a2da5479891fa602a0e3e44a3/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.636873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7492fd2d-5b1a-44c1-b80d-d145425526ea None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:03.638506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7492fd2d-5b1a-44c1-b80d-d145425526ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:03.670529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290433ce-6032-44a1-be4a-957ae34d86e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63064183d224222b64d25d55fff5b78, user_id=42650d2a2da5479891fa602a0e3e44a3, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:03.674596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1955/3903] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:03.676514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492fd2d-5b1a-44c1-b80d-d145425526ea None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.677172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290433ce-6032-44a1-be4a-957ae34d86e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.698060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492fd2d-5b1a-44c1-b80d-d145425526ea None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:03.708421 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1949/3904] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:03 2022] PUT /identity/v3/projects/d63064183d224222b64d25d55fff5b78/users/42650d2a2da5479891fa602a0e3e44a3/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:03.721932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.722216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.722489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.771993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] MFA Rules not processed for user `42650d2a2da5479891fa602a0e3e44a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:03.773705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:03.821834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:03.822591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.823320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.823698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.824985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:03.825329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:03.830231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.857084 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1956/3905] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:03.857266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:03.861132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.883162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489bb2-11e3-4404-85ef-78de8520800a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:03.897592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:03.898673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:03.899073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:03.899276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:03.900000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:03.902032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:03.909601 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1950/3906] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:03.927191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:03.930842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:04.021283 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1957/3907] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:03 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:04.022291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:04.351586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fc01c-8cba-4730-b29f-12411130b5dd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:04.369990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d16a06-ba93-4500-9eeb-847813513288 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:04.385680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:04.389395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:04.389699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:04.389978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:04.393930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:04.403498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:04.489786 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1958/3908] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:04 2022] POST /identity/v3/users => generated 291 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:04.493404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:04.517968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11f649-2cb3-45e2-b5e6-ca97f5657b29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:04.518955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f649-2cb3-45e2-b5e6-ca97f5657b29 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:04.520999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f649-2cb3-45e2-b5e6-ca97f5657b29 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:04.520999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f649-2cb3-45e2-b5e6-ca97f5657b29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:04.525639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d32296-a7c7-47ee-8aad-8aef3bfbb73c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:04.544217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:04.546936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:04.547452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:04.548011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:04.549412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:04.551662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:04.621802 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1959/3909] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:04.627147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:04.654784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bc99b-d04b-405b-a08f-ae093bdbb335 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:04.664994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:04.666068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:04.666907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:04.666907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:04.670403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:04.672287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:04.711365 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1960/3910] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:04.712806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:04.713087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f649-2cb3-45e2-b5e6-ca97f5657b29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:04.716962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f649-2cb3-45e2-b5e6-ca97f5657b29 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:04.729737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435719e-99c3-47a2-a6ee-d8079b1cf010 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:04.736922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:04.739079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:04.739662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:04.740028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] PATH_INFO: `/v3/projects/b98348e8bdf54b388b5612512ca5252d/users/ae87f94c39ba403195516e259f4fa6fc/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:04.744637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:04.752001 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1951/3911] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:04.783620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98348e8bdf54b388b5612512ca5252d, user_id=ae87f94c39ba403195516e259f4fa6fc, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:04.789927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:04.856675 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1961/3912] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:04 2022] PUT /identity/v3/projects/b98348e8bdf54b388b5612512ca5252d/users/ae87f94c39ba403195516e259f4fa6fc/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:04.863701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84639f4f-bc70-4c01-8bbe-03f457d96a81 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:04.863701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84639f4f-bc70-4c01-8bbe-03f457d96a81 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:04.863701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84639f4f-bc70-4c01-8bbe-03f457d96a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:04.902797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-84639f4f-bc70-4c01-8bbe-03f457d96a81 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:04.905370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-84639f4f-bc70-4c01-8bbe-03f457d96a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:04.969609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:05.034710 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1952/3913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:05.051922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:05.053880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:05.140204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84639f4f-bc70-4c01-8bbe-03f457d96a81 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:05.157637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84639f4f-bc70-4c01-8bbe-03f457d96a81 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:05.167514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:05.169753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:05.170037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:05.170321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] PATH_INFO: `/v3/users/42650d2a2da5479891fa602a0e3e44a3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:05.174897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=42650d2a2da5479891fa602a0e3e44a3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:05.177388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:05.189615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6006-de47-4cdc-a88d-383f408e7b89 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:05.200776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:05.200776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:05.200776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:05.200776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:05.227724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:05.229588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:05.252157 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1962/3914] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:05.253337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:05.255044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:05.274768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b22c02-aac2-4ec1-8e49-59dc032892d7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:05.283073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:05.285191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:05.285515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:05.285799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] PATH_INFO: `/v3/users/0e8a394c0a284416ac893321bd860e51` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:05.287522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8a394c0a284416ac893321bd860e51)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:05.290745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:05.313683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42650d2a2da5479891fa602a0e3e44a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.317206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42650d2a2da5479891fa602a0e3e44a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.357220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42650d2a2da5479891fa602a0e3e44a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.360300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42650d2a2da5479891fa602a0e3e44a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.383286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc9bf12-c2b9-418f-b8c3-b0461afd29cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42650d2a2da5479891fa602a0e3e44a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.397949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8a394c0a284416ac893321bd860e51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.399062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8a394c0a284416ac893321bd860e51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.426085 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1953/3915] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:05 2022] DELETE /identity/v3/users/42650d2a2da5479891fa602a0e3e44a3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:05.429398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:05.429750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:05.430040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:05.445562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8a394c0a284416ac893321bd860e51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.447384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8a394c0a284416ac893321bd860e51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.475900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe886651-0336-4df9-903a-ac8686422e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8a394c0a284416ac893321bd860e51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:05.489432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:05.491057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:05.515628 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1963/3916] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:05 2022] DELETE /identity/v3/users/0e8a394c0a284416ac893321bd860e51 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:05.517288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:05.517584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:05.517864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:05.560421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:05.562034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:05.679227 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1954/3917] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:05.700503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:05.717831 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1964/3918] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:05.718168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:05.720201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:05.727603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:05.729116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:05.822033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:05.824733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfc8c3-5873-4f38-bcbb-31bfaa1433f3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:05.833172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:05.835951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f054b94-469d-44dc-b4f0-426c644bcdf1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:05.837525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:05.837832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:05.838125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:05.845315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:05.846338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:05.847945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:05.847945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:05.889424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:05.889995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:05.891552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:05.893401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:05.903263 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1955/3919] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:15:05.911905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1965/3920] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:15:06.450108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:06.452170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:06.466868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a123cd-c37a-4970-9ed3-229069f86b36 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:06.474092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:06.475117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:06.475429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:06.475780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] PATH_INFO: `/v3/projects/ac774f9b327041a887378bd2725853c6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:06.477433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac774f9b327041a887378bd2725853c6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:06.480369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:06.560092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:06.562128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:06.591982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42eadc8-cd16-4069-96e7-dacb971e05bf service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:06.600191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac774f9b327041a887378bd2725853c6', 'request_id': 'req-6ac7ce05-f550-4750-9d81-06b5a6b183ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.611787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac774f9b327041a887378bd2725853c6', 'request_id': 'req-6ac7ce05-f550-4750-9d81-06b5a6b183ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.627408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac774f9b327041a887378bd2725853c6', 'request_id': 'req-6ac7ce05-f550-4750-9d81-06b5a6b183ec'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.647664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] The token cache is being invalidate because project ac774f9b327041a887378bd2725853c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:06.647997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.648625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.654307 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1956/3921] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:06 2022] DELETE /identity/v3/projects/ac774f9b327041a887378bd2725853c6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:06.656731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:06.658365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:06.715897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:06.718341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:06.718627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:06.718903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] PATH_INFO: `/v3/projects/d63064183d224222b64d25d55fff5b78` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:06.722541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63064183d224222b64d25d55fff5b78)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:06.724524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:06.783617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7ce05-f550-4750-9d81-06b5a6b183ec admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:06.790696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63064183d224222b64d25d55fff5b78', 'request_id': 'req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.820994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63064183d224222b64d25d55fff5b78', 'request_id': 'req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.838852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63064183d224222b64d25d55fff5b78', 'request_id': 'req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.852870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] The token cache is being invalidate because project d63064183d224222b64d25d55fff5b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:06.853455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.854415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-382ad2f2-3cd1-47e3-84ab-530dbbb2d0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:06.856300 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1966/3922] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:06 2022] DELETE /identity/v3/projects/d63064183d224222b64d25d55fff5b78 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:06.861878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff7f33-85d7-4037-8df4-80e10eca28bc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:06.862582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff7f33-85d7-4037-8df4-80e10eca28bc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:06.863095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff7f33-85d7-4037-8df4-80e10eca28bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:06.921199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-16ff7f33-85d7-4037-8df4-80e10eca28bc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:06.923190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-16ff7f33-85d7-4037-8df4-80e10eca28bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:06.982555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:06.988854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:06.989670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:06.995226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] PATH_INFO: `/v3/users/7fa98fb81589488fa53a6f07a208b7fa` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:06.996685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa98fb81589488fa53a6f07a208b7fa)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:07.000797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:07.020503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:07.078821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:07.094313 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1967/3923] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:07.097715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d4015-31ab-427b-bb67-3753d77c78fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:07.098008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d4015-31ab-427b-bb67-3753d77c78fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:07.098367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d4015-31ab-427b-bb67-3753d77c78fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:07.136087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa98fb81589488fa53a6f07a208b7fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:07.137203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa98fb81589488fa53a6f07a208b7fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:07.141231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-910d4015-31ab-427b-bb67-3753d77c78fd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:07.142819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-910d4015-31ab-427b-bb67-3753d77c78fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:07.162462 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1968/3924] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:07.165479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d4015-31ab-427b-bb67-3753d77c78fd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:07.173805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa98fb81589488fa53a6f07a208b7fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:07.175463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa98fb81589488fa53a6f07a208b7fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:07.182936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d4015-31ab-427b-bb67-3753d77c78fd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:07.193479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa98fb81589488fa53a6f07a208b7fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:07.199419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:07.200121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:07.200397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:07.200668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:07.201969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:07.202663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:07.207924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:07.232260 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1957/3925] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:06 2022] DELETE /identity/v3/users/7fa98fb81589488fa53a6f07a208b7fa => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:07.243703 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1969/3926] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:07.245645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:07.427253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bb82d-d9bd-464f-8f19-d8b0fd97923c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:07.441734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:07.456646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:07.457515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:07.457515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:07.458022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:07.459935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:07.512368 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1958/3927] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:07 2022] POST /identity/v3/projects => generated 407 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:07.514203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:07.535798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c015c-5b00-4bc4-8cf1-d11d8caf337a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:07.701730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:07.702461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:07.702744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:07.703027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:07.703746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:07.706092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:07.746756 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1970/3928] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:07 2022] POST /identity/v3/users => generated 304 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:07.748413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:07.774942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4803105-1c15-4f58-8965-2480b4d9afe7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:07.787617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:07.788403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:07.788766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:07.789140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:07.789973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:07.791745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:07.838416 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1959/3929] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:07.842743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:07.857806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f02da-0935-4df9-a00c-ef62636eaeb7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:07.870740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2b975-daf4-4b7b-80e7-e4c223b902ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:07.871868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b975-daf4-4b7b-80e7-e4c223b902ac admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:07.872197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b975-daf4-4b7b-80e7-e4c223b902ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:07.872481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2b975-daf4-4b7b-80e7-e4c223b902ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:07.873617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b975-daf4-4b7b-80e7-e4c223b902ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:07.875057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2b975-daf4-4b7b-80e7-e4c223b902ac admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:07.907179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1971/3930] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:07.908869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:07.923897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd3b3-3d9f-432d-af8f-5ed32cae4cf0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:07.955313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:07.957022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:07.957341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:07.957623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] PATH_INFO: `/v3/projects/76078cfe59ac4b1e932108cc326ffabe/users/0df101f8de81420bbc94f05da3e1465a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.005331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=76078cfe59ac4b1e932108cc326ffabe, user_id=0df101f8de81420bbc94f05da3e1465a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.008673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.038149 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1960/3931] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:07 2022] PUT /identity/v3/projects/76078cfe59ac4b1e932108cc326ffabe/users/0df101f8de81420bbc94f05da3e1465a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:08.048166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa16c0c-7044-4188-8e89-8abe35997bd4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.048721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa16c0c-7044-4188-8e89-8abe35997bd4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.048721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa16c0c-7044-4188-8e89-8abe35997bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.102166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4fa16c0c-7044-4188-8e89-8abe35997bd4 None None] MFA Rules not processed for user `0df101f8de81420bbc94f05da3e1465a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:08.104844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4fa16c0c-7044-4188-8e89-8abe35997bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:08.159753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.165669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:08.268295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:08.287528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1972/3932] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:08.293572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa16c0c-7044-4188-8e89-8abe35997bd4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.304107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a2a4d-a589-4809-a2b7-e4c5310894bb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.311176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.312201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.312599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa16c0c-7044-4188-8e89-8abe35997bd4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.312910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.313324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] PATH_INFO: `/v3/projects/aa9654b224af4e6d9705c4a622c32a01` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.315142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9654b224af4e6d9705c4a622c32a01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.317362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.331154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.332023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.332311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.332593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.333330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.335300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.385152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:08.394325 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1973/3933] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:08 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:15:08.398571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.427314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9654b224af4e6d9705c4a622c32a01', 'request_id': 'req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:08.447231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9654b224af4e6d9705c4a622c32a01', 'request_id': 'req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:08.474674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9654b224af4e6d9705c4a622c32a01', 'request_id': 'req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:08.511651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] The token cache is being invalidate because project aa9654b224af4e6d9705c4a622c32a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:08.515584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:08.518562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8aed4193-0b79-4f94-9e8e-1a13cafd07d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:08.524091 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1961/3934] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:08 2022] DELETE /identity/v3/projects/aa9654b224af4e6d9705c4a622c32a01 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:08.529503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7a6f7-526a-43e6-bc26-0ee20e843da4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.530089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7a6f7-526a-43e6-bc26-0ee20e843da4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.530789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7a6f7-526a-43e6-bc26-0ee20e843da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.541587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda7ab-0787-4ebf-9fb0-13b0108c5122 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.557920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.558642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.558933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.559281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.560305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.566562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.617907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3da7a6f7-526a-43e6-bc26-0ee20e843da4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:08.622188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3da7a6f7-526a-43e6-bc26-0ee20e843da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:08.636623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1974/3935] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:08 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:15:08.637694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.644115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:08.663974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1962/3936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:08.670810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa66b5d-f8d2-47d6-8068-dbc532fe9a36 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.671480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa66b5d-f8d2-47d6-8068-dbc532fe9a36 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.671998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa66b5d-f8d2-47d6-8068-dbc532fe9a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.688868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c4856-8851-419f-8298-c79f34b19e97 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.707355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.708063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.708346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.708621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.709402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.711090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.733093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1975/3937] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:08.734272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.738316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-afa66b5d-f8d2-47d6-8068-dbc532fe9a36 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:08.743785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-afa66b5d-f8d2-47d6-8068-dbc532fe9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:08.747819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd095a3f-b8b7-4453-bd1c-ef6e99db983b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.753475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.754536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.754914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.755315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] PATH_INFO: `/v3/projects/1ab0248cf3aa4f3ca403aa851d991bba/users/c0824bfc3a83414eb5673b87da463e33/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.776630 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1963/3938] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:08.778153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa66b5d-f8d2-47d6-8068-dbc532fe9a36 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.797284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa66b5d-f8d2-47d6-8068-dbc532fe9a36 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.799641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab0248cf3aa4f3ca403aa851d991bba, user_id=c0824bfc3a83414eb5673b87da463e33, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.803424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.811956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.813297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.813661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.814060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.815814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:08.816227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.818339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.836014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1976/3939] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:08 2022] PUT /identity/v3/projects/1ab0248cf3aa4f3ca403aa851d991bba/users/c0824bfc3a83414eb5673b87da463e33/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:08.840451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.857091 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1964/3940] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:08.864934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:08.877522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1557a-2c1b-4b49-9cdd-509e10ce4bc9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.971362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.971955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.972237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.973021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.973157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0430a5-4797-478c-9fa0-7a58d90e74eb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:08.973709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.976183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:08.982203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:08.982908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:08.983193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:08.983474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:08.984224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:08.985940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:09.011885 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1977/3941] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:09.015633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:09.034949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598c19-9c67-478d-a180-41e78ef48025 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:09.050353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070a7e9-9f1e-4083-99c0-1e1a41460b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:09.051283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070a7e9-9f1e-4083-99c0-1e1a41460b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.051566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070a7e9-9f1e-4083-99c0-1e1a41460b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.051846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070a7e9-9f1e-4083-99c0-1e1a41460b71 admin admin] PATH_INFO: `/v3/projects/1ab0248cf3aa4f3ca403aa851d991bba/users/c0824bfc3a83414eb5673b87da463e33/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.054128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070a7e9-9f1e-4083-99c0-1e1a41460b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab0248cf3aa4f3ca403aa851d991bba, user_id=c0824bfc3a83414eb5673b87da463e33, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:09.056723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070a7e9-9f1e-4083-99c0-1e1a41460b71 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:09.084060 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1965/3942] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:08 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:09.085074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:09.086187 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1978/3943] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:09 2022] PUT /identity/v3/projects/1ab0248cf3aa4f3ca403aa851d991bba/users/c0824bfc3a83414eb5673b87da463e33/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:09.101528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.101826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.102637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.165951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:09.168828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] MFA Rules not processed for user `c0824bfc3a83414eb5673b87da463e33`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:09.170131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:09.224006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60d8c3-82c9-4bed-b8ec-ec78e4ed8de8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:09.238792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:09.350849 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1979/3944] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:09.371348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:09.372913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:09.470315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:09.472084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.472084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.474628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.480800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:09.486239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:09.544559 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1966/3945] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:09 2022] POST /identity/v3/users => generated 288 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:09.554179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:09.571453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad7053-ef73-44a3-84b8-9839c2593e1f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:09.573292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee38367-60ed-4e42-bf9b-9fff118e514a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:09.577625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:09.578434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.579532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.580013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.581578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:09.583547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:09.590803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:09.591831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.592336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.592824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.607700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:09.608544 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1967/3946] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:09.609597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:09.612417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:09.624419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8fb0b-74aa-49e5-8afc-57e1cfeb667b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:09.630523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09da57-1f86-4b2d-8b0b-e637a5154aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:09.639750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09da57-1f86-4b2d-8b0b-e637a5154aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.640047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09da57-1f86-4b2d-8b0b-e637a5154aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.640342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09da57-1f86-4b2d-8b0b-e637a5154aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.641292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09da57-1f86-4b2d-8b0b-e637a5154aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:09.644087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09da57-1f86-4b2d-8b0b-e637a5154aa2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:09.663534 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1980/3947] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:15:09.667510 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1968/3948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:09.671896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:09.683861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a613-e4e1-4c17-bef9-196336c99fc6 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:09.721583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:09.723027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.723727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.723986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] PATH_INFO: `/v3/projects/5c772080b72445a48e12bb226f1207f0/users/d8d0634b92d24057af2051ef4d9ebc62/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.776264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c772080b72445a48e12bb226f1207f0, user_id=d8d0634b92d24057af2051ef4d9ebc62, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:09.781103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:09.827936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d1e2-47c8-4876-a574-fde64cc7bd6d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:09.828281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d1e2-47c8-4876-a574-fde64cc7bd6d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:09.828518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479d1e2-47c8-4876-a574-fde64cc7bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:09.831040 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1981/3949] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:09 2022] PUT /identity/v3/projects/5c772080b72445a48e12bb226f1207f0/users/d8d0634b92d24057af2051ef4d9ebc62/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:09.870633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e479d1e2-47c8-4876-a574-fde64cc7bd6d None None] MFA Rules not processed for user `d8d0634b92d24057af2051ef4d9ebc62`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:09.872263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e479d1e2-47c8-4876-a574-fde64cc7bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:09.984284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1969/3950] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:09.988371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:10.070295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1842a0-61c0-4894-a1e1-436dfb157eed admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:10.076603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:10.077339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:10.077843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:10.078484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:10.078819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:10.080763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:10.118707 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1982/3951] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:09 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:10.119987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d1e2-47c8-4876-a574-fde64cc7bd6d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:10.132277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479d1e2-47c8-4876-a574-fde64cc7bd6d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:10.247142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:10.279908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:10.280599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:10.280992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:10.281376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:10.282242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:10.284334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:10.356749 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1970/3952] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:10 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:10.360612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:10.426595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684c0a-deeb-443a-a7de-f2ac5440b361 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:10.440827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:10.442253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:10.442634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:10.444974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:10.446814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:10.453175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:10.477232 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1983/3953] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:10.481775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:10.498018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec147eb-897d-45cb-ba32-df3047d41815 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:10.504857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:10.506309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:10.506775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:10.507428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] PATH_INFO: `/v3/projects/b41440dd7063428b904727873657e75a/users/08b29f968afe4daa9cd6a0b444b9c9e5/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:10.531343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41440dd7063428b904727873657e75a, user_id=08b29f968afe4daa9cd6a0b444b9c9e5, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:10.535423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:10.563826 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1971/3954] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:10 2022] PUT /identity/v3/projects/b41440dd7063428b904727873657e75a/users/08b29f968afe4daa9cd6a0b444b9c9e5/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:10.567947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:10.584582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658d9b1-57de-49b6-a3f6-a4083966633a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:10.598229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:10.737169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214345d-2457-4ec4-ad31-167d1d352486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:10.738064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214345d-2457-4ec4-ad31-167d1d352486 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:10.738543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214345d-2457-4ec4-ad31-167d1d352486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:10.751062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214345d-2457-4ec4-ad31-167d1d352486 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:10.751947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214345d-2457-4ec4-ad31-167d1d352486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:10.755493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214345d-2457-4ec4-ad31-167d1d352486 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:10.773051 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1984/3955] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:10.774546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:10.802367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8135-e071-4ba8-aab2-93e5e12ae484 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:10.814970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:10.820937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:10.821494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:10.821494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] PATH_INFO: `/v3/projects/b41440dd7063428b904727873657e75a/users/08b29f968afe4daa9cd6a0b444b9c9e5/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:10.828013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41440dd7063428b904727873657e75a, user_id=08b29f968afe4daa9cd6a0b444b9c9e5, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:10.835556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:10.876079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1972/3956] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:10 2022] PUT /identity/v3/projects/b41440dd7063428b904727873657e75a/users/08b29f968afe4daa9cd6a0b444b9c9e5/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:10.887714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3dd0-ec5d-4cad-8f74-bfa2ac10184f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:10.888064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3dd0-ec5d-4cad-8f74-bfa2ac10184f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:10.888282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3dd0-ec5d-4cad-8f74-bfa2ac10184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:10.947776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6f2e3dd0-ec5d-4cad-8f74-bfa2ac10184f None None] MFA Rules not processed for user `08b29f968afe4daa9cd6a0b444b9c9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:10.949210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6f2e3dd0-ec5d-4cad-8f74-bfa2ac10184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:11.096919 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1985/3957] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:11.103209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:11.114723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0193-1d4f-4488-8962-2b75bf330bf8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:11.119718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:11.120475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:11.120764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:11.121058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:11.121835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:11.122149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:11.124121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:11.141870 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1973/3958] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:11.143623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3dd0-ec5d-4cad-8f74-bfa2ac10184f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:11.156553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3dd0-ec5d-4cad-8f74-bfa2ac10184f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:11.173255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:11.173845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:11.174546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:11.174918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:11.176296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:11.178366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:11.241805 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1986/3959] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:11 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:11.246172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:11.265853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9dd2-6904-459f-98b4-d88d8241961b tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:11.553703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe717ee5-a3ee-405f-a28a-5eb3d5b2b984 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:11.556523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe717ee5-a3ee-405f-a28a-5eb3d5b2b984 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:11.560183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe717ee5-a3ee-405f-a28a-5eb3d5b2b984 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:11.560629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe717ee5-a3ee-405f-a28a-5eb3d5b2b984 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:11.563745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe717ee5-a3ee-405f-a28a-5eb3d5b2b984 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:11.563745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe717ee5-a3ee-405f-a28a-5eb3d5b2b984 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:11.567812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe717ee5-a3ee-405f-a28a-5eb3d5b2b984 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:11.623642 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1974/3960] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:11.638863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:11.640631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:11.755744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35099766-7a92-4760-b216-d0f124bcef08 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:11.762890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:11.763623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:11.763905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:11.764438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:11.775809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:11.777663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:11.783388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:11.795884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1987/3961] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:11.821406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186922-78ab-4931-b6eb-9f53abec385a None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:11.821634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186922-78ab-4931-b6eb-9f53abec385a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:11.821874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186922-78ab-4931-b6eb-9f53abec385a None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:11.823491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1975/3962] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:15:11.841732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:15:11.858851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:11.878611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d3fa0-a837-47cf-8bf9-ff206f91696f service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:11.896988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:11.898356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:11.898836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:11.899350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/projects/4621db39d40d4d0796341acdcd95a4a2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:11.901225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:get_project(project_id=4621db39d40d4d0796341acdcd95a4a2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:11.904437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:11.907804 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1988/3963] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:15:11 2022] GET /identity/v3/projects/4621db39d40d4d0796341acdcd95a4a2 => generated 367 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:12.283787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730cfd-5b23-4740-926c-31c22e83ab3d None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:12.284750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730cfd-5b23-4740-926c-31c22e83ab3d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:12.285320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f730cfd-5b23-4740-926c-31c22e83ab3d None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:12.287312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1976/3964] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:15:12.295380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:15:12.297219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:12.316065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:12.330148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c5c85-285a-4cb3-95b7-277432653796 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:12.335098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:12.335999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:12.336276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:12.336555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/projects/4621db39d40d4d0796341acdcd95a4a2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:12.338976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:get_project(project_id=4621db39d40d4d0796341acdcd95a4a2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:12.341297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:12.343147 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1989/3965] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:15:12 2022] GET /identity/v3/projects/4621db39d40d4d0796341acdcd95a4a2 => generated 367 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:12.398098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f730cfd-5b23-4740-926c-31c22e83ab3d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:12.419524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f730cfd-5b23-4740-926c-31c22e83ab3d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:12.439717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:12.441313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:12.441841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:12.442806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:12.443857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:12.444966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:12.447036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:12.466838 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1977/3966] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:12.470148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:12.483793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b22c48-7d18-42fb-8d93-0f59030124a7 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:12.491124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b68de0-1bc7-450f-a5cc-f2a4a91d001a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:12.491951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68de0-1bc7-450f-a5cc-f2a4a91d001a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:12.492517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68de0-1bc7-450f-a5cc-f2a4a91d001a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:12.492908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b68de0-1bc7-450f-a5cc-f2a4a91d001a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:12.493827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b68de0-1bc7-450f-a5cc-f2a4a91d001a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:12.496077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b68de0-1bc7-450f-a5cc-f2a4a91d001a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:12.538000 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1990/3967] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:12 2022] POST /identity/v3/users => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:12.542262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:12.559127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb7680-7e1a-46eb-891d-d6bc27a5944e tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:12.575069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:12.577919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:12.579374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:12.579954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:12.581704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:12.584021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:12.589645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:12.627763 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1978/3968] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:12.665894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc6ba-d731-47bc-90e5-3b9f57b2b89e None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:12.666735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc6ba-d731-47bc-90e5-3b9f57b2b89e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:12.667319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc6ba-d731-47bc-90e5-3b9f57b2b89e None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:12.669658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1991/3969] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:15:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:15:12.674688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:15:12.693404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:12.715328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9486-5440-427d-932f-f83b4fc5d610 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:12.728016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:12.729401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:12.729841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:12.730260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/projects/4621db39d40d4d0796341acdcd95a4a2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:12.732179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:get_project(project_id=4621db39d40d4d0796341acdcd95a4a2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:12.734954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:12.743137 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1979/3970] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:15:12 2022] GET /identity/v3/projects/4621db39d40d4d0796341acdcd95a4a2 => generated 367 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:13.115917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874980-3be2-493d-baee-b358e2dafbc8 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:13.116206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874980-3be2-493d-baee-b358e2dafbc8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:13.116490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874980-3be2-493d-baee-b358e2dafbc8 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:13.117931 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1992/3971] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:15:13.129971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:15:13.153955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:13.173099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce8617-2a26-4f87-9fef-1eca125641d8 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:13.185383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:13.186293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:13.187802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:13.188094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/projects/4621db39d40d4d0796341acdcd95a4a2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:13.189582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:get_project(project_id=4621db39d40d4d0796341acdcd95a4a2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:13.191691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:13.193550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1980/3972] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:15:13 2022] GET /identity/v3/projects/4621db39d40d4d0796341acdcd95a4a2 => generated 367 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:13.257673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c874980-3be2-493d-baee-b358e2dafbc8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:13.288784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c874980-3be2-493d-baee-b358e2dafbc8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:13.295444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:13.297177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:13.301755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:13.302282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/users/3fe9fc91651c4a299069cc25c63fcb9a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:13.332598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fe9fc91651c4a299069cc25c63fcb9a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:13.335150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:13.434794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe9fc91651c4a299069cc25c63fcb9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.435957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe9fc91651c4a299069cc25c63fcb9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.454876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe9fc91651c4a299069cc25c63fcb9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.455730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe9fc91651c4a299069cc25c63fcb9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.464931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe9fc91651c4a299069cc25c63fcb9a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.495263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1993/3973] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:13 2022] DELETE /identity/v3/users/3fe9fc91651c4a299069cc25c63fcb9a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:13.500035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:13.502322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:13.515098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244173fa-385a-4ed3-968e-22a05d73c48f tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:13.571129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:13.616398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b29f968afe4daa9cd6a0b444b9c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b41440dd7063428b904727873657e75a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:13.618033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:13.618577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:13.619308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] PATH_INFO: `/v3/projects/4621db39d40d4d0796341acdcd95a4a2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:13.620854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4621db39d40d4d0796341acdcd95a4a2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:13.623086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:13.719424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4621db39d40d4d0796341acdcd95a4a2', 'request_id': 'req-2a39f59d-afbc-470b-94cf-62495cc68c7a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.733937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4621db39d40d4d0796341acdcd95a4a2', 'request_id': 'req-2a39f59d-afbc-470b-94cf-62495cc68c7a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.751440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4621db39d40d4d0796341acdcd95a4a2', 'request_id': 'req-2a39f59d-afbc-470b-94cf-62495cc68c7a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.773180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] The token cache is being invalidate because project 4621db39d40d4d0796341acdcd95a4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:13.773891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.775372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2a39f59d-afbc-470b-94cf-62495cc68c7a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:13.778910 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1981/3974] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:13 2022] DELETE /identity/v3/projects/4621db39d40d4d0796341acdcd95a4a2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:13.784900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:13.786472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:13.928931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c32b1-7c7b-41b5-b650-587e7055ff3a tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:13.978373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:14.033717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:14.034792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:14.035257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:14.036126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] PATH_INFO: `/v3/users/d8d0634b92d24057af2051ef4d9ebc62` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:14.036946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d0634b92d24057af2051ef4d9ebc62)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:14.039556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:14.134992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d0634b92d24057af2051ef4d9ebc62'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:14.135982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d0634b92d24057af2051ef4d9ebc62'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:14.157503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d0634b92d24057af2051ef4d9ebc62'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:14.159382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d0634b92d24057af2051ef4d9ebc62'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:14.177314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d0634b92d24057af2051ef4d9ebc62'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:14.230285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1994/3975] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:13 2022] DELETE /identity/v3/users/d8d0634b92d24057af2051ef4d9ebc62 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:14.234854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:14.236099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:14.236567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:14.278310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:14.279875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:14.379113 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1982/3976] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:14.440822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:14.442581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:14.618949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d00182-3c43-4312-bfb3-ec9e342b5817 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:14.627666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68e13e-a401-440e-a4b3-277fa4399987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:14.628845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68e13e-a401-440e-a4b3-277fa4399987 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:14.629525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68e13e-a401-440e-a4b3-277fa4399987 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:14.632106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68e13e-a401-440e-a4b3-277fa4399987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:14.657205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68e13e-a401-440e-a4b3-277fa4399987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:14.658765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68e13e-a401-440e-a4b3-277fa4399987 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:14.683085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1995/3977] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:15.497236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:15.498751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:15.516509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a92b88-d4d5-4e8a-8a41-6ae2d900ddd4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:15.521932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:15.522952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:15.524292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:15.524669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] PATH_INFO: `/v3/users/0df101f8de81420bbc94f05da3e1465a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:15.526399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df101f8de81420bbc94f05da3e1465a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:15.528600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:15.600521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df101f8de81420bbc94f05da3e1465a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:15.601918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df101f8de81420bbc94f05da3e1465a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:15.612143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:15.620620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df101f8de81420bbc94f05da3e1465a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:15.622655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df101f8de81420bbc94f05da3e1465a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:15.641620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df101f8de81420bbc94f05da3e1465a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:15.668468 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1983/3978] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:15 2022] DELETE /identity/v3/users/0df101f8de81420bbc94f05da3e1465a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:15.673003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:15.673538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:15.673637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:15.702196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:15.703985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:15.808892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:15.839801 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1996/3979] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:15.897233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:15.898831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:15.993491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f5d98-46ce-4729-a37e-3655c9b5222d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:16.003212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:16.004362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:16.004763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:16.005670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:16.045306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:16.051795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:16.075633 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1984/3980] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:16.352907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:16.354637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:16.399179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90828-b8fd-438b-a240-7aeb017c07f7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:16.405879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:16.406892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:16.407133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:16.407317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] PATH_INFO: `/v3/projects/5c772080b72445a48e12bb226f1207f0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:16.408650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c772080b72445a48e12bb226f1207f0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:16.411244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:16.541098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c772080b72445a48e12bb226f1207f0', 'request_id': 'req-32d76c03-f708-4ecd-96a7-4d6afe4b0105'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.550311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c772080b72445a48e12bb226f1207f0', 'request_id': 'req-32d76c03-f708-4ecd-96a7-4d6afe4b0105'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.566214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c772080b72445a48e12bb226f1207f0', 'request_id': 'req-32d76c03-f708-4ecd-96a7-4d6afe4b0105'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.580018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] The token cache is being invalidate because project 5c772080b72445a48e12bb226f1207f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:16.580691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.581413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.583370 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1997/3981] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:16 2022] DELETE /identity/v3/projects/5c772080b72445a48e12bb226f1207f0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:16.587155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:16.598398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7c04-6c0d-47fb-a68c-7446814d5b55 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:16.805564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:16.806475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:16.807392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:16.807392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] PATH_INFO: `/v3/users/08b29f968afe4daa9cd6a0b444b9c9e5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:16.808405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b29f968afe4daa9cd6a0b444b9c9e5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:16.811792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:16.888272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b29f968afe4daa9cd6a0b444b9c9e5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.889040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b29f968afe4daa9cd6a0b444b9c9e5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.915495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b29f968afe4daa9cd6a0b444b9c9e5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.916430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b29f968afe4daa9cd6a0b444b9c9e5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.919713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:16.923123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:16.926346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b29f968afe4daa9cd6a0b444b9c9e5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:16.945709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:16.958679 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1985/3982] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:16 2022] DELETE /identity/v3/users/08b29f968afe4daa9cd6a0b444b9c9e5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:16.973393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d76c03-f708-4ecd-96a7-4d6afe4b0105 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:17.123911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:17.124808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:17.125160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:17.125443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] PATH_INFO: `/v3/projects/76078cfe59ac4b1e932108cc326ffabe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:17.126673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76078cfe59ac4b1e932108cc326ffabe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:17.128807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:17.191522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76078cfe59ac4b1e932108cc326ffabe', 'request_id': 'req-40e60221-818a-47ba-919c-14dc8dbe0ea3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.200266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76078cfe59ac4b1e932108cc326ffabe', 'request_id': 'req-40e60221-818a-47ba-919c-14dc8dbe0ea3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.213991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76078cfe59ac4b1e932108cc326ffabe', 'request_id': 'req-40e60221-818a-47ba-919c-14dc8dbe0ea3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.229524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] The token cache is being invalidate because project 76078cfe59ac4b1e932108cc326ffabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:17.229860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.230772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.232856 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1998/3983] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:16 2022] DELETE /identity/v3/projects/76078cfe59ac4b1e932108cc326ffabe => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:17.236601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:17.238413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:17.259847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5cf3a-12bc-4367-a483-e513b5904820 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:17.427298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:17.428218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:17.428680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:17.428968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] PATH_INFO: `/v3/users/c0824bfc3a83414eb5673b87da463e33` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:17.432839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0824bfc3a83414eb5673b87da463e33)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:17.435171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:17.519564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0824bfc3a83414eb5673b87da463e33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.520689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0824bfc3a83414eb5673b87da463e33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.535389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0824bfc3a83414eb5673b87da463e33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.536375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0824bfc3a83414eb5673b87da463e33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.545295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a537da8c-fb80-48d1-85cb-1709a8d0b8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0824bfc3a83414eb5673b87da463e33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.571968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1986/3984] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:17 2022] DELETE /identity/v3/users/c0824bfc3a83414eb5673b87da463e33 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:17.690470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:17.692489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:17.730808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60221-818a-47ba-919c-14dc8dbe0ea3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:17.731658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290849-ec49-441e-befa-183d0407d384 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:17.733332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290849-ec49-441e-befa-183d0407d384 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:17.733624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290849-ec49-441e-befa-183d0407d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:17.735505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:17.772057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-65290849-ec49-441e-befa-183d0407d384 None None] MFA Rules not processed for user `ae87f94c39ba403195516e259f4fa6fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:17.773865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65290849-ec49-441e-befa-183d0407d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:17.808617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:17.810088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:17.810711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:17.811167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] PATH_INFO: `/v3/projects/b41440dd7063428b904727873657e75a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:17.812700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41440dd7063428b904727873657e75a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:17.815251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:17.883830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41440dd7063428b904727873657e75a', 'request_id': 'req-cb465956-9944-46cd-95b7-73c9068fe2c5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.892229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41440dd7063428b904727873657e75a', 'request_id': 'req-cb465956-9944-46cd-95b7-73c9068fe2c5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.906780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41440dd7063428b904727873657e75a', 'request_id': 'req-cb465956-9944-46cd-95b7-73c9068fe2c5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.916683 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1987/3985] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:17.933818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65290849-ec49-441e-befa-183d0407d384 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:17.935692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65290849-ec49-441e-befa-183d0407d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:17.939888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] The token cache is being invalidate because project b41440dd7063428b904727873657e75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:17.940414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.940953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb465956-9944-46cd-95b7-73c9068fe2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:17.943198 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 1999/3986] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:17 2022] DELETE /identity/v3/projects/b41440dd7063428b904727873657e75a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:17.950076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:17.950349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:17.950743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:17.959482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:18.022002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:18.024558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:18.107946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65290849-ec49-441e-befa-183d0407d384 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.124215 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2000/3987] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:18.125515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.127442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:18.143293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051197ca-0bfc-4b75-af5b-fe24755590f1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.149433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.151050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.151524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.152492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] PATH_INFO: `/v3/projects/1ab0248cf3aa4f3ca403aa851d991bba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.154808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab0248cf3aa4f3ca403aa851d991bba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.157616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.239782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390c0a6-ba7e-44b7-8f40-a38f56e8c2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.241795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390c0a6-ba7e-44b7-8f40-a38f56e8c2c8 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.242396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390c0a6-ba7e-44b7-8f40-a38f56e8c2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.244414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390c0a6-ba7e-44b7-8f40-a38f56e8c2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.252075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f390c0a6-ba7e-44b7-8f40-a38f56e8c2c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:18.255996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:18.281719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab0248cf3aa4f3ca403aa851d991bba', 'request_id': 'req-a219bec7-b551-4592-952a-5c5453869a37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:18.292311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab0248cf3aa4f3ca403aa851d991bba', 'request_id': 'req-a219bec7-b551-4592-952a-5c5453869a37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:18.303925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab0248cf3aa4f3ca403aa851d991bba', 'request_id': 'req-a219bec7-b551-4592-952a-5c5453869a37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:18.333240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] The token cache is being invalidate because project 1ab0248cf3aa4f3ca403aa851d991bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:18.333540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:18.337179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a219bec7-b551-4592-952a-5c5453869a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:18.339776 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2001/3988] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:18 2022] DELETE /identity/v3/projects/1ab0248cf3aa4f3ca403aa851d991bba => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:18.342915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6acaa-3568-46bf-8fa7-f9d0dfdb3167 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.343251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6acaa-3568-46bf-8fa7-f9d0dfdb3167 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.345073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6acaa-3568-46bf-8fa7-f9d0dfdb3167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.377205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-67d6acaa-3568-46bf-8fa7-f9d0dfdb3167 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:18.379507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-67d6acaa-3568-46bf-8fa7-f9d0dfdb3167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:18.401408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390c0a6-ba7e-44b7-8f40-a38f56e8c2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.403045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390c0a6-ba7e-44b7-8f40-a38f56e8c2c8 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.425713 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1988/3989] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:18.438487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb15e-85d9-4398-8182-7364d85b6d69 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.438772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb15e-85d9-4398-8182-7364d85b6d69 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.439046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb15e-85d9-4398-8182-7364d85b6d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.481942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c9edb15e-85d9-4398-8182-7364d85b6d69 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:18.485794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c9edb15e-85d9-4398-8182-7364d85b6d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:18.501098 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1989/3990] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:18.501296 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2002/3991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:18.504805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edb15e-85d9-4398-8182-7364d85b6d69 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.505673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6730d3-78db-49f4-8341-29dc72d7744e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.505960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6730d3-78db-49f4-8341-29dc72d7744e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.506234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6730d3-78db-49f4-8341-29dc72d7744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.533097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edb15e-85d9-4398-8182-7364d85b6d69 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.539741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.540676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.541397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.541685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.542439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:18.542756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.544553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.546394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9b6730d3-78db-49f4-8341-29dc72d7744e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:18.547826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9b6730d3-78db-49f4-8341-29dc72d7744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:18.558873 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2003/3992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:18.563732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6730d3-78db-49f4-8341-29dc72d7744e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.567964 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1990/3993] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:18.572803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.575465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6730d3-78db-49f4-8341-29dc72d7744e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.581527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.582215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.582630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.582834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.583583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:18.583887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.586161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.601078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeaa8e-8aaf-446d-b108-a56c19d065f6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.608406 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2004/3994] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:18.627999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.628667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.630578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.633169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.633836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.638812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.642098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.656280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a32d8-5e1d-497d-a33b-a5ef27c6c8ca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.671848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.672526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.672810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.673266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.673994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.677905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.692992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:18.717084 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1991/3995] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:18 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:18.718930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.758736 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2005/3996] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:18 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:18.763105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.859948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a3ada-91af-409a-82b2-e21bb52bcce0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.878873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.879587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.879870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.880146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.885758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.888399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.913306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc38f0-e631-4ea0-b5cb-a0d2a16d3d46 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.922914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.925123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.925123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.925123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.925854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.939411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:18.939826 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2006/3997] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:18 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:18.939826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.969384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875e6e-e194-4482-9586-962de366aaaa admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:18.980863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:18.983687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:18.984781 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1992/3998] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:18 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:18.985450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:18.986079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:18.987139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:18.988965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:18.998893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.010454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:19.031435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d5c37-d069-42f8-adcc-647082dd47d5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.056791 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2007/3999] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:19.056791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:19.057261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.058867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.059164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.059439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.060233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.062504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.077127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e927133-27b3-4f4a-a84c-535ee07cf499 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.084102 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1993/4000] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:19.087316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:19.088356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.089501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.090443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.091305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.093233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.095073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.110899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d8385-e3c3-463f-8de6-67e426ca79ee admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.116817 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2008/4001] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:19.122249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:19.124996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.125932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.126437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.127300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.129423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.132011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.148110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb8c74-7cb0-4727-a5cf-540b73532dde admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.160901 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1994/4002] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:19.161149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d90f84-7e0b-4432-b1a1-5d9bba667728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.161409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d90f84-7e0b-4432-b1a1-5d9bba667728 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.161862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d90f84-7e0b-4432-b1a1-5d9bba667728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.162591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d90f84-7e0b-4432-b1a1-5d9bba667728 admin admin] PATH_INFO: `/v3/projects/ce682b74440f4be18787cca2b563b4e2/users/1938674200b7408da079537bf6b4d2ec/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.163411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:19.175853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53953-5354-4ad8-8d34-99d61c05bdf4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.181260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773a1ff-19af-4a10-9ab4-1f46b683618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.182366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a1ff-19af-4a10-9ab4-1f46b683618d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.182656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a1ff-19af-4a10-9ab4-1f46b683618d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.182934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773a1ff-19af-4a10-9ab4-1f46b683618d admin admin] PATH_INFO: `/v3/projects/7f0580017de8448c8c2a9fbe3e8bf935/users/4ef611adbc2e4b29bc48b6cef05adeeb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.184917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d90f84-7e0b-4432-b1a1-5d9bba667728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce682b74440f4be18787cca2b563b4e2, user_id=1938674200b7408da079537bf6b4d2ec, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.187836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d90f84-7e0b-4432-b1a1-5d9bba667728 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.205771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a1ff-19af-4a10-9ab4-1f46b683618d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0580017de8448c8c2a9fbe3e8bf935, user_id=4ef611adbc2e4b29bc48b6cef05adeeb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.207541 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2009/4003] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:19 2022] PUT /identity/v3/projects/ce682b74440f4be18787cca2b563b4e2/users/1938674200b7408da079537bf6b4d2ec/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:19.209877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773a1ff-19af-4a10-9ab4-1f46b683618d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.217934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.218242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.218500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.233283 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1995/4004] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:19 2022] PUT /identity/v3/projects/7f0580017de8448c8c2a9fbe3e8bf935/users/4ef611adbc2e4b29bc48b6cef05adeeb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:19.246400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.246547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.246796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.273739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] MFA Rules not processed for user `1938674200b7408da079537bf6b4d2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:19.274992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:19.285930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] MFA Rules not processed for user `4ef611adbc2e4b29bc48b6cef05adeeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:19.287306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:19.380192 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2010/4005] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:19.403166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:19.404841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:19.437084 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1996/4006] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:19.448980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:19.452333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:19.561745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92466d6c-6b9b-4c79-b2e6-4346dd6c04be None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.573534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.574222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.574504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.574781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.579043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:19.593467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.594967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.627939 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2011/4007] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:15:19.657658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6308-8d6b-4460-8db3-58781a42e129 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.667899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03952872-eca7-4420-b27c-4c3a66340b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.668861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03952872-eca7-4420-b27c-4c3a66340b80 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.669343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03952872-eca7-4420-b27c-4c3a66340b80 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.670504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03952872-eca7-4420-b27c-4c3a66340b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.688581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03952872-eca7-4420-b27c-4c3a66340b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.690388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03952872-eca7-4420-b27c-4c3a66340b80 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:19.711851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1997/4008] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:15:19.767975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:19.876124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:19.909357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e73d1f-3763-45a3-b483-2ce06186557d service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:19.962385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:19.964385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:19.964688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:19.964970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] PATH_INFO: `/v3/users/1938674200b7408da079537bf6b4d2ec` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:19.972679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1938674200b7408da079537bf6b4d2ec)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:19.979131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:20.113376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1938674200b7408da079537bf6b4d2ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:20.114517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1938674200b7408da079537bf6b4d2ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:20.132021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1938674200b7408da079537bf6b4d2ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:20.133836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1938674200b7408da079537bf6b4d2ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:20.144574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1938674200b7408da079537bf6b4d2ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:20.169888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2012/4009] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:19 2022] DELETE /identity/v3/users/1938674200b7408da079537bf6b4d2ec => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:20.172152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:20.172658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:20.172744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:20.208215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:20.210048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:20.319306 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1998/4010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:20.339443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:20.343593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:20.496743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a835db-c870-4a2d-8d94-b613acff7b10 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:20.501179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919b1aa-5d97-4a1a-b7dc-ec599bc119bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:20.501857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919b1aa-5d97-4a1a-b7dc-ec599bc119bc service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:20.502141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919b1aa-5d97-4a1a-b7dc-ec599bc119bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:20.502419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919b1aa-5d97-4a1a-b7dc-ec599bc119bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:20.519436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919b1aa-5d97-4a1a-b7dc-ec599bc119bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:20.521105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919b1aa-5d97-4a1a-b7dc-ec599bc119bc service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:20.544089 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2013/4011] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:21.016579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:21.018661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:21.049359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d52dab-dfac-4689-bbd9-c4e348ee9fdb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:21.055792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:21.056931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:21.057226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:21.057501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] PATH_INFO: `/v3/users/4ef611adbc2e4b29bc48b6cef05adeeb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:21.058769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef611adbc2e4b29bc48b6cef05adeeb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:21.060778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:21.140595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef611adbc2e4b29bc48b6cef05adeeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:21.141373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef611adbc2e4b29bc48b6cef05adeeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:21.156253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef611adbc2e4b29bc48b6cef05adeeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:21.157419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef611adbc2e4b29bc48b6cef05adeeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:21.168554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef611adbc2e4b29bc48b6cef05adeeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:21.190677 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 1999/4012] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:21 2022] DELETE /identity/v3/users/4ef611adbc2e4b29bc48b6cef05adeeb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:21.193393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:21.193879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:21.194156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:21.213880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:21.215518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:21.289596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2014/4013] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:21.300246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:21.302108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:21.374679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:21.408921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49efdf-7b70-46e3-a7d3-9c3a92b16081 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:21.413438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:21.414068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:21.414668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:21.415139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:21.432175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:21.433729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:21.448809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2000/4014] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:21.806874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:21.811655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:21.835612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cbe47-efd6-4303-b7cd-3def55fb4378 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:21.849684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:21.850585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:21.850865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:21.851142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] PATH_INFO: `/v3/projects/ce682b74440f4be18787cca2b563b4e2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:21.858598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce682b74440f4be18787cca2b563b4e2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:21.862641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:21.890764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:22.011098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.015579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:22.027361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce682b74440f4be18787cca2b563b4e2', 'request_id': 'req-fe5fa7d7-d8d4-416c-9543-df6226787f83'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.048382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ea004-7d1c-430a-918d-bf9390f06365 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.048992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce682b74440f4be18787cca2b563b4e2', 'request_id': 'req-fe5fa7d7-d8d4-416c-9543-df6226787f83'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.074791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce682b74440f4be18787cca2b563b4e2', 'request_id': 'req-fe5fa7d7-d8d4-416c-9543-df6226787f83'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.114406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] The token cache is being invalidate because project ce682b74440f4be18787cca2b563b4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:22.114797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.115564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fe5fa7d7-d8d4-416c-9543-df6226787f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.117815 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2015/4015] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:21 2022] DELETE /identity/v3/projects/ce682b74440f4be18787cca2b563b4e2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:22.125528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb262b-79a2-411e-addd-93509da26464 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.126174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb262b-79a2-411e-addd-93509da26464 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.126666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb262b-79a2-411e-addd-93509da26464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.152282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a5fb262b-79a2-411e-addd-93509da26464 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:22.153531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a5fb262b-79a2-411e-addd-93509da26464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:22.183974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.185267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.185705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.186155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] PATH_INFO: `/v3/projects/7f0580017de8448c8c2a9fbe3e8bf935` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.187874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0580017de8448c8c2a9fbe3e8bf935)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.190061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.265509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0580017de8448c8c2a9fbe3e8bf935', 'request_id': 'req-1646f83a-102d-40d8-a2af-b52c031b7825'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.266969 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2016/4016] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:22.274304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0580017de8448c8c2a9fbe3e8bf935', 'request_id': 'req-1646f83a-102d-40d8-a2af-b52c031b7825'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.277168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6954db-f4e3-46b8-9de3-e7a6ac5730c9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.277689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6954db-f4e3-46b8-9de3-e7a6ac5730c9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.278272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6954db-f4e3-46b8-9de3-e7a6ac5730c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.289815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0580017de8448c8c2a9fbe3e8bf935', 'request_id': 'req-1646f83a-102d-40d8-a2af-b52c031b7825'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.304282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2d6954db-f4e3-46b8-9de3-e7a6ac5730c9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:22.305583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d6954db-f4e3-46b8-9de3-e7a6ac5730c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:22.308232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] The token cache is being invalidate because project 7f0580017de8448c8c2a9fbe3e8bf935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:22.308541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.309971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1646f83a-102d-40d8-a2af-b52c031b7825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:22.313501 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2001/4017] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:22 2022] DELETE /identity/v3/projects/7f0580017de8448c8c2a9fbe3e8bf935 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:22.318630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68eec1-f8f0-4858-b5f0-0673a5e7ae3c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.319033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68eec1-f8f0-4858-b5f0-0673a5e7ae3c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.320300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68eec1-f8f0-4858-b5f0-0673a5e7ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.349369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dd68eec1-f8f0-4858-b5f0-0673a5e7ae3c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:22.351090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dd68eec1-f8f0-4858-b5f0-0673a5e7ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:22.401601 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2017/4018] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:22.404820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6954db-f4e3-46b8-9de3-e7a6ac5730c9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.416091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6954db-f4e3-46b8-9de3-e7a6ac5730c9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.427377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.428317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.428317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.428641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.429359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:22.429684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.432107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.449593 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2018/4019] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:22.453672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.455270 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2002/4020] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:22.464186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db1ba-01a3-4715-afb3-9146ae10900c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.464476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db1ba-01a3-4715-afb3-9146ae10900c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.464762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8db1ba-01a3-4715-afb3-9146ae10900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.465889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e5389-f492-43d4-b439-b2bc9bb7c343 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.470985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.472000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.472497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.473561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.475513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:22.475726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.478575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.489957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ae8db1ba-01a3-4715-afb3-9146ae10900c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:22.492089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ae8db1ba-01a3-4715-afb3-9146ae10900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:22.516038 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2003/4021] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:22.519083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8db1ba-01a3-4715-afb3-9146ae10900c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.526440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2019/4022] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:15:22.530205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.531030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8db1ba-01a3-4715-afb3-9146ae10900c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.544000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:22.621905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.624966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.625507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.625936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.626898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:22.627877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.631079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.641482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e0319-9a8d-41bd-960e-cd185d75d541 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.654030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.654876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.657224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.657453 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2004/4023] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:22.658030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.661202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.662082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.676954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.680160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3dd1a-a59d-41e7-bfeb-175fcc051a86 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.686047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.687032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.687467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.687894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.688745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.690918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.737184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2005/4024] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:15:22.737970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2020/4025] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/users => generated 281 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:22.741961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.750600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.785986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052efa5-5d0d-4863-8fef-5fe5052aeef1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.821585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16adf1-d0e1-45e4-87aa-0219b82d3828 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.828876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.833061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.833751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.834038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.834763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.843112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.901563 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2006/4026] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:22 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:22.905597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.930534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed53df-45ec-46ec-8692-adc80f552037 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:22.934718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.935776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.937201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.938126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.938887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.943710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.945969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:22.946340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:22.946498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:22.946774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:22.949161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:22.952864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:22.972336 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2021/4027] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:22.974528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:22.986896 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2007/4028] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:22.987944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:23.003623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd8bd9-68f7-4c3e-830a-51daca0dc864 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:23.013802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80bd53-05d7-4d5f-9a60-8f45aca34c2b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:23.014817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:23.015594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.016447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.017016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.017852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:23.019564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:23.027534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:23.028851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.028851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.029085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.030353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:23.032182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:23.035161 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2022/4029] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:23.041591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:23.059039 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2008/4030] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:23.063100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:23.068852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a59b2-c476-40bd-ac99-718927cc50f1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:23.083935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2334b74-719f-4bdd-b9ce-e5e5c2d1f159 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:23.085735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5c0a3-61e9-4944-adb8-db9c53f0b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:23.086898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c0a3-61e9-4944-adb8-db9c53f0b7be admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.087258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c0a3-61e9-4944-adb8-db9c53f0b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.088106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5c0a3-61e9-4944-adb8-db9c53f0b7be admin admin] PATH_INFO: `/v3/projects/4df74fcc6d984028ad048ec32ae06da6/users/366a0817471843488a6a464d15a72929/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.089420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f709-ae11-476d-864b-a428d27c9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:23.090513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f709-ae11-476d-864b-a428d27c9939 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.090860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f709-ae11-476d-864b-a428d27c9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.091201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f709-ae11-476d-864b-a428d27c9939 admin admin] PATH_INFO: `/v3/projects/1de35489d4f8404193901d8cbb47d4a0/users/260479bb8ed0447e889d0be2a5bd2c8a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.109361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168f709-ae11-476d-864b-a428d27c9939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de35489d4f8404193901d8cbb47d4a0, user_id=260479bb8ed0447e889d0be2a5bd2c8a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:23.112605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168f709-ae11-476d-864b-a428d27c9939 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:23.126642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5c0a3-61e9-4944-adb8-db9c53f0b7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df74fcc6d984028ad048ec32ae06da6, user_id=366a0817471843488a6a464d15a72929, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:23.130261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5c0a3-61e9-4944-adb8-db9c53f0b7be admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:23.143044 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2009/4031] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:23 2022] PUT /identity/v3/projects/1de35489d4f8404193901d8cbb47d4a0/users/260479bb8ed0447e889d0be2a5bd2c8a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:23.148197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.148529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.148773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.163062 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2023/4032] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:23 2022] PUT /identity/v3/projects/4df74fcc6d984028ad048ec32ae06da6/users/366a0817471843488a6a464d15a72929/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:23.172908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.173587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.173951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.181774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:23.185069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:23.205772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:23.241315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] MFA Rules not processed for user `366a0817471843488a6a464d15a72929`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:23.243143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:23.339641 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2010/4033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:23.366209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:23.369108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:23.370773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:23.437223 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2024/4034] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:23.456166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:23.457814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:23.527939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643317-6103-4c74-b097-b1dbebfc7ddc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:23.535243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:23.537663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.537905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.539810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.558248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:23.560137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:23.585831 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2011/4035] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:23.586038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189a91-fe89-49fc-b8a0-c6309f86a9e9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:23.590964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:23.591589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:23.591870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:23.592144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:23.602541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:23.604279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:23.616148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2025/4036] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:25.151960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:25.153767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:25.167952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d851dc-8396-41b8-a792-da7a286101b0 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:25.183793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:25.185742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:25.186340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:25.186869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] PATH_INFO: `/v3/users/ae87f94c39ba403195516e259f4fa6fc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:25.189145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae87f94c39ba403195516e259f4fa6fc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:25.192085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:25.293501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae87f94c39ba403195516e259f4fa6fc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:25.294573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae87f94c39ba403195516e259f4fa6fc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:25.382090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae87f94c39ba403195516e259f4fa6fc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:25.384928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae87f94c39ba403195516e259f4fa6fc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:25.416530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a983032-fc87-4185-85d5-6d8f09a1b161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae87f94c39ba403195516e259f4fa6fc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:25.446454 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2012/4037] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:25 2022] DELETE /identity/v3/users/ae87f94c39ba403195516e259f4fa6fc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:25.782046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:25.802388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8186a6-0898-4af5-a76f-81ec677155ce service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:25.923391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:25.924647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:25.925115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:25.925427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] PATH_INFO: `/v3/projects/b98348e8bdf54b388b5612512ca5252d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:25.926946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98348e8bdf54b388b5612512ca5252d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:25.929958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:26.014954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98348e8bdf54b388b5612512ca5252d', 'request_id': 'req-18fb8e17-0341-49ba-acf3-55a9f82ec503'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:26.020858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98348e8bdf54b388b5612512ca5252d', 'request_id': 'req-18fb8e17-0341-49ba-acf3-55a9f82ec503'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:26.035164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98348e8bdf54b388b5612512ca5252d', 'request_id': 'req-18fb8e17-0341-49ba-acf3-55a9f82ec503'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:26.054123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] The token cache is being invalidate because project b98348e8bdf54b388b5612512ca5252d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:26.054589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:26.056090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-18fb8e17-0341-49ba-acf3-55a9f82ec503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:26.058387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2026/4038] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:25 2022] DELETE /identity/v3/projects/b98348e8bdf54b388b5612512ca5252d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:26.063995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b2f9-a7f2-43f6-a0bb-dfa8929866b4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.064407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b2f9-a7f2-43f6-a0bb-dfa8929866b4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.064799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5b2f9-a7f2-43f6-a0bb-dfa8929866b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.092674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fcf5b2f9-a7f2-43f6-a0bb-dfa8929866b4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:26.094502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fcf5b2f9-a7f2-43f6-a0bb-dfa8929866b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:26.141484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:26.192975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2013/4039] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:26.202293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca61d-794a-4eed-be70-f0b986b4f51b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.202756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca61d-794a-4eed-be70-f0b986b4f51b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.203126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca61d-794a-4eed-be70-f0b986b4f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.227752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-453ca61d-794a-4eed-be70-f0b986b4f51b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:26.230778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-453ca61d-794a-4eed-be70-f0b986b4f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:26.242054 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2027/4040] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:26.246802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b2f9-a7f2-43f6-a0bb-dfa8929866b4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:26.258400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5b2f9-a7f2-43f6-a0bb-dfa8929866b4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:26.263766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:26.264988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.265519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.265892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.266803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:26.267207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:26.269068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:26.299223 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2014/4041] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:26.303811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ca61d-794a-4eed-be70-f0b986b4f51b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:26.325434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ca61d-794a-4eed-be70-f0b986b4f51b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:26.328475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:26.329423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.329832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.330327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.331404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:26.334531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:26.346865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:26.376580 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2028/4042] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:26 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:26.378136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:26.394575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ace4-5d9c-448f-a1be-9d440342e6a0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:26.517326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:26.518587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.519114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.519563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.520643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:26.524109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:26.587578 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2015/4043] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:26 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:26.592184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:26.605733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495374c-ac71-4ce6-a5f9-03944f815871 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:26.611256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:26.612079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.612462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.612841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.613735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:26.616117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:26.632266 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2029/4044] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:26.633566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:26.649211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfb254-ba3c-47c8-8e52-0e7821d458c2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:26.671070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73c2ae-4be6-41cf-bdbc-021e4833348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:26.671776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c2ae-4be6-41cf-bdbc-021e4833348e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.672053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c2ae-4be6-41cf-bdbc-021e4833348e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.672323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73c2ae-4be6-41cf-bdbc-021e4833348e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.673119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c2ae-4be6-41cf-bdbc-021e4833348e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:26.675185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73c2ae-4be6-41cf-bdbc-021e4833348e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:26.703694 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2016/4045] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:15:26.705874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:26.734895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46371855-f1c6-476a-9c2d-cc8880d2cdda admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:26.756581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:26.758624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.759602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.761340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] PATH_INFO: `/v3/projects/d3167cc3e4a54982af2ec54124a5c730/users/b4f52f9c60b649679aaa6e98b575d43a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.793082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3167cc3e4a54982af2ec54124a5c730, user_id=b4f52f9c60b649679aaa6e98b575d43a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:26.797528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:26.829415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2030/4046] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:26 2022] PUT /identity/v3/projects/d3167cc3e4a54982af2ec54124a5c730/users/b4f52f9c60b649679aaa6e98b575d43a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:26.832361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a68e-20a6-493f-96af-cd28dbdf4d5f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:26.833305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a68e-20a6-493f-96af-cd28dbdf4d5f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:26.833839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a68e-20a6-493f-96af-cd28dbdf4d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:26.855528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-acb9a68e-20a6-493f-96af-cd28dbdf4d5f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:26.857745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-acb9a68e-20a6-493f-96af-cd28dbdf4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:27.017391 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2017/4047] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:15:27.037733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:27.040702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:27.161803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a5ec8-c55b-4ae9-83fc-8984bb2c3bc1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:27.165954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f66a20-2889-41e7-8be1-f85c50dcf940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:27.166637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66a20-2889-41e7-8be1-f85c50dcf940 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:27.166922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66a20-2889-41e7-8be1-f85c50dcf940 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:27.168016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66a20-2889-41e7-8be1-f85c50dcf940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:27.180002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f66a20-2889-41e7-8be1-f85c50dcf940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:27.181915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f66a20-2889-41e7-8be1-f85c50dcf940 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:27.198494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2031/4048] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:30.587808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:30.588649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:30.589121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:30.627455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] MFA Rules not processed for user `65fa96c0dcf948d185e7d5fdcf280fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:30.629459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:30.666788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:30.740268 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2018/4049] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:32.062956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ea54-773a-46f3-bf7d-672fc73af847 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:32.065765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ea54-773a-46f3-bf7d-672fc73af847 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:32.065765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ea54-773a-46f3-bf7d-672fc73af847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:32.130158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-76b8ea54-773a-46f3-bf7d-672fc73af847 None None] MFA Rules not processed for user `260479bb8ed0447e889d0be2a5bd2c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:32.131600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-76b8ea54-773a-46f3-bf7d-672fc73af847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:32.289682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2032/4050] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:32.291115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:32.293310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:32.400900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d056f1-d02f-4faf-b057-3bc195f3a281 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:32.411728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:32.412915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:32.413544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:32.414672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:32.437247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:32.439643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:32.476128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2019/4051] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:36.073300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb947-2611-4de7-9e02-96c4d5d9ecce None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:36.074252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb947-2611-4de7-9e02-96c4d5d9ecce None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:36.074689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb947-2611-4de7-9e02-96c4d5d9ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:36.116019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-497fb947-2611-4de7-9e02-96c4d5d9ecce None None] MFA Rules not processed for user `b4f52f9c60b649679aaa6e98b575d43a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:36.117537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-497fb947-2611-4de7-9e02-96c4d5d9ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:36.175381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:36.220034 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2033/4052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:36.347658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:36.349407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:36.374967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb5e8-11c2-4f22-bca4-d1217da4baba service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:36.383994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:36.385524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:36.385878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:36.386239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:36.404474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:36.406361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:36.424647 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2020/4053] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:39.556685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccee3-7f18-48ae-b07c-eca426c2a724 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:39.557193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccee3-7f18-48ae-b07c-eca426c2a724 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:39.557333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddccee3-7f18-48ae-b07c-eca426c2a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:39.579435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ddccee3-7f18-48ae-b07c-eca426c2a724 None None] MFA Rules not processed for user `b4f52f9c60b649679aaa6e98b575d43a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:39.581555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ddccee3-7f18-48ae-b07c-eca426c2a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:39.590991 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2034/4054] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:44.038887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:44.041173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:44.057293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aa0b0-f6d1-4d7d-88d9-423f57c52c08 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:44.063006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:44.063906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:44.064384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:44.064998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] PATH_INFO: `/v3/users/366a0817471843488a6a464d15a72929` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:44.066213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=366a0817471843488a6a464d15a72929)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:44.068370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:44.144885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366a0817471843488a6a464d15a72929'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:44.145666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366a0817471843488a6a464d15a72929'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:44.166786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366a0817471843488a6a464d15a72929'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:44.167733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366a0817471843488a6a464d15a72929'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:44.178013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366a0817471843488a6a464d15a72929'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:44.211989 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2021/4055] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:44 2022] DELETE /identity/v3/users/366a0817471843488a6a464d15a72929 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:44.217071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:44.217569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:44.217880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:44.258288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:44.261128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:44.359048 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2035/4056] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:44.379958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:44.382987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:44.452829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:44.525054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0df9-d27b-4fe1-aadc-74ef02ac2d6f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:44.529101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95b508-9344-4905-87b5-e9f4238b17d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:44.529873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b508-9344-4905-87b5-e9f4238b17d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:44.530278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b508-9344-4905-87b5-e9f4238b17d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:44.530560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95b508-9344-4905-87b5-e9f4238b17d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:44.542687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95b508-9344-4905-87b5-e9f4238b17d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:44.544505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95b508-9344-4905-87b5-e9f4238b17d7 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:44.560871 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2022/4057] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:45.313526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:45.315934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:45.329819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cea95-a6e9-49ae-8977-c340d345eaa9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:45.335937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:45.336835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.337206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.337486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] PATH_INFO: `/v3/projects/4df74fcc6d984028ad048ec32ae06da6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.339016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df74fcc6d984028ad048ec32ae06da6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:45.340981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:45.399346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df74fcc6d984028ad048ec32ae06da6', 'request_id': 'req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:45.406411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df74fcc6d984028ad048ec32ae06da6', 'request_id': 'req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:45.416952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df74fcc6d984028ad048ec32ae06da6', 'request_id': 'req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:45.431456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] The token cache is being invalidate because project 4df74fcc6d984028ad048ec32ae06da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:45.431753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:45.432419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-487e7784-b096-4ea5-aa3c-fe38c9c5cc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:45.434228 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2036/4058] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:45 2022] DELETE /identity/v3/projects/4df74fcc6d984028ad048ec32ae06da6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:45.439478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8addd48-a764-4721-9acf-de149b279f21 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.439991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8addd48-a764-4721-9acf-de149b279f21 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.440117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8addd48-a764-4721-9acf-de149b279f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.459954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b8addd48-a764-4721-9acf-de149b279f21 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:45.461207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b8addd48-a764-4721-9acf-de149b279f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:45.523675 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2023/4059] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:45.533439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe01c19-883b-456c-9408-852b75c07f8f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.533742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe01c19-883b-456c-9408-852b75c07f8f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.534264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe01c19-883b-456c-9408-852b75c07f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.554282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-afe01c19-883b-456c-9408-852b75c07f8f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:45.555546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-afe01c19-883b-456c-9408-852b75c07f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:45.564775 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2037/4060] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:45.569208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8addd48-a764-4721-9acf-de149b279f21 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:45.580405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8addd48-a764-4721-9acf-de149b279f21 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:45.585564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:45.586256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.586697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.586986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.587844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:45.588156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:45.589825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:45.605349 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2024/4061] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:15:45.607553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe01c19-883b-456c-9408-852b75c07f8f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:45.617478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe01c19-883b-456c-9408-852b75c07f8f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:45.624053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:45.624923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.625402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.625865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.626743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:45.628835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:45.661850 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2038/4062] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:45 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:45.663134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:45.674071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27c7f2-5bb8-4348-8a56-63227ac573f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:45.734388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:45.735083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.735363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.735628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.736334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:45.738387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:45.763124 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2025/4063] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:45 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:45.764422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:45.775904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b7937-1bcd-471e-abd9-ecc9a4ccef9f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:45.782174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:45.782934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.783266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.783603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.784414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:45.786219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:45.797393 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2039/4064] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:45.801743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:45.813662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59813f2-215f-4114-83ef-5a6304c82c1e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:45.819061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448a369-e3e2-4b4e-b5b1-9c3d8462f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:45.820020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a369-e3e2-4b4e-b5b1-9c3d8462f5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.820417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a369-e3e2-4b4e-b5b1-9c3d8462f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.820794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448a369-e3e2-4b4e-b5b1-9c3d8462f5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.821582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448a369-e3e2-4b4e-b5b1-9c3d8462f5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:45.823222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448a369-e3e2-4b4e-b5b1-9c3d8462f5d9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:45.835175 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2026/4065] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:15:45.839720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:45.850273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075d171-0c91-4bba-97e3-1c2b5c80b49e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:45.855450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:45.856355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.856636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.859551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] PATH_INFO: `/v3/projects/a9bf3189899e419cb0b702e896d5b9c5/users/4601e151bd20435e87ef6572a27cd170/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.870389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:45.874398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bf3189899e419cb0b702e896d5b9c5, user_id=4601e151bd20435e87ef6572a27cd170, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:45.878252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:45.894004 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2040/4066] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:45 2022] PUT /identity/v3/projects/a9bf3189899e419cb0b702e896d5b9c5/users/4601e151bd20435e87ef6572a27cd170/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:45.904947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e51e6-d897-4316-bcd8-3dc96c0306b1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:45.904947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e51e6-d897-4316-bcd8-3dc96c0306b1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:45.904947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e51e6-d897-4316-bcd8-3dc96c0306b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:45.957626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-528e51e6-d897-4316-bcd8-3dc96c0306b1 None None] MFA Rules not processed for user `4601e151bd20435e87ef6572a27cd170`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:45.959019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-528e51e6-d897-4316-bcd8-3dc96c0306b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:45.984597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:46.087967 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2027/4067] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:46.100103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:46.102072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:46.166041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14b21f-71c7-4cbb-9a27-a1b2e24d0255 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:46.169841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:46.170661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:46.171032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:46.172043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:46.181975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:46.183612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:46.193892 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2041/4068] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:48.275914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:48.276458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:48.276575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:48.297368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] MFA Rules not processed for user `cc3d993686bc4416a4015ac3e96b029c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:48.298912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:48.370022 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2028/4069] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:52.759199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:52.761504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:52.832676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:52.837534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:52.892345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b763f-8154-4726-b7ea-9f96528da760 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:52.898681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:52.899487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:52.900067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:52.900349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:52.903005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:52.924717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:52.932352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:52.955913 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2042/4070] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:53.003354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0662c8-7854-446f-9583-a758723f7c80 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:53.011955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:53.013175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:53.013515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:53.014160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] PATH_INFO: `/v3/users/260479bb8ed0447e889d0be2a5bd2c8a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:53.017692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260479bb8ed0447e889d0be2a5bd2c8a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:53.022811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:53.124443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260479bb8ed0447e889d0be2a5bd2c8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:53.125340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260479bb8ed0447e889d0be2a5bd2c8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:53.149797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260479bb8ed0447e889d0be2a5bd2c8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:53.150557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260479bb8ed0447e889d0be2a5bd2c8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:53.156718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:53.181215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-65236dee-6769-449a-8872-4fb100ed2235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260479bb8ed0447e889d0be2a5bd2c8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:53.217757 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2029/4071] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:52 2022] DELETE /identity/v3/users/260479bb8ed0447e889d0be2a5bd2c8a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:53.944059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:53.978336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e27d1f-48bc-4d9c-a842-c7af97a0d3a6 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.071913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.072942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.073331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.073708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] PATH_INFO: `/v3/projects/1de35489d4f8404193901d8cbb47d4a0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.075673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de35489d4f8404193901d8cbb47d4a0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.079023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.118552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:54.137326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de35489d4f8404193901d8cbb47d4a0', 'request_id': 'req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:54.143917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de35489d4f8404193901d8cbb47d4a0', 'request_id': 'req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:54.152151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de35489d4f8404193901d8cbb47d4a0', 'request_id': 'req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:54.163530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] The token cache is being invalidate because project 1de35489d4f8404193901d8cbb47d4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:54.163815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:54.164496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-60ba7eb9-d371-4e3a-b810-b4b784aa7b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:54.166392 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2043/4072] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:53 2022] DELETE /identity/v3/projects/1de35489d4f8404193901d8cbb47d4a0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:54.171603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366507-d032-428a-aef8-c3b57cbc86fb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.172179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366507-d032-428a-aef8-c3b57cbc86fb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.172585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366507-d032-428a-aef8-c3b57cbc86fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.192849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cc366507-d032-428a-aef8-c3b57cbc86fb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:54.194399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cc366507-d032-428a-aef8-c3b57cbc86fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:54.261855 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2030/4073] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:54.270237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7437af-ba78-4c74-b344-20708e5acab5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.270528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7437af-ba78-4c74-b344-20708e5acab5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.270812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7437af-ba78-4c74-b344-20708e5acab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.290070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ff7437af-ba78-4c74-b344-20708e5acab5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:54.291423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ff7437af-ba78-4c74-b344-20708e5acab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:54.300260 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2044/4074] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:54.304635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc366507-d032-428a-aef8-c3b57cbc86fb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:54.315002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc366507-d032-428a-aef8-c3b57cbc86fb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.320965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.321853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.321853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.321853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.322785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:54.323120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.326357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.340551 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2031/4075] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:15:54.345348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7437af-ba78-4c74-b344-20708e5acab5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:54.356709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7437af-ba78-4c74-b344-20708e5acab5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.364032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.364752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.365131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.365362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.366066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.368901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.404029 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2045/4076] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:54 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:54.408544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:54.424330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa47884-9519-4fb6-ad56-72a219d2c70a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.501554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.502530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.503090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.503535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.504426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.506694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.534051 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2032/4077] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:54 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:15:54.538557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:54.551172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5717-9ddd-4147-841c-ab0248b91047 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.557711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.558563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.558906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.559453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.560943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.563893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.580740 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2046/4078] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:54.582030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:54.595192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f43bc7-22f9-432d-a0fb-f46f543389af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.604352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e50a6-9039-490c-af7b-6d6f675da91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.605352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e50a6-9039-490c-af7b-6d6f675da91b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.606253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e50a6-9039-490c-af7b-6d6f675da91b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.606253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e50a6-9039-490c-af7b-6d6f675da91b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.606962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e50a6-9039-490c-af7b-6d6f675da91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.609328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e50a6-9039-490c-af7b-6d6f675da91b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.630763 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2033/4079] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:15:54.635454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:54.646825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738148-96cf-4f32-a897-0e964b8aa701 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.652808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.653761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.654093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.654408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] PATH_INFO: `/v3/projects/da420173beee4ad89d07cd4776311263/users/d4eaaa82838b4e2b91d3fedead03a1eb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.672276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da420173beee4ad89d07cd4776311263, user_id=d4eaaa82838b4e2b91d3fedead03a1eb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.677534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.698439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.698729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.699011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.701428 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2047/4080] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:15:54 2022] PUT /identity/v3/projects/da420173beee4ad89d07cd4776311263/users/d4eaaa82838b4e2b91d3fedead03a1eb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:54.719038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:54.720541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:54.795303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:54.821594 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2034/4081] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:54.830324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:54.832149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:54.919928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7f13-c9df-43b7-8ff2-50db138eb0f3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:54.925565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d9ccb-7c9f-4288-a94f-5b3779d23981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:54.929842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d9ccb-7c9f-4288-a94f-5b3779d23981 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:54.930304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d9ccb-7c9f-4288-a94f-5b3779d23981 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:54.930939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d9ccb-7c9f-4288-a94f-5b3779d23981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:54.948466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d9ccb-7c9f-4288-a94f-5b3779d23981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:54.951330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d9ccb-7c9f-4288-a94f-5b3779d23981 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:54.975476 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2048/4082] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:58.590090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:58.591698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:58.606538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330d608-2b54-48ab-813b-39b7b1f01829 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:58.612403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:58.613746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:58.614465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:58.615232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] PATH_INFO: `/v3/users/4601e151bd20435e87ef6572a27cd170` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:58.617386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4601e151bd20435e87ef6572a27cd170)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:58.619898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:58.765177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4601e151bd20435e87ef6572a27cd170'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:58.766040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4601e151bd20435e87ef6572a27cd170'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:58.782750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4601e151bd20435e87ef6572a27cd170'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:58.783553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4601e151bd20435e87ef6572a27cd170'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:58.803137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4601e151bd20435e87ef6572a27cd170'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:58.824233 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2035/4083] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:15:58 2022] DELETE /identity/v3/users/4601e151bd20435e87ef6572a27cd170 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:15:58.830046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:58.830547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:58.830802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:58.865601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:58.867552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:58.933819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:58.958815 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2049/4084] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:58.970300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:58.971986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:59.062379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d7264-4841-4daa-9744-320ee6e8805a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:59.067221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00407d11-1073-46dd-9aee-41eff572b0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:59.068286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407d11-1073-46dd-9aee-41eff572b0ab service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:59.068636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407d11-1073-46dd-9aee-41eff572b0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:59.069068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407d11-1073-46dd-9aee-41eff572b0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:59.083243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00407d11-1073-46dd-9aee-41eff572b0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:59.085300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00407d11-1073-46dd-9aee-41eff572b0ab service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:59.100813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2036/4085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:15:59.333477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:59.335276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:59.353689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec25145-8b74-4f28-aba5-8b53098a4f74 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:59.365483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:59.366474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:59.366865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:59.367359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] PATH_INFO: `/v3/projects/a9bf3189899e419cb0b702e896d5b9c5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:59.369488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bf3189899e419cb0b702e896d5b9c5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:59.371859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:59.459738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bf3189899e419cb0b702e896d5b9c5', 'request_id': 'req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:59.469019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bf3189899e419cb0b702e896d5b9c5', 'request_id': 'req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:59.478604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bf3189899e419cb0b702e896d5b9c5', 'request_id': 'req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:59.495189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] The token cache is being invalidate because project a9bf3189899e419cb0b702e896d5b9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:15:59.495567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:59.496642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c57bc65-f89c-4a8c-8ae7-3d6ba78a711a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:15:59.498703 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2050/4086] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:15:59 2022] DELETE /identity/v3/projects/a9bf3189899e419cb0b702e896d5b9c5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:15:59.504142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ef855-127e-4002-87df-ae6b0b91b54e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:59.504479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ef855-127e-4002-87df-ae6b0b91b54e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:59.504836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ef855-127e-4002-87df-ae6b0b91b54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:59.532423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-236ef855-127e-4002-87df-ae6b0b91b54e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:59.534560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-236ef855-127e-4002-87df-ae6b0b91b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:59.639349 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2037/4087] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:59.647774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99a5e-1b3c-4576-ac5c-45568e4d9004 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:59.648571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99a5e-1b3c-4576-ac5c-45568e4d9004 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:59.649054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99a5e-1b3c-4576-ac5c-45568e4d9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:59.678673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4ae99a5e-1b3c-4576-ac5c-45568e4d9004 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:15:59.680931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4ae99a5e-1b3c-4576-ac5c-45568e4d9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:15:59.698049 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2051/4088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:15:59.702604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ef855-127e-4002-87df-ae6b0b91b54e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:59.718215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ef855-127e-4002-87df-ae6b0b91b54e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:59.731269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:59.732057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:59.741480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:59.741480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:59.741480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:15:59.741480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:59.741480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:59.750921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:59.773230 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2038/4089] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:15:59.781008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99a5e-1b3c-4576-ac5c-45568e4d9004 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:59.800279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99a5e-1b3c-4576-ac5c-45568e4d9004 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:15:59.808451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:15:59.809891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:15:59.810174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:15:59.810654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:15:59.811685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:15:59.823867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:15:59.876549 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2052/4090] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:15:59 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:15:59.887106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:15:59.907078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4656e0-f2f9-4564-9c39-48d2523ff36f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:00.049617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:00.050440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.050699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.050973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.055245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:00.055245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:00.084961 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2039/4091] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:15:59 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:00.089146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:00.103290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b257-564e-46a2-ae3d-30c5d75816b4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:00.111112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:00.112258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.112810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.114300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.115089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:00.117888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:00.137844 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2053/4092] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:00.140324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:00.156100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b1fa-25c3-41b1-805f-8a4cc8ba1ad4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:00.178540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681ed17-c541-489f-897f-884415316922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:00.179990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ed17-c541-489f-897f-884415316922 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.181405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ed17-c541-489f-897f-884415316922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.181891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ed17-c541-489f-897f-884415316922 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.183059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681ed17-c541-489f-897f-884415316922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:00.185461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681ed17-c541-489f-897f-884415316922 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:00.205236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2040/4093] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:00.208429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:00.224769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a85c4-df07-4384-8e47-2b16a293c1ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:00.235034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:00.237441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.238198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.238896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] PATH_INFO: `/v3/projects/39c5459a57f74e4397551140b9b38726/users/04ff72bd5e02459293b6ecf2e67ce8cb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.262251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c5459a57f74e4397551140b9b38726, user_id=04ff72bd5e02459293b6ecf2e67ce8cb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:00.266451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:00.286447 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2054/4094] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:00 2022] PUT /identity/v3/projects/39c5459a57f74e4397551140b9b38726/users/04ff72bd5e02459293b6ecf2e67ce8cb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:00.306227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f000e2-e6ad-4247-b084-0dc792996dad None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.306547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f000e2-e6ad-4247-b084-0dc792996dad None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.306831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f000e2-e6ad-4247-b084-0dc792996dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.366381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40f000e2-e6ad-4247-b084-0dc792996dad None None] MFA Rules not processed for user `04ff72bd5e02459293b6ecf2e67ce8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:00.367656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40f000e2-e6ad-4247-b084-0dc792996dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:00.535080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2041/4095] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:00.539182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:00.636822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd255313-af69-4ab3-93d0-835fc5a55596 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:00.645272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:00.646306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.646930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.647363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.648251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:00.652443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:00.681497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:00.714078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f000e2-e6ad-4247-b084-0dc792996dad None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:00.727712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2055/4096] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:00 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:00.734621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f000e2-e6ad-4247-b084-0dc792996dad None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:00.905933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:00.907418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.908681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.909229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.910161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:00.914191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:00.927693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:00.957545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2042/4097] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:00 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:00.962360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:00.983730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03ddee-cdf4-4bce-b22c-e79ee823af0e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:00.992465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:00.994711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:00.995247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:00.995731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:00.996689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:01.000635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:01.021640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2056/4098] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:01.044227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:01.077863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ce78e-5563-4f4b-9fd6-84df58bd8dbf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:01.085530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:01.087386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:01.089496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:01.089732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] PATH_INFO: `/v3/projects/f4199baf2b544f5794619c2f5b7d7f57/users/61500f140ea646c898ac7e14f29aa1ad/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:01.112246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4199baf2b544f5794619c2f5b7d7f57, user_id=61500f140ea646c898ac7e14f29aa1ad, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:01.117313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:01.173557 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2043/4099] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:01 2022] PUT /identity/v3/projects/f4199baf2b544f5794619c2f5b7d7f57/users/61500f140ea646c898ac7e14f29aa1ad/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:01.174575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:01.190195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa78dd-d5c1-4b27-ae90-4f588cd9e8ab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:01.309743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf9026-c938-4a81-ac47-f345c92dc659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:01.310602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf9026-c938-4a81-ac47-f345c92dc659 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:01.311020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf9026-c938-4a81-ac47-f345c92dc659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:01.311392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf9026-c938-4a81-ac47-f345c92dc659 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:01.312243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf9026-c938-4a81-ac47-f345c92dc659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:01.314110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf9026-c938-4a81-ac47-f345c92dc659 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:01.329513 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2057/4100] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:01.331032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:01.344542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb0255-6059-421b-bb01-d47e91a09fb3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:01.351379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:01.352732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:01.353324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:01.353658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] PATH_INFO: `/v3/projects/f4199baf2b544f5794619c2f5b7d7f57/users/61500f140ea646c898ac7e14f29aa1ad/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:01.356279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4199baf2b544f5794619c2f5b7d7f57, user_id=61500f140ea646c898ac7e14f29aa1ad, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:01.359416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:01.388194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcae49-3f2c-401e-9c39-5f0298deed79 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:01.389474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcae49-3f2c-401e-9c39-5f0298deed79 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:01.390107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcae49-3f2c-401e-9c39-5f0298deed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:01.393948 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2044/4101] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:01 2022] PUT /identity/v3/projects/f4199baf2b544f5794619c2f5b7d7f57/users/61500f140ea646c898ac7e14f29aa1ad/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:01.447339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d3bcae49-3f2c-401e-9c39-5f0298deed79 None None] MFA Rules not processed for user `61500f140ea646c898ac7e14f29aa1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:01.448958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d3bcae49-3f2c-401e-9c39-5f0298deed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:01.628250 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2058/4102] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:01.635157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:01.637842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:01.730353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a1778-4b31-45f1-b941-ac4db1739bb2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:01.735085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21134c85-8214-4e1a-9884-39bcd3834acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:01.736009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21134c85-8214-4e1a-9884-39bcd3834acc service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:01.736516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21134c85-8214-4e1a-9884-39bcd3834acc service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:01.736981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21134c85-8214-4e1a-9884-39bcd3834acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:01.839217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21134c85-8214-4e1a-9884-39bcd3834acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:01.846235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21134c85-8214-4e1a-9884-39bcd3834acc service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:01.862419 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2045/4103] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:04.946148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcae49-3f2c-401e-9c39-5f0298deed79 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:04.963618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcae49-3f2c-401e-9c39-5f0298deed79 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:04.983920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:04.984780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:04.984959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:04.985848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:04.996446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3129b8-f5db-448d-9b42-4b16e1847a5b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:04.997051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3129b8-f5db-448d-9b42-4b16e1847a5b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:04.997051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3129b8-f5db-448d-9b42-4b16e1847a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:05.034513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:05.036068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:05.087501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cb3129b8-f5db-448d-9b42-4b16e1847a5b None None] MFA Rules not processed for user `d4eaaa82838b4e2b91d3fedead03a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:05.090216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cb3129b8-f5db-448d-9b42-4b16e1847a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:05.116240 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2059/4104] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:05.294029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:05.319626 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2046/4105] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:16:05.338181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:05.340242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:05.440287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:05.497346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df85b7d-0a71-4199-adbd-566af495aead service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:05.503507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:05.504344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:05.504718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:05.505328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:05.533852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:05.537180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:05.588713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2060/4106] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:07.971674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22971-7e27-49f9-909d-268145960161 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:07.972204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22971-7e27-49f9-909d-268145960161 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:07.972319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22971-7e27-49f9-909d-268145960161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:08.000426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3ab22971-7e27-49f9-909d-268145960161 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:08.005777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ab22971-7e27-49f9-909d-268145960161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:08.113185 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2047/4107] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:16:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:16:08.183252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:08.185156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:08.369635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202efc80-4e75-4e80-b654-9c7b536be8bf service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:08.378877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:08.379808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:08.380704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:08.380704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:08.422461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:08.424143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:08.454254 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2061/4108] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:10.486692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22971-7e27-49f9-909d-268145960161 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:10.488188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ab22971-7e27-49f9-909d-268145960161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:10.664860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22971-7e27-49f9-909d-268145960161 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:10.671201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:10.676481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:10.677206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:10.677724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] PATH_INFO: `/v3/users/b4f52f9c60b649679aaa6e98b575d43a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:10.679324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f52f9c60b649679aaa6e98b575d43a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:10.681881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:10.814539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f52f9c60b649679aaa6e98b575d43a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:10.815564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f52f9c60b649679aaa6e98b575d43a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:10.841851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f52f9c60b649679aaa6e98b575d43a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:10.842909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f52f9c60b649679aaa6e98b575d43a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:10.861443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9361e357-ee00-4450-9c8d-e2b19e854bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f52f9c60b649679aaa6e98b575d43a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:10.900777 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2048/4109] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:10 2022] DELETE /identity/v3/users/b4f52f9c60b649679aaa6e98b575d43a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:11.828685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:11.853728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484e333-fbd2-4950-a951-5d093976f9a4 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:12.039133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:12.040508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:12.041006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:12.041639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] PATH_INFO: `/v3/projects/d3167cc3e4a54982af2ec54124a5c730` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:12.043161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3167cc3e4a54982af2ec54124a5c730)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:12.046135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:12.150729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3167cc3e4a54982af2ec54124a5c730', 'request_id': 'req-9427703e-22fd-4d31-a229-2a98a51dbae2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:12.158394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3167cc3e4a54982af2ec54124a5c730', 'request_id': 'req-9427703e-22fd-4d31-a229-2a98a51dbae2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:12.180522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3167cc3e4a54982af2ec54124a5c730', 'request_id': 'req-9427703e-22fd-4d31-a229-2a98a51dbae2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:12.206972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:12.243721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] The token cache is being invalidate because project d3167cc3e4a54982af2ec54124a5c730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:12.244828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:12.245771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9427703e-22fd-4d31-a229-2a98a51dbae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:12.247623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2062/4110] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:11 2022] DELETE /identity/v3/projects/d3167cc3e4a54982af2ec54124a5c730 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:12.252708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da500b4-1deb-4bc3-8ef2-e7230f29d873 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:12.253276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da500b4-1deb-4bc3-8ef2-e7230f29d873 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:12.253276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da500b4-1deb-4bc3-8ef2-e7230f29d873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:12.310553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5da500b4-1deb-4bc3-8ef2-e7230f29d873 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:12.314740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5da500b4-1deb-4bc3-8ef2-e7230f29d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:12.392997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:12.530146 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2049/4111] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:12.537652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbb9e-7f5b-4268-8458-7249b9a74f5a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:12.538071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbb9e-7f5b-4268-8458-7249b9a74f5a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:12.538447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bbb9e-7f5b-4268-8458-7249b9a74f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:12.566715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c70bbb9e-7f5b-4268-8458-7249b9a74f5a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:12.568299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c70bbb9e-7f5b-4268-8458-7249b9a74f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:12.582399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2063/4112] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:12.586418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da500b4-1deb-4bc3-8ef2-e7230f29d873 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:12.601278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da500b4-1deb-4bc3-8ef2-e7230f29d873 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:12.608898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:12.610191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:12.610708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:12.611193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:12.612158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:12.612670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:12.614646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:12.631587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2050/4113] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:12.636154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bbb9e-7f5b-4268-8458-7249b9a74f5a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:12.661332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bbb9e-7f5b-4268-8458-7249b9a74f5a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:12.681941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:12.682809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:12.683246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:12.683872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:12.684687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:12.687393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:12.817352 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2064/4114] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:12 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:12.818696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:12.846987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d7aeb-e4ac-4250-a916-5f458883b851 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:13.063891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:13.064698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:13.065114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:13.065428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:13.067134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:13.070017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:13.114335 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2051/4115] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:12 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:13.115528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:13.127937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5340f6-070e-4ece-b3ba-edab9cb053fb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:13.134824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:13.140354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:13.140843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:13.141327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:13.142407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:13.144232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:13.167240 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2065/4116] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:13.171445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:13.186767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e54ee-056e-4c9c-8de6-857c964d91d6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:13.198730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6ee4c-d7f0-4e8a-8868-34162d44c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:13.199440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6ee4c-d7f0-4e8a-8868-34162d44c4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:13.199726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6ee4c-d7f0-4e8a-8868-34162d44c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:13.200008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6ee4c-d7f0-4e8a-8868-34162d44c4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:13.201177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6ee4c-d7f0-4e8a-8868-34162d44c4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:13.202810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6ee4c-d7f0-4e8a-8868-34162d44c4b5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:13.232444 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2052/4117] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:13.233380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:13.263177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0a125-6fe6-49ca-b088-84fed1ea47d0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:13.290957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe6340-6f88-480d-80a6-a5a24531ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:13.292148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe6340-6f88-480d-80a6-a5a24531ef8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:13.293436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe6340-6f88-480d-80a6-a5a24531ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:13.294235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe6340-6f88-480d-80a6-a5a24531ef8f admin admin] PATH_INFO: `/v3/projects/7a2876fd37d44561940f36cc02783e7e/users/f21b927a5dc54a9d822b54984257b792/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:13.384529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe6340-6f88-480d-80a6-a5a24531ef8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2876fd37d44561940f36cc02783e7e, user_id=f21b927a5dc54a9d822b54984257b792, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:13.391394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe6340-6f88-480d-80a6-a5a24531ef8f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:13.473579 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2066/4118] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:13 2022] PUT /identity/v3/projects/7a2876fd37d44561940f36cc02783e7e/users/f21b927a5dc54a9d822b54984257b792/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:13.487813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:13.488367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:13.488367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:13.538007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] MFA Rules not processed for user `f21b927a5dc54a9d822b54984257b792`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:13.539097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:13.658095 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2053/4119] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:13.668555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:13.668893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:13.669156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:13.692229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] MFA Rules not processed for user `f21b927a5dc54a9d822b54984257b792`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:13.693843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:13.706745 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2067/4120] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:13.719794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:13.721243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:13.755432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:13.885883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f0874-2588-4295-9bc1-1947fff3c0a4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:13.892729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:13.893447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:13.893726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:13.893997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:13.904252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:13.906822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:13.919580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2054/4121] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:15.798873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:15.801304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:16.013846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74981ca5-908c-4e7d-a77c-7be0d80b52fc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:16.028093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:16.032037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:16.032586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:16.033397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] PATH_INFO: `/v3/users/79eddf3b96304e86a213d7238783e960` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:16.039242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79eddf3b96304e86a213d7238783e960)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:16.042487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:16.242324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79eddf3b96304e86a213d7238783e960'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.251219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79eddf3b96304e86a213d7238783e960'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.302186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79eddf3b96304e86a213d7238783e960'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.303069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79eddf3b96304e86a213d7238783e960'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.345706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79eddf3b96304e86a213d7238783e960'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.369960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:16.375449 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2068/4122] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:15 2022] DELETE /identity/v3/users/79eddf3b96304e86a213d7238783e960 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:16.694272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:16.695877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:16.721519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d891bab-c76c-4bd8-b110-6b71d5e1a4c6 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:16.801952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:16.804588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:16.839109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:16.840895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:16.841290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:16.841839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] PATH_INFO: `/v3/users/d4eaaa82838b4e2b91d3fedead03a1eb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:16.846910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4eaaa82838b4e2b91d3fedead03a1eb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:16.849793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:16.927103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4eaaa82838b4e2b91d3fedead03a1eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.929132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4eaaa82838b4e2b91d3fedead03a1eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.953910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fc0a-514e-425c-8779-c7e8d4cb7fa4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:16.954644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4eaaa82838b4e2b91d3fedead03a1eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.955436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4eaaa82838b4e2b91d3fedead03a1eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.964528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:16.965099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4eaaa82838b4e2b91d3fedead03a1eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:16.967976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:16.968592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:16.969305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] PATH_INFO: `/v3/projects/be43b4b4305647cfb63bdcaa91331b55` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:16.975192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be43b4b4305647cfb63bdcaa91331b55)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:16.985767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:16.990382 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2055/4123] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:16 2022] DELETE /identity/v3/users/d4eaaa82838b4e2b91d3fedead03a1eb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:17.094225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:17.095645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:17.109277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be43b4b4305647cfb63bdcaa91331b55', 'request_id': 'req-db34bb36-8b63-468d-84fd-236364451156'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.124013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be43b4b4305647cfb63bdcaa91331b55', 'request_id': 'req-db34bb36-8b63-468d-84fd-236364451156'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.129190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:17.140489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be43b4b4305647cfb63bdcaa91331b55', 'request_id': 'req-db34bb36-8b63-468d-84fd-236364451156'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.169417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] The token cache is being invalidate because project be43b4b4305647cfb63bdcaa91331b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:17.171766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.173749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-db34bb36-8b63-468d-84fd-236364451156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.176599 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2069/4124] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:16 2022] DELETE /identity/v3/projects/be43b4b4305647cfb63bdcaa91331b55 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:16:17.181935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.182502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.183032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.195990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813111c1-2002-42e3-b69a-fe49fd0f3f79 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:17.212363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:17.214752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:17.372546 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2070/4125] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:17.374008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:17.375677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:17.392923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f78d4c-5282-4c02-b9ad-9d9be0ec435d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:17.399706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:17.400647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.401525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.402231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] PATH_INFO: `/v3/projects/da420173beee4ad89d07cd4776311263` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.403526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da420173beee4ad89d07cd4776311263)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:17.405879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:17.419247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea8f5b-2c8a-4bfa-80e1-3a30e1e02f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:17.420144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea8f5b-2c8a-4bfa-80e1-3a30e1e02f0d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.420724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea8f5b-2c8a-4bfa-80e1-3a30e1e02f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.421211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea8f5b-2c8a-4bfa-80e1-3a30e1e02f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.435051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6eea8f5b-2c8a-4bfa-80e1-3a30e1e02f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:17.480443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:17.552638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da420173beee4ad89d07cd4776311263', 'request_id': 'req-cf4fffab-d641-4ad2-95b7-5820003698c9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.570741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da420173beee4ad89d07cd4776311263', 'request_id': 'req-cf4fffab-d641-4ad2-95b7-5820003698c9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.594152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da420173beee4ad89d07cd4776311263', 'request_id': 'req-cf4fffab-d641-4ad2-95b7-5820003698c9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.620444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea8f5b-2c8a-4bfa-80e1-3a30e1e02f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:17.623614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] The token cache is being invalidate because project da420173beee4ad89d07cd4776311263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:17.624177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.625249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cf4fffab-d641-4ad2-95b7-5820003698c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:17.626771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea8f5b-2c8a-4bfa-80e1-3a30e1e02f0d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:17.626908 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2071/4126] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:17 2022] DELETE /identity/v3/projects/da420173beee4ad89d07cd4776311263 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:17.628866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43446de9-f6b8-42a6-b0b9-f7540a8cd9a5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.629155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43446de9-f6b8-42a6-b0b9-f7540a8cd9a5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.629439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43446de9-f6b8-42a6-b0b9-f7540a8cd9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.668647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-43446de9-f6b8-42a6-b0b9-f7540a8cd9a5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:17.670064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-43446de9-f6b8-42a6-b0b9-f7540a8cd9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:17.676798 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2056/4127] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:17.685402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a74a7-93a8-42ad-8481-2b16c9037f6a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.686013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a74a7-93a8-42ad-8481-2b16c9037f6a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.686396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a74a7-93a8-42ad-8481-2b16c9037f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.714790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-799a74a7-93a8-42ad-8481-2b16c9037f6a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:17.716318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-799a74a7-93a8-42ad-8481-2b16c9037f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:17.790636 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2057/4128] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:17.798967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d1a0-e9b5-4593-9a35-f33f4058fd30 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.799314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d1a0-e9b5-4593-9a35-f33f4058fd30 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.799703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d1a0-e9b5-4593-9a35-f33f4058fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.825178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b359d1a0-e9b5-4593-9a35-f33f4058fd30 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:17.826834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b359d1a0-e9b5-4593-9a35-f33f4058fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:17.827096 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2072/4129] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:17.833224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43446de9-f6b8-42a6-b0b9-f7540a8cd9a5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:17.837100 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2058/4130] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:17.844129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d1a0-e9b5-4593-9a35-f33f4058fd30 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:17.853307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43446de9-f6b8-42a6-b0b9-f7540a8cd9a5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:17.861050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d1a0-e9b5-4593-9a35-f33f4058fd30 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:17.864203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:17.864928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.866087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.867305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.870368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:17.870879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:17.875848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:17.877977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:17.880278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.880686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.881020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.881835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:17.882297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:17.887434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:17.914183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2073/4131] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:17.917683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:17.934140 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2059/4132] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:17.943772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:17.945681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c2603-b290-4a7f-b98a-ce33e6261fab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:17.953911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:17.961074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bd170-66fc-4169-be0f-3cba8af09a9e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:17.971789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:17.972634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.973004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.973572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.974396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:17.975773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:17.976466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:17.976788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:17.977139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:17.977767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:17.977899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:17.988812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.021209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2060/4133] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:17 2022] POST /identity/v3/projects => generated 399 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:16:18.031426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.048620 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2074/4134] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:17 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:18.052934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.151555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd98ae-fc2a-48c2-8045-5b6fde50645b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.158803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.159652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.160014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.160363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.161168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.163513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.183851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae73c4-9f80-40b0-8258-595706bb4aa7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.196847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.198949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.199239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.203026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.205341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.211791 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2075/4135] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:18 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:18.212767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.214157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.230242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86356c1-1e1f-4b79-a0f2-9f984f93b1d4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.235599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.236292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.236622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.236909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.238634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.240669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.245422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:18.264362 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2076/4136] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:18.265236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.273170 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2061/4137] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:18 2022] POST /identity/v3/users => generated 300 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:18.278438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.282327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674c54d-6b5e-4d41-9344-8b8715d84224 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.291069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.294271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.294271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.294801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf599-a05f-46c9-9b97-a26ee006445a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.295205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.297163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.298841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.301099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da258df8-d856-4677-b356-486c17427649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.301898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da258df8-d856-4677-b356-486c17427649 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.302279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da258df8-d856-4677-b356-486c17427649 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.302688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da258df8-d856-4677-b356-486c17427649 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.305935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da258df8-d856-4677-b356-486c17427649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.305935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da258df8-d856-4677-b356-486c17427649 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.319018 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2062/4138] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:16:18.321301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2077/4139] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:18.323393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da258df8-d856-4677-b356-486c17427649 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.336160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da258df8-d856-4677-b356-486c17427649 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.341389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.342098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.342982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.343334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.343808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.344860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.346560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.365474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8310f-e848-4055-b5b3-ee815eec4f50 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.372221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2063/4140] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:18.374349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.383870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc976e8-af4e-43a5-a844-a22c3acdceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.384796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc976e8-af4e-43a5-a844-a22c3acdceca admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.385272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc976e8-af4e-43a5-a844-a22c3acdceca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.385555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc976e8-af4e-43a5-a844-a22c3acdceca admin admin] PATH_INFO: `/v3/projects/851177a639b248a0b4508112a9b6e6bf/users/4c071daa57f24e9fa1ae5d173a99d2ca/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.393200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e44c5-957b-4497-8399-1896402a9f7a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.401677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37c9d8-d730-4992-820b-701cb07641b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.402439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37c9d8-d730-4992-820b-701cb07641b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.402721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37c9d8-d730-4992-820b-701cb07641b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.403001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37c9d8-d730-4992-820b-701cb07641b9 admin admin] PATH_INFO: `/v3/projects/2ed8b40ca3a94586a2363bd22f6de045/users/d5516d85f0ee482facf6a96e2709c41d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.407338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc976e8-af4e-43a5-a844-a22c3acdceca admin admin] RBAC: Authorizing `identity:create_grant(project_id=851177a639b248a0b4508112a9b6e6bf, user_id=4c071daa57f24e9fa1ae5d173a99d2ca, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.410572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc976e8-af4e-43a5-a844-a22c3acdceca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.428963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37c9d8-d730-4992-820b-701cb07641b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed8b40ca3a94586a2363bd22f6de045, user_id=d5516d85f0ee482facf6a96e2709c41d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.432695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37c9d8-d730-4992-820b-701cb07641b9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.435722 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2078/4141] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:18 2022] PUT /identity/v3/projects/851177a639b248a0b4508112a9b6e6bf/users/4c071daa57f24e9fa1ae5d173a99d2ca/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:18.441203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.441844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.442395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.471381 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2064/4142] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:18 2022] PUT /identity/v3/projects/2ed8b40ca3a94586a2363bd22f6de045/users/d5516d85f0ee482facf6a96e2709c41d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:18.472707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:18.474319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:18.475007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.475353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.475640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.504174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:18.507132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:18.588005 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2079/4143] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:16:18.599526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.601218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:18.619717 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2065/4144] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:18.630432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:18.632168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:18.696729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:18.723542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddaae1a-5cd1-43fd-8d06-fad96e7f8a9c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.734047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.736021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.736668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.737462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.751637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ddd3c-020a-47e5-8dfd-25d5d571a4ab None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:18.759851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.760756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.760884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:18.761931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:18.762393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:18.762946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:18.774593 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2080/4145] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:18.782505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:18.784442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:18.803518 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2066/4146] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:19.381734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:19.395976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1403e-c328-4b4b-b639-4976f94251f6 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:19.411921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27893407-81fb-462d-9d54-161ef9da535c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:19.412610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893407-81fb-462d-9d54-161ef9da535c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:19.412899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893407-81fb-462d-9d54-161ef9da535c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:19.413210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27893407-81fb-462d-9d54-161ef9da535c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:19.423925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-27893407-81fb-462d-9d54-161ef9da535c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:19.706956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:19.730181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27893407-81fb-462d-9d54-161ef9da535c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:19.731878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27893407-81fb-462d-9d54-161ef9da535c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:19.756523 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2081/4147] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:22.074062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:22.084866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:22.123420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865b5d6-e4af-43fc-b4e6-0eee8c5a2807 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:22.147911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:22.148879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:22.153791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:22.154164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] PATH_INFO: `/v3/users/04ff72bd5e02459293b6ecf2e67ce8cb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:22.165070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ff72bd5e02459293b6ecf2e67ce8cb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:22.170763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:22.325284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ff72bd5e02459293b6ecf2e67ce8cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:22.326868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ff72bd5e02459293b6ecf2e67ce8cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:22.344538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ff72bd5e02459293b6ecf2e67ce8cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:22.345971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ff72bd5e02459293b6ecf2e67ce8cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:22.354973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ff72bd5e02459293b6ecf2e67ce8cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:22.395145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2067/4148] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:22 2022] DELETE /identity/v3/users/04ff72bd5e02459293b6ecf2e67ce8cb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:22.397916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:22.398410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:22.398682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:22.440607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:22.444461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:22.649578 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2082/4149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:22.676078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:22.681587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:22.855480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb9a67-f9db-45a5-81de-5548ed2a0202 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:22.868614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:22.869637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:22.870094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:22.870561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:22.892471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:22.896104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:22.925641 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2068/4150] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:25.163683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:25.165308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:25.187079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460f648-a62f-4e62-ab64-9596ca5f5a6b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:25.197066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:25.197984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:25.198264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:25.198560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] PATH_INFO: `/v3/projects/39c5459a57f74e4397551140b9b38726` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:25.201778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c5459a57f74e4397551140b9b38726)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:25.204028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:25.372745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c5459a57f74e4397551140b9b38726', 'request_id': 'req-46321440-c14c-40ff-98f5-fdc0ccfa14e7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.384699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c5459a57f74e4397551140b9b38726', 'request_id': 'req-46321440-c14c-40ff-98f5-fdc0ccfa14e7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.399058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c5459a57f74e4397551140b9b38726', 'request_id': 'req-46321440-c14c-40ff-98f5-fdc0ccfa14e7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.420418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] The token cache is being invalidate because project 39c5459a57f74e4397551140b9b38726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:25.420774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.421487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.423780 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2083/4151] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:25 2022] DELETE /identity/v3/projects/39c5459a57f74e4397551140b9b38726 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:25.427264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:25.439244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58da94-adc1-48e0-a699-d5794b915a79 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:25.573729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:25.621851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:25.623060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:25.627317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:25.627674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] PATH_INFO: `/v3/users/61500f140ea646c898ac7e14f29aa1ad` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:25.630400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61500f140ea646c898ac7e14f29aa1ad)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:25.635529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:25.744769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61500f140ea646c898ac7e14f29aa1ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.745488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61500f140ea646c898ac7e14f29aa1ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.777077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61500f140ea646c898ac7e14f29aa1ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.777840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61500f140ea646c898ac7e14f29aa1ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.796772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5a2c89a1-1546-4376-9a60-d74e39f447e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61500f140ea646c898ac7e14f29aa1ad'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:25.824194 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2069/4152] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:25 2022] DELETE /identity/v3/users/61500f140ea646c898ac7e14f29aa1ad => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:16:27.903336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:27.904709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:27.934103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321440-c14c-40ff-98f5-fdc0ccfa14e7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:28.122417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:28.123599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:28.124031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:28.124463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] PATH_INFO: `/v3/projects/f4199baf2b544f5794619c2f5b7d7f57` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:28.130873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4199baf2b544f5794619c2f5b7d7f57)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:28.134822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:28.197285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:28.267311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4199baf2b544f5794619c2f5b7d7f57', 'request_id': 'req-772c992c-a8a0-4660-bee4-657b01a46857'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:28.281738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4199baf2b544f5794619c2f5b7d7f57', 'request_id': 'req-772c992c-a8a0-4660-bee4-657b01a46857'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:28.305920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4199baf2b544f5794619c2f5b7d7f57', 'request_id': 'req-772c992c-a8a0-4660-bee4-657b01a46857'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:28.349661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] The token cache is being invalidate because project f4199baf2b544f5794619c2f5b7d7f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:28.349955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:28.350657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-772c992c-a8a0-4660-bee4-657b01a46857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:28.357462 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2084/4153] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:27 2022] DELETE /identity/v3/projects/f4199baf2b544f5794619c2f5b7d7f57 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:28.359774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2389f-c841-41d2-bebe-791847fc4c54 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:28.360479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2389f-c841-41d2-bebe-791847fc4c54 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:28.360479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2389f-c841-41d2-bebe-791847fc4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:28.384382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9fc2389f-c841-41d2-bebe-791847fc4c54 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:28.385922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9fc2389f-c841-41d2-bebe-791847fc4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:28.522283 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2070/4154] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:28.581426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90cf33-4811-4914-8269-cc185b372ea5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:28.581426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90cf33-4811-4914-8269-cc185b372ea5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:28.581426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90cf33-4811-4914-8269-cc185b372ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:28.608952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1d90cf33-4811-4914-8269-cc185b372ea5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:28.610274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1d90cf33-4811-4914-8269-cc185b372ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:28.696588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2085/4155] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:28.702083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2389f-c841-41d2-bebe-791847fc4c54 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:28.763996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2389f-c841-41d2-bebe-791847fc4c54 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:28.786021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:28.786759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:28.787116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:28.787888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:28.788433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:28.789359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:28.791641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:28.823697 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2071/4156] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:28.826254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90cf33-4811-4914-8269-cc185b372ea5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:28.841745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90cf33-4811-4914-8269-cc185b372ea5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:28.865429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:28.866913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:28.867412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:28.867840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:28.869448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:28.882326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:28.930408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2086/4157] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:28 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:28.934329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:28.951890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db886346-ddf7-40d2-ac7d-1bdcfcbef057 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:29.058997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:29.086988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:29.088018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:29.088753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:29.089168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:29.091423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:29.096065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:29.155635 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2072/4158] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:28 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:29.156825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:29.174705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ce79-b825-4396-88bd-4d0ef45da127 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:29.187890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:29.188899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:29.189360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:29.190391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:29.191333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:29.193650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:29.235572 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2087/4159] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:29.240754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:29.256609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947a02d-fd17-400b-9845-9400c1d6fb2e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:29.268514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87c0c-c3ec-4d65-9dfb-0993290473e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:29.271080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87c0c-c3ec-4d65-9dfb-0993290473e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:29.271553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87c0c-c3ec-4d65-9dfb-0993290473e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:29.271847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87c0c-c3ec-4d65-9dfb-0993290473e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:29.272629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87c0c-c3ec-4d65-9dfb-0993290473e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:29.274456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87c0c-c3ec-4d65-9dfb-0993290473e0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:29.312878 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2073/4160] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:29.313937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:29.330912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6fb89-b2d7-4a58-957b-ca5024d81479 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:29.347567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:29.348593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:29.348993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:29.349300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] PATH_INFO: `/v3/projects/29cf1154404143ef83f332a659c6e7fe/users/335622d3457a4cb48cb2fe0a57064d2b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:29.402148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cf1154404143ef83f332a659c6e7fe, user_id=335622d3457a4cb48cb2fe0a57064d2b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:29.412817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:29.462280 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2088/4161] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:29 2022] PUT /identity/v3/projects/29cf1154404143ef83f332a659c6e7fe/users/335622d3457a4cb48cb2fe0a57064d2b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:16:29.473737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c2ca-5dca-4898-8313-015e23632360 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:29.474235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c2ca-5dca-4898-8313-015e23632360 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:29.474333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0c2ca-5dca-4898-8313-015e23632360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:29.531819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-23f0c2ca-5dca-4898-8313-015e23632360 None None] MFA Rules not processed for user `335622d3457a4cb48cb2fe0a57064d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:29.533249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-23f0c2ca-5dca-4898-8313-015e23632360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:29.729676 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2074/4162] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:29.731451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:29.933399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b0ced-372a-4f21-8735-369400574852 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:29.946230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:29.947900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:29.948202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:29.948469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:29.949234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:29.964964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:30.064804 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2089/4163] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:29 2022] POST /identity/v3/projects => generated 369 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:30.068868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c2ca-5dca-4898-8313-015e23632360 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:30.092853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0c2ca-5dca-4898-8313-015e23632360 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:30.268424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:30.269166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:30.270120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:30.271142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:30.271991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:30.278964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:30.326783 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2075/4164] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:30 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:30.329725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:30.344588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb225d5d-e72b-4750-bf5b-39e049e8d297 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:30.358425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:30.359369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:30.359774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:30.361925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:30.363751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:30.366728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:30.396346 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2090/4165] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:30.400605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:30.415622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a830cc-aedf-4801-8c1b-66eb6091b655 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:30.430303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:30.431247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:30.431532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:30.434122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] PATH_INFO: `/v3/projects/2ea7ac7fc472495ab9ccb99fa69a8d32/users/97b7b10a449d4d4e89431565496aaa24/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:30.478595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea7ac7fc472495ab9ccb99fa69a8d32, user_id=97b7b10a449d4d4e89431565496aaa24, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:30.486461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:30.520606 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2076/4166] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:30 2022] PUT /identity/v3/projects/2ea7ac7fc472495ab9ccb99fa69a8d32/users/97b7b10a449d4d4e89431565496aaa24/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:30.524993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:30.541834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5b603-8db3-4f2f-a303-609a06500597 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:30.571357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:30.687533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a471f-4838-4c5a-b534-9f9553df5b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:30.689196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a471f-4838-4c5a-b534-9f9553df5b71 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:30.689497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a471f-4838-4c5a-b534-9f9553df5b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:30.689779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a471f-4838-4c5a-b534-9f9553df5b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:30.691052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a471f-4838-4c5a-b534-9f9553df5b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:30.693112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a471f-4838-4c5a-b534-9f9553df5b71 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:30.716342 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2091/4167] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:30.719358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:30.734916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69294d-eff2-4793-9b94-b36c9531157f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:30.746106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:30.747138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:30.747495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:30.747847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] PATH_INFO: `/v3/projects/2ea7ac7fc472495ab9ccb99fa69a8d32/users/97b7b10a449d4d4e89431565496aaa24/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:30.763950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea7ac7fc472495ab9ccb99fa69a8d32, user_id=97b7b10a449d4d4e89431565496aaa24, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:30.774184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:30.834639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2077/4168] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:30 2022] PUT /identity/v3/projects/2ea7ac7fc472495ab9ccb99fa69a8d32/users/97b7b10a449d4d4e89431565496aaa24/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:30.845957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:30.845957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:30.845957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:30.915137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] MFA Rules not processed for user `97b7b10a449d4d4e89431565496aaa24`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:30.916401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:31.276925 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2092/4169] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:31.289137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:31.291075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:31.310259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:31.399838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d6ef9-1547-47f5-a794-f2777249189b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:31.403549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4c5e8-da60-4569-b6e9-f07fad628872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:31.404221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c5e8-da60-4569-b6e9-f07fad628872 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:31.404509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c5e8-da60-4569-b6e9-f07fad628872 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:31.404832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c5e8-da60-4569-b6e9-f07fad628872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:31.417156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4c5e8-da60-4569-b6e9-f07fad628872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:31.418630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4c5e8-da60-4569-b6e9-f07fad628872 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:31.434678 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2078/4170] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:31.503216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:31.504993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:31.519473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e9243-808b-485a-8cb2-66af51e5bbc6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:31.523835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab3ab6-add9-4fab-947d-89116a5338bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:31.524744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab3ab6-add9-4fab-947d-89116a5338bb service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:31.525301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab3ab6-add9-4fab-947d-89116a5338bb service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:31.526304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab3ab6-add9-4fab-947d-89116a5338bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:31.616029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab3ab6-add9-4fab-947d-89116a5338bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:31.617626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab3ab6-add9-4fab-947d-89116a5338bb service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:31.630061 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2093/4171] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:32.182815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:32.183878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:32.184653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:32.274809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] MFA Rules not processed for user `4c071daa57f24e9fa1ae5d173a99d2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:32.279882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:32.487311 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2079/4172] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:32.496373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:32.496918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:32.500901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:32.531060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] MFA Rules not processed for user `4c071daa57f24e9fa1ae5d173a99d2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:32.532987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:32.563428 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2094/4173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:32.757874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:32.759595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:32.966623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e24d-f3a7-4b77-8ac9-70643a354f68 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:32.978998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3e3f5-0a70-476c-8f58-8b46a56b6b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:32.979767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e3f5-0a70-476c-8f58-8b46a56b6b36 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:32.980058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e3f5-0a70-476c-8f58-8b46a56b6b36 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:32.980441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3e3f5-0a70-476c-8f58-8b46a56b6b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:33.008909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3e3f5-0a70-476c-8f58-8b46a56b6b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:33.011100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3e3f5-0a70-476c-8f58-8b46a56b6b36 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:33.030391 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2080/4174] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:34.362735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:34.365069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:34.444401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:34.534628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b33a80-215b-471e-8400-68a585f9e817 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:34.547509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee950a03-ef4f-4056-b8e9-1399415484c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:34.548291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950a03-ef4f-4056-b8e9-1399415484c7 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:34.548641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950a03-ef4f-4056-b8e9-1399415484c7 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:34.549049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950a03-ef4f-4056-b8e9-1399415484c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:34.551527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ee950a03-ef4f-4056-b8e9-1399415484c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:34.608166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee950a03-ef4f-4056-b8e9-1399415484c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:34.610860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee950a03-ef4f-4056-b8e9-1399415484c7 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:34.635416 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2095/4175] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:34.967202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc63d55-8013-4dd4-a98a-4266612158a9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:34.967754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc63d55-8013-4dd4-a98a-4266612158a9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:34.967852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc63d55-8013-4dd4-a98a-4266612158a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:35.050115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2fc63d55-8013-4dd4-a98a-4266612158a9 None None] MFA Rules not processed for user `d5516d85f0ee482facf6a96e2709c41d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:35.051364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2fc63d55-8013-4dd4-a98a-4266612158a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:35.075373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:35.233942 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2081/4176] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:35.246265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc4af-d8ae-4ecf-b0d5-cdceb6d46b1e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:35.247098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc4af-d8ae-4ecf-b0d5-cdceb6d46b1e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:35.247847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc4af-d8ae-4ecf-b0d5-cdceb6d46b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:35.273412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f09dc4af-d8ae-4ecf-b0d5-cdceb6d46b1e None None] MFA Rules not processed for user `d5516d85f0ee482facf6a96e2709c41d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:35.287453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f09dc4af-d8ae-4ecf-b0d5-cdceb6d46b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:35.297493 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2096/4177] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:35.309735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc63d55-8013-4dd4-a98a-4266612158a9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:35.333759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc63d55-8013-4dd4-a98a-4266612158a9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:35.347059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60eba6c-08dc-428b-8663-d1dd5db3f5cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:35.347986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eba6c-08dc-428b-8663-d1dd5db3f5cf service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:35.349545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eba6c-08dc-428b-8663-d1dd5db3f5cf service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:35.349979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60eba6c-08dc-428b-8663-d1dd5db3f5cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:35.377793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60eba6c-08dc-428b-8663-d1dd5db3f5cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:35.386875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60eba6c-08dc-428b-8663-d1dd5db3f5cf service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:35.413237 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2082/4178] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:36.488338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc4af-d8ae-4ecf-b0d5-cdceb6d46b1e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:36.666471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc4af-d8ae-4ecf-b0d5-cdceb6d46b1e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:36.680060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:36.683852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:36.685061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:36.685520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] PATH_INFO: `/v3/users/335622d3457a4cb48cb2fe0a57064d2b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:36.689635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335622d3457a4cb48cb2fe0a57064d2b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:36.696505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:36.832248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335622d3457a4cb48cb2fe0a57064d2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:36.833389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335622d3457a4cb48cb2fe0a57064d2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:36.868426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335622d3457a4cb48cb2fe0a57064d2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:36.869268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335622d3457a4cb48cb2fe0a57064d2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:36.891188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335622d3457a4cb48cb2fe0a57064d2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:36.917147 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2097/4179] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:36 2022] DELETE /identity/v3/users/335622d3457a4cb48cb2fe0a57064d2b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:36.922914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:36.923651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:36.923758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:36.955046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:36.958674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:37.118359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2083/4180] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:37.125282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:37.126825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:37.223510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:37.322080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621bdb5-1714-4709-8e9c-e6c76bd58790 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:37.350921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:37.357338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:37.359317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:37.360480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:37.389175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:37.391175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:37.410343 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2098/4181] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:38.996244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:38.997767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:39.018560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ce596-3c13-4e3e-834c-d091adf3573b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:39.033314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:39.034443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:39.034850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:39.035243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] PATH_INFO: `/v3/projects/29cf1154404143ef83f332a659c6e7fe` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:39.037459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cf1154404143ef83f332a659c6e7fe)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:39.039700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:39.195378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cf1154404143ef83f332a659c6e7fe', 'request_id': 'req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.220465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cf1154404143ef83f332a659c6e7fe', 'request_id': 'req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.236281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cf1154404143ef83f332a659c6e7fe', 'request_id': 'req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.266242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] The token cache is being invalidate because project 29cf1154404143ef83f332a659c6e7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:39.266542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.268354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.275377 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2084/4182] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:38 2022] DELETE /identity/v3/projects/29cf1154404143ef83f332a659c6e7fe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:39.276513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:39.293219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74571-684d-4dd0-a5eb-c8313cbd6a97 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:39.378410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:39.379696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:39.380268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:39.380706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] PATH_INFO: `/v3/users/97b7b10a449d4d4e89431565496aaa24` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:39.382480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b7b10a449d4d4e89431565496aaa24)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:39.384714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:39.491188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b7b10a449d4d4e89431565496aaa24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.495042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b7b10a449d4d4e89431565496aaa24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.515546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b7b10a449d4d4e89431565496aaa24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.516598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b7b10a449d4d4e89431565496aaa24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.528311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b7b10a449d4d4e89431565496aaa24'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:39.553214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2099/4183] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:39 2022] DELETE /identity/v3/users/97b7b10a449d4d4e89431565496aaa24 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:39.615528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:39.617357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:39.683793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:39.724204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1388b91-f6ac-4e2f-8faa-2dbeb67e4f89 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:39.803129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a30cf-eec5-42fb-8f57-8124bfa9bce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:39.804248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a30cf-eec5-42fb-8f57-8124bfa9bce4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:39.804831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a30cf-eec5-42fb-8f57-8124bfa9bce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:39.805312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a30cf-eec5-42fb-8f57-8124bfa9bce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:39.808804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6b1a30cf-eec5-42fb-8f57-8124bfa9bce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:39.826916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a30cf-eec5-42fb-8f57-8124bfa9bce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:39.828724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a30cf-eec5-42fb-8f57-8124bfa9bce4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:39.842593 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2085/4184] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:40.289848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:40.291447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:40.409876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:40.427270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a33c8-3bf3-44fd-bf0e-f292617dd782 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:40.434079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:40.436134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:40.436736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:40.441954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] PATH_INFO: `/v3/projects/2ea7ac7fc472495ab9ccb99fa69a8d32` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:40.443845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea7ac7fc472495ab9ccb99fa69a8d32)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:40.446427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:40.547662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea7ac7fc472495ab9ccb99fa69a8d32', 'request_id': 'req-ff55adf2-226f-4a19-9109-0160daa41043'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:40.557472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea7ac7fc472495ab9ccb99fa69a8d32', 'request_id': 'req-ff55adf2-226f-4a19-9109-0160daa41043'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:40.574319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea7ac7fc472495ab9ccb99fa69a8d32', 'request_id': 'req-ff55adf2-226f-4a19-9109-0160daa41043'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:40.594974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] The token cache is being invalidate because project 2ea7ac7fc472495ab9ccb99fa69a8d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:40.597442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:40.598206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff55adf2-226f-4a19-9109-0160daa41043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:40.600343 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2100/4185] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:40 2022] DELETE /identity/v3/projects/2ea7ac7fc472495ab9ccb99fa69a8d32 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:40.605504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6fa8d-2304-466a-b72d-0a5abe14fbf2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:40.606336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6fa8d-2304-466a-b72d-0a5abe14fbf2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:40.606948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6fa8d-2304-466a-b72d-0a5abe14fbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:40.654672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-72e6fa8d-2304-466a-b72d-0a5abe14fbf2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:40.656225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-72e6fa8d-2304-466a-b72d-0a5abe14fbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:40.756444 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2086/4186] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:40.765210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:40.766010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:40.766581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:40.787522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:40.788987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:40.802479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6fa8d-2304-466a-b72d-0a5abe14fbf2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:40.803023 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2101/4187] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:40.809999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:40.812558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:40.816068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6fa8d-2304-466a-b72d-0a5abe14fbf2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:40.821987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:40.822755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:40.823102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:40.823463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:40.824281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:40.824942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:40.826850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146491d2-db5d-444e-b07f-2b7d42af9566 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:40.828456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:40.833912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:40.835103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:40.835659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:40.836125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] PATH_INFO: `/v3/users/cc3d993686bc4416a4015ac3e96b029c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:40.837879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3d993686bc4416a4015ac3e96b029c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:40.840083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:40.866349 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2087/4188] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:40.868994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:40.901159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5b757-0448-4dae-b758-ec8b6c6f349c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:40.913336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:40.914089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:40.914348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:40.914624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:40.915585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:40.919156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:40.963562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3d993686bc4416a4015ac3e96b029c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:40.965623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3d993686bc4416a4015ac3e96b029c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:40.989148 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2088/4189] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:40 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:40.992871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:40.997863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:41.018509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3d993686bc4416a4015ac3e96b029c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:41.019390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3d993686bc4416a4015ac3e96b029c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:41.047994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3d993686bc4416a4015ac3e96b029c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:41.087172 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2102/4190] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:40 2022] DELETE /identity/v3/users/cc3d993686bc4416a4015ac3e96b029c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:41.120023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:41.137522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ed50-e3d2-4a31-b7ce-11e47fc0f969 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:41.258797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:41.260590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:41.304299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:41.305419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:41.305419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:41.305419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:41.306065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:41.308021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:41.365839 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2089/4191] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:40 2022] POST /identity/v3/users => generated 291 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:41.371434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:41.399897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43f7fd-8327-4071-abf7-22c40a145b4c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:41.402056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:41.408169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fb9db-5ffe-4c26-a469-edb3b6cc0867 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:41.412043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:41.412755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:41.413063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:41.413335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:41.414196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:41.417088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:41.420200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d1c3-6667-4a96-a419-0874afc9656b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:41.420876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d1c3-6667-4a96-a419-0874afc9656b service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:41.421176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d1c3-6667-4a96-a419-0874afc9656b service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:41.421447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d1c3-6667-4a96-a419-0874afc9656b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:41.424253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-85f1d1c3-6667-4a96-a419-0874afc9656b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:41.446481 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2090/4192] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:41.453879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:41.477469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263d3dc-2dfd-4f4a-a025-7226afb6d3bd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:41.498390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:41.499087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:41.499364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:41.499633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:41.500374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:41.502033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:41.520701 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2091/4193] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:41.521773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:41.538934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26fe86-b03c-4b0c-b75f-9e21ea18826a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:41.547440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d1c3-6667-4a96-a419-0874afc9656b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:41.549860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d1c3-6667-4a96-a419-0874afc9656b service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:41.555977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:41.556896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:41.557209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:41.557486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] PATH_INFO: `/v3/projects/35278a0575fc44339b287185f367f27f/users/3e59113e7c874504a95b5a4d28d1ba61/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:41.563945 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2103/4194] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:16:41.581625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35278a0575fc44339b287185f367f27f, user_id=3e59113e7c874504a95b5a4d28d1ba61, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:41.584924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:41.609711 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2092/4195] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:41 2022] PUT /identity/v3/projects/35278a0575fc44339b287185f367f27f/users/3e59113e7c874504a95b5a4d28d1ba61/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:41.620208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771c53f-b1d1-4c0c-9d6f-6ce360d7c604 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:41.620522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771c53f-b1d1-4c0c-9d6f-6ce360d7c604 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:41.621334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771c53f-b1d1-4c0c-9d6f-6ce360d7c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:41.697829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8771c53f-b1d1-4c0c-9d6f-6ce360d7c604 None None] MFA Rules not processed for user `3e59113e7c874504a95b5a4d28d1ba61`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:41.699485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8771c53f-b1d1-4c0c-9d6f-6ce360d7c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:41.851256 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2104/4196] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:41.856230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:41.974834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050df2c-115a-4376-9187-d1db525f0e28 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:41.980155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:41.981066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:41.981911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:41.982200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:41.982908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:41.985085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:42.047790 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2093/4197] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:41 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:42.053534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771c53f-b1d1-4c0c-9d6f-6ce360d7c604 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:42.089214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771c53f-b1d1-4c0c-9d6f-6ce360d7c604 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:42.202579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:42.211171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:42.306353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:42.308844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:42.309224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:42.309591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:42.311485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:42.311620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:42.316086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:42.367470 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2105/4198] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:42 2022] POST /identity/v3/users => generated 296 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:42.368524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:42.373916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:42.400598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604c79e-86ac-43b4-9a97-e780c429243d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:42.416679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:42.419624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:42.419916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:42.420194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] PATH_INFO: `/v3/projects/635aa1d3d9b24f59a1b25f107438855e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:42.424832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635aa1d3d9b24f59a1b25f107438855e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:42.426966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:42.447767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:42.574103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635aa1d3d9b24f59a1b25f107438855e', 'request_id': 'req-aaca9da1-563c-4bc3-bf19-abc854f092c5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:42.587688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569186f5-edce-4bbe-bc2b-8427f3ecf344 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:42.588280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635aa1d3d9b24f59a1b25f107438855e', 'request_id': 'req-aaca9da1-563c-4bc3-bf19-abc854f092c5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:42.607905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635aa1d3d9b24f59a1b25f107438855e', 'request_id': 'req-aaca9da1-563c-4bc3-bf19-abc854f092c5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:42.631607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] The token cache is being invalidate because project 635aa1d3d9b24f59a1b25f107438855e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:42.632235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:42.632654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:42.638249 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2094/4199] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:42 2022] DELETE /identity/v3/projects/635aa1d3d9b24f59a1b25f107438855e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:42.638582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:42.646383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:42.751744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff998431-c08c-44cf-997f-5125b5ee3389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:42.752839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998431-c08c-44cf-997f-5125b5ee3389 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:42.753369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998431-c08c-44cf-997f-5125b5ee3389 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:42.753795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998431-c08c-44cf-997f-5125b5ee3389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:42.756994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ff998431-c08c-44cf-997f-5125b5ee3389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:42.775817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff998431-c08c-44cf-997f-5125b5ee3389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:42.778491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff998431-c08c-44cf-997f-5125b5ee3389 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:42.801677 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2106/4200] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:42.804432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b13c64-19e9-4ff1-831d-abbb42559169 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:42.804975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b13c64-19e9-4ff1-831d-abbb42559169 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:42.805387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b13c64-19e9-4ff1-831d-abbb42559169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:42.832731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca9da1-563c-4bc3-bf19-abc854f092c5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:42.854992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e3b13c64-19e9-4ff1-831d-abbb42559169 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:42.855331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e3b13c64-19e9-4ff1-831d-abbb42559169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:42.857700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:42.862209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:42.862546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:42.865747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:42.866698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:42.871208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:42.891466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2107/4201] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:42.894286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982bc2-17c1-47fd-b235-48044329ea93 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:42.894577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982bc2-17c1-47fd-b235-48044329ea93 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:42.894884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982bc2-17c1-47fd-b235-48044329ea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:42.905532 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2095/4202] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:42.909706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:42.934835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b3adc-f63a-46a3-aa69-86b9960ebe10 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:42.950328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-db982bc2-17c1-47fd-b235-48044329ea93 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:42.953472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:42.954148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-db982bc2-17c1-47fd-b235-48044329ea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:42.954402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:42.954689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:42.954977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] PATH_INFO: `/v3/projects/10853300c2734221b15dc082036f569b/users/01dce8dc12204807a8bdb2fe7c3ec0b7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:42.975633 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2108/4203] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:42.980352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db982bc2-17c1-47fd-b235-48044329ea93 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.004804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db982bc2-17c1-47fd-b235-48044329ea93 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.017098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10853300c2734221b15dc082036f569b, user_id=01dce8dc12204807a8bdb2fe7c3ec0b7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.020083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.029026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.029026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.032488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.034844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.037804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:43.041021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.049316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.054652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2096/4204] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:42 2022] PUT /identity/v3/projects/10853300c2734221b15dc082036f569b/users/01dce8dc12204807a8bdb2fe7c3ec0b7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:43.057470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.087811 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2109/4205] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:43.092115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.116260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1c22c-6654-4906-8578-12a1d233d9f7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.147449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:43.222244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736ba11-e8bd-46c6-8f10-6d7e07d25526 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.242805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.244148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.244148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.247438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.248524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.252907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.304428 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2097/4206] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:43.306500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.307741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.308435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.308715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.309006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.310329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.318074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.329745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff5bb8-c785-4e3d-a4cb-cabb80b0238c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.344295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687941c-9674-48a3-beb6-5e56c76d4be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.347073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687941c-9674-48a3-beb6-5e56c76d4be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.347967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687941c-9674-48a3-beb6-5e56c76d4be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.349240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687941c-9674-48a3-beb6-5e56c76d4be2 admin admin] PATH_INFO: `/v3/projects/10853300c2734221b15dc082036f569b/users/01dce8dc12204807a8bdb2fe7c3ec0b7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.355530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687941c-9674-48a3-beb6-5e56c76d4be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10853300c2734221b15dc082036f569b, user_id=01dce8dc12204807a8bdb2fe7c3ec0b7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.360771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687941c-9674-48a3-beb6-5e56c76d4be2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.383701 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2110/4207] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:43 2022] POST /identity/v3/projects => generated 397 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:43.389586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.392624 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2098/4208] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:43 2022] PUT /identity/v3/projects/10853300c2734221b15dc082036f569b/users/01dce8dc12204807a8bdb2fe7c3ec0b7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:43.407647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.407944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.408208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.411085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:43.490333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] MFA Rules not processed for user `01dce8dc12204807a8bdb2fe7c3ec0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:43.491997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:43.614122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b329b7d-7f41-41e4-93f0-6ddd5b726e63 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.624372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.627089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.627796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.628330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.629618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.629939 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2099/4209] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:43.634407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.642885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.647787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:43.674640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2111/4210] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:43 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:43.676465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.695580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de37d-25aa-48c3-b131-fe164182e1ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.706256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.721068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.722483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.725096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.726121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.734064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.769497 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2112/4211] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:43.770930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.791060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf69e-f12e-43b1-a5c1-1698f97893e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.801378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.807128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.808300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.808801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.809783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.812234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.816879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394010-5afa-46a0-a9c2-7e208b913e8f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.828677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e2965-ae6b-4ff6-8229-c06f01b7649b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.830017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2965-ae6b-4ff6-8229-c06f01b7649b service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.830474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2965-ae6b-4ff6-8229-c06f01b7649b service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.831064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e2965-ae6b-4ff6-8229-c06f01b7649b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.836761 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2113/4212] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:16:43.840307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:43.849236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e2965-ae6b-4ff6-8229-c06f01b7649b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.851302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e2965-ae6b-4ff6-8229-c06f01b7649b service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.859643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20e88-7329-4955-a747-278ebdee023a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:43.864444 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2100/4213] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:43.866381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2592c-aa29-4264-91e2-2a99cd11e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:43.866783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.867255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.867631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2592c-aa29-4264-91e2-2a99cd11e997 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.867933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.868187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2592c-aa29-4264-91e2-2a99cd11e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.868684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2592c-aa29-4264-91e2-2a99cd11e997 admin admin] PATH_INFO: `/v3/projects/7ed1dce6dabe4bad91282d31153e2698/users/cf632c9596904fd494c0d6190ede1d67/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:43.891976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2592c-aa29-4264-91e2-2a99cd11e997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed1dce6dabe4bad91282d31153e2698, user_id=cf632c9596904fd494c0d6190ede1d67, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:43.894880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2592c-aa29-4264-91e2-2a99cd11e997 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:43.895134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:43.898093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:43.920466 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2114/4214] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:43 2022] PUT /identity/v3/projects/7ed1dce6dabe4bad91282d31153e2698/users/cf632c9596904fd494c0d6190ede1d67/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:43.936148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8cc14-9e2f-4f3c-8e62-76691e3a774c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:43.936478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8cc14-9e2f-4f3c-8e62-76691e3a774c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:43.936844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8cc14-9e2f-4f3c-8e62-76691e3a774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:44.008614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:44.020618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7bd8cc14-9e2f-4f3c-8e62-76691e3a774c None None] MFA Rules not processed for user `cf632c9596904fd494c0d6190ede1d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:44.022816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7bd8cc14-9e2f-4f3c-8e62-76691e3a774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:44.069296 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2101/4215] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:44.086489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:44.089569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:44.189821 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2115/4216] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:44.205659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:44.206220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:44.206664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:44.259287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] MFA Rules not processed for user `cf632c9596904fd494c0d6190ede1d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:44.263429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:44.277873 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2116/4217] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:16:44.286183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:44.286392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dcc1c-3209-4f21-8337-01f926e3ecd8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:44.287892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:44.372509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:44.426021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562ff8e-665c-43f3-96cf-402e7c182bcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:44.426730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ff8e-665c-43f3-96cf-402e7c182bcd service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:44.427040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ff8e-665c-43f3-96cf-402e7c182bcd service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:44.427359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ff8e-665c-43f3-96cf-402e7c182bcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:44.459604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b6478-ac29-402f-bda8-ab0280dcace0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:44.470215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b56e5-a2a0-48a9-8f5c-e7aada9cbe72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:44.470969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b56e5-a2a0-48a9-8f5c-e7aada9cbe72 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:44.471228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b56e5-a2a0-48a9-8f5c-e7aada9cbe72 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:44.471519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b56e5-a2a0-48a9-8f5c-e7aada9cbe72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:44.517935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b56e5-a2a0-48a9-8f5c-e7aada9cbe72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:44.520106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b56e5-a2a0-48a9-8f5c-e7aada9cbe72 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:44.535071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2117/4218] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:44.568279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168323-b56e-46eb-ba78-48e0f01bd093 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:44.568639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168323-b56e-46eb-ba78-48e0f01bd093 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:44.569005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168323-b56e-46eb-ba78-48e0f01bd093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:44.590487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b6168323-b56e-46eb-ba78-48e0f01bd093 None None] MFA Rules not processed for user `cf632c9596904fd494c0d6190ede1d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:44.591973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b6168323-b56e-46eb-ba78-48e0f01bd093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:44.600243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2118/4219] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:16:44.607098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562ff8e-665c-43f3-96cf-402e7c182bcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:44.609058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562ff8e-665c-43f3-96cf-402e7c182bcd service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:44.628654 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2102/4220] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:44.705309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6168323-b56e-46eb-ba78-48e0f01bd093 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:44.817218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6168323-b56e-46eb-ba78-48e0f01bd093 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:44.831760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:44.831760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:44.831760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:44.831760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] PATH_INFO: `/v3/users/3e59113e7c874504a95b5a4d28d1ba61` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:44.832268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e59113e7c874504a95b5a4d28d1ba61)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:44.832268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:44.909712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e59113e7c874504a95b5a4d28d1ba61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:44.910773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e59113e7c874504a95b5a4d28d1ba61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:44.926136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e59113e7c874504a95b5a4d28d1ba61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:44.927088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e59113e7c874504a95b5a4d28d1ba61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:44.939610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e59113e7c874504a95b5a4d28d1ba61'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:44.959605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2119/4221] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:44 2022] DELETE /identity/v3/users/3e59113e7c874504a95b5a4d28d1ba61 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:44.968956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79c9f-abf7-445f-84fc-5d4f04626dab None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:44.969481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79c9f-abf7-445f-84fc-5d4f04626dab None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:44.969774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e79c9f-abf7-445f-84fc-5d4f04626dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:44.991995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c0e79c9f-abf7-445f-84fc-5d4f04626dab None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:44.993806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c0e79c9f-abf7-445f-84fc-5d4f04626dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.042668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:45.086535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2103/4222] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:45.097071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:45.099334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.177402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:45.233823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcd021-f80a-4b81-90d7-93e9cbab7a13 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:45.234387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcd021-f80a-4b81-90d7-93e9cbab7a13 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:45.234829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcd021-f80a-4b81-90d7-93e9cbab7a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:45.250049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451cbc4-addb-4b86-9f48-05d217678317 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:45.261068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbe4b5-d8d5-4184-abcb-c82f1266c98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:45.265252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe4b5-d8d5-4184-abcb-c82f1266c98d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:45.265774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe4b5-d8d5-4184-abcb-c82f1266c98d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:45.267443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbe4b5-d8d5-4184-abcb-c82f1266c98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:45.273105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-78fcd021-f80a-4b81-90d7-93e9cbab7a13 None None] MFA Rules not processed for user `cf632c9596904fd494c0d6190ede1d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:45.275653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-78fcd021-f80a-4b81-90d7-93e9cbab7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.286741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbe4b5-d8d5-4184-abcb-c82f1266c98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:45.290293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbe4b5-d8d5-4184-abcb-c82f1266c98d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:45.321503 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2120/4223] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:45.426224 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2104/4224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:45.465982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:45.466535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:45.466976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:45.517670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] MFA Rules not processed for user `cf632c9596904fd494c0d6190ede1d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:45.519807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.541569 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2121/4225] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:45.577022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161032-b72a-459d-baa5-eea76950187e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:45.577351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161032-b72a-459d-baa5-eea76950187e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:45.577768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48161032-b72a-459d-baa5-eea76950187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:45.611642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-48161032-b72a-459d-baa5-eea76950187e None None] MFA Rules not processed for user `cf632c9596904fd494c0d6190ede1d67`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:45.614093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48161032-b72a-459d-baa5-eea76950187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.629212 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2105/4226] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:16:45.651624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:45.651624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.689542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9750ca-a66f-41dd-bf12-5907536188aa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:45.710890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:45.712792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:45.713110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:45.713393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] PATH_INFO: `/v3/users/cf632c9596904fd494c0d6190ede1d67` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:45.718300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf632c9596904fd494c0d6190ede1d67)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:45.725568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:45.820321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161032-b72a-459d-baa5-eea76950187e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:45.823387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48161032-b72a-459d-baa5-eea76950187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.855209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48161032-b72a-459d-baa5-eea76950187e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:45.859654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf632c9596904fd494c0d6190ede1d67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:45.861217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf632c9596904fd494c0d6190ede1d67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:45.873653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:45.874377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:45.874765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:45.875080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] PATH_INFO: `/v3/projects/35278a0575fc44339b287185f367f27f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:45.876420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=35278a0575fc44339b287185f367f27f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:45.879377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:45.897897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf632c9596904fd494c0d6190ede1d67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:45.899235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf632c9596904fd494c0d6190ede1d67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:45.922674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e873b4f-8e0e-4e72-bbe3-b99102a83719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf632c9596904fd494c0d6190ede1d67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:45.946259 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2122/4227] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:45 2022] DELETE /identity/v3/users/cf632c9596904fd494c0d6190ede1d67 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:45.952011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:45.952011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:45.952355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:45.968676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35278a0575fc44339b287185f367f27f', 'request_id': 'req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:45.976829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35278a0575fc44339b287185f367f27f', 'request_id': 'req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:45.978972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:45.980222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:45.988814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35278a0575fc44339b287185f367f27f', 'request_id': 'req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.024672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] The token cache is being invalidate because project 35278a0575fc44339b287185f367f27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:46.025058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.025739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.030657 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2106/4228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:45 2022] DELETE /identity/v3/projects/35278a0575fc44339b287185f367f27f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:46.031444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:46.033676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:46.108641 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2123/4229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:46.120302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:46.122180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:46.129703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:46.178557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ebe7c-abec-4f2b-add9-1da2185b4ddf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:46.192996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:46.194123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:46.194501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:46.194946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] PATH_INFO: `/v3/users/01dce8dc12204807a8bdb2fe7c3ec0b7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:46.197780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=01dce8dc12204807a8bdb2fe7c3ec0b7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:46.210415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:46.230337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:46.268842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770dbc7-d8ec-4668-b6b2-f847d807aed5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:46.277756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:46.279012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:46.279611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:46.280061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:46.303268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:46.305184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:46.327276 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2124/4230] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:46.328099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01dce8dc12204807a8bdb2fe7c3ec0b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.328913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01dce8dc12204807a8bdb2fe7c3ec0b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.362420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01dce8dc12204807a8bdb2fe7c3ec0b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.364915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01dce8dc12204807a8bdb2fe7c3ec0b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.385315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01dce8dc12204807a8bdb2fe7c3ec0b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:46.421336 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2107/4231] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:46 2022] DELETE /identity/v3/users/01dce8dc12204807a8bdb2fe7c3ec0b7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:46.842926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:46.844429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:46.902246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06126-9210-4db7-8746-1edf9846851a service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.041671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.042653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.043004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.043354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] PATH_INFO: `/v3/projects/7ed1dce6dabe4bad91282d31153e2698` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.045729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed1dce6dabe4bad91282d31153e2698)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.048163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.134347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed1dce6dabe4bad91282d31153e2698', 'request_id': 'req-5d79a065-aee8-474e-a89d-f5ec28c98bca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.154175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.158513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:47.166800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed1dce6dabe4bad91282d31153e2698', 'request_id': 'req-5d79a065-aee8-474e-a89d-f5ec28c98bca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.185583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed1dce6dabe4bad91282d31153e2698', 'request_id': 'req-5d79a065-aee8-474e-a89d-f5ec28c98bca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.198553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] The token cache is being invalidate because project 7ed1dce6dabe4bad91282d31153e2698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:47.198916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.199547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6dc2-c797-4fcc-96ca-708bd9035ceb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.199976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d79a065-aee8-474e-a89d-f5ec28c98bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.203722 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2125/4232] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:46 2022] DELETE /identity/v3/projects/7ed1dce6dabe4bad91282d31153e2698 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:47.213495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3013b-9fc2-4d7c-921c-c2b2b2f9cf30 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.213887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3013b-9fc2-4d7c-921c-c2b2b2f9cf30 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.214304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3013b-9fc2-4d7c-921c-c2b2b2f9cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.240523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fbd3013b-9fc2-4d7c-921c-c2b2b2f9cf30 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:47.242216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fbd3013b-9fc2-4d7c-921c-c2b2b2f9cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:47.288081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.289330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.289621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.289901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] PATH_INFO: `/v3/projects/10853300c2734221b15dc082036f569b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.292072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10853300c2734221b15dc082036f569b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.294870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.356651 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2126/4233] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:47.367891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac15c-9638-4fa9-8e9f-2700526a2e4d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.367891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac15c-9638-4fa9-8e9f-2700526a2e4d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.367891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac15c-9638-4fa9-8e9f-2700526a2e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.388244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10853300c2734221b15dc082036f569b', 'request_id': 'req-8faf70a3-1901-4600-b328-e9dd3da279a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.397846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10853300c2734221b15dc082036f569b', 'request_id': 'req-8faf70a3-1901-4600-b328-e9dd3da279a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.400561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ccaac15c-9638-4fa9-8e9f-2700526a2e4d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:47.401830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ccaac15c-9638-4fa9-8e9f-2700526a2e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:47.408268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:47.409896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10853300c2734221b15dc082036f569b', 'request_id': 'req-8faf70a3-1901-4600-b328-e9dd3da279a3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.419771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:47.424643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] The token cache is being invalidate because project 10853300c2734221b15dc082036f569b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:47.426223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.427545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8faf70a3-1901-4600-b328-e9dd3da279a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:47.432682 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2108/4234] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:47 2022] DELETE /identity/v3/projects/10853300c2734221b15dc082036f569b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:16:47.435293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5fb1-66bf-4fd7-87c2-b746a1657355 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.435775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5fb1-66bf-4fd7-87c2-b746a1657355 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.436280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea5fb1-66bf-4fd7-87c2-b746a1657355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.464399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ddea5fb1-66bf-4fd7-87c2-b746a1657355 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:47.466310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ddea5fb1-66bf-4fd7-87c2-b746a1657355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:47.533733 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2127/4235] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:47.534920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac15c-9638-4fa9-8e9f-2700526a2e4d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.545170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac15c-9638-4fa9-8e9f-2700526a2e4d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.550837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.552056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.552467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.553070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.553892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:47.554294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.563206 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2109/4236] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:47.563437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.574666 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2128/4237] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:47.578856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.579357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa502-7bcf-4f39-97e0-28bf5ecff52f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.580433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa502-7bcf-4f39-97e0-28bf5ecff52f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.580779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa502-7bcf-4f39-97e0-28bf5ecff52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.601396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ed800-3eec-411e-8e65-502bbeee02e9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.606431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.607106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.607387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.607807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.608507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.610637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.617552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-72bfa502-7bcf-4f39-97e0-28bf5ecff52f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:47.619133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-72bfa502-7bcf-4f39-97e0-28bf5ecff52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:47.630259 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2110/4238] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:47.634812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfa502-7bcf-4f39-97e0-28bf5ecff52f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.657358 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2129/4239] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:47 2022] POST /identity/v3/projects => generated 403 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:47.658359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.668154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfa502-7bcf-4f39-97e0-28bf5ecff52f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.734775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581fd53-07fe-438d-9b0d-bdc3f7ff61cf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.741100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.742559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.742559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.742959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.743759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.746992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.793949 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2130/4240] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:47 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:47.796111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.818080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60133a-2aa8-491e-937b-52a84c437b47 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.826442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.827288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.827676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.827974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.829190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.830949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.857148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2131/4241] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:16:47.864259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.882845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.883553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.883835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.884113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.884861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:47.885000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54faacb-d5cd-483f-82d1-fe13114ea8b7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.885241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.890153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.890833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.891116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.891394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.892133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.893096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.893848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.911389 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2132/4242] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:47.913984 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2111/4243] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:47.918206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.918859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:47.934547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331ed7d-0ee1-451f-ba26-e74fc9c900fd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.938664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137fdaf-5d55-4eaa-bdf4-ee18026ae747 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:47.944765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32156240-d07c-4945-b214-9f4c932a9762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.945831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32156240-d07c-4945-b214-9f4c932a9762 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.946405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32156240-d07c-4945-b214-9f4c932a9762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.946779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32156240-d07c-4945-b214-9f4c932a9762 admin admin] PATH_INFO: `/v3/projects/e6e76753152c4fe7881769f5477f65e5/users/17bce7b531bd49b5a54a2e7eab57834f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.947400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:47.951207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:47.951958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:47.952412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:47.953544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.955787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.982735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32156240-d07c-4945-b214-9f4c932a9762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e76753152c4fe7881769f5477f65e5, user_id=17bce7b531bd49b5a54a2e7eab57834f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:47.986548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32156240-d07c-4945-b214-9f4c932a9762 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:47.997905 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2112/4244] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:47 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:48.001651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:48.006730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2133/4245] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:47 2022] PUT /identity/v3/projects/e6e76753152c4fe7881769f5477f65e5/users/17bce7b531bd49b5a54a2e7eab57834f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:48.027519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.027961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.028531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.057727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:48.059670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:48.077634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:48.134496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105fd2d-445d-49b0-bd1d-3240e696c92f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:48.145788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:48.162374 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2134/4246] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:48.175039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:48.177011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:48.214515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:48.215057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.215057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.215218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.215936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:48.223328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:48.286934 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2113/4247] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:48 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:48.291844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:48.303875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8930637-8b0d-4329-bbf0-2f313bbf346e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:48.320566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:48.321289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.321571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.321845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.322672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:48.324539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:48.336291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2114/4248] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:48.344625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:48.353402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f95dc-c660-480f-a00b-41eb70417c11 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:48.358792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfb664-77b9-4df0-92fc-d74981ac6310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:48.359575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb664-77b9-4df0-92fc-d74981ac6310 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.359949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb664-77b9-4df0-92fc-d74981ac6310 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.360372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb664-77b9-4df0-92fc-d74981ac6310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.362328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dc1f6-3e42-44ae-a41e-8d911b368d58 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:48.368202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:48.368952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.369331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.369623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.370385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:48.372194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:48.373055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfb664-77b9-4df0-92fc-d74981ac6310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:48.374591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfb664-77b9-4df0-92fc-d74981ac6310 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:48.386862 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2115/4249] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:48.387491 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2135/4250] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:48.391161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:48.403077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9f5d-ed12-4ae5-a9f7-95375122edc3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:48.410211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:48.411292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.411692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.412053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] PATH_INFO: `/v3/projects/c955c878b3e846f3b1157def13c7753c/users/e4db7c707e8c4f98845b6bc8efead0ee/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.435568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c955c878b3e846f3b1157def13c7753c, user_id=e4db7c707e8c4f98845b6bc8efead0ee, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:48.439407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:48.489444 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2116/4251] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:48 2022] PUT /identity/v3/projects/c955c878b3e846f3b1157def13c7753c/users/e4db7c707e8c4f98845b6bc8efead0ee/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:16:48.505984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce67c0f-4d7f-42d1-8773-2ee489c553ca None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.506283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce67c0f-4d7f-42d1-8773-2ee489c553ca None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.506586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce67c0f-4d7f-42d1-8773-2ee489c553ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.592411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6ce67c0f-4d7f-42d1-8773-2ee489c553ca None None] MFA Rules not processed for user `e4db7c707e8c4f98845b6bc8efead0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:48.594484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6ce67c0f-4d7f-42d1-8773-2ee489c553ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:48.758713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2136/4252] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:48.764328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:48.932189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0323-d2bb-422e-825e-c1c57c74a01d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:48.940398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:48.941835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:48.942140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:48.942991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:48.943863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:48.949096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:49.009270 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2117/4253] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:48 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:49.013283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce67c0f-4d7f-42d1-8773-2ee489c553ca None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:49.038734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce67c0f-4d7f-42d1-8773-2ee489c553ca None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:49.102488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:49.117374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:49.119010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:49.119624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:49.120067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:49.120942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:49.123104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:49.159510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2137/4254] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:49 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:49.160436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:49.176947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1eb9f-f280-4d94-9154-1aabd9364e88 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:49.185988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:49.186720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:49.187095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:49.187384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:49.188291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:49.190524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:49.221053 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2118/4255] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:49.222810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:49.271877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163b7a2-5f8f-46de-adf1-81416e10e662 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:49.306125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:49.307847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:49.317113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:49.318107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] PATH_INFO: `/v3/projects/cc421f79e2384d48b6bd166a189eee88/users/0e96997fff394a0abc629247966c325c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:49.408181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc421f79e2384d48b6bd166a189eee88, user_id=0e96997fff394a0abc629247966c325c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:49.412760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:49.481124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2138/4256] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:49 2022] PUT /identity/v3/projects/cc421f79e2384d48b6bd166a189eee88/users/0e96997fff394a0abc629247966c325c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:16:49.486106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:49.507937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc71e2d-9b4b-4d08-ae2d-04010b306f5e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:49.595691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:49.663385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02c6a1-16b2-4325-a3dd-c4b0bfc33b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:49.664063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c6a1-16b2-4325-a3dd-c4b0bfc33b5a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:49.664348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c6a1-16b2-4325-a3dd-c4b0bfc33b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:49.664638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c6a1-16b2-4325-a3dd-c4b0bfc33b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:49.665483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02c6a1-16b2-4325-a3dd-c4b0bfc33b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:49.668672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02c6a1-16b2-4325-a3dd-c4b0bfc33b5a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:49.692247 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2119/4257] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:49.696193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:49.725690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a50ae-51de-4fb8-bf33-ef6672970ed5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:49.738837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:49.739872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:49.740234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:49.740588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] PATH_INFO: `/v3/projects/cc421f79e2384d48b6bd166a189eee88/users/0e96997fff394a0abc629247966c325c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:49.745647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc421f79e2384d48b6bd166a189eee88, user_id=0e96997fff394a0abc629247966c325c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:49.748493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:49.769764 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2139/4258] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:49 2022] PUT /identity/v3/projects/cc421f79e2384d48b6bd166a189eee88/users/0e96997fff394a0abc629247966c325c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:49.781653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205642c-f937-4ba0-a85b-db89b437b2ad None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:49.781948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205642c-f937-4ba0-a85b-db89b437b2ad None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:49.782232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205642c-f937-4ba0-a85b-db89b437b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:49.821579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0205642c-f937-4ba0-a85b-db89b437b2ad None None] MFA Rules not processed for user `0e96997fff394a0abc629247966c325c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:49.823432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0205642c-f937-4ba0-a85b-db89b437b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:49.930098 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2120/4259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:49.944957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:49.946292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:50.095220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e91-6c5d-4b97-be3b-de45362e6c0f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:50.105235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:50.105913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:50.106189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:50.106462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:50.130518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:50.132062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:50.151621 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2140/4260] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:50.277644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205642c-f937-4ba0-a85b-db89b437b2ad None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:50.292436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205642c-f937-4ba0-a85b-db89b437b2ad None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:50.302167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0238-0d3d-43da-bfa7-cac2d819a696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:50.303118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0238-0d3d-43da-bfa7-cac2d819a696 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:50.303501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0238-0d3d-43da-bfa7-cac2d819a696 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:50.304055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0238-0d3d-43da-bfa7-cac2d819a696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:50.421203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0238-0d3d-43da-bfa7-cac2d819a696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:50.422729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0238-0d3d-43da-bfa7-cac2d819a696 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:50.478505 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2121/4261] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:51.038740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:51.214242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d8bf1-c809-4c19-b546-9ee0b6f5fdf7 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:51.230141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:51.232414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:51.232414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:51.232414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] PATH_INFO: `/v3/users/e4db7c707e8c4f98845b6bc8efead0ee` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:51.232781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4db7c707e8c4f98845b6bc8efead0ee)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:51.239735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:51.360518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4db7c707e8c4f98845b6bc8efead0ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:51.362786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4db7c707e8c4f98845b6bc8efead0ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:51.367625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:51.396021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4db7c707e8c4f98845b6bc8efead0ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:51.397437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4db7c707e8c4f98845b6bc8efead0ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:51.424809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4db7c707e8c4f98845b6bc8efead0ee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:51.467907 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2141/4262] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:51 2022] DELETE /identity/v3/users/e4db7c707e8c4f98845b6bc8efead0ee => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:51.469126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:51.469628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:51.469764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:51.511445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:51.515230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:51.684673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:51.733820 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2122/4263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:51.789297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:51.790855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:51.922643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a9f65-8cab-445d-829e-a4e1ee72e3b7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:51.936240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:51.936920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:51.937226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:51.937498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:51.959498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:51.961050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:51.987921 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2142/4264] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:52.870912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:52.874101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:52.905751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c4b11-5a42-41af-bd7f-5f95abe508bf None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:52.917212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:52.918125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:52.920504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:52.921523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] PATH_INFO: `/v3/projects/c955c878b3e846f3b1157def13c7753c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:52.923430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c955c878b3e846f3b1157def13c7753c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:52.925430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:53.040797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c955c878b3e846f3b1157def13c7753c', 'request_id': 'req-3953770a-247e-4ad9-91df-0e4960d1806b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.049442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c955c878b3e846f3b1157def13c7753c', 'request_id': 'req-3953770a-247e-4ad9-91df-0e4960d1806b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.077640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c955c878b3e846f3b1157def13c7753c', 'request_id': 'req-3953770a-247e-4ad9-91df-0e4960d1806b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.127768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] The token cache is being invalidate because project c955c878b3e846f3b1157def13c7753c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:53.128082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.130002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.134000 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2123/4265] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:52 2022] DELETE /identity/v3/projects/c955c878b3e846f3b1157def13c7753c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:53.146473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:53.148503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d37ce4-7b61-47db-8270-f68533982260 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:53.261732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:53.262969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:53.263928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:53.264259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] PATH_INFO: `/v3/users/0e96997fff394a0abc629247966c325c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:53.266792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e96997fff394a0abc629247966c325c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:53.271432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:53.388249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e96997fff394a0abc629247966c325c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.390010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e96997fff394a0abc629247966c325c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.414706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e96997fff394a0abc629247966c325c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.415946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e96997fff394a0abc629247966c325c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.452288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:53.458231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b083dae8-5768-4f4e-9325-efc6e8455eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e96997fff394a0abc629247966c325c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:53.501413 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2143/4266] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:53 2022] DELETE /identity/v3/users/0e96997fff394a0abc629247966c325c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:54.560264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:54.562694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:54.608069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953770a-247e-4ad9-91df-0e4960d1806b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:54.844506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:54.850211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:54.853688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:54.854148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] PATH_INFO: `/v3/projects/cc421f79e2384d48b6bd166a189eee88` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:54.855754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc421f79e2384d48b6bd166a189eee88)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:54.871098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:55.023873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc421f79e2384d48b6bd166a189eee88', 'request_id': 'req-142da78b-0994-4775-ad15-58150972fdc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.041580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc421f79e2384d48b6bd166a189eee88', 'request_id': 'req-142da78b-0994-4775-ad15-58150972fdc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.067134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc421f79e2384d48b6bd166a189eee88', 'request_id': 'req-142da78b-0994-4775-ad15-58150972fdc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.092674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] The token cache is being invalidate because project cc421f79e2384d48b6bd166a189eee88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:55.092882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.094631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.101858 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2124/4267] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:54 2022] DELETE /identity/v3/projects/cc421f79e2384d48b6bd166a189eee88 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:55.106927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46ba3-73a2-429f-95e9-4bcec2e77bb1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:55.108321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46ba3-73a2-429f-95e9-4bcec2e77bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:55.108770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46ba3-73a2-429f-95e9-4bcec2e77bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:55.156465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ae46ba3-73a2-429f-95e9-4bcec2e77bb1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:55.157785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ae46ba3-73a2-429f-95e9-4bcec2e77bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:55.204896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:55.206972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:55.216725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:55.334014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2144/4268] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:55.342168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd519-538e-427c-8037-7147f233dc4e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:55.343115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd519-538e-427c-8037-7147f233dc4e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:55.343678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd519-538e-427c-8037-7147f233dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:55.348276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142da78b-0994-4775-ad15-58150972fdc4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:55.359540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:55.360461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:55.360741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:55.361019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] PATH_INFO: `/v3/users/f21b927a5dc54a9d822b54984257b792` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:55.362293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21b927a5dc54a9d822b54984257b792)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:55.367910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:55.380875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7acfd519-538e-427c-8037-7147f233dc4e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:55.382464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7acfd519-538e-427c-8037-7147f233dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:55.404698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2145/4269] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:55.408600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfd519-538e-427c-8037-7147f233dc4e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:55.428553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfd519-538e-427c-8037-7147f233dc4e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:55.453533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:55.455852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:55.456566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:55.458325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:55.461925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:55.465024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:55.470541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:55.507579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21b927a5dc54a9d822b54984257b792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.515352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21b927a5dc54a9d822b54984257b792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.532118 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2146/4270] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:16:55.538919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:55.541825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:55.568064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21b927a5dc54a9d822b54984257b792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.568673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b3227-bf3f-4dd4-ae13-3724201c6682 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:55.570102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21b927a5dc54a9d822b54984257b792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.587622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:55.588323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:55.588611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:55.588886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:55.593952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:55.598284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:55.601367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5d629ba-b34a-4dfd-a87a-d0d9a922a018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21b927a5dc54a9d822b54984257b792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:55.646706 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2125/4271] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:55 2022] DELETE /identity/v3/users/f21b927a5dc54a9d822b54984257b792 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:55.654192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:55.654850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:55.655359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:55.679391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2147/4272] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:55 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:16:55.680633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:55.724280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:55.725369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:55.851041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09f05d-db70-42f5-80e0-3d516f8390ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:55.872350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:55.874392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:55.874696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:55.878602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:55.880762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:55.886310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:55.902629 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2126/4273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:55.923536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:55.926117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:55.948918 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2148/4274] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:55 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:55.954114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:55.986929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe4ed0-32c6-4598-b7d2-d0bf0927b528 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:56.001901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:56.002607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:56.002889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:56.003172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:56.004631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:56.006453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:56.027785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:56.078100 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2149/4275] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:56.079116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:56.112085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde294-db31-421d-bf1f-0b9bb20856bc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:56.119079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:56.119784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:56.120068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:56.120344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:56.121104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:56.122739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:56.156106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d4c92-dbf7-4ebd-b108-2809b3c97946 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:56.158674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2150/4276] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:56.163070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:56.182984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e723-28bc-4d8f-a0d9-80b6005a1acf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:56.186971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:56.187621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:56.187903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:56.188171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:56.196755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baec1b-d22e-498a-8950-ab074e279fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:56.197713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baec1b-d22e-498a-8950-ab074e279fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:56.198008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baec1b-d22e-498a-8950-ab074e279fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:56.198272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baec1b-d22e-498a-8950-ab074e279fc1 admin admin] PATH_INFO: `/v3/projects/0ab099c8ad694d25967778ef8d6c4d43/users/61dea8cb1be043f78a35d5a9b7430f67/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:56.233591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:56.241809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:56.243716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baec1b-d22e-498a-8950-ab074e279fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab099c8ad694d25967778ef8d6c4d43, user_id=61dea8cb1be043f78a35d5a9b7430f67, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:56.248196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:56.253661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baec1b-d22e-498a-8950-ab074e279fc1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:56.304390 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2151/4277] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:56 2022] PUT /identity/v3/projects/0ab099c8ad694d25967778ef8d6c4d43/users/61dea8cb1be043f78a35d5a9b7430f67/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:16:56.304657 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2127/4278] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:56.306812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5a937-8ba0-4ef6-ace1-1e5f2c204e50 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:56.307106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5a937-8ba0-4ef6-ace1-1e5f2c204e50 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:56.307380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5a937-8ba0-4ef6-ace1-1e5f2c204e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:56.418056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-55e5a937-8ba0-4ef6-ace1-1e5f2c204e50 None None] MFA Rules not processed for user `61dea8cb1be043f78a35d5a9b7430f67`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:56.419704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-55e5a937-8ba0-4ef6-ace1-1e5f2c204e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:56.618870 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2152/4279] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:56.627879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:56.630075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:56.787089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e282-af0b-4fb8-922c-9143bcb76b35 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:56.870326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:56.871001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:56.871282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:56.871678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:56.881925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:56.884451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:56.895699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2128/4280] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:56.915270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5a937-8ba0-4ef6-ace1-1e5f2c204e50 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:57.055495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5a937-8ba0-4ef6-ace1-1e5f2c204e50 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:57.062455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:57.063377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:57.065553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:57.065553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] PATH_INFO: `/v3/users/61dea8cb1be043f78a35d5a9b7430f67` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:57.065771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dea8cb1be043f78a35d5a9b7430f67)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:57.067729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:57.174495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dea8cb1be043f78a35d5a9b7430f67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.176317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:57.177876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dea8cb1be043f78a35d5a9b7430f67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.178794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:57.216972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a95da0-09eb-451c-929c-578ce7eadab8 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:57.220283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dea8cb1be043f78a35d5a9b7430f67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.221380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dea8cb1be043f78a35d5a9b7430f67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.235268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:57.236223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:57.236504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:57.236784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] PATH_INFO: `/v3/projects/7a2876fd37d44561940f36cc02783e7e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:57.239525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2876fd37d44561940f36cc02783e7e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:57.241561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:57.258082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a8049c3-43cf-4399-9d94-94e2b2b1dd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dea8cb1be043f78a35d5a9b7430f67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.275997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:57.282440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2153/4281] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:16:56 2022] DELETE /identity/v3/users/61dea8cb1be043f78a35d5a9b7430f67 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:57.286696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e78daa-b898-444c-9c32-da72952c344c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:57.287282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e78daa-b898-444c-9c32-da72952c344c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:57.287790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e78daa-b898-444c-9c32-da72952c344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:57.327410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-28e78daa-b898-444c-9c32-da72952c344c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:57.328629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-28e78daa-b898-444c-9c32-da72952c344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:57.439198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2876fd37d44561940f36cc02783e7e', 'request_id': 'req-636f8307-229c-46dc-b850-b36313271787'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.449987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2876fd37d44561940f36cc02783e7e', 'request_id': 'req-636f8307-229c-46dc-b850-b36313271787'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.458563 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2154/4282] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:57.468782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e78daa-b898-444c-9c32-da72952c344c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:57.470408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-28e78daa-b898-444c-9c32-da72952c344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:57.477162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2876fd37d44561940f36cc02783e7e', 'request_id': 'req-636f8307-229c-46dc-b850-b36313271787'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.498212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] The token cache is being invalidate because project 7a2876fd37d44561940f36cc02783e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:57.500516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.501108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-636f8307-229c-46dc-b850-b36313271787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:57.508122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2129/4283] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:57 2022] DELETE /identity/v3/projects/7a2876fd37d44561940f36cc02783e7e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:57.509801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:57.510203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:57.510592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:57.546971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:57.548740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:57.581945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:57.623269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e78daa-b898-444c-9c32-da72952c344c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:57.747211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb933a00-ebc5-4fc1-aa5c-67c079f69744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:57.748250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933a00-ebc5-4fc1-aa5c-67c079f69744 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:57.750068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933a00-ebc5-4fc1-aa5c-67c079f69744 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:57.751556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb933a00-ebc5-4fc1-aa5c-67c079f69744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:57.757785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eb933a00-ebc5-4fc1-aa5c-67c079f69744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:57.788091 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2130/4284] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:57.792147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:57.798780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:57.825885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933a00-ebc5-4fc1-aa5c-67c079f69744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:57.828775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb933a00-ebc5-4fc1-aa5c-67c079f69744 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:57.851984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2155/4285] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:16:57.853933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790316-0626-4779-85be-b12dd7e928d0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:57.854400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790316-0626-4779-85be-b12dd7e928d0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:57.855108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790316-0626-4779-85be-b12dd7e928d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:57.891371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-75790316-0626-4779-85be-b12dd7e928d0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:57.893714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-75790316-0626-4779-85be-b12dd7e928d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:57.909775 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2156/4286] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:57.914326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75790316-0626-4779-85be-b12dd7e928d0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:57.936277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75790316-0626-4779-85be-b12dd7e928d0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:57.951380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:57.952824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:57.954508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:57.954903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:57.956881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:57.958865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:57.969365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:58.001975 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2157/4287] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:58.006986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:58.046363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e4ea-b7f1-473c-9ea7-a8a48ed60e97 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:58.057414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:58.059406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.059694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.060928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.061812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:58.068588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:58.087350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0006c-342a-487a-a2f5-214ecd3493bc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:58.107053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:58.107753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.108038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.115286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.141662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:58.164646 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2158/4288] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:58 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:58.167722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:58.254420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:58.404152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938adac1-42e4-473e-b40b-8ce407fe81f6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:58.441131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:58.441845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.442127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.442402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.443107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:58.453673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:58.458105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:58.460336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:58.501118 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2131/4289] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:58.517175 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2159/4290] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:16:58 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:16:58.523008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:58.556086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52aadd-29af-4bf6-a9b5-616ee94bacc1 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:58.574411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567e747-3ddb-4741-afd1-12c8f7c941a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:58.579409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e747-3ddb-4741-afd1-12c8f7c941a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.580043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e747-3ddb-4741-afd1-12c8f7c941a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.582408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567e747-3ddb-4741-afd1-12c8f7c941a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.583462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567e747-3ddb-4741-afd1-12c8f7c941a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:58.587767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567e747-3ddb-4741-afd1-12c8f7c941a9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:58.645378 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2132/4291] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:16:58.649868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:58.672240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe7ce-96cb-409b-b766-db7ae041628d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:58.699333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:58.700704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.700963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.701290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.702043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:58.704836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ced5-34e6-4586-b5a9-98a6bddc40a8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.705149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ced5-34e6-4586-b5a9-98a6bddc40a8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.705428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6ced5-34e6-4586-b5a9-98a6bddc40a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.706968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:58.750227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a1e6ced5-34e6-4586-b5a9-98a6bddc40a8 None None] MFA Rules not processed for user `4c071daa57f24e9fa1ae5d173a99d2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:58.751497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1e6ced5-34e6-4586-b5a9-98a6bddc40a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:58.755528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2160/4292] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:16:58.770231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:58.793935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c73895-6de6-4204-8a30-b52c8cc36d89 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:58.805974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:58.808192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.808828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.809311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] PATH_INFO: `/v3/projects/e7126d757bd748f291963f779f8eaad3/users/7a41eb42094f418685b83cc0a57852d5/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.844423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:58.845284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7126d757bd748f291963f779f8eaad3, user_id=7a41eb42094f418685b83cc0a57852d5, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:58.848906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:58.905560 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2161/4293] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:16:58 2022] PUT /identity/v3/projects/e7126d757bd748f291963f779f8eaad3/users/7a41eb42094f418685b83cc0a57852d5/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:58.907282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:58.909758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:58.920558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2133/4294] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:58.922277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:58.924715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:58.925375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:58.975069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:58.976593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:59.089096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2134/4295] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:59.110133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:59.112033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:59.135488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155548-1f53-40ca-9954-7506f053e1a7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:59.142925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:59.146623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:59.146910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:59.147189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] PATH_INFO: `/v3/projects/0ab099c8ad694d25967778ef8d6c4d43` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:59.161323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab099c8ad694d25967778ef8d6c4d43)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:59.164291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:59.195277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d998b-a2b1-42fb-b80c-1effd0ecd50a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:59.210262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138b757-bad3-4300-a58d-83e95a210287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:59.212285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b757-bad3-4300-a58d-83e95a210287 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:59.213198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b757-bad3-4300-a58d-83e95a210287 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:59.213607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138b757-bad3-4300-a58d-83e95a210287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:59.229228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138b757-bad3-4300-a58d-83e95a210287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:59.230820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138b757-bad3-4300-a58d-83e95a210287 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:59.260552 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2135/4296] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:16:59.381370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab099c8ad694d25967778ef8d6c4d43', 'request_id': 'req-854b9035-cf54-4211-bf7b-1a00f13bf13e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:59.409553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab099c8ad694d25967778ef8d6c4d43', 'request_id': 'req-854b9035-cf54-4211-bf7b-1a00f13bf13e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:59.448848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab099c8ad694d25967778ef8d6c4d43', 'request_id': 'req-854b9035-cf54-4211-bf7b-1a00f13bf13e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:59.471808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] The token cache is being invalidate because project 0ab099c8ad694d25967778ef8d6c4d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:16:59.472152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:59.474355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-854b9035-cf54-4211-bf7b-1a00f13bf13e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:16:59.476813 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2162/4297] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:16:58 2022] DELETE /identity/v3/projects/0ab099c8ad694d25967778ef8d6c4d43 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:16:59.482895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b204-2be8-493a-8cf3-a0cd33d15a1d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:59.483306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b204-2be8-493a-8cf3-a0cd33d15a1d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:59.483701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b204-2be8-493a-8cf3-a0cd33d15a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:59.533939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4051b204-2be8-493a-8cf3-a0cd33d15a1d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:59.541249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4051b204-2be8-493a-8cf3-a0cd33d15a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:59.724075 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2136/4298] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:59.733605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc550d-8ee4-463f-ae2d-c360e90f1a6c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:59.733870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc550d-8ee4-463f-ae2d-c360e90f1a6c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:59.734154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc550d-8ee4-463f-ae2d-c360e90f1a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:59.762050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:59.806726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-50fc550d-8ee4-463f-ae2d-c360e90f1a6c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:16:59.809026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-50fc550d-8ee4-463f-ae2d-c360e90f1a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:16:59.835244 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2163/4299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:16:59.839887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051b204-2be8-493a-8cf3-a0cd33d15a1d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:59.855889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051b204-2be8-493a-8cf3-a0cd33d15a1d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:59.892492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:16:59.896172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:16:59.896609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:16:59.898450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:16:59.899910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:16:59.901019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:16:59.904153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:16:59.931899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2137/4300] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:16:59.948409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc550d-8ee4-463f-ae2d-c360e90f1a6c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:59.976059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:16:59.990509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc550d-8ee4-463f-ae2d-c360e90f1a6c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:16:59.998000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:00.003004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:00.003819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:00.004742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:00.005675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:00.007726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:00.013393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:00.071998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:00.077618 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2164/4301] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:16:59 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:00.080188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:00.267867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707c62-a866-47de-b704-c9d7fd99b237 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:00.276864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:00.277592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:00.277885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:00.280391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:00.281495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:00.281984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047994ce-79c9-4b19-9531-50027aa865f6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:00.287373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:00.350045 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2165/4302] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:00 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:00.351158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:00.388287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b1d80-c957-4334-833a-f43cb35f8855 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:00.411082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:00.412046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:00.414492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:00.416272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:00.420308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:00.424212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:00.454896 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2166/4303] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:00.465999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:00.492521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547dc79-72ee-4204-b62b-9ea1feaf00f8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:00.505009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:00.505661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:00.505936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:00.506210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:00.508624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:00.513438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:00.536923 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2167/4304] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:00.540268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0e127-33f8-48f1-9e87-a74167b846bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:00.541844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e127-33f8-48f1-9e87-a74167b846bf service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:00.543477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e127-33f8-48f1-9e87-a74167b846bf service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:00.543943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:00.544177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0e127-33f8-48f1-9e87-a74167b846bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:00.550523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-58d0e127-33f8-48f1-9e87-a74167b846bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:00.566089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9431b-a85c-4ee1-b296-9508879dec9c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:00.580575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:00.581694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:00.582555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:00.582555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] PATH_INFO: `/v3/projects/fc4aec54b8e64552972b915826bc7eba/users/de35eef08935474a8dc6e980cbd07b51/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:00.592631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e127-33f8-48f1-9e87-a74167b846bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:00.599980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0e127-33f8-48f1-9e87-a74167b846bf service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:00.627858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4aec54b8e64552972b915826bc7eba, user_id=de35eef08935474a8dc6e980cbd07b51, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:00.632768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:00.642667 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2138/4305] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:16:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:00.662198 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2168/4306] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:00 2022] PUT /identity/v3/projects/fc4aec54b8e64552972b915826bc7eba/users/de35eef08935474a8dc6e980cbd07b51/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:00.672238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:00.672547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:00.672827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:00.741349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] MFA Rules not processed for user `de35eef08935474a8dc6e980cbd07b51`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:00.743993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:00.913781 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2139/4307] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:00.926115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:00.927847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:01.046995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c502bc-a14e-4d32-8bbf-99d3902222d8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:01.052476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5f5eb-dcf8-4cbd-8ec8-15da478ed826 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:01.053196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5f5eb-dcf8-4cbd-8ec8-15da478ed826 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:01.053527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5f5eb-dcf8-4cbd-8ec8-15da478ed826 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:01.053858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5f5eb-dcf8-4cbd-8ec8-15da478ed826 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:01.063990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5f5eb-dcf8-4cbd-8ec8-15da478ed826 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:01.065681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5f5eb-dcf8-4cbd-8ec8-15da478ed826 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:01.077471 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2169/4308] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:01.658246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:01.659804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:01.715753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:01.778212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bdcd0-b0df-48c0-b682-71502bc5a751 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:01.784506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:01.785290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:01.785823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:01.787584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:01.793178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:01.818821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:01.821164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:01.858652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2140/4309] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:03.687326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b12b4-467e-4b2e-b989-8b1c8653eeb2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:03.688154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b12b4-467e-4b2e-b989-8b1c8653eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:03.688601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b12b4-467e-4b2e-b989-8b1c8653eeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:03.766766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-053b12b4-467e-4b2e-b989-8b1c8653eeb2 None None] MFA Rules not processed for user `17bce7b531bd49b5a54a2e7eab57834f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:03.771561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-053b12b4-467e-4b2e-b989-8b1c8653eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:03.796949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:03.963053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:03.965226 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2170/4310] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:03.966604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:04.253517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de52f-7c96-4866-a0c9-31e96ba4c8bb service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:04.271611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:04.273948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:04.275939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:04.278645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:04.279507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:04.289157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:04.369519 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2141/4311] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:03 2022] POST /identity/v3/projects => generated 405 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:17:04.371603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b12b4-467e-4b2e-b989-8b1c8653eeb2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:04.395998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b12b4-467e-4b2e-b989-8b1c8653eeb2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:04.595174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:04.596336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:04.598246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:04.598825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:04.601259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:04.606385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:04.659241 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2171/4312] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:04 2022] POST /identity/v3/users => generated 303 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:04.660698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:04.680679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104564-18f7-4a7a-99c9-ebd4a81e7c3f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:04.699088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:04.701129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:04.706190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:04.706503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:04.707319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:04.711448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:04.768654 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2142/4313] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:04.770376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:04.790463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e74ca-7bef-4d53-b52e-c2aacd83e231 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:04.805716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:04.808716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:04.810910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:04.812083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:04.816545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:04.830481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:04.871626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2172/4314] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:04.873474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:04.892105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cf220-5578-4a5f-85b0-c357113542e9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:04.911689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4012ab8-d8df-48a1-a87d-e6ab2d9c082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:04.913732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4012ab8-d8df-48a1-a87d-e6ab2d9c082e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:04.918832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4012ab8-d8df-48a1-a87d-e6ab2d9c082e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:04.919163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4012ab8-d8df-48a1-a87d-e6ab2d9c082e admin admin] PATH_INFO: `/v3/projects/a23826e63b5c48f2ac201e0929ab5e5b/users/3755bd71d3cb4e2582ef9ef2f54545a9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:04.981618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4012ab8-d8df-48a1-a87d-e6ab2d9c082e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23826e63b5c48f2ac201e0929ab5e5b, user_id=3755bd71d3cb4e2582ef9ef2f54545a9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:04.985751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4012ab8-d8df-48a1-a87d-e6ab2d9c082e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:05.021250 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2143/4315] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:04 2022] PUT /identity/v3/projects/a23826e63b5c48f2ac201e0929ab5e5b/users/3755bd71d3cb4e2582ef9ef2f54545a9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:08.360660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:08.381219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e58c98-6742-40b4-acfb-65219f492121 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:08.574523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:08.580561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:08.581387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:08.581861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] PATH_INFO: `/v3/users/de35eef08935474a8dc6e980cbd07b51` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:08.583483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de35eef08935474a8dc6e980cbd07b51)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:08.589400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:08.720681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:08.761617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de35eef08935474a8dc6e980cbd07b51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:08.762311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de35eef08935474a8dc6e980cbd07b51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:08.785326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de35eef08935474a8dc6e980cbd07b51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:08.786532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de35eef08935474a8dc6e980cbd07b51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:08.795757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de35eef08935474a8dc6e980cbd07b51'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:08.816952 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2173/4316] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:17:08 2022] DELETE /identity/v3/users/de35eef08935474a8dc6e980cbd07b51 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:08.822807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:08.823891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:08.824546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:08.853601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:08.854822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:08.943119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2144/4317] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:17:08.997578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:08.999149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:09.227343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979592f-4b56-43c6-a3a2-6786b65807b6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:09.247840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dac07-a022-4748-9132-19943da20ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:09.248530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dac07-a022-4748-9132-19943da20ace service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:09.248811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dac07-a022-4748-9132-19943da20ace service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:09.249239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dac07-a022-4748-9132-19943da20ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:09.305369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dac07-a022-4748-9132-19943da20ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:09.310970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dac07-a022-4748-9132-19943da20ace service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:09.352605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2174/4318] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:11.602622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:11.609567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:11.638315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a5e1-f7d4-4b43-9c2d-7b8a2685ef3e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:11.662501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:11.664147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:11.667024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:11.667687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] PATH_INFO: `/v3/projects/fc4aec54b8e64552972b915826bc7eba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:11.670834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4aec54b8e64552972b915826bc7eba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:11.676684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:11.715291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:11.799382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4aec54b8e64552972b915826bc7eba', 'request_id': 'req-d794eb7e-ec99-4899-879e-f557a22deadc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:11.822347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4aec54b8e64552972b915826bc7eba', 'request_id': 'req-d794eb7e-ec99-4899-879e-f557a22deadc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:11.841530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4aec54b8e64552972b915826bc7eba', 'request_id': 'req-d794eb7e-ec99-4899-879e-f557a22deadc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:11.870297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] The token cache is being invalidate because project fc4aec54b8e64552972b915826bc7eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:17:11.870610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:11.873273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d794eb7e-ec99-4899-879e-f557a22deadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:11.877858 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2145/4319] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:17:11 2022] DELETE /identity/v3/projects/fc4aec54b8e64552972b915826bc7eba => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:11.883233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9babfe1-447e-4e29-8847-14f97fc64c80 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:11.884153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9babfe1-447e-4e29-8847-14f97fc64c80 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:11.884595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9babfe1-447e-4e29-8847-14f97fc64c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:11.938144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d9babfe1-447e-4e29-8847-14f97fc64c80 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:11.939600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d9babfe1-447e-4e29-8847-14f97fc64c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:12.089055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2175/4320] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:12.096769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd1c4-7522-4657-a426-e5eec14da735 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.097193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd1c4-7522-4657-a426-e5eec14da735 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.097545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd1c4-7522-4657-a426-e5eec14da735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.121086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-498cd1c4-7522-4657-a426-e5eec14da735 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:12.122888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-498cd1c4-7522-4657-a426-e5eec14da735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:12.132878 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2146/4321] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:12.138255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9babfe1-447e-4e29-8847-14f97fc64c80 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:12.152612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9babfe1-447e-4e29-8847-14f97fc64c80 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:12.160567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:12.161419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.161822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.162459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.163105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:17:12.163610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:12.169342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:12.190280 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2176/4322] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:17:12.193198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cd1c4-7522-4657-a426-e5eec14da735 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:12.210177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cd1c4-7522-4657-a426-e5eec14da735 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:12.217708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:12.219068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.219553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.220001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.222091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:12.224444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:12.271583 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2147/4323] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:12 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:12.271873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:12.283217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847858f-88fe-43ed-b560-819d1202d3b3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:12.338505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:12.373019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:12.373644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.384386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.384386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.384386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:12.385224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:12.443536 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2177/4324] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:12 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:17:12.447564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:12.464211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91c541-e44b-45ed-8d25-c05db9ab8dcf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:12.477558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:12.478168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.479810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.480260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.482215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:12.484162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:12.497417 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2148/4325] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:12.501717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:12.513607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42f688-e317-4990-976e-50469b378223 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:12.518658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b58288-b87d-478e-8af7-0665095f766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:12.519340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b58288-b87d-478e-8af7-0665095f766c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.519778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b58288-b87d-478e-8af7-0665095f766c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.520063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b58288-b87d-478e-8af7-0665095f766c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.520813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b58288-b87d-478e-8af7-0665095f766c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:12.522720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b58288-b87d-478e-8af7-0665095f766c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:12.534841 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2178/4326] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:12.539634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:12.550886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bcc782-34e2-4b48-9d8e-7f3050e032ce admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:12.556752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:12.558114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.558447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.558824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] PATH_INFO: `/v3/projects/a41092816c6b441fb67de74cdad1a54f/users/3a1ed7ee7f5d4673a19a26073b505bbb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.579862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41092816c6b441fb67de74cdad1a54f, user_id=3a1ed7ee7f5d4673a19a26073b505bbb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:12.583240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:12.608452 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2149/4327] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:12 2022] PUT /identity/v3/projects/a41092816c6b441fb67de74cdad1a54f/users/3a1ed7ee7f5d4673a19a26073b505bbb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:17:12.620418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:12.620710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:12.620993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:12.666548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] MFA Rules not processed for user `3a1ed7ee7f5d4673a19a26073b505bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:12.668383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:12.849638 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2179/4328] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:12.856979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:12.861115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:13.020363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15afc-8905-46a0-b8ad-f9018f12c184 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:13.039149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:13.039785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:13.040172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:13.040554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:13.053991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:13.055849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:13.092037 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2150/4329] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:19.531991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:19.532481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:19.732389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce81130-04b9-4f12-8d09-ed8279efdedf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:19.749342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5f2be-6263-4867-96f7-aa32c6a13f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:19.752387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5f2be-6263-4867-96f7-aa32c6a13f0a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:19.752673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5f2be-6263-4867-96f7-aa32c6a13f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:19.752950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5f2be-6263-4867-96f7-aa32c6a13f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:19.763450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-94e5f2be-6263-4867-96f7-aa32c6a13f0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:20.071461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:20.074590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5f2be-6263-4867-96f7-aa32c6a13f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:20.076615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5f2be-6263-4867-96f7-aa32c6a13f0a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:20.099705 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2180/4330] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:20.930280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:20.953467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38589147-8a41-4d4a-8ccf-94479bd52e27 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:20.960308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:20.961537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:20.964139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:20.964616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] PATH_INFO: `/v3/users/3a1ed7ee7f5d4673a19a26073b505bbb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:20.966769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1ed7ee7f5d4673a19a26073b505bbb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:20.968994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:21.043651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:21.085097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1ed7ee7f5d4673a19a26073b505bbb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:21.089164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1ed7ee7f5d4673a19a26073b505bbb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:21.126968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1ed7ee7f5d4673a19a26073b505bbb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:21.129478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1ed7ee7f5d4673a19a26073b505bbb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:21.140495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1ed7ee7f5d4673a19a26073b505bbb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:21.172148 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2151/4331] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:17:20 2022] DELETE /identity/v3/users/3a1ed7ee7f5d4673a19a26073b505bbb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:21.176494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b145-a412-4200-9bc9-44581410d202 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:21.178001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b145-a412-4200-9bc9-44581410d202 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:21.178450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513b145-a412-4200-9bc9-44581410d202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:21.210803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8513b145-a412-4200-9bc9-44581410d202 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:21.212145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8513b145-a412-4200-9bc9-44581410d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:21.343514 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2181/4332] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:21.396765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:21.398934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:21.536323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a3701-21dc-4ecb-b261-83352437f2af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:21.540556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:21.541348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:21.541878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:21.542170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:21.554461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:21.555941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:21.581898 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2152/4333] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:17:21.596973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1199692-a746-4c7c-a6a1-8cb731e23076 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:21.603896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1199692-a746-4c7c-a6a1-8cb731e23076 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:21.604551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1199692-a746-4c7c-a6a1-8cb731e23076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:21.656123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b1199692-a746-4c7c-a6a1-8cb731e23076 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:21.657473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b1199692-a746-4c7c-a6a1-8cb731e23076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:21.782610 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2182/4334] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:21.808983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:21.814020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:21.972485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4d6d-0dfb-478c-9cf6-60cf1555bdd8 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:21.979069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:21.979918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:21.980463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:21.980840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:22.001920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:22.005476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:22.034416 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2153/4335] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:17:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:17:23.882321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:23.883610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:23.884054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:23.963654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] MFA Rules not processed for user `7a41eb42094f418685b83cc0a57852d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:23.965186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:24.095014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2183/4336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:24.419071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:24.421237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:24.534239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:24.605402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c9abf-018f-4ee5-a865-960cfee7fdaa service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:24.621755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f59f51-4564-436d-a7f0-a9ffc7d84b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:24.623322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59f51-4564-436d-a7f0-a9ffc7d84b41 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:24.624304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59f51-4564-436d-a7f0-a9ffc7d84b41 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:24.624849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59f51-4564-436d-a7f0-a9ffc7d84b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:24.653413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f59f51-4564-436d-a7f0-a9ffc7d84b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:24.655921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f59f51-4564-436d-a7f0-a9ffc7d84b41 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:24.696858 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2154/4337] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:26.066520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:26.068198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:26.098321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe6b1-889b-4006-8a9a-fa78101a6cee None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:26.121868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:26.122777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:26.123054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:26.126956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] PATH_INFO: `/v3/projects/a41092816c6b441fb67de74cdad1a54f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:26.136339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41092816c6b441fb67de74cdad1a54f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:26.140107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:26.327266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:26.435071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41092816c6b441fb67de74cdad1a54f', 'request_id': 'req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:26.454798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41092816c6b441fb67de74cdad1a54f', 'request_id': 'req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:26.472956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41092816c6b441fb67de74cdad1a54f', 'request_id': 'req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:26.491558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] The token cache is being invalidate because project a41092816c6b441fb67de74cdad1a54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:17:26.491987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:26.493540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca9c9823-bb87-4bca-90c4-fe0c36e2a511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:26.497332 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2184/4338] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:17:26 2022] DELETE /identity/v3/projects/a41092816c6b441fb67de74cdad1a54f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:26.503343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb205-5be5-4115-8daf-71af069a2348 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:26.506497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb205-5be5-4115-8daf-71af069a2348 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:26.506835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb205-5be5-4115-8daf-71af069a2348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:26.578892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-760bb205-5be5-4115-8daf-71af069a2348 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:26.583603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-760bb205-5be5-4115-8daf-71af069a2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:26.839160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2155/4339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:26.847195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe3c7-f5b2-47b4-9378-2b3f306594b3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:26.847464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe3c7-f5b2-47b4-9378-2b3f306594b3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:26.847746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffe3c7-f5b2-47b4-9378-2b3f306594b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:26.896977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5fffe3c7-f5b2-47b4-9378-2b3f306594b3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:26.903785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5fffe3c7-f5b2-47b4-9378-2b3f306594b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:26.939364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2185/4340] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:26.944406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb205-5be5-4115-8daf-71af069a2348 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:26.958952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb205-5be5-4115-8daf-71af069a2348 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:26.982982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:26.983685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:26.983969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:26.984242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:26.985409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:17:26.987298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:26.989218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:27.041580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2156/4341] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:17:27.045947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffe3c7-f5b2-47b4-9378-2b3f306594b3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:27.058009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffe3c7-f5b2-47b4-9378-2b3f306594b3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:27.069767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:27.071115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:27.071565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:27.071994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:27.072887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:27.076537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:27.123400 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2186/4342] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:27 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:27.127684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:27.142846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ff9ad-0733-4b25-b85e-7943762f3807 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:27.266023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:27.267159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:27.267605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:27.268186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:27.269182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:27.271614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:27.310536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2157/4343] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:27 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:17:27.312158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:27.337172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636a023-1b2b-4bdb-b6c7-edd05011ba76 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:27.370485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:27.371281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:27.376735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:27.380119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:27.386106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:27.393252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:27.461613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:27.463014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2187/4344] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:27.478735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2f78b-15d7-4aaf-90e2-b4a7fea7d219 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:27.488157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a42f1-b348-4da8-aa20-56cf11b8f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:27.489108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a42f1-b348-4da8-aa20-56cf11b8f7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:27.489642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a42f1-b348-4da8-aa20-56cf11b8f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:27.495364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a42f1-b348-4da8-aa20-56cf11b8f7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:27.497811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a42f1-b348-4da8-aa20-56cf11b8f7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:27.501703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a42f1-b348-4da8-aa20-56cf11b8f7b5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:27.536907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:27.537938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2158/4345] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:27.560554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6976da-536b-427e-b2fa-83b131827c56 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:27.583501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:27.590341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:27.590855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:27.591299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] PATH_INFO: `/v3/projects/3b58cb4c698443589ba9e0f6444a125e/users/7a2c9649eee14666bfcbeea55e2fd98d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:27.643387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b58cb4c698443589ba9e0f6444a125e, user_id=7a2c9649eee14666bfcbeea55e2fd98d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:27.646842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:27.684712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2188/4346] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:27 2022] PUT /identity/v3/projects/3b58cb4c698443589ba9e0f6444a125e/users/7a2c9649eee14666bfcbeea55e2fd98d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:27.697482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6ec0a-f15b-4808-b190-51196c95b190 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:27.698138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6ec0a-f15b-4808-b190-51196c95b190 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:27.699274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6ec0a-f15b-4808-b190-51196c95b190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:27.807467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ade6ec0a-f15b-4808-b190-51196c95b190 None None] MFA Rules not processed for user `7a2c9649eee14666bfcbeea55e2fd98d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:27.807467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ade6ec0a-f15b-4808-b190-51196c95b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:27.888797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:27.970072 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2159/4347] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:17:27.977243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:28.185730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b070be-0e40-44eb-9484-f4735174da79 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:28.194459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:28.196427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:28.197221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:28.197702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:28.198744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:28.201273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:28.255190 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2189/4348] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:27 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:28.258273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6ec0a-f15b-4808-b190-51196c95b190 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:28.282628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6ec0a-f15b-4808-b190-51196c95b190 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:28.420303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:28.420940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:28.422400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:28.422693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:28.423417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:28.431120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:28.479837 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2160/4349] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:28 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:28.484619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:28.503715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a40d6f-2e2e-4815-8ee9-926b9628199a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:28.519685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:28.525578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:28.527787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:28.529156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:28.532345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:28.536863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:28.571128 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2190/4350] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:28.575655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:28.595987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516543d-5bd5-41de-a81a-9761fb316149 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:28.611747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:28.613242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:28.613728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:28.614287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] PATH_INFO: `/v3/projects/d55d320879d64659ad2e5c95e2213f38/users/3849a86674e74a4a9b55a4c4406f8d5c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:28.654460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55d320879d64659ad2e5c95e2213f38, user_id=3849a86674e74a4a9b55a4c4406f8d5c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:28.660339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:28.689844 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2161/4351] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:28 2022] PUT /identity/v3/projects/d55d320879d64659ad2e5c95e2213f38/users/3849a86674e74a4a9b55a4c4406f8d5c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:28.697700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:28.731675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc490d-6255-4a31-a561-1dd62bd82c2c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:28.840179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:28.957137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97cd54-0b5f-47d1-867d-e5187530af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:28.958324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97cd54-0b5f-47d1-867d-e5187530af24 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:28.958822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97cd54-0b5f-47d1-867d-e5187530af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:28.959356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97cd54-0b5f-47d1-867d-e5187530af24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:28.960349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97cd54-0b5f-47d1-867d-e5187530af24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:28.968526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97cd54-0b5f-47d1-867d-e5187530af24 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:28.992291 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2191/4352] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:28.996718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:29.014863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba313-117d-4515-b0b1-df353c4ba037 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:29.023099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:29.024411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:29.024950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:29.025500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] PATH_INFO: `/v3/projects/d55d320879d64659ad2e5c95e2213f38/users/3849a86674e74a4a9b55a4c4406f8d5c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:29.032649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55d320879d64659ad2e5c95e2213f38, user_id=3849a86674e74a4a9b55a4c4406f8d5c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:29.035475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:29.069481 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2162/4353] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:28 2022] PUT /identity/v3/projects/d55d320879d64659ad2e5c95e2213f38/users/3849a86674e74a4a9b55a4c4406f8d5c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:17:29.071368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17298-b4d3-45be-bb73-76d33bd5da2e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:29.071662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17298-b4d3-45be-bb73-76d33bd5da2e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:29.071942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17298-b4d3-45be-bb73-76d33bd5da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:29.161735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cca17298-b4d3-45be-bb73-76d33bd5da2e None None] MFA Rules not processed for user `3849a86674e74a4a9b55a4c4406f8d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:29.163294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cca17298-b4d3-45be-bb73-76d33bd5da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:29.345165 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2192/4354] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:29.357199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:29.359027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:29.644213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0bda6-b1b2-456a-b1f7-f56d7c7d64a3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:29.644871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0bda6-b1b2-456a-b1f7-f56d7c7d64a3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:29.645568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0bda6-b1b2-456a-b1f7-f56d7c7d64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:29.720357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ce50-0211-4cbd-a086-7912efed0f0c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:29.729402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ffb0bda6-b1b2-456a-b1f7-f56d7c7d64a3 None None] MFA Rules not processed for user `3755bd71d3cb4e2582ef9ef2f54545a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:29.734541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffb0bda6-b1b2-456a-b1f7-f56d7c7d64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:29.750071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a76a-aa50-40e2-a15e-584364706301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:29.751241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a76a-aa50-40e2-a15e-584364706301 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:29.754692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a76a-aa50-40e2-a15e-584364706301 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:29.755270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a76a-aa50-40e2-a15e-584364706301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:29.919777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:29.991922 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2193/4355] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:29.994312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:29.994605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:29.994887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:30.029222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a76a-aa50-40e2-a15e-584364706301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:30.031447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a76a-aa50-40e2-a15e-584364706301 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:30.058624 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2163/4356] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:30.060225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:30.063660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:30.064586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:30.087465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] MFA Rules not processed for user `7a41eb42094f418685b83cc0a57852d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:30.088140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:30.126722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] MFA Rules not processed for user `17bce7b531bd49b5a54a2e7eab57834f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:30.131485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:30.272859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:30.439268 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2194/4357] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:30.474438 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2164/4358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:31.466284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:31.467872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:31.640551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4436-0f4c-4e81-9bfe-de09d4b6fab9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:31.653967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:31.654922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:31.655415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:31.655913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:31.661555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:31.680508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:31.682747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:31.706234 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2195/4359] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:32.658731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:32.660441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:32.969367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158d401-f67a-4936-89ec-118d5261abf7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:32.987193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be620147-bee0-4224-a196-65845b9e4c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:32.991943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620147-bee0-4224-a196-65845b9e4c71 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:32.997450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620147-bee0-4224-a196-65845b9e4c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:33.001439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620147-bee0-4224-a196-65845b9e4c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:33.010395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-be620147-bee0-4224-a196-65845b9e4c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:33.082120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be620147-bee0-4224-a196-65845b9e4c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:33.084113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be620147-bee0-4224-a196-65845b9e4c71 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:33.128829 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2165/4360] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:33.260110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:33.423177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270a5f-c2d1-4050-b3c6-b4618d909742 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:33.429602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:33.430920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:33.432899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:33.434025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] PATH_INFO: `/v3/users/7a2c9649eee14666bfcbeea55e2fd98d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:33.435726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2c9649eee14666bfcbeea55e2fd98d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:33.438434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:33.542510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2c9649eee14666bfcbeea55e2fd98d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:33.543416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2c9649eee14666bfcbeea55e2fd98d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:33.576139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2c9649eee14666bfcbeea55e2fd98d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:33.577017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2c9649eee14666bfcbeea55e2fd98d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:33.579539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:33.591972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2c9649eee14666bfcbeea55e2fd98d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:33.625164 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2196/4361] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:17:33 2022] DELETE /identity/v3/users/7a2c9649eee14666bfcbeea55e2fd98d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:33.627022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:33.627315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:33.627660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:33.703029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:33.715873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:34.064910 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2166/4362] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:34.087894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:34.090604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:34.295021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3538700-31e8-4e87-8bab-2baad4dc3d83 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:34.300555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:34.301834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:34.302289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:34.302809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:34.330023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:34.331118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:34.344226 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2197/4363] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:37.609006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:37.610852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:37.635565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f90bc-9ef2-4cd8-819b-f1189c3f1db1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:37.645519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:37.646608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:37.647097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:37.647618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] PATH_INFO: `/v3/projects/3b58cb4c698443589ba9e0f6444a125e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:37.649496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b58cb4c698443589ba9e0f6444a125e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:37.668300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:37.704363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:37.804303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b58cb4c698443589ba9e0f6444a125e', 'request_id': 'req-9830b050-98b5-4638-9e7a-f8073009ec9c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:37.838647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b58cb4c698443589ba9e0f6444a125e', 'request_id': 'req-9830b050-98b5-4638-9e7a-f8073009ec9c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:37.871119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b58cb4c698443589ba9e0f6444a125e', 'request_id': 'req-9830b050-98b5-4638-9e7a-f8073009ec9c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:37.887579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] The token cache is being invalidate because project 3b58cb4c698443589ba9e0f6444a125e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:17:37.888568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:37.889702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:37.891888 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2167/4364] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:17:37 2022] DELETE /identity/v3/projects/3b58cb4c698443589ba9e0f6444a125e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:37.896004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:37.908808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904e5b-1270-498b-83d2-80931ab2889a service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:38.384073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:38.384991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:38.401628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:38.401966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] PATH_INFO: `/v3/users/3849a86674e74a4a9b55a4c4406f8d5c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:38.403443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3849a86674e74a4a9b55a4c4406f8d5c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:38.405634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:38.546795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3849a86674e74a4a9b55a4c4406f8d5c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:38.548112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3849a86674e74a4a9b55a4c4406f8d5c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:38.567683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3849a86674e74a4a9b55a4c4406f8d5c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:38.569101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3849a86674e74a4a9b55a4c4406f8d5c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:38.579517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfe04951-374e-4da6-bec9-eac965d1fe18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3849a86674e74a4a9b55a4c4406f8d5c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:38.632658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2198/4365] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:17:37 2022] DELETE /identity/v3/users/3849a86674e74a4a9b55a4c4406f8d5c => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:39.388705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:39.390350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:39.435666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830b050-98b5-4638-9e7a-f8073009ec9c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:39.597352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:39.598604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:39.603831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:39.604332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] PATH_INFO: `/v3/projects/d55d320879d64659ad2e5c95e2213f38` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:39.607536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55d320879d64659ad2e5c95e2213f38)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:39.609950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:39.691474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55d320879d64659ad2e5c95e2213f38', 'request_id': 'req-442ec8b3-4506-4071-976c-e810136ccc06'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:39.706873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55d320879d64659ad2e5c95e2213f38', 'request_id': 'req-442ec8b3-4506-4071-976c-e810136ccc06'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:39.722897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55d320879d64659ad2e5c95e2213f38', 'request_id': 'req-442ec8b3-4506-4071-976c-e810136ccc06'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:39.747871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] The token cache is being invalidate because project d55d320879d64659ad2e5c95e2213f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:17:39.748140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:39.748835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-442ec8b3-4506-4071-976c-e810136ccc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:39.752885 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2168/4366] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:17:39 2022] DELETE /identity/v3/projects/d55d320879d64659ad2e5c95e2213f38 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:39.758982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c49bd-eabb-4e57-814a-4c865ada376b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:39.759585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c49bd-eabb-4e57-814a-4c865ada376b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:39.760842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c49bd-eabb-4e57-814a-4c865ada376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:39.777824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:39.800148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9a8c49bd-eabb-4e57-814a-4c865ada376b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:39.802721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9a8c49bd-eabb-4e57-814a-4c865ada376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:39.920494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2199/4367] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:39.931363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202ae6-c0f5-4e97-93f7-89db6c6982aa None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:39.931765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202ae6-c0f5-4e97-93f7-89db6c6982aa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:39.932093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202ae6-c0f5-4e97-93f7-89db6c6982aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:39.991848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5a202ae6-c0f5-4e97-93f7-89db6c6982aa None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:39.993478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5a202ae6-c0f5-4e97-93f7-89db6c6982aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:40.017436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2169/4368] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:40.035809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c49bd-eabb-4e57-814a-4c865ada376b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:40.058231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c49bd-eabb-4e57-814a-4c865ada376b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:40.071267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:40.073913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:40.074208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:40.074490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:40.076676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:17:40.077320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:40.085341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:40.120457 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2200/4369] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:17:40.124874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a202ae6-c0f5-4e97-93f7-89db6c6982aa None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:40.144684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a202ae6-c0f5-4e97-93f7-89db6c6982aa None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:40.150937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:40.151756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:40.152140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:40.152528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:40.154362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:40.156578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:40.199738 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2170/4370] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:40 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:40.204638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:40.220701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9031c0-f091-4469-8045-35edbf4a02d4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:40.345192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:40.345894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:40.346321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:40.346606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:40.347309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:40.350705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:40.400760 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2201/4371] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:40 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:40.402717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:40.415979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:40.424471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97249bd-1c1a-47a9-bb43-a780d207e24b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:40.445651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:40.446818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:40.447414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:40.451194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:40.452224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:40.454993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:40.498658 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2171/4372] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:40.500619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:40.515410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369669f6-687e-4cf0-ba0a-733a185e14b6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:40.529924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6280a8-d8b6-48de-bbab-87397e0c5bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:40.531536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6280a8-d8b6-48de-bbab-87397e0c5bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:40.532066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6280a8-d8b6-48de-bbab-87397e0c5bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:40.532568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6280a8-d8b6-48de-bbab-87397e0c5bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:40.536763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6280a8-d8b6-48de-bbab-87397e0c5bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:40.540505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6280a8-d8b6-48de-bbab-87397e0c5bb1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:40.576540 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2202/4373] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:40.581155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:40.624743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d184e1-56ee-4bc9-bdc3-12869835c275 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:40.649844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:40.650795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:40.651080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:40.651362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] PATH_INFO: `/v3/projects/99b9d140d26640cca3a442c2b17e0712/users/16c9d7373adb43d6b452cf4f8d007637/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:40.699488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b9d140d26640cca3a442c2b17e0712, user_id=16c9d7373adb43d6b452cf4f8d007637, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:40.702626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:40.747010 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2172/4374] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:40 2022] PUT /identity/v3/projects/99b9d140d26640cca3a442c2b17e0712/users/16c9d7373adb43d6b452cf4f8d007637/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:40.753764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:40.756771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:40.757326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:40.858085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] MFA Rules not processed for user `16c9d7373adb43d6b452cf4f8d007637`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:40.860024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:40.985144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2203/4375] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:40.997166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:40.999619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:41.183062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59af180-5458-4add-aca5-49ce55911e56 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:41.190348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:41.191041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:41.195859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:41.196254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:41.217003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:41.218508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:41.259584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2173/4376] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:42.986536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:42.989702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:43.007038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:43.107601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bfb2e-c49d-47a9-8b2a-c680b054fced None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:43.112838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:43.114118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:43.114685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:43.115411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] PATH_INFO: `/v3/users/65fa96c0dcf948d185e7d5fdcf280fa4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:43.117071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fa96c0dcf948d185e7d5fdcf280fa4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:43.120194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:43.203846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fa96c0dcf948d185e7d5fdcf280fa4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:43.205195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fa96c0dcf948d185e7d5fdcf280fa4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:43.223361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fa96c0dcf948d185e7d5fdcf280fa4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:43.224977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fa96c0dcf948d185e7d5fdcf280fa4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:43.237138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9a6d064a-c7b8-439a-b84c-f9a09657ff2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fa96c0dcf948d185e7d5fdcf280fa4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:43.286712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2204/4377] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:17:42 2022] DELETE /identity/v3/users/65fa96c0dcf948d185e7d5fdcf280fa4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:44.734157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:44.753282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970b28-6152-4589-99cf-568d9f5a4ee6 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:44.957373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:44.959612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:44.961675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:44.963583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] PATH_INFO: `/v3/projects/a9a765e6391f4d36bd54b8119d4c84eb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:44.971702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a765e6391f4d36bd54b8119d4c84eb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:44.975731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:45.074377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a765e6391f4d36bd54b8119d4c84eb', 'request_id': 'req-f69df41a-9c65-4c8d-aa84-f167693a87c6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:45.090195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a765e6391f4d36bd54b8119d4c84eb', 'request_id': 'req-f69df41a-9c65-4c8d-aa84-f167693a87c6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:45.117364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a765e6391f4d36bd54b8119d4c84eb', 'request_id': 'req-f69df41a-9c65-4c8d-aa84-f167693a87c6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:45.143456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] The token cache is being invalidate because project a9a765e6391f4d36bd54b8119d4c84eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:17:45.144524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:45.149003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69df41a-9c65-4c8d-aa84-f167693a87c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:45.153322 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2174/4378] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:17:44 2022] DELETE /identity/v3/projects/a9a765e6391f4d36bd54b8119d4c84eb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:45.158121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acf06-4779-49f0-a84b-a7e82946db86 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:45.158622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acf06-4779-49f0-a84b-a7e82946db86 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:45.158748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248acf06-4779-49f0-a84b-a7e82946db86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:45.184244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-248acf06-4779-49f0-a84b-a7e82946db86 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:45.185607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-248acf06-4779-49f0-a84b-a7e82946db86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:45.299759 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2205/4379] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:45.301827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1261dd-a345-4474-8cbf-19e9298d4a13 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:45.302110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1261dd-a345-4474-8cbf-19e9298d4a13 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:45.302445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1261dd-a345-4474-8cbf-19e9298d4a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:45.316257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:45.351738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bd1261dd-a345-4474-8cbf-19e9298d4a13 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:45.353008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bd1261dd-a345-4474-8cbf-19e9298d4a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:45.367083 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2175/4380] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:45.372649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acf06-4779-49f0-a84b-a7e82946db86 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:45.393339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248acf06-4779-49f0-a84b-a7e82946db86 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:45.418228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:45.418941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:45.419228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:45.419514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:45.425908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:17:45.429017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:45.434983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:45.482134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1261dd-a345-4474-8cbf-19e9298d4a13 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:45.483129 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2206/4381] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:17:45.505173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1261dd-a345-4474-8cbf-19e9298d4a13 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:45.510944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:45.511741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:45.512230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:45.512571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:45.515287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:45.517506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:45.573495 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2176/4382] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:45 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:45.574132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:45.586115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e39a3c-3c6f-49be-9638-bb87a5dcb69b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:45.622425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:45.761773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:45.763076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:45.763463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:45.764034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:45.764843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:45.769672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:45.825610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:45.872019 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2207/4383] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:45 2022] POST /identity/v3/users => generated 283 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:17:45.925107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9504a9-74ad-42f5-9131-64367a7c2bd4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:45.961016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:45.961955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:45.962235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:45.962509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:45.963293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:45.967513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:46.012145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2177/4384] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:46.016250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:46.035270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b3ea8-0938-4bb6-86df-2ae3c84731ad admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:46.047398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93b750-2f17-4395-bec5-5e23bbc2c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:46.048299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b750-2f17-4395-bec5-5e23bbc2c4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:46.048645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b750-2f17-4395-bec5-5e23bbc2c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:46.052334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93b750-2f17-4395-bec5-5e23bbc2c4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:46.054136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b750-2f17-4395-bec5-5e23bbc2c4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:46.056436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93b750-2f17-4395-bec5-5e23bbc2c4d5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:46.075591 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2208/4385] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:46.081169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:46.097831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391def96-79b5-460d-b524-2520d0a609cb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:46.104587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a9d31-32b7-4f95-9786-bffa6bf89068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:46.105837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a9d31-32b7-4f95-9786-bffa6bf89068 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:46.106313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a9d31-32b7-4f95-9786-bffa6bf89068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:46.106686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a9d31-32b7-4f95-9786-bffa6bf89068 admin admin] PATH_INFO: `/v3/projects/28c54796fc944347a190465d4c0732a8/users/20c4f7872035427d9bfb6a6ecfb7a0da/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:46.127002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a9d31-32b7-4f95-9786-bffa6bf89068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c54796fc944347a190465d4c0732a8, user_id=20c4f7872035427d9bfb6a6ecfb7a0da, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:46.131803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a9d31-32b7-4f95-9786-bffa6bf89068 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:46.198359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:46.201104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:46.201792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:46.204858 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2178/4386] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:46 2022] PUT /identity/v3/projects/28c54796fc944347a190465d4c0732a8/users/20c4f7872035427d9bfb6a6ecfb7a0da/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:46.238707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:46.240693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:46.294523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:46.294920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:46.295328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:46.324007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] MFA Rules not processed for user `d5516d85f0ee482facf6a96e2709c41d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:46.325774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:46.332365 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2209/4387] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:46.342134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:46.344485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:46.414575 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2179/4388] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:46.449602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00e80c-30b3-4ec8-9fce-337188d29f75 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:46.473423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911f8f1-8929-4754-bf66-6278b19f76bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:46.474143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911f8f1-8929-4754-bf66-6278b19f76bf service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:46.474429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911f8f1-8929-4754-bf66-6278b19f76bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:46.475285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911f8f1-8929-4754-bf66-6278b19f76bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:46.500465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911f8f1-8929-4754-bf66-6278b19f76bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:46.502026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911f8f1-8929-4754-bf66-6278b19f76bf service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:46.539312 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2210/4389] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:51.613322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:51.616516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:51.654931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb94e64-164c-443c-b808-56a66e0505fc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:51.668710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:51.669974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:51.670463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:51.671491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:51.675707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:51.723700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:51.727723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:51.760247 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2180/4390] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:52.212989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:52.217049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:52.218444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:52.262833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:52.265194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:52.338240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:52.409049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:52.414709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:52.440375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf8424-13f8-4aaa-8540-0934c48a1300 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:52.457723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:52.458582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:52.458851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:52.462362 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2211/4391] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:17:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:52.462666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] PATH_INFO: `/v3/users/4c071daa57f24e9fa1ae5d173a99d2ca` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:52.464148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c071daa57f24e9fa1ae5d173a99d2ca)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:52.466167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:52.476739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:52.478230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:52.582354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c071daa57f24e9fa1ae5d173a99d2ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:52.585149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c071daa57f24e9fa1ae5d173a99d2ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:52.612315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c071daa57f24e9fa1ae5d173a99d2ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:52.613085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c071daa57f24e9fa1ae5d173a99d2ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:52.625627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a5600-ee83-41c6-b5b1-6450c004560c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:52.627795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c071daa57f24e9fa1ae5d173a99d2ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:52.632623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:52.633381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:52.633682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:52.633948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:52.637304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:52.657665 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2181/4392] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:17:52 2022] DELETE /identity/v3/users/4c071daa57f24e9fa1ae5d173a99d2ca => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:17:52.682567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:52.684837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:52.729096 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2212/4393] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:17:53.376744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:53.380083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:53.387165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:53.606257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa4cc-a607-4ab8-a971-e1d32cea73e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:53.624636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:53.626021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:53.626406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:53.626809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] PATH_INFO: `/v3/users/16c9d7373adb43d6b452cf4f8d007637` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:53.626974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:53.628558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:53.637801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c9d7373adb43d6b452cf4f8d007637)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:53.648389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:53.655357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725abe3-e343-4288-a0cd-2210f180ab7c service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:53.665760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:53.666663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:53.666949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:53.667226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] PATH_INFO: `/v3/projects/851177a639b248a0b4508112a9b6e6bf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:53.669005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851177a639b248a0b4508112a9b6e6bf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:53.670980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:53.765524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c9d7373adb43d6b452cf4f8d007637'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.766539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c9d7373adb43d6b452cf4f8d007637'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.791331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851177a639b248a0b4508112a9b6e6bf', 'request_id': 'req-34c210e3-9068-4a25-9426-105178b4d034'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.813846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c9d7373adb43d6b452cf4f8d007637'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.814886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851177a639b248a0b4508112a9b6e6bf', 'request_id': 'req-34c210e3-9068-4a25-9426-105178b4d034'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.815299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c9d7373adb43d6b452cf4f8d007637'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.834240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09df1c6a-9ee9-4f73-85d3-acf1592c8b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c9d7373adb43d6b452cf4f8d007637'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.835930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851177a639b248a0b4508112a9b6e6bf', 'request_id': 'req-34c210e3-9068-4a25-9426-105178b4d034'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.851262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] The token cache is being invalidate because project 851177a639b248a0b4508112a9b6e6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:17:53.851813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.854655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-34c210e3-9068-4a25-9426-105178b4d034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:53.858353 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2213/4394] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:17:53 2022] DELETE /identity/v3/projects/851177a639b248a0b4508112a9b6e6bf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:53.863270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b1c55-2d07-4fed-abfb-95dc191345dd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:53.863738 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2182/4395] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:17:53 2022] DELETE /identity/v3/users/16c9d7373adb43d6b452cf4f8d007637 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:53.867461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b1c55-2d07-4fed-abfb-95dc191345dd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:53.867754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b1c55-2d07-4fed-abfb-95dc191345dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:53.869856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:53.870482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:53.870962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:53.901553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:53.906565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:53.912216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7d0b1c55-2d07-4fed-abfb-95dc191345dd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:53.917951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7d0b1c55-2d07-4fed-abfb-95dc191345dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:54.134143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:54.146133 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2183/4396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:54.179087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.182141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:54.221975 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2214/4397] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:17:54.230919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126957e-d832-41ad-b651-0793d77a94c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.231385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126957e-d832-41ad-b651-0793d77a94c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.231763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126957e-d832-41ad-b651-0793d77a94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.245574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:54.291570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e126957e-d832-41ad-b651-0793d77a94c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:54.293537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e126957e-d832-41ad-b651-0793d77a94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:54.309071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2215/4398] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:54.313783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126957e-d832-41ad-b651-0793d77a94c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.319217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf5e36-c620-43c1-bc12-8f020e5c9a28 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.323830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.325176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.325700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.326000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126957e-d832-41ad-b651-0793d77a94c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.326434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.332503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.333668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.333956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.334234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.334978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:17:54.335286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.337098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.340388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.342963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.352628 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2216/4399] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:17:54.359699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2184/4400] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:17:54.366072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.383078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4fed-1127-4ea0-9143-273a17dffced admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.389652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.390580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.390872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.391156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.392160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.394828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.474173 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2217/4401] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:54 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:54.477048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.493352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0a7ce-d0cf-455d-912c-ea3c26ffc690 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.603522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.604595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.604877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.605598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.607048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.610315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.645535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2185/4402] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:54 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:54.649558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.663188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4abea3-cdb5-45a0-bd65-add187127cc7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.669833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.671470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.672315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.672795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.673883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.692744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.723647 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2218/4403] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:54.726795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.741404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70195289-12b3-494c-848d-2e44df7613bf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.758679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.759566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.760114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.760476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.761391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.763942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.779054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.781124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:54.793545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2186/4404] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:17:54.798195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:54.801002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96798ee-7e89-497e-b1ac-43fd2b92550c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.812813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3070-ee50-4fd4-a8ae-6d0e20b51f01 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:54.819746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc445911-8139-477b-b401-683f7250c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.821523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445911-8139-477b-b401-683f7250c4db admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.822137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445911-8139-477b-b401-683f7250c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.822435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445911-8139-477b-b401-683f7250c4db admin admin] PATH_INFO: `/v3/projects/b2a741fcf70249ecb8c3c727459c84c9/users/deabdfddc88b4db2bb61ae4da4b4808d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.827170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:54.828273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.831052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.831501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] PATH_INFO: `/v3/projects/99b9d140d26640cca3a442c2b17e0712` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.835150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b9d140d26640cca3a442c2b17e0712)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.839215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.843757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc445911-8139-477b-b401-683f7250c4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a741fcf70249ecb8c3c727459c84c9, user_id=deabdfddc88b4db2bb61ae4da4b4808d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:54.846660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc445911-8139-477b-b401-683f7250c4db admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:54.869136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2187/4405] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:54 2022] PUT /identity/v3/projects/b2a741fcf70249ecb8c3c727459c84c9/users/deabdfddc88b4db2bb61ae4da4b4808d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:54.874270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.877320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.877851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:54.904690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:54.906401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:54.907248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b9d140d26640cca3a442c2b17e0712', 'request_id': 'req-ab327740-a0c0-4a02-9865-94ca2f62fa29'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:54.920513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b9d140d26640cca3a442c2b17e0712', 'request_id': 'req-ab327740-a0c0-4a02-9865-94ca2f62fa29'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:54.938928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b9d140d26640cca3a442c2b17e0712', 'request_id': 'req-ab327740-a0c0-4a02-9865-94ca2f62fa29'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:54.959566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] The token cache is being invalidate because project 99b9d140d26640cca3a442c2b17e0712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:17:54.960090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:54.960746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ab327740-a0c0-4a02-9865-94ca2f62fa29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:17:54.969443 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2219/4406] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:17:54 2022] DELETE /identity/v3/projects/99b9d140d26640cca3a442c2b17e0712 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:54.971011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf7633-9529-4c58-badf-80e6c153b9bb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:54.971302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf7633-9529-4c58-badf-80e6c153b9bb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:54.971579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf7633-9529-4c58-badf-80e6c153b9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.014919 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2188/4407] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:55.027644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.029164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:55.030160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-97cf7633-9529-4c58-badf-80e6c153b9bb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:55.035244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-97cf7633-9529-4c58-badf-80e6c153b9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:55.074449 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2220/4408] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:55.076587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0273da-bb43-4060-9a85-bb9bdc961bdd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.078246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0273da-bb43-4060-9a85-bb9bdc961bdd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.078641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0273da-bb43-4060-9a85-bb9bdc961bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.082059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:55.129601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bc0273da-bb43-4060-9a85-bb9bdc961bdd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:55.130990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bc0273da-bb43-4060-9a85-bb9bdc961bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:55.149703 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2221/4409] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:17:55.153779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0273da-bb43-4060-9a85-bb9bdc961bdd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.161376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1a29d-852f-401f-89f5-513615984c74 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.167842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.168521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.168802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.169512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.171630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0273da-bb43-4060-9a85-bb9bdc961bdd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.180867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.183371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.183549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.184032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.185125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:17:55.185736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.187749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.190422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.191426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.203655 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2189/4410] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:17:55.206302 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2222/4411] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:17:55.210662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.221372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15f50f-a449-436c-b23c-a44422dd307f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.228060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.228788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.229112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.229433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.230232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.232170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.273274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.281084 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2190/4412] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:17:55 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:17:55.286018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ded5-2253-4881-8a69-b1b4111e940e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.350062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:55.363743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.364597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.364884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.365367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.365960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.369242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.398836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.399296 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2223/4413] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:17:55 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:17:55.412141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1613d-477c-42a7-97d3-7266d0ad236f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.419983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.420276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.420626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.420771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.421570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.423559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.437239 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2191/4414] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:55.441379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.454534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154abe0-0040-411c-9f8a-3f06f5506ce6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.462981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af812a-88d4-471a-b2c9-0476bf3d0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.463630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af812a-88d4-471a-b2c9-0476bf3d0d7f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.463969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af812a-88d4-471a-b2c9-0476bf3d0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.464245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af812a-88d4-471a-b2c9-0476bf3d0d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.465262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af812a-88d4-471a-b2c9-0476bf3d0d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.466660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af812a-88d4-471a-b2c9-0476bf3d0d7f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.485456 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2224/4415] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:17:55.489458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.501280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feee0d7-f8c9-4051-a210-b678b1301ca3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.508449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb19a99-b8f1-46de-a795-8e2c5231ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.509494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb19a99-b8f1-46de-a795-8e2c5231ef85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.509830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb19a99-b8f1-46de-a795-8e2c5231ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.510091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb19a99-b8f1-46de-a795-8e2c5231ef85 admin admin] PATH_INFO: `/v3/projects/641fef3f3fb34ea2b3606b8b019b40ed/users/7b1e07ea16ab4ee18386f84b02a7d934/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.534973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb19a99-b8f1-46de-a795-8e2c5231ef85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641fef3f3fb34ea2b3606b8b019b40ed, user_id=7b1e07ea16ab4ee18386f84b02a7d934, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.538809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb19a99-b8f1-46de-a795-8e2c5231ef85 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.574698 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2192/4416] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:17:55 2022] PUT /identity/v3/projects/641fef3f3fb34ea2b3606b8b019b40ed/users/7b1e07ea16ab4ee18386f84b02a7d934/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:17:55.575600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.575880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.576160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.587872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.588503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.589104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.610789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:55.613579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:55.636552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] MFA Rules not processed for user `7b1e07ea16ab4ee18386f84b02a7d934`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:55.637677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:55.685410 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2193/4417] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:17:55.702046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.703851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:55.741698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2225/4418] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:17:55.757290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:55.759038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:55.803275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9fd62-aa64-47ee-8d83-4a74d1b55071 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.810860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcaf3f-37eb-46f6-8290-00a3da6efec3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.811544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcaf3f-37eb-46f6-8290-00a3da6efec3 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.812336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcaf3f-37eb-46f6-8290-00a3da6efec3 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.812623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcaf3f-37eb-46f6-8290-00a3da6efec3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.822857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcaf3f-37eb-46f6-8290-00a3da6efec3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.825144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcaf3f-37eb-46f6-8290-00a3da6efec3 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.831652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:55.837165 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2194/4419] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:17:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:17:55.877699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07357f1b-dab1-45d1-91ef-8af24288be7c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:55.881919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:55.882590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:55.882872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:55.883161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:55.892713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:55.894213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:55.916218 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2226/4420] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:17:56.408246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:56.408593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:56.408961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:56.430581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:17:56.432086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:17:56.457580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2195/4421] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:17:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:17:56.458163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:17:56.477110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fe9a-0979-4245-a59d-438cc49db958 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:17:56.494824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423713fb-bc86-4a8d-b507-6fdde505b2fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:17:56.495588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423713fb-bc86-4a8d-b507-6fdde505b2fc service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:17:56.495944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423713fb-bc86-4a8d-b507-6fdde505b2fc service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:17:56.496291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423713fb-bc86-4a8d-b507-6fdde505b2fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:17:56.532408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423713fb-bc86-4a8d-b507-6fdde505b2fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:17:56.534570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423713fb-bc86-4a8d-b507-6fdde505b2fc service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:17:56.545105 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2227/4422] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:17:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:02.231014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:02.232600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:02.464905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cf170-803e-4700-9026-5c2a629cc12f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:02.473160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645403f-0841-4fd1-bc49-802f4e1823fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:02.477294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645403f-0841-4fd1-bc49-802f4e1823fc service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:02.483234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645403f-0841-4fd1-bc49-802f4e1823fc service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:02.483379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645403f-0841-4fd1-bc49-802f4e1823fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:02.486166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1645403f-0841-4fd1-bc49-802f4e1823fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:02.623228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645403f-0841-4fd1-bc49-802f4e1823fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:02.629513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645403f-0841-4fd1-bc49-802f4e1823fc service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:02.666457 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2196/4423] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:02 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:04.560236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ad49b-22c3-40c2-964f-869c82ca1abe None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:04.561026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ad49b-22c3-40c2-964f-869c82ca1abe None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:04.561509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ad49b-22c3-40c2-964f-869c82ca1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:04.643254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d86ad49b-22c3-40c2-964f-869c82ca1abe None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:04.644973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d86ad49b-22c3-40c2-964f-869c82ca1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:04.696707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:04.809967 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2228/4424] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:04.827499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda701d9-c049-4b88-8759-f1a896e0aa16 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:04.828135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda701d9-c049-4b88-8759-f1a896e0aa16 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:04.828135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda701d9-c049-4b88-8759-f1a896e0aa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:04.878216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eda701d9-c049-4b88-8759-f1a896e0aa16 None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:04.880153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eda701d9-c049-4b88-8759-f1a896e0aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:04.899792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2197/4425] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:05.072643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ad49b-22c3-40c2-964f-869c82ca1abe None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:05.092670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ad49b-22c3-40c2-964f-869c82ca1abe None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:05.110305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c83a2-6dd8-4153-8ac3-42098458e009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:05.110968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83a2-6dd8-4153-8ac3-42098458e009 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:05.112381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83a2-6dd8-4153-8ac3-42098458e009 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:05.112381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83a2-6dd8-4153-8ac3-42098458e009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:05.126146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c83a2-6dd8-4153-8ac3-42098458e009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:05.127778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c83a2-6dd8-4153-8ac3-42098458e009 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:05.156360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2229/4426] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:06.978414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93897-3da7-402a-8b7e-3f2ca9452dec None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:06.978941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93897-3da7-402a-8b7e-3f2ca9452dec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:06.979308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93897-3da7-402a-8b7e-3f2ca9452dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:07.037846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b4d93897-3da7-402a-8b7e-3f2ca9452dec None None] MFA Rules not processed for user `ab975e8ffd0448939b2105aed58003fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:07.042676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b4d93897-3da7-402a-8b7e-3f2ca9452dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:07.214633 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2198/4427] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:09.876484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:09.876955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:09.877138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:09.967178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] MFA Rules not processed for user `deabdfddc88b4db2bb61ae4da4b4808d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:09.974669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:10.268596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2230/4428] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:10.276383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fa218-a374-410d-9334-2b5197ac0f31 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:10.278980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fa218-a374-410d-9334-2b5197ac0f31 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:10.282058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fa218-a374-410d-9334-2b5197ac0f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:10.359581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-571fa218-a374-410d-9334-2b5197ac0f31 None None] MFA Rules not processed for user `deabdfddc88b4db2bb61ae4da4b4808d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:10.361079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-571fa218-a374-410d-9334-2b5197ac0f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:10.390652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2199/4429] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:10.402510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:10.404643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:10.439994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af49cb-ecde-4d6e-8659-227ec208d1ff None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:10.462848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe722b-a699-432b-b816-871cf4ad972c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:10.463550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe722b-a699-432b-b816-871cf4ad972c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:10.467772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe722b-a699-432b-b816-871cf4ad972c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:10.468131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe722b-a699-432b-b816-871cf4ad972c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:10.528441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe722b-a699-432b-b816-871cf4ad972c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:10.539347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe722b-a699-432b-b816-871cf4ad972c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:10.591546 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2231/4430] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:18:12.560521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fa218-a374-410d-9334-2b5197ac0f31 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:12.624359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:13.011480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fa218-a374-410d-9334-2b5197ac0f31 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:13.022380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:13.039822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:13.040158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:13.040438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] PATH_INFO: `/v3/users/7b1e07ea16ab4ee18386f84b02a7d934` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:13.043973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1e07ea16ab4ee18386f84b02a7d934)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:13.051053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:13.157339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1e07ea16ab4ee18386f84b02a7d934'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:13.158332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1e07ea16ab4ee18386f84b02a7d934'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:13.188744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1e07ea16ab4ee18386f84b02a7d934'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:13.189565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1e07ea16ab4ee18386f84b02a7d934'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:13.208305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1e07ea16ab4ee18386f84b02a7d934'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:13.246981 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2200/4431] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:18:12 2022] DELETE /identity/v3/users/7b1e07ea16ab4ee18386f84b02a7d934 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:13.255887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:13.257667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:13.259046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:13.302088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:13.303620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:13.670494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2232/4432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:18:13.703042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:13.704537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:14.006418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3ff7-ccfd-462e-9e7f-b42b04f69b2d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:14.035721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd21c-e907-4a4d-9569-294153abed66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:14.036848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd21c-e907-4a4d-9569-294153abed66 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:14.037366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd21c-e907-4a4d-9569-294153abed66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:14.037855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd21c-e907-4a4d-9569-294153abed66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:14.098548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdd21c-e907-4a4d-9569-294153abed66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:14.102337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdd21c-e907-4a4d-9569-294153abed66 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:14.128616 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2201/4433] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:15.899080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:15.901521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:15.920245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae4d94-9860-4939-80a4-6c6e29ca4222 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:15.936806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:15.937730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:15.938197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:15.939418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] PATH_INFO: `/v3/projects/641fef3f3fb34ea2b3606b8b019b40ed` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:15.943184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641fef3f3fb34ea2b3606b8b019b40ed)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:15.945414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:16.016705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:16.076377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641fef3f3fb34ea2b3606b8b019b40ed', 'request_id': 'req-30a278d3-9e05-44a5-a8b4-433ccf23f515'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:16.084135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641fef3f3fb34ea2b3606b8b019b40ed', 'request_id': 'req-30a278d3-9e05-44a5-a8b4-433ccf23f515'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:16.113574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641fef3f3fb34ea2b3606b8b019b40ed', 'request_id': 'req-30a278d3-9e05-44a5-a8b4-433ccf23f515'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:16.131522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] The token cache is being invalidate because project 641fef3f3fb34ea2b3606b8b019b40ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:16.131885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:16.132470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30a278d3-9e05-44a5-a8b4-433ccf23f515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:16.134495 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2233/4434] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:15 2022] DELETE /identity/v3/projects/641fef3f3fb34ea2b3606b8b019b40ed => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:16.139881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392272-e21f-4d2c-a458-e3afae3c210a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:16.140763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392272-e21f-4d2c-a458-e3afae3c210a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:16.141227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392272-e21f-4d2c-a458-e3afae3c210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:16.184761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e9392272-e21f-4d2c-a458-e3afae3c210a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:16.186281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e9392272-e21f-4d2c-a458-e3afae3c210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:16.339980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:16.376481 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2202/4435] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:16.384175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8066-a9b3-4a5d-8459-d40ea38903c5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:16.384467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8066-a9b3-4a5d-8459-d40ea38903c5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:16.384750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8066-a9b3-4a5d-8459-d40ea38903c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:16.415594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-97ac8066-a9b3-4a5d-8459-d40ea38903c5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:16.416845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-97ac8066-a9b3-4a5d-8459-d40ea38903c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:16.436173 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2234/4436] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:18:16.441181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392272-e21f-4d2c-a458-e3afae3c210a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:16.469114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392272-e21f-4d2c-a458-e3afae3c210a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:16.490035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:16.490035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:16.490035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:16.518113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:16.522278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:18:16.523014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:16.530807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:16.570123 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2203/4437] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:16.574943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac8066-a9b3-4a5d-8459-d40ea38903c5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:16.590841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac8066-a9b3-4a5d-8459-d40ea38903c5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:16.625489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:16.626522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:16.627038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:16.627477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:16.628613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:16.631829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:16.677321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:16.679292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:16.697815 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2235/4438] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:18:16 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:16.702624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:16.741427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff325beb-b63c-4425-8ea5-7362c4032d9d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:16.829673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192fc96-708f-4f85-81da-c8fe02df8714 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:16.836362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:16.837270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:16.837822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:16.838209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:16.839187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:16.841983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:16.905576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2236/4439] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:18:16 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:18:16.910257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:16.942188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3cf6f-c6d8-4845-b4f3-f52bd0c1a77f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:16.959452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:16.960330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:16.961192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:16.961339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:16.961583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:16.961791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] PATH_INFO: `/v3/users/a8eb1a760d644f97bf3aae882e905b85` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:16.962744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:16.963010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8eb1a760d644f97bf3aae882e905b85)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:16.963471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:16.964940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:16.965249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:16.967173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:16.980991 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2237/4440] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:18:16.985306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.001728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cf95c-b847-435a-b973-061265c00139 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.009144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.010472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.011041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.012138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.014896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.017003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.048391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2238/4441] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:18:17.053573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.061889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8eb1a760d644f97bf3aae882e905b85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:17.062673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8eb1a760d644f97bf3aae882e905b85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:17.077284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8eb1a760d644f97bf3aae882e905b85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:17.078039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8eb1a760d644f97bf3aae882e905b85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:17.081476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f5fba-2d2c-4399-ab85-11bd9a87d9e2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.085824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-58b2f1d0-b92d-4b91-81f7-9d9b3c7a1c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8eb1a760d644f97bf3aae882e905b85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:17.093232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.095625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.096355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.096675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] PATH_INFO: `/v3/projects/970d8031a4b149188d5a2bee95524169/users/caa130c208d44d798cb0a5ba41193976/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.109211 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2204/4442] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:18:16 2022] DELETE /identity/v3/users/a8eb1a760d644f97bf3aae882e905b85 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:18:17.130324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] RBAC: Authorizing `identity:create_grant(project_id=970d8031a4b149188d5a2bee95524169, user_id=caa130c208d44d798cb0a5ba41193976, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.135183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.161876 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2239/4443] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:17 2022] PUT /identity/v3/projects/970d8031a4b149188d5a2bee95524169/users/caa130c208d44d798cb0a5ba41193976/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:17.172051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb5ac8-f037-46d6-83a3-b57d5e040434 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.172995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb5ac8-f037-46d6-83a3-b57d5e040434 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.173541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb5ac8-f037-46d6-83a3-b57d5e040434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.202677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c1bb5ac8-f037-46d6-83a3-b57d5e040434 None None] MFA Rules not processed for user `caa130c208d44d798cb0a5ba41193976`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:17.204937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c1bb5ac8-f037-46d6-83a3-b57d5e040434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:17.252340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:17.292876 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2205/4444] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:17.296073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.298679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:17.335163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:17.398343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed440e-d20a-495d-b731-e66d79c9845b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.407897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.408612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.409360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.410103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.410905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.417740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.464021 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2240/4445] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:18:17 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:17.467537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb5ac8-f037-46d6-83a3-b57d5e040434 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.485276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb5ac8-f037-46d6-83a3-b57d5e040434 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.594557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.595428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.595823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.596188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.597186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.600187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.638859 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2206/4446] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:18:17 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:17.642680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.660758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fec745-8d1e-46e1-b5db-8bb4b86c61bc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.675049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.676022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.676561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.677071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.678023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.679973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.694835 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2241/4447] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:17.699186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.710282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003fb5-627c-42f4-9592-7b7f08b9ce67 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.714893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.715808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.716077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.716350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] PATH_INFO: `/v3/projects/70d6639cf2ab40a0a3e8012708beaab7/users/7346777fd2734ad8a2ea2e80653a0208/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.736792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d6639cf2ab40a0a3e8012708beaab7, user_id=7346777fd2734ad8a2ea2e80653a0208, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.739840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.766246 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2207/4448] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:17 2022] PUT /identity/v3/projects/70d6639cf2ab40a0a3e8012708beaab7/users/7346777fd2734ad8a2ea2e80653a0208/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:17.767540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.786679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c469e7d-96f4-498a-a0cd-88b0e0b91680 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.871493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d3174-6b69-4e35-8407-ccdec36a9b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.872175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3174-6b69-4e35-8407-ccdec36a9b61 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.872456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3174-6b69-4e35-8407-ccdec36a9b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.872730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d3174-6b69-4e35-8407-ccdec36a9b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.873671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d3174-6b69-4e35-8407-ccdec36a9b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.875793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d3174-6b69-4e35-8407-ccdec36a9b61 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.891368 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2242/4449] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:17.893450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:17.917509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0da7a-4a56-4186-aca7-bcf1be45c0a5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:17.927989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:17.928910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.929217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.929488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] PATH_INFO: `/v3/projects/70d6639cf2ab40a0a3e8012708beaab7/users/7346777fd2734ad8a2ea2e80653a0208/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:17.933972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d6639cf2ab40a0a3e8012708beaab7, user_id=7346777fd2734ad8a2ea2e80653a0208, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:17.937956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:17.965144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:17.966545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2208/4450] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:17 2022] PUT /identity/v3/projects/70d6639cf2ab40a0a3e8012708beaab7/users/7346777fd2734ad8a2ea2e80653a0208/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:17.970007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:17.970384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:18.028625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] MFA Rules not processed for user `7346777fd2734ad8a2ea2e80653a0208`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:18.033100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:18.183816 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2243/4451] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:18.227651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:18.231645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:18.327691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3c7fd-2a3c-4cac-a336-dbaffeda03d6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:18.332875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:18.334283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:18.334838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:18.335336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:18.388912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:18.404459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:18.406247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:18.430397 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2209/4452] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:18.954987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:18.960073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:19.001385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:19.139110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb89b94-9210-4ad6-bd17-861e532e948f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:19.151559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:19.152471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:19.152750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:19.153025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] PATH_INFO: `/v3/projects/b8ddaa6fbcdf4368a8e9be0d07596178` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:19.157893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ddaa6fbcdf4368a8e9be0d07596178)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:19.160347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:19.290128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'request_id': 'req-a099686d-591e-473e-9458-d66697f68065'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.310451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'request_id': 'req-a099686d-591e-473e-9458-d66697f68065'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.324339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'request_id': 'req-a099686d-591e-473e-9458-d66697f68065'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.339553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] The token cache is being invalidate because project b8ddaa6fbcdf4368a8e9be0d07596178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:19.340714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.341736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.344682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2244/4453] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:18 2022] DELETE /identity/v3/projects/b8ddaa6fbcdf4368a8e9be0d07596178 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:19.350688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:19.364768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f342ba-93c1-4dc3-b202-62b5d652989f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:19.455881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:19.456928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:19.457547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:19.458061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] PATH_INFO: `/v3/users/a515052b9fa24db68d9878c44dac8be6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:19.460050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a515052b9fa24db68d9878c44dac8be6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:19.462550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:19.666725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a515052b9fa24db68d9878c44dac8be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.669014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a515052b9fa24db68d9878c44dac8be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.697257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a515052b9fa24db68d9878c44dac8be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.704809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a515052b9fa24db68d9878c44dac8be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.718186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a81a057-c279-4ae6-a74e-43201e3484a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a515052b9fa24db68d9878c44dac8be6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:19.758543 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2210/4454] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:18:19 2022] DELETE /identity/v3/users/a515052b9fa24db68d9878c44dac8be6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:20.928942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:20.932242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:20.933113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526502a-1f4a-4f47-af83-92958aec2452 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:20.933517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526502a-1f4a-4f47-af83-92958aec2452 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:20.933517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526502a-1f4a-4f47-af83-92958aec2452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:20.960994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d526502a-1f4a-4f47-af83-92958aec2452 None None] MFA Rules not processed for user `d5516d85f0ee482facf6a96e2709c41d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:20.962296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d526502a-1f4a-4f47-af83-92958aec2452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:20.962829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099686d-591e-473e-9458-d66697f68065 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:21.069791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:21.072581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.072865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.073192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] PATH_INFO: `/v3/projects/8ec9cc48ad274c40992a64efc76dac39` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.078102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec9cc48ad274c40992a64efc76dac39)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:21.084445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:21.084798 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2211/4455] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:18:21.227148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec9cc48ad274c40992a64efc76dac39', 'request_id': 'req-0d140354-5728-42bf-a478-1ba77378e1c6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:21.228636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:21.256749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec9cc48ad274c40992a64efc76dac39', 'request_id': 'req-0d140354-5728-42bf-a478-1ba77378e1c6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:21.279304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec9cc48ad274c40992a64efc76dac39', 'request_id': 'req-0d140354-5728-42bf-a478-1ba77378e1c6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:21.323762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] The token cache is being invalidate because project 8ec9cc48ad274c40992a64efc76dac39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:21.324013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:21.325315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0d140354-5728-42bf-a478-1ba77378e1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:21.330998 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2245/4456] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:20 2022] DELETE /identity/v3/projects/8ec9cc48ad274c40992a64efc76dac39 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:21.336218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968b94-0315-4405-8dff-9166997c5f83 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.336514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968b94-0315-4405-8dff-9166997c5f83 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.336802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968b94-0315-4405-8dff-9166997c5f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.371118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a1968b94-0315-4405-8dff-9166997c5f83 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:21.373990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1968b94-0315-4405-8dff-9166997c5f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:21.404691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:21.560610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2212/4457] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:21.568613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4321-d3fe-4a4c-9d19-78dfe3398e7d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.569326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4321-d3fe-4a4c-9d19-78dfe3398e7d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.569783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f4321-d3fe-4a4c-9d19-78dfe3398e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.594758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a24f4321-d3fe-4a4c-9d19-78dfe3398e7d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:21.598025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a24f4321-d3fe-4a4c-9d19-78dfe3398e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:21.610387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2246/4458] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:21.614388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968b94-0315-4405-8dff-9166997c5f83 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:21.637527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968b94-0315-4405-8dff-9166997c5f83 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:21.661613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:21.662886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.663589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.664044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.665131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:18:21.665620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:21.667438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:21.682269 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2213/4459] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:18:21.686364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4321-d3fe-4a4c-9d19-78dfe3398e7d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:21.696803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f4321-d3fe-4a4c-9d19-78dfe3398e7d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:21.702307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:21.703558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.704105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.704606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.705680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:21.708067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:21.749406 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2247/4460] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:18:21 2022] POST /identity/v3/projects => generated 395 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:21.753506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:21.767743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a7d6-faba-4330-a3ee-61671745625a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:21.857362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:21.858683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.859199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.859702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.860822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:21.864543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:21.904904 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2214/4461] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:18:21 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:21.907406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:21.923794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d4f89-ad4a-42b8-b64e-e46fc1f4c270 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:21.930251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:21.931121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.931502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.931875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.933260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:21.935576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:21.950549 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2248/4462] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:21.958557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:21.976167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f1e0-aeba-4e23-af61-5208a7453e2d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:21.982787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637db2f0-145e-48ec-b883-0cb5ac4bea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:21.983499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db2f0-145e-48ec-b883-0cb5ac4bea3d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:21.983785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db2f0-145e-48ec-b883-0cb5ac4bea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:21.984254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db2f0-145e-48ec-b883-0cb5ac4bea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:21.986622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637db2f0-145e-48ec-b883-0cb5ac4bea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:21.988541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637db2f0-145e-48ec-b883-0cb5ac4bea3d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:22.002991 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2215/4463] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:22.007440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:22.019963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1b6fa-500d-4755-8b95-8f69021c4514 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:22.025387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:22.026305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:22.026582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:22.026858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] PATH_INFO: `/v3/projects/691097edd2ac46af9e83a119b87340e8/users/eb2d051325e2465b8eb1fa505770857c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:22.051192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691097edd2ac46af9e83a119b87340e8, user_id=eb2d051325e2465b8eb1fa505770857c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:22.054451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:22.077086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2249/4464] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:22 2022] PUT /identity/v3/projects/691097edd2ac46af9e83a119b87340e8/users/eb2d051325e2465b8eb1fa505770857c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:18:22.082173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:22.082995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:22.083646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:22.104871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:22.106214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:22.196755 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2216/4465] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:22.225749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:22.227740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:22.322701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1ca2d-ca23-4c64-9fa5-f0a6706c17e7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:22.328766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:22.330550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:22.330901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:22.331534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:22.345162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:22.348367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:22.360639 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2250/4466] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:23.353761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:23.355278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:23.374214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad046491-1eff-49c7-919b-5a61debe6bfe None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:23.384656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd81873-268a-4b83-8890-a75ca42047d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:23.385650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd81873-268a-4b83-8890-a75ca42047d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:23.386100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd81873-268a-4b83-8890-a75ca42047d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:23.386542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd81873-268a-4b83-8890-a75ca42047d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:23.391465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5cd81873-268a-4b83-8890-a75ca42047d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:23.421598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:23.537857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd81873-268a-4b83-8890-a75ca42047d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:23.539766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd81873-268a-4b83-8890-a75ca42047d6 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:23.566777 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2217/4467] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:29.310383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:29.314414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:29.527522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7867be-49b1-41e5-9343-c88dba577470 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:29.561889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9860-32b4-429d-a2be-ebc9ac692875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:29.605383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9860-32b4-429d-a2be-ebc9ac692875 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:29.605654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9860-32b4-429d-a2be-ebc9ac692875 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:29.605937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9860-32b4-429d-a2be-ebc9ac692875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:29.617275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1f9b9860-32b4-429d-a2be-ebc9ac692875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:29.670727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b9860-32b4-429d-a2be-ebc9ac692875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:29.684900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b9860-32b4-429d-a2be-ebc9ac692875 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:29.743055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2251/4468] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:30.379197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bedc5-834e-4177-b208-076ae9168c53 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:30.379796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bedc5-834e-4177-b208-076ae9168c53 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:30.381695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bedc5-834e-4177-b208-076ae9168c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:30.436082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f65bedc5-834e-4177-b208-076ae9168c53 None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:30.437396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f65bedc5-834e-4177-b208-076ae9168c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:30.639750 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2218/4469] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:35.344248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:35.344792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:35.344901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:35.352310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:35.409654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] MFA Rules not processed for user `eb2d051325e2465b8eb1fa505770857c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:35.422046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:35.585459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dd59-f60d-423a-bccc-3ef978a1b8f8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:35.586055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dd59-f60d-423a-bccc-3ef978a1b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:35.586055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dd59-f60d-423a-bccc-3ef978a1b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:35.586719 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2252/4470] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:35.642139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-97e1dd59-f60d-423a-bccc-3ef978a1b8f8 None None] MFA Rules not processed for user `eb2d051325e2465b8eb1fa505770857c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:35.643397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-97e1dd59-f60d-423a-bccc-3ef978a1b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:35.658452 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2219/4471] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:18:36.053710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:36.055908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:36.081225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16865dc-3719-4f79-8af4-a916950d3e22 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:36.110917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:36.112628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:36.112921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:36.114945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] PATH_INFO: `/v3/users/17bce7b531bd49b5a54a2e7eab57834f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:36.125129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bce7b531bd49b5a54a2e7eab57834f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:36.125593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dd59-f60d-423a-bccc-3ef978a1b8f8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:36.125702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:36.144170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dd59-f60d-423a-bccc-3ef978a1b8f8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:36.166401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:36.167436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:36.167960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:36.168398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:36.197467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:36.200867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:36.236317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bce7b531bd49b5a54a2e7eab57834f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:36.238316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bce7b531bd49b5a54a2e7eab57834f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:36.255021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bce7b531bd49b5a54a2e7eab57834f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:36.256070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bce7b531bd49b5a54a2e7eab57834f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:36.258849 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2220/4472] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:18:36.265281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bce7b531bd49b5a54a2e7eab57834f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:36.289858 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2253/4473] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:18:36 2022] DELETE /identity/v3/users/17bce7b531bd49b5a54a2e7eab57834f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:37.016469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:37.056089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca9d4-9e80-4007-9c3f-6d0bc73a938a service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:37.214143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:37.218868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:37.220053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:37.221461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] PATH_INFO: `/v3/projects/e6e76753152c4fe7881769f5477f65e5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:37.226624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e76753152c4fe7881769f5477f65e5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:37.233874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:37.361468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:37.393917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e76753152c4fe7881769f5477f65e5', 'request_id': 'req-af87a24f-c665-4606-a561-26c174522d76'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.416803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e76753152c4fe7881769f5477f65e5', 'request_id': 'req-af87a24f-c665-4606-a561-26c174522d76'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.441378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e76753152c4fe7881769f5477f65e5', 'request_id': 'req-af87a24f-c665-4606-a561-26c174522d76'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.465626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] The token cache is being invalidate because project e6e76753152c4fe7881769f5477f65e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:37.466001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.467119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-af87a24f-c665-4606-a561-26c174522d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.469912 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2221/4474] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:37 2022] DELETE /identity/v3/projects/e6e76753152c4fe7881769f5477f65e5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:37.474016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:37.476279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:37.510377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5c79f-e8ca-4fb5-85e6-34fcf10db614 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:37.657916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:37.659226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:37.659749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:37.660278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] PATH_INFO: `/v3/users/3755bd71d3cb4e2582ef9ef2f54545a9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:37.662805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3755bd71d3cb4e2582ef9ef2f54545a9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:37.665575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:37.671644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:37.759792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3755bd71d3cb4e2582ef9ef2f54545a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.762196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3755bd71d3cb4e2582ef9ef2f54545a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.795890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3755bd71d3cb4e2582ef9ef2f54545a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.797452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3755bd71d3cb4e2582ef9ef2f54545a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.818841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3755bd71d3cb4e2582ef9ef2f54545a9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:37.856976 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2254/4475] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:18:37 2022] DELETE /identity/v3/users/3755bd71d3cb4e2582ef9ef2f54545a9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:37.958187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c83f0a-7bea-441f-842f-8e897b5ed5f1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:37.958507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c83f0a-7bea-441f-842f-8e897b5ed5f1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:37.958789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c83f0a-7bea-441f-842f-8e897b5ed5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:38.021264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c1c83f0a-7bea-441f-842f-8e897b5ed5f1 None None] MFA Rules not processed for user `caa130c208d44d798cb0a5ba41193976`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:38.053459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c1c83f0a-7bea-441f-842f-8e897b5ed5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:38.225256 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2222/4476] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:38.685452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:38.687270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:38.908355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fb6c1-9a67-47eb-9c61-0c1e771dc2af admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:38.920962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:38.921893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:38.922216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:38.922525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] PATH_INFO: `/v3/projects/a23826e63b5c48f2ac201e0929ab5e5b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:38.927471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23826e63b5c48f2ac201e0929ab5e5b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:38.943269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:39.076927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23826e63b5c48f2ac201e0929ab5e5b', 'request_id': 'req-967cc1d0-0c54-4cef-9ea5-8864954d73af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:39.085285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23826e63b5c48f2ac201e0929ab5e5b', 'request_id': 'req-967cc1d0-0c54-4cef-9ea5-8864954d73af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:39.098733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23826e63b5c48f2ac201e0929ab5e5b', 'request_id': 'req-967cc1d0-0c54-4cef-9ea5-8864954d73af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:39.128187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] The token cache is being invalidate because project a23826e63b5c48f2ac201e0929ab5e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:39.128687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:39.129590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-967cc1d0-0c54-4cef-9ea5-8864954d73af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:39.134798 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2255/4477] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:38 2022] DELETE /identity/v3/projects/a23826e63b5c48f2ac201e0929ab5e5b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:39.136516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8d7b6-dd88-44bd-a2e7-64fa3a43a756 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.136996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8d7b6-dd88-44bd-a2e7-64fa3a43a756 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.137599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8d7b6-dd88-44bd-a2e7-64fa3a43a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.167640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a4a8d7b6-dd88-44bd-a2e7-64fa3a43a756 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:39.169773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a4a8d7b6-dd88-44bd-a2e7-64fa3a43a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:39.302717 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2223/4478] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:39.311694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663390-826f-404c-838e-96510992547b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.312128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663390-826f-404c-838e-96510992547b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.312505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6663390-826f-404c-838e-96510992547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.367874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d6663390-826f-404c-838e-96510992547b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:39.377813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d6663390-826f-404c-838e-96510992547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:39.404169 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2256/4479] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:39.409882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8d7b6-dd88-44bd-a2e7-64fa3a43a756 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:39.427735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8d7b6-dd88-44bd-a2e7-64fa3a43a756 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:39.453781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:39.454679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.454968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.455249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.456002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:18:39.456309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:39.461228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:39.490609 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2224/4480] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:39.491878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663390-826f-404c-838e-96510992547b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:39.510993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6663390-826f-404c-838e-96510992547b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:39.520669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:39.521945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.522609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.524212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.524919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:39.527335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:39.531181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:39.569095 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2257/4481] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:18:39 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:39.570596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:39.584028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd2b1-c886-454c-9eca-d3065b1e002c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:39.667731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720ec3-b95b-4a8b-90aa-69b89fce6a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:39.668655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720ec3-b95b-4a8b-90aa-69b89fce6a1a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.669154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720ec3-b95b-4a8b-90aa-69b89fce6a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.669784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720ec3-b95b-4a8b-90aa-69b89fce6a1a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.670854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720ec3-b95b-4a8b-90aa-69b89fce6a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:39.676550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720ec3-b95b-4a8b-90aa-69b89fce6a1a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:39.684228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:39.709454 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2225/4482] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:18:39 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:18:39.711458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:39.727878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e09da-5159-44a5-a64e-cf081024a796 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:39.748514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:39.749242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.749552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.749822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.750883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:39.752791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:39.773840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.774275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.774644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.783928 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2258/4483] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:39.787187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:39.808974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b6c6-07c2-4062-83ed-ba5ca0f7587c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:39.815106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:39.815800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.816118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.816394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.817231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:39.818855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:39.831984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:39.835256 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2259/4484] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:39.836431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:39.837841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:39.859556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82213583-c41d-4e2c-ba39-2d7a72fe2228 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:39.886937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db25ec-95e6-48f3-a6f2-76f68b8bdf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:39.887540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db25ec-95e6-48f3-a6f2-76f68b8bdf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.887879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db25ec-95e6-48f3-a6f2-76f68b8bdf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.888161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db25ec-95e6-48f3-a6f2-76f68b8bdf82 admin admin] PATH_INFO: `/v3/projects/b6c1a383333e4e30ace00bcdba714600/users/8d81ad22e9434bff9b01fb434231428f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.916627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db25ec-95e6-48f3-a6f2-76f68b8bdf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c1a383333e4e30ace00bcdba714600, user_id=8d81ad22e9434bff9b01fb434231428f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:39.919865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db25ec-95e6-48f3-a6f2-76f68b8bdf82 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:39.949872 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2260/4485] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:39 2022] PUT /identity/v3/projects/b6c1a383333e4e30ace00bcdba714600/users/8d81ad22e9434bff9b01fb434231428f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:39.956054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d98ce1-0101-4387-9335-165648195c95 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:39.956518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d98ce1-0101-4387-9335-165648195c95 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:39.957000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d98ce1-0101-4387-9335-165648195c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:39.974794 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2226/4486] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:18:39.979189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-84d98ce1-0101-4387-9335-165648195c95 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:39.980649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-84d98ce1-0101-4387-9335-165648195c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:40.113089 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2261/4487] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:40.226804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:40.228681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:40.376273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3de3c2-7ec4-432e-b346-b3e32240de4b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:40.597111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:40.598067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:40.616181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:40.616614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:40.651737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:40.655811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:40.689260 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2227/4488] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:18:50.101610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:50.672335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=3,keystone:SELECT=73 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:52.988905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d98ce1-0101-4387-9335-165648195c95 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:52.992091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-84d98ce1-0101-4387-9335-165648195c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:53.013783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d98ce1-0101-4387-9335-165648195c95 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:53.021391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:53.024201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:53.025112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:53.025588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] PATH_INFO: `/v3/users/deabdfddc88b4db2bb61ae4da4b4808d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:53.027964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deabdfddc88b4db2bb61ae4da4b4808d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:53.030230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:53.098733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deabdfddc88b4db2bb61ae4da4b4808d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.099447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deabdfddc88b4db2bb61ae4da4b4808d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.120476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deabdfddc88b4db2bb61ae4da4b4808d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.121247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deabdfddc88b4db2bb61ae4da4b4808d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.144884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb3c9472-1b25-4bd0-ae3a-c2bc10693304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deabdfddc88b4db2bb61ae4da4b4808d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.177361 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2262/4489] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:18:52 2022] DELETE /identity/v3/users/deabdfddc88b4db2bb61ae4da4b4808d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:53.414966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:53.425771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac74d7-66cc-447b-a1e0-454828a3f133 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:53.513967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:53.514994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:53.515346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:53.515854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] PATH_INFO: `/v3/projects/b2a741fcf70249ecb8c3c727459c84c9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:53.517925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a741fcf70249ecb8c3c727459c84c9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:53.520448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:53.584054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a741fcf70249ecb8c3c727459c84c9', 'request_id': 'req-ef7e31d0-3e5c-485d-a81a-365333524749'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.593386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a741fcf70249ecb8c3c727459c84c9', 'request_id': 'req-ef7e31d0-3e5c-485d-a81a-365333524749'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.615406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a741fcf70249ecb8c3c727459c84c9', 'request_id': 'req-ef7e31d0-3e5c-485d-a81a-365333524749'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.630126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] The token cache is being invalidate because project b2a741fcf70249ecb8c3c727459c84c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:53.630418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.631410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ef7e31d0-3e5c-485d-a81a-365333524749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:53.637362 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2228/4490] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:53 2022] DELETE /identity/v3/projects/b2a741fcf70249ecb8c3c727459c84c9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:53.639760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990d530-7822-4f08-b2f2-e5809e116ef9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:53.640162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990d530-7822-4f08-b2f2-e5809e116ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:53.640535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990d530-7822-4f08-b2f2-e5809e116ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:53.666949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b990d530-7822-4f08-b2f2-e5809e116ef9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:53.667563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b990d530-7822-4f08-b2f2-e5809e116ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:53.752065 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2263/4491] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:53.763446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1debf-0822-4519-ae59-c89bb1d616af None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:53.763446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1debf-0822-4519-ae59-c89bb1d616af None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:53.763446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1debf-0822-4519-ae59-c89bb1d616af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:53.800856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c293a-9303-4afb-adeb-2d5f6002376a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:53.801325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c293a-9303-4afb-adeb-2d5f6002376a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:53.801460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-98e1debf-0822-4519-ae59-c89bb1d616af None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:53.803518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c293a-9303-4afb-adeb-2d5f6002376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:53.804641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-98e1debf-0822-4519-ae59-c89bb1d616af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:53.827825 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2229/4492] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:53.829773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1debf-0822-4519-ae59-c89bb1d616af None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:53.847868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7e3c293a-9303-4afb-adeb-2d5f6002376a None None] MFA Rules not processed for user `8d81ad22e9434bff9b01fb434231428f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:53.849551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7e3c293a-9303-4afb-adeb-2d5f6002376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:53.850463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1debf-0822-4519-ae59-c89bb1d616af None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:53.878501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:53.878501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:53.878501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:53.878501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:53.882430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:18:53.883000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:53.889373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:53.925152 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2230/4493] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:53.929270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:53.943420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2e3d-c5b2-4b64-a9c7-9a9859cc6b11 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:53.949438 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2264/4494] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:53.952477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:53.953488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:53.953941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:53.954241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:53.955057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:53.957421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:53.992562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2231/4495] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:18:53 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:18:53.996808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c293a-9303-4afb-adeb-2d5f6002376a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.007154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:54.013809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c293a-9303-4afb-adeb-2d5f6002376a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.092268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.093117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.093405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.093684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.094410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.096503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.123034 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2265/4496] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:18:53 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:54.127190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.143708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723159e-3140-4923-87fd-6c2069568b4b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.148474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.149431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.149710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.150025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.150782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.152386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.166612 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2232/4497] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:54.170615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.181973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916a27-374c-4652-9b19-8741f3d1d5bb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.188180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137639-d8db-4190-a304-5103459e8c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.188870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137639-d8db-4190-a304-5103459e8c97 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.189328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137639-d8db-4190-a304-5103459e8c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.189451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137639-d8db-4190-a304-5103459e8c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.190923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137639-d8db-4190-a304-5103459e8c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.192738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137639-d8db-4190-a304-5103459e8c97 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.206678 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2266/4498] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:54.211172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.225367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51b46-76bd-4338-bee6-e1f5917e4a4c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.231831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.232639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.233343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.233766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] PATH_INFO: `/v3/projects/28ef82f1bf63430884c03ca89261f0a6/users/9bc641577da24c06bc57778cbaf74c99/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.255604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ef82f1bf63430884c03ca89261f0a6, user_id=9bc641577da24c06bc57778cbaf74c99, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.259548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.285934 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2233/4499] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:54 2022] PUT /identity/v3/projects/28ef82f1bf63430884c03ca89261f0a6/users/9bc641577da24c06bc57778cbaf74c99/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:54.293686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4fd66-5955-472d-a0d5-480f8a7a3477 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.293686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4fd66-5955-472d-a0d5-480f8a7a3477 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.293686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4fd66-5955-472d-a0d5-480f8a7a3477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.346894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a0d4fd66-5955-472d-a0d5-480f8a7a3477 None None] MFA Rules not processed for user `9bc641577da24c06bc57778cbaf74c99`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:54.347209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.348337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a0d4fd66-5955-472d-a0d5-480f8a7a3477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:54.348977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:54.368414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:54.448214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2267/4500] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:54.453261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4fd66-5955-472d-a0d5-480f8a7a3477 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.460388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed07c2-d71b-42df-927e-9be4b7814fb7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.474079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.474878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.475162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.476016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.578124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.582668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.586534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4fd66-5955-472d-a0d5-480f8a7a3477 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.601587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2234/4501] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:18:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:18:54.605665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.606466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.608989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.610003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.610405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.613847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.668206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:54.695340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.701418 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2268/4502] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:18:54 2022] POST /identity/v3/projects => generated 389 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:18:54.716690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa450387-df42-4fcd-9472-7f1184c5599f service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.841776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.843034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.843034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.843575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.844641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.848174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.883073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2235/4503] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:18:54 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:18:54.887015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.898434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d102-e406-44a7-b389-6a55f797c920 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.904345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.905300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.905714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.906087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.907184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.908896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:54.928622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:54.935601 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2269/4504] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:18:54.942635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224d248-baf7-4f9f-a5fa-ea1358eb18e9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:54.948405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:54.949822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:54.950362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:54.950599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] PATH_INFO: `/v3/projects/782d7923a10a4eaf874a91b72c6f7fb6/users/c01cdf8bf38245289c997e1303ea01d8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:54.970265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782d7923a10a4eaf874a91b72c6f7fb6, user_id=c01cdf8bf38245289c997e1303ea01d8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:54.974717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.008182 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2236/4505] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:54 2022] PUT /identity/v3/projects/782d7923a10a4eaf874a91b72c6f7fb6/users/c01cdf8bf38245289c997e1303ea01d8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:55.013562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.048043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e421c6f-ce20-4864-a361-d8920745daf1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.128750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19980-ef61-4ab7-86de-a7ccb5977bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.129891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19980-ef61-4ab7-86de-a7ccb5977bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.130365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19980-ef61-4ab7-86de-a7ccb5977bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.130791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19980-ef61-4ab7-86de-a7ccb5977bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.131679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19980-ef61-4ab7-86de-a7ccb5977bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.133747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19980-ef61-4ab7-86de-a7ccb5977bf8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.145337 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2270/4506] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:55.150898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.166540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe9de5-77a3-4ad6-aa52-83ecaed20056 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.172954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.174038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.182115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.182542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] PATH_INFO: `/v3/projects/782d7923a10a4eaf874a91b72c6f7fb6/users/c01cdf8bf38245289c997e1303ea01d8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.185434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782d7923a10a4eaf874a91b72c6f7fb6, user_id=c01cdf8bf38245289c997e1303ea01d8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.188273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.217117 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2237/4507] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:18:55 2022] PUT /identity/v3/projects/782d7923a10a4eaf874a91b72c6f7fb6/users/c01cdf8bf38245289c997e1303ea01d8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:55.295120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da24c8-52e5-46ce-b6a9-204c4a098715 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.295406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da24c8-52e5-46ce-b6a9-204c4a098715 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.295687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da24c8-52e5-46ce-b6a9-204c4a098715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.331361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-29da24c8-52e5-46ce-b6a9-204c4a098715 None None] MFA Rules not processed for user `c01cdf8bf38245289c997e1303ea01d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:55.332874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-29da24c8-52e5-46ce-b6a9-204c4a098715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:55.425418 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2271/4508] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:55.430742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.437427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:55.444192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42ea9d-d79f-4c40-9850-c26092aa1951 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.453807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.455290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.457345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.457740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.458600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.464222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.496785 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2238/4509] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:18:55 2022] POST /identity/v3/domains => generated 275 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:18:55.497772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da24c8-52e5-46ce-b6a9-204c4a098715 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.521880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da24c8-52e5-46ce-b6a9-204c4a098715 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.652358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.655801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.656484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.656899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.657875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=025f18fcc4fb4ee1b7719595bc4e5944)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.659351 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:55.659351 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:18:55.659351 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:18:55.660617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.672288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:55.760314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2272/4510] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:18:55 2022] PUT /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config => generated 138 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:55.766216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.789872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89557274-d90a-4fac-965e-3e38550717d0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.795662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.796880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.797298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.797749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.800084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=025f18fcc4fb4ee1b7719595bc4e5944, group=identity)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.800868 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:55.800868 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:18:55.800868 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:18:55.802241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.813987 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2239/4511] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:18:55 2022] GET /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/identity => generated 45 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:18:55.818026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.837811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0f79-6c32-4312-a574-7aeabe1fae49 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.843406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.844459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.845312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.845595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/identity/driver` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.848119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=025f18fcc4fb4ee1b7719595bc4e5944, group=identity, option=driver)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.849222 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:55.849222 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:18:55.849222 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:18:55.850304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.859068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2273/4512] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Jun 18 22:18:55 2022] GET /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/identity/driver => generated 31 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:18:55.863258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.880473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd02f4e-aa6a-454f-86ac-d7d67098ac41 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.887870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.890394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.891328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.891909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/ldap` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.895115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=025f18fcc4fb4ee1b7719595bc4e5944, group=ldap)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.899791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.908213 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2240/4513] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:18:55 2022] GET /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/ldap => generated 106 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:18:55.912238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.930049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1952a-ad4f-4875-89cb-89e39f14a9af tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.940073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.941540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.941828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.942106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/ldap/url` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.944304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=025f18fcc4fb4ee1b7719595bc4e5944, group=ldap, option=url)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:55.946320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:55.955057 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2274/4514] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:18:55 2022] GET /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/ldap/url => generated 46 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:18:55.958931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:55.975635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3fffd-9b9c-4b59-9ad6-a63f989e4972 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:55.993591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:55.994678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:55.994952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:55.995378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/ldap/user_tree_dn` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:55.998450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=025f18fcc4fb4ee1b7719595bc4e5944, group=ldap, option=user_tree_dn)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:56.000109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:56.022076 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2241/4515] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:18:55 2022] GET /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config/ldap/user_tree_dn => generated 63 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:18:56.025365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:56.044437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e236f-0c91-4664-9284-665965c637d1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:56.056843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:56.058490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:56.058786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:56.059068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:56.059742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=025f18fcc4fb4ee1b7719595bc4e5944)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:56.060953 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:56.060953 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:18:56.060953 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:18:56.062074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:56.077478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2275/4516] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:18:56 2022] DELETE /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944/config => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:56.081188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:56.095741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd8f2-0b52-4ac6-836f-1fbdbfd1986e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:56.101589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:56.103019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:56.103403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:56.103812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:56.105566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=025f18fcc4fb4ee1b7719595bc4e5944)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:56.124732 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:56.124732 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:18:56.124732 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:18:56.127078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:56.175491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.176317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.221509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.222272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.226974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2242/4517] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:18:56 2022] PATCH /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944 => generated 276 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:56.230920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:56.233374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:56.259497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b96667-07f8-47ab-8803-5af58b2bb283 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:56.381620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:56.382525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:56.382843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:56.384865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:56.419538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=025f18fcc4fb4ee1b7719595bc4e5944)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:56.420998 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:56.420998 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:18:56.420998 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:18:56.424505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:56.541914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.556978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.670331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944', 'request_id': 'req-ef957aa9-5c1f-40ec-a828-e5600ad481cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.678173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944', 'request_id': 'req-ef957aa9-5c1f-40ec-a828-e5600ad481cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.689408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944', 'request_id': 'req-ef957aa9-5c1f-40ec-a828-e5600ad481cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.705904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] The token cache is being invalidate because project 025f18fcc4fb4ee1b7719595bc4e5944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:56.706248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.707385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.713994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:56.745012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944', 'request_id': 'req-ef957aa9-5c1f-40ec-a828-e5600ad481cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.758798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944', 'request_id': 'req-ef957aa9-5c1f-40ec-a828-e5600ad481cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.759574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '025f18fcc4fb4ee1b7719595bc4e5944', 'request_id': 'req-ef957aa9-5c1f-40ec-a828-e5600ad481cf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:56.816809 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2276/4518] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:18:56 2022] DELETE /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:18:56.818097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:56.830074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fbd1a-d87b-43f2-8df5-4e65abd81fc3 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.034177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.035152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.035618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.036103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.037065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.038935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.071106 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2243/4519] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:18:56 2022] POST /identity/v3/domains => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:18:57.075504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.079283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:57.106122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957aa9-5c1f-40ec-a828-e5600ad481cf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.251492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.258484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.258835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.259117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.259953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.264332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.355653 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2277/4520] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:18:57 2022] PUT /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config => generated 138 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:57.360168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.396574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b2b8-e1b8-4e52-b343-e8bdc22a3a99 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.411853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.413319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.416209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.418252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.419264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.420566 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:57.420566 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:18:57.420566 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:18:57.424338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.490110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2244/4521] 10.222.0.30 () {60 vars in 1270 bytes} [Sat Jun 18 22:18:57 2022] PATCH /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config => generated 141 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:57.494028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.512449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2d776-4a8c-4710-85ef-fd44a377cf63 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.539602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.540478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.540769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.541071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.542441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.544112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.562327 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2278/4522] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:18:57 2022] GET /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config => generated 141 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:57.563474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.593106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1c76f-a92a-4e5e-b7f1-3e9ba0bb2e0e tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.611353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.612505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.613014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.613334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.614018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.615111 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:57.615111 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:18:57.615111 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:18:57.616057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.643184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2245/4523] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:18:57 2022] DELETE /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:57.647946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.661165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f42c7-2082-4c5f-b705-4433d53a4dde tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.666922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.667735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.668104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.668393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.670112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.671936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Could not find any options in domain configuration for domain 52b8fae1510141a589e7dd2d2fa11c64.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 52b8fae1510141a589e7dd2d2fa11c64. Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:18:57.705227 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 52b8fae1510141a589e7dd2d2fa11c64. Jun 18 22:18:57.706296 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:18:57.710098 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2279/4524] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:18:57 2022] GET /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config => generated 151 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:18:57.710980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.725667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ee01b-24fd-4051-a4c2-a8768661ddbd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.738000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.738889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.739170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.739455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.740134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.741810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.759551 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2246/4525] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:18:57 2022] DELETE /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64/config => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:18:57.764427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.781706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dc740-cd9d-45e3-a495-43774194a86b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.797189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:57.798819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:57.799464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:57.800230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:57.801935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:57.804213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:57.849389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:57.850253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:57.910515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:57.911322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:57.926175 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2280/4526] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:18:57 2022] PATCH /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64 => generated 276 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:57.930071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:57.931902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:57.955643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c86f8-461a-4c8a-bf7a-c3328f4fe013 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:57.991786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:58.088671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:58.089628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:58.090082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:58.090665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:58.115695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=52b8fae1510141a589e7dd2d2fa11c64)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:58.122284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:58.170137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.174820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.255317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64', 'request_id': 'req-a0583503-db24-41e2-9ecf-dadf6ba44b0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.265953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64', 'request_id': 'req-a0583503-db24-41e2-9ecf-dadf6ba44b0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.280504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64', 'request_id': 'req-a0583503-db24-41e2-9ecf-dadf6ba44b0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.295543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] The token cache is being invalidate because project 52b8fae1510141a589e7dd2d2fa11c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:58.295762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.296514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.307670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64', 'request_id': 'req-a0583503-db24-41e2-9ecf-dadf6ba44b0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.308619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64', 'request_id': 'req-a0583503-db24-41e2-9ecf-dadf6ba44b0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.309360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '52b8fae1510141a589e7dd2d2fa11c64', 'request_id': 'req-a0583503-db24-41e2-9ecf-dadf6ba44b0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:58.324380 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2247/4527] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:18:57 2022] DELETE /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:58.329896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:58.341013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038572-3bd4-43b5-9cfc-262fc99a94bb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:58.415338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3ae9-8872-43f7-8428-9005a30f1dc5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:58.416028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3ae9-8872-43f7-8428-9005a30f1dc5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:58.416324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3ae9-8872-43f7-8428-9005a30f1dc5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:58.416590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3ae9-8872-43f7-8428-9005a30f1dc5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:58.417371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f3ae9-8872-43f7-8428-9005a30f1dc5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:58.419013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f3ae9-8872-43f7-8428-9005a30f1dc5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:58.422379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:58.451696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:58.453451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:58.461601 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2281/4528] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:18:58 2022] POST /identity/v3/domains => generated 276 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:58.468912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583503-db24-41e2-9ecf-dadf6ba44b0b tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:58.582368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271517-ee60-45b8-8a75-f0c5b92db9cc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:58.582656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271517-ee60-45b8-8a75-f0c5b92db9cc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:58.583063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b271517-ee60-45b8-8a75-f0c5b92db9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:58.619693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:58.620578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:58.621108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:58.622367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:58.624011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:58.624937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3b271517-ee60-45b8-8a75-f0c5b92db9cc None None] MFA Rules not processed for user `8d81ad22e9434bff9b01fb434231428f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:18:58.625656 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:58.625656 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:18:58.625656 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:18:58.626205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b271517-ee60-45b8-8a75-f0c5b92db9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:58.629547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:58.632334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:58.701320 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2248/4529] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:18:58 2022] PUT /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config => generated 138 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:18:58.702349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:58.719678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c356b-4117-4a22-84b6-78dd89f04080 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:58.727839 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2282/4530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:18:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:18:58.730381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:58.731563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:58.731950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:58.745238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:58.747513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd, group=identity)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:58.749394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:58.823911 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2249/4531] 10.222.0.30 () {60 vars in 1296 bytes} [Sat Jun 18 22:18:58 2022] PATCH /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity => generated 177 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:58.829140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271517-ee60-45b8-8a75-f0c5b92db9cc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:58.844663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b271517-ee60-45b8-8a75-f0c5b92db9cc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:58.858935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:58.860187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:58.860632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:58.861215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity/driver` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:58.862341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd, group=identity, option=driver)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:58.863733 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:58.863733 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:18:58.863733 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:18:58.864956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:58.907403 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2283/4532] 10.222.0.30 () {60 vars in 1317 bytes} [Sat Jun 18 22:18:58 2022] PATCH /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity/driver => generated 176 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:58.911452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:58.925147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543a50-2b4e-4591-837f-81a836c5b470 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:58.937987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:58.938848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:58.939204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:58.939486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity/driver` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:58.940180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd, group=identity, option=driver)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:58.950603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:58.993363 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2250/4533] 10.222.0.30 () {58 vars in 1298 bytes} [Sat Jun 18 22:18:58 2022] DELETE /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity/driver => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:58.997462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.012603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abfa4b-f913-4695-8792-e3d99317afb5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.021632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.022738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.023263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.023647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity/driver` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.029713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd, group=identity, option=driver)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.032599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Could not find option driver in group identity in domain configuration for domain 57aaa03e7c5b4b6088ea25519cfb2fcd.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 57aaa03e7c5b4b6088ea25519cfb2fcd. Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:18:59.052554 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 57aaa03e7c5b4b6088ea25519cfb2fcd. Jun 18 22:18:59.053424 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:18:59.056766 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2284/4534] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Jun 18 22:18:58 2022] GET /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity/driver => generated 171 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:18:59.061275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.080701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115a2a-77ba-44bb-8a09-680b62ff74ec tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.094355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.095267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.095866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.095866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.096515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd, group=identity)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.098225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.148601 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2251/4535] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Jun 18 22:18:59 2022] DELETE /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:59.153628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.168234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb311b5-cbb6-4a9e-a179-6e3180d92d03 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.174431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.175528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.175860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.176287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.177709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd, group=identity)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.179414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Could not find group identity in domain configuration for domain 57aaa03e7c5b4b6088ea25519cfb2fcd.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 57aaa03e7c5b4b6088ea25519cfb2fcd. Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:18:59.201380 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 57aaa03e7c5b4b6088ea25519cfb2fcd. Jun 18 22:18:59.202202 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:18:59.205025 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2285/4536] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config/identity => generated 154 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:18:59.208377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.222826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d26eee-3865-4ef7-87d7-b9ad0402aeb2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.228046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.228922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.229491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.229774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.230443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.232194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.246519 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2252/4537] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:18:59 2022] DELETE /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd/config => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:18:59.247965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.260652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55512b-a6a5-48d0-a653-869122425022 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.267537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.268794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.269218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.269559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.271886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.273988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.298783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.299554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.327960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.328547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.331529 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2286/4538] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:18:59 2022] PATCH /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd => generated 277 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:18:59.335664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.337641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:59.350566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442726f-9887-47cb-b4c3-555220474491 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.413914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.414781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.415082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.415359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.428191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=57aaa03e7c5b4b6088ea25519cfb2fcd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.429962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.457463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.460983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.480997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:59.512188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd', 'request_id': 'req-1292d3f9-c65e-4c16-bddd-4f8c90728fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.520992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd', 'request_id': 'req-1292d3f9-c65e-4c16-bddd-4f8c90728fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.531844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd', 'request_id': 'req-1292d3f9-c65e-4c16-bddd-4f8c90728fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.543439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] The token cache is being invalidate because project 57aaa03e7c5b4b6088ea25519cfb2fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:18:59.543731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.544382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.552178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd', 'request_id': 'req-1292d3f9-c65e-4c16-bddd-4f8c90728fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.552858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd', 'request_id': 'req-1292d3f9-c65e-4c16-bddd-4f8c90728fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.553519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '57aaa03e7c5b4b6088ea25519cfb2fcd', 'request_id': 'req-1292d3f9-c65e-4c16-bddd-4f8c90728fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:18:59.565388 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2253/4539] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:18:59 2022] DELETE /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:18:59.573110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.591744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cefbb6-cc99-4d4e-995a-4aaa3478fa61 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.683188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.683856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.684140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.684417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.685163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.686526 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:59.686526 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:18:59.686526 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:18:59.687549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.694760 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2287/4540] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:59.698205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.700639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:18:59.719421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292d3f9-c65e-4c16-bddd-4f8c90728fee tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.733400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.734469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.734904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.735282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.736059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.738781 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:18:59.738781 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:18:59.738781 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:18:59.740214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.742825 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2254/4541] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:18:59.746153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.761761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9737a-ae5a-4685-8c47-8c080a4aa0a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.768018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.769231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.769557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.769844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.770520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.772701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.774552 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2288/4542] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:18:59.781730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.793581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b321c17-7992-46cf-942d-31c9596a25ba tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.799378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.800352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.800717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.801521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.802292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.804010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.805891 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2255/4543] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:18:59.809722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.821998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fc671-ae71-45e9-8d8a-da468b99de6c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.830514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.832054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.832532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.832988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.833939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.835803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.838075 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2289/4544] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:18:59.842003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.856079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4405e-33fa-48b5-8325-7b59acc5ee6f tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.863111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.864211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.864666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.865147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.866379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.868500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.870550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2256/4545] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:18:59.875458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.890550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7d0bf-9e8d-48ab-b93d-470bc518f439 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.911818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.912207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.912568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.913007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.913863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.918521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.920541 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2290/4546] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:18:59.927222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.944716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef9af1-ebab-4dac-bbd8-74818599e6b1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:18:59.957985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:18:59.960075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:18:59.960520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:18:59.961755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:18:59.962709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:18:59.964490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:18:59.967036 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2257/4547] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:18:59.974663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:18:59.981162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:59.994043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde6ff0-4ae5-435e-a863-fc94c2893812 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.010519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.011528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.011958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.012480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.013335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.015337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.018534 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2291/4548] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:18:59 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.022843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.032616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.036627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:00.052634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de83791-5c80-4b0e-8861-3662c381e25a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.059752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.061861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.062426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.062926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.063785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.065688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.071222 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2258/4549] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.072716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.085082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea5857-b547-4adb-b038-e01d5d224eed tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.091445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.092856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.093333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.093714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.094643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.096866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.106277 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2259/4550] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.108502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.131353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df00a5-16fd-4a5d-a88e-0deda5b40c10 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.138277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.139274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.139967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.140391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.141324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.143085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.145875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2260/4551] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.149782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.169341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b952c-69ba-4307-b1a5-aacbb55dd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.176605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.177448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.177729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.178009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.178689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.180504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.180964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97e94-a6fc-4b69-894b-3a6c343205aa tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.182277 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2261/4552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:00.185820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.186727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.186959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.187084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.189176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:00.192060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.211063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.214910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.219783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05b243-98d1-4129-95fd-5d80445ce10a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.227044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.227831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.228178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.228359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.230011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.231994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.236295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2292/4553] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:19:00.237527 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2262/4554] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.241483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.260182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e64c-21ed-4c4e-babe-406967a49d8c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.266920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.268079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.268475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.268821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.269644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.272121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.274867 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2293/4555] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.278730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.297018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92971997-564c-4f9f-85be-3ffc914770c2 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.305843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.306090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.306373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.306864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.309376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.311477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.313141 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2263/4556] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.317511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.349158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d373291-dae7-4a5a-955d-271ebcd6cccd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.367558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.368728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.369117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.369915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.370185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.372544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.374422 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2294/4557] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.378289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.390124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0675f6e-df8c-49e4-8876-768d10fb5488 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.396232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.397680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.398027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.398378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.399547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.403946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.405992 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2264/4558] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.410033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.425578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d96d8-3ad4-442a-89ce-3a701df4d915 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.432329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.435256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.435617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.435965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.437382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.439883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.442001 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2295/4559] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.445888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.465571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a05c7-a6f6-401a-b907-51db07452ed4 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.470951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.472183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.472529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.472874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.473693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.476506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.478560 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2265/4560] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.482302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.494877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0c792-c86d-4750-8d08-0620ab15f6f6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.503755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.504544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.509180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.509480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.510209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.511882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.517277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2296/4561] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.521782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.534384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e79257-bd4b-494a-be9e-19c040fb4bbf tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.540663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.541555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.541997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.542370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.543199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.545130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.547736 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2266/4562] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.552036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.567823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9b79-549e-47dc-89e2-c5d5ddcdfefb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.577387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.578564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.579255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.580432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.581486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.583303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.584984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2297/4563] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.588778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.599240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d9089-951c-4296-be90-abe95e792327 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.603951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.604847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.605228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.605572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.606788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.608492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.610809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2267/4564] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.614440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.629060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad889817-b665-4fec-8b0c-0b80ab95fd0a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.642171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.643690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.646992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.647402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.649413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.652231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.654426 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2298/4565] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.659384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.672629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb840-ead4-4db1-9d71-9f46da26ad8d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.679702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.680539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.680927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.681806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.682576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.684646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.688134 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2268/4566] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.691875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.713919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a0b45-c5b7-41f8-8de9-7ed032b27af6 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.719135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.720027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.720814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.720814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.721735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.723369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.727569 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2299/4567] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:00.729183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.743706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b8040-d8fe-4213-8beb-eed4b2b4cef5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.759835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.760763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.760935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.761266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.761923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.763519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.767978 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2269/4568] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.769290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.780134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400654-49ed-437d-a819-7549bfc8b948 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.785327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.786394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.786890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.787339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.788170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.789987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.791723 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2300/4569] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.795412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.806922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6792f9-0190-4989-a55a-e1894409cfd5 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.811957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.813407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.814006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.814121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.815505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.819015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.825081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2270/4570] 10.222.0.30 () {58 vars in 1307 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:00.827042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.842975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ed039-a755-4ac3-9d30-e5da1f05e541 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.849049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.850452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.850452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.850656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.851651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.854527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.856085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:00.857624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.859824 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2301/4571] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.863652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.879251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774fcd2-2ce3-4709-b4e4-dff7248a6954 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.886302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.887122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.887409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.887689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.888516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.890643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.896019 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2302/4572] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:00.898899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.926367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88af294-6aea-4e9c-a2e9-15d0d5d77c58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.934147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.935003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.935322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.935649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.936361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.938234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.940484 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2303/4573] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:00.944458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.944713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3c26-654e-4479-8896-a63e224ce6dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.950277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.951169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.951450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.951723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] PATH_INFO: `/v3/users/d5516d85f0ee482facf6a96e2709c41d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.953017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5516d85f0ee482facf6a96e2709c41d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.954921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.958920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab19272-9970-4fa3-95cc-8d998cf9268d tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.964322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.965558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.966044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.966785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.967800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.970212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:00.970399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:00.974807 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2304/4574] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:00.976078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:00.987339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdd2d-20e8-43d4-8333-05705403a87a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:00.992795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:00.993748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:00.994101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:00.994519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:00.997114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:00.997114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.001707 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2305/4575] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:19:00 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:01.002818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.014217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b14e-0fab-4610-8ab3-1e8c1aee56dd tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.019796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5516d85f0ee482facf6a96e2709c41d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.020513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5516d85f0ee482facf6a96e2709c41d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.021264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.022272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.022701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.022985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.023685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.025437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.026821 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2306/4576] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.030966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.032729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:01.035186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5516d85f0ee482facf6a96e2709c41d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.036050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5516d85f0ee482facf6a96e2709c41d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.046123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5516d85f0ee482facf6a96e2709c41d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.047354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7531431-dc55-4f5f-8039-41b8dc9bb088 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.055796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.057145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.057505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.057855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.058775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.061987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.063598 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2307/4577] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.071629 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2271/4578] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:00 2022] DELETE /identity/v3/users/d5516d85f0ee482facf6a96e2709c41d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:01.071801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.080583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191851d-87b3-4155-9669-c5c7b43a5ff8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.181185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.182173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.182638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.183010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.183781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.186431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.190981 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2308/4579] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.192240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.210937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862f8d6-e90a-4b7b-b1d8-5935a6c902c5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.220030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.221297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.221651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.221935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.223554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.228972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.234026 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2272/4580] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.236138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.258650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb862ee9-340b-4816-b737-c10e2018e046 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.291341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.292266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.300852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.301294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.302020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.303687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.313569 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2309/4581] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.315358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.328501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2ae74-ddfc-4cb3-9f8c-59f6f2e39570 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.336710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.338180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.338669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.339139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.340545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.343103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.344625 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2273/4582] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:01.349167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.364543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a00a8e-2df6-46fa-9c82-e82a01d3e690 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.385875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.386758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.387417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.388889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.389606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.391261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.396781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.397013 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2310/4583] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.408579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cc713-e8aa-4408-b274-748561c19ae0 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.418300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.419466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.419996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.420229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.420660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.421988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.422538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:01.427231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.435008 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2274/4584] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.438495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.461443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bacc61-23ab-49b3-84b8-5939444a6cd8 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.473059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.474248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.474248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.474442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.475083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.479077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.480416 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2275/4585] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.481573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:01.490155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.514902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d2263-dd26-46f7-b7b1-20eaafb91c53 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.522213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.522997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.523286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.523570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.524271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.525958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.527710 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2276/4586] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.531611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.545831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4983b-0fc4-4b93-ba15-80ee7e1bf73c tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.550810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.551609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.551892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.553078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.553969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.556288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.558119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2277/4587] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.562726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.575609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ced82-19f4-4041-81ab-9e574645723a tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.580257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.581259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.581541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.581821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] PATH_INFO: `/v3/projects/2ed8b40ca3a94586a2363bd22f6de045` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.583220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed8b40ca3a94586a2363bd22f6de045)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.585197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.594952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6e6f-c9c2-4f26-aadd-b29471ceadfc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.609869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.611008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.613166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.615218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.616678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.625290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.630393 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2278/4588] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.635659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.648792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed8b40ca3a94586a2363bd22f6de045', 'request_id': 'req-dea78818-9c2c-4082-afb8-23ddd68f6f2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.659902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d059f-9ed6-41a7-87d2-afbd1abdd0ea tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.660019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed8b40ca3a94586a2363bd22f6de045', 'request_id': 'req-dea78818-9c2c-4082-afb8-23ddd68f6f2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.671104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed8b40ca3a94586a2363bd22f6de045', 'request_id': 'req-dea78818-9c2c-4082-afb8-23ddd68f6f2b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.685653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] The token cache is being invalidate because project 2ed8b40ca3a94586a2363bd22f6de045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:01.686421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.686781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dea78818-9c2c-4082-afb8-23ddd68f6f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:01.688623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2311/4589] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:01 2022] DELETE /identity/v3/projects/2ed8b40ca3a94586a2363bd22f6de045 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:01.693893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f8ce4-500c-453b-833c-d8a58cbbdcee None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.694223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f8ce4-500c-453b-833c-d8a58cbbdcee None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.694461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f8ce4-500c-453b-833c-d8a58cbbdcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.717353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-aa3f8ce4-500c-453b-833c-d8a58cbbdcee None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:01.719022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aa3f8ce4-500c-453b-833c-d8a58cbbdcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:01.761301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.762112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.762418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.762668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.763401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.765325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.766766 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2279/4590] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.771634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.773404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:01.787134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab88e4-3815-49d0-8d31-224f5d8235dc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.792375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.793244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.793526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.793806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.794671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.796393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.797808 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2280/4591] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.802373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.809199 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2312/4592] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:01.816174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c3d9f-69ea-4765-b489-cbb1c34f35bf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.816656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c3d9f-69ea-4765-b489-cbb1c34f35bf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.817067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c3d9f-69ea-4765-b489-cbb1c34f35bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.819309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cdf53-b766-4306-a4f9-b4f4e41ad559 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.833671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.835092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.835440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.835730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.836416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.838132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.839825 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2281/4593] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.843700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.849765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-976c3d9f-69ea-4765-b489-cbb1c34f35bf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:01.850998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-976c3d9f-69ea-4765-b489-cbb1c34f35bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:01.857948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5781-e849-4709-89e7-c8fde950eabc tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.862811 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2313/4594] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:01.867590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c3d9f-69ea-4765-b489-cbb1c34f35bf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.868463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.869432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.870345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.870728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.871726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.874098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.888215 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2282/4595] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:01.888693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c3d9f-69ea-4765-b489-cbb1c34f35bf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.892540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.896549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.897269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.897606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.897806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.899608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:01.899913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.901568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.904445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0533e99-0c2c-4bc0-baff-763471473d40 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.921646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.922696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.923108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.923683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.924216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.926081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.929978 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2314/4596] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:01.932317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2283/4597] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jun 18 22:19:01.933704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.933929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:01.947876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921b067-c1f9-4aee-8989-3cdaebd961e3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.956983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.958907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.959373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.959601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.960315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.963531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.972799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a503-4fa3-4f38-83fc-9a51a6e720a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:01.979568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:01.980596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:01.981054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:01.981482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:01.982328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:01.984117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:01.996874 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2284/4598] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:01 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:02.006249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.038833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6210-0f78-4c29-9926-1fcf906f57a9 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.055337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.056220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.056510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.056786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.057679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:02.059392 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2315/4599] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:01 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:02.060074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:02.062736 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2285/4600] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Jun 18 22:19:02 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:19:02.064107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.068555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.090675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c176f-ffdf-4ee1-b46c-f0e4aac94abb tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.106601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:02.146744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:02.199723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f18f-0c72-437d-ba54-cc5363ed51f7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.205891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.207175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.207465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.207753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.211509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.212224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.212560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.213151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.213765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:02.216651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:02.229133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Could not find domain: 57aaa03e7c5b4b6088ea25519cfb2fcd.: keystone.exception.DomainNotFound: Could not find domain: 57aaa03e7c5b4b6088ea25519cfb2fcd. Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 57aaa03e7c5b4b6088ea25519cfb2fcd. Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:02.253576 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:02.254537 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:02.255380 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 57aaa03e7c5b4b6088ea25519cfb2fcd. Jun 18 22:19:02.256222 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:02.260086 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2286/4601] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:02 2022] PATCH /identity/v3/domains/57aaa03e7c5b4b6088ea25519cfb2fcd => generated 112 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:02.267919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.271314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2316/4602] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:02 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:02.277813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.290890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e2c32-a192-4b71-ad45-3d950b6393a1 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.303581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.303782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251309df-aad4-4c71-85e0-4f5cfbc1f00d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.304574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.306414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.306414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/52b8fae1510141a589e7dd2d2fa11c64` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.318151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.319072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.319566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.319961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.320486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:02.320876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:02.323298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Could not find domain: 52b8fae1510141a589e7dd2d2fa11c64.: keystone.exception.DomainNotFound: Could not find domain: 52b8fae1510141a589e7dd2d2fa11c64. Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 52b8fae1510141a589e7dd2d2fa11c64. Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:02.340590 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:02.341566 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:02.342371 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 52b8fae1510141a589e7dd2d2fa11c64. Jun 18 22:19:02.343198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:02.347352 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2317/4603] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:02.347931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2287/4604] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:02 2022] PATCH /identity/v3/domains/52b8fae1510141a589e7dd2d2fa11c64 => generated 112 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:02.348007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.359191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.361323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61edf7-dab0-4be6-9020-39eb9be10a28 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.368332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01cdf8bf38245289c997e1303ea01d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782d7923a10a4eaf874a91b72c6f7fb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.369466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.370496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.370705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] PATH_INFO: `/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.383352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b826583-a95a-4ea8-9891-afe113feee58 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.388530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.389802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.390266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.390715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.391549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:02.391854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:02.394874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:02.412309 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2288/4605] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:02.416130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Could not find domain: 025f18fcc4fb4ee1b7719595bc4e5944.: keystone.exception.DomainNotFound: Could not find domain: 025f18fcc4fb4ee1b7719595bc4e5944. Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 025f18fcc4fb4ee1b7719595bc4e5944. Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:02.423200 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:02.424121 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:02.425010 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 025f18fcc4fb4ee1b7719595bc4e5944. Jun 18 22:19:02.425860 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:02.432429 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2318/4606] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:02 2022] PATCH /identity/v3/domains/025f18fcc4fb4ee1b7719595bc4e5944 => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:02.438381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.444695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:02.452149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7651e-4bc2-402d-9937-e48d8943b5a4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.476345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563c2ed-c933-45a3-887b-28d83b994bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.479529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c2ed-c933-45a3-887b-28d83b994bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.479902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c2ed-c933-45a3-887b-28d83b994bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.480508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563c2ed-c933-45a3-887b-28d83b994bfe admin admin] PATH_INFO: `/v3/projects/1647414fea0e49879f9309df26d0415c/users/2b54e680f9de45bbb79113f9f54cb92b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.495604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58e5c2-e23b-4a5b-8882-0030e3737523 tempest-DomainConfigurationTestJSON-595627443 tempest-DomainConfigurationTestJSON-595627443-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.505071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:02.506893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.508918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.509071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] PATH_INFO: `/v3/users/9bc641577da24c06bc57778cbaf74c99` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.514874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc641577da24c06bc57778cbaf74c99)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:02.518050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:02.527942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563c2ed-c933-45a3-887b-28d83b994bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1647414fea0e49879f9309df26d0415c, user_id=2b54e680f9de45bbb79113f9f54cb92b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:02.541415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563c2ed-c933-45a3-887b-28d83b994bfe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:02.570753 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2289/4607] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:02 2022] PUT /identity/v3/projects/1647414fea0e49879f9309df26d0415c/users/2b54e680f9de45bbb79113f9f54cb92b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:02.582851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.583189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.583542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.611823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc641577da24c06bc57778cbaf74c99'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:02.613611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc641577da24c06bc57778cbaf74c99'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:02.623278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] MFA Rules not processed for user `2b54e680f9de45bbb79113f9f54cb92b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:02.626934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:02.632798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc641577da24c06bc57778cbaf74c99'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:02.633972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc641577da24c06bc57778cbaf74c99'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:02.643785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a89f6c8c-2c2a-431e-8305-402b41dd86d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc641577da24c06bc57778cbaf74c99'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:02.670505 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2319/4608] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:02 2022] DELETE /identity/v3/users/9bc641577da24c06bc57778cbaf74c99 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:02.672626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:02.672987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:02.673391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:02.694688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:02.696088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:02.733626 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2290/4609] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:02.748163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.750889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:02.819418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:02.841689 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2320/4610] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:02.850085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:02.853839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:02.868849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807537-fba2-42e6-a274-9f20e662ac08 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:02.898073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:03.015618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:03.016318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:03.016639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:03.016858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:03.020233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331fc41-6d3d-4ca6-85c8-76ad12fd4a82 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:03.031434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:03.032380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:03.032685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:03.033119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:03.061527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:03.064761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:03.091761 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2321/4611] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:03.093730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:03.095412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:03.106474 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2291/4612] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:03.404461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:03.405990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:03.420444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f68d6-5d94-45dd-ab80-3483ab818ce8 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:03.431066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:03.432650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:03.432939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:03.433256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] PATH_INFO: `/v3/users/2b54e680f9de45bbb79113f9f54cb92b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:03.434561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b54e680f9de45bbb79113f9f54cb92b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:03.436718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:03.492021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b54e680f9de45bbb79113f9f54cb92b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.493905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b54e680f9de45bbb79113f9f54cb92b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.516485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b54e680f9de45bbb79113f9f54cb92b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.517322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b54e680f9de45bbb79113f9f54cb92b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.519840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:03.521640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:03.536239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2e0f01be-3344-46f2-af5c-0ebae59de6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b54e680f9de45bbb79113f9f54cb92b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.539098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abec0c-3006-4637-bd77-349d49b6f01d service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:03.544996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:03.546263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:03.546618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:03.546960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] PATH_INFO: `/v3/projects/28ef82f1bf63430884c03ca89261f0a6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:03.549351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ef82f1bf63430884c03ca89261f0a6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:03.552541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:03.566448 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2322/4613] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:03 2022] DELETE /identity/v3/users/2b54e680f9de45bbb79113f9f54cb92b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:03.571638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:03.571840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:03.572123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:03.596112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:03.598089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:03.616797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ef82f1bf63430884c03ca89261f0a6', 'request_id': 'req-9280833a-e5cc-49b8-9f11-0f4bb620de30'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.629523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ef82f1bf63430884c03ca89261f0a6', 'request_id': 'req-9280833a-e5cc-49b8-9f11-0f4bb620de30'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.639824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ef82f1bf63430884c03ca89261f0a6', 'request_id': 'req-9280833a-e5cc-49b8-9f11-0f4bb620de30'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.662104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] The token cache is being invalidate because project 28ef82f1bf63430884c03ca89261f0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:03.663438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.664378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.666371 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2292/4614] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:03 2022] DELETE /identity/v3/projects/28ef82f1bf63430884c03ca89261f0a6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:03.676071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:03.676750 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2323/4615] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:03.680904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:03.698715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:03.700829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:03.730228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:03.751968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:03.806767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280833a-e5cc-49b8-9f11-0f4bb620de30 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:03.820538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:03.834004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:03.834487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:03.834871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] PATH_INFO: `/v3/users/c01cdf8bf38245289c997e1303ea01d8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:03.837426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01cdf8bf38245289c997e1303ea01d8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:03.840467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:03.841562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564b4c-8397-4cb2-b8e0-07239c57a49c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:03.929638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01cdf8bf38245289c997e1303ea01d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.930530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01cdf8bf38245289c997e1303ea01d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.933913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:03.934586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:03.935004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:03.935288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:03.937209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:03.947382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01cdf8bf38245289c997e1303ea01d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.948279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01cdf8bf38245289c997e1303ea01d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.951403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:03.953538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:03.957821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbe4fd7a-3fdd-4890-9aa7-895e1671fa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01cdf8bf38245289c997e1303ea01d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:03.966566 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2324/4616] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:03.972839 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2293/4617] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:03 2022] DELETE /identity/v3/users/c01cdf8bf38245289c997e1303ea01d8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:04.362245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:04.364078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:04.390746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661408-841e-4f6a-8b93-d3d9c4ec5d38 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:04.518379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:04.519287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:04.519622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:04.519842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] PATH_INFO: `/v3/projects/782d7923a10a4eaf874a91b72c6f7fb6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:04.521158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=782d7923a10a4eaf874a91b72c6f7fb6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:04.523381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:04.584941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782d7923a10a4eaf874a91b72c6f7fb6', 'request_id': 'req-679574d6-1892-4bc4-a203-dfee99ab7e1d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:04.593525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782d7923a10a4eaf874a91b72c6f7fb6', 'request_id': 'req-679574d6-1892-4bc4-a203-dfee99ab7e1d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:04.606288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782d7923a10a4eaf874a91b72c6f7fb6', 'request_id': 'req-679574d6-1892-4bc4-a203-dfee99ab7e1d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:04.656579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] The token cache is being invalidate because project 782d7923a10a4eaf874a91b72c6f7fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:04.656913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:04.658333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-679574d6-1892-4bc4-a203-dfee99ab7e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:04.664005 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2325/4618] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:04 2022] DELETE /identity/v3/projects/782d7923a10a4eaf874a91b72c6f7fb6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:04.665759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628c869-1600-477e-926c-fc11b2b5b21b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:04.666285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628c869-1600-477e-926c-fc11b2b5b21b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:04.666358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628c869-1600-477e-926c-fc11b2b5b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:04.718796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c628c869-1600-477e-926c-fc11b2b5b21b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:04.720170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c628c869-1600-477e-926c-fc11b2b5b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:04.815686 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2294/4619] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:04.818175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bdad-4ad5-48fe-bf61-5ed061937ebd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:04.818463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bdad-4ad5-48fe-bf61-5ed061937ebd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:04.818739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bdad-4ad5-48fe-bf61-5ed061937ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:04.827783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:04.850792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ccc0bdad-4ad5-48fe-bf61-5ed061937ebd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:04.854497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ccc0bdad-4ad5-48fe-bf61-5ed061937ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:04.872797 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2326/4620] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:04.876725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628c869-1600-477e-926c-fc11b2b5b21b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:04.888122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628c869-1600-477e-926c-fc11b2b5b21b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:04.893413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:04.894421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:04.894714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:04.894990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:04.895787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:04.896207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:04.898077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:04.919017 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2295/4621] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:04.919847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0bdad-4ad5-48fe-bf61-5ed061937ebd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:04.938905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0bdad-4ad5-48fe-bf61-5ed061937ebd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:04.948913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:04.952191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:04.952830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:04.953417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:04.954516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:04.957455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:04.993642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:04.996693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:04.999777 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2327/4622] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:04 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:05.004146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.014114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc3fce-2d0b-41d4-abcc-96cd853296d3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.121435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0f5fc-41ba-4aac-9375-04af7029310a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.126754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.127612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.127768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.128052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.128752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.130747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.138266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:05.162312 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2328/4623] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:05.164126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.178112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.179160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.179540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b1dfb-e487-46e3-b535-e328b7fdcb14 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.179811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.180259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] PATH_INFO: `/v3/projects/1647414fea0e49879f9309df26d0415c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.181792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1647414fea0e49879f9309df26d0415c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.185363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.198116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.198892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.199476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.199754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.200507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.202584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.217280 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2329/4624] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:05.220961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.232304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7377f-e7c7-4f91-ae95-26c102e774c9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.246719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.247619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.248140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.248572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.249568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.251773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.265014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2330/4625] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:05.269996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.276489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1647414fea0e49879f9309df26d0415c', 'request_id': 'req-48c65848-c2c4-4e3f-b02b-e74f1a871b12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:05.292173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323fe37-df5f-4dd5-bb13-80eb4826858e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.299569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1647414fea0e49879f9309df26d0415c', 'request_id': 'req-48c65848-c2c4-4e3f-b02b-e74f1a871b12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:05.318349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1647414fea0e49879f9309df26d0415c', 'request_id': 'req-48c65848-c2c4-4e3f-b02b-e74f1a871b12'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:05.348231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] The token cache is being invalidate because project 1647414fea0e49879f9309df26d0415c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:05.349845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:05.350778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48c65848-c2c4-4e3f-b02b-e74f1a871b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:05.353532 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2296/4626] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:04 2022] DELETE /identity/v3/projects/1647414fea0e49879f9309df26d0415c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:05.358336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec1fe-af01-4f30-ac12-464957fc7752 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.358870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec1fe-af01-4f30-ac12-464957fc7752 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.360082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec1fe-af01-4f30-ac12-464957fc7752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.398720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-118ec1fe-af01-4f30-ac12-464957fc7752 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:05.400462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-118ec1fe-af01-4f30-ac12-464957fc7752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:05.407593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af951ce-2117-4e9a-bc0a-f0f4461bed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.409062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af951ce-2117-4e9a-bc0a-f0f4461bed8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.409459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af951ce-2117-4e9a-bc0a-f0f4461bed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.409802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af951ce-2117-4e9a-bc0a-f0f4461bed8d admin admin] PATH_INFO: `/v3/projects/7d5468afa95c47368bff1437aa9b3d8d/users/2fb86acd04b5484c9a256e36c45f4af1/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.413625 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2297/4627] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:05.421546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e2c5-9d7d-40ac-ae20-c449ae056a13 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.422020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e2c5-9d7d-40ac-ae20-c449ae056a13 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.422309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082e2c5-9d7d-40ac-ae20-c449ae056a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.440596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af951ce-2117-4e9a-bc0a-f0f4461bed8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5468afa95c47368bff1437aa9b3d8d, user_id=2fb86acd04b5484c9a256e36c45f4af1, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.444462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af951ce-2117-4e9a-bc0a-f0f4461bed8d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.471420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2082e2c5-9d7d-40ac-ae20-c449ae056a13 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:05.471420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2082e2c5-9d7d-40ac-ae20-c449ae056a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:05.475102 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2331/4628] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:05 2022] PUT /identity/v3/projects/7d5468afa95c47368bff1437aa9b3d8d/users/2fb86acd04b5484c9a256e36c45f4af1/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:05.486832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.487169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.487699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.535900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] MFA Rules not processed for user `2fb86acd04b5484c9a256e36c45f4af1`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:05.537480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:05.560447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:05.580252 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2298/4629] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:05.584843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082e2c5-9d7d-40ac-ae20-c449ae056a13 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.608233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082e2c5-9d7d-40ac-ae20-c449ae056a13 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.618060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.619842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.620447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.621905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.623180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:05.624015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.625923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.653022 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2299/4630] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:05.654849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.668581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69627f-3020-46e7-87bf-4465f3e59314 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.675876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.676834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.677288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.677715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.678548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.680777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.713599 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2332/4631] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:05.716657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.719769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:05.732337 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2300/4632] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:05.734811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.751149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5abfa2-2f76-492c-8c35-17bdf289ecfa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.820593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:05.843935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.844622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.844900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.845204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.846048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.848367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.881081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026785-bcc5-4455-88fe-baaa7617d2f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:05.883772 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2333/4633] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:05.887909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.890049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:05.890929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:05.891037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:05.891301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:05.892033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:05.894156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:05.944156 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2301/4634] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:05.948152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:05.967465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0564b9-dba2-4e0f-903a-eef1249f7d40 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.034527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89416524-daa3-4369-9e1d-05e7ea352af0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.046135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.048820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.049708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.051706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.052711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.059687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.090789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.091428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.091722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.092000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.092747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.094395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.121011 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2334/4635] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:05 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:06.122209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2302/4636] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:06.125840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:06.130182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:06.137599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4f89e-30f0-4ebe-b672-efa6ad0567d0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.142765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.144005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.144005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.144192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.145177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.147209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.162983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0486b-68fb-493f-a2b0-4355613ee7b8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.165840 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2303/4637] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:06.167352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:06.179586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.182517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.182768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.183061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.183823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.186743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.223742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf6cd-5e38-4a9f-a941-817a98fe1496 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.240239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c5fc7-242a-49c2-9bcd-41ffcf307861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.241458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c5fc7-242a-49c2-9bcd-41ffcf307861 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.244534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c5fc7-242a-49c2-9bcd-41ffcf307861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.245019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c5fc7-242a-49c2-9bcd-41ffcf307861 admin admin] PATH_INFO: `/v3/projects/f249362c9ded4f7f80f577091cd7d7aa/users/a709d118d06040129e89deacd3a54c10/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.247286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2335/4638] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:06.248423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:06.277625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c5fc7-242a-49c2-9bcd-41ffcf307861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f249362c9ded4f7f80f577091cd7d7aa, user_id=a709d118d06040129e89deacd3a54c10, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.280348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c5fc7-242a-49c2-9bcd-41ffcf307861 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.292558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15385314-6514-483d-b46b-2a49e582a5e6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.315242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.316177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.316458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.316734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] PATH_INFO: `/v3/projects/9102d9b054c5451e88b9dabd019f2c69/users/b2a3eeb6417b4c72ab0a8faecbb48609/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.324442 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2304/4639] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:06 2022] PUT /identity/v3/projects/f249362c9ded4f7f80f577091cd7d7aa/users/a709d118d06040129e89deacd3a54c10/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:06.335396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d35ce-6473-48e4-b67c-6578d7aa203d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.335734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d35ce-6473-48e4-b67c-6578d7aa203d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.335949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d35ce-6473-48e4-b67c-6578d7aa203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.373171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] RBAC: Authorizing `identity:create_grant(project_id=9102d9b054c5451e88b9dabd019f2c69, user_id=b2a3eeb6417b4c72ab0a8faecbb48609, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.376495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.377402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b74d35ce-6473-48e4-b67c-6578d7aa203d None None] MFA Rules not processed for user `a709d118d06040129e89deacd3a54c10`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:06.378999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b74d35ce-6473-48e4-b67c-6578d7aa203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:06.414786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:06.463226 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2336/4640] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:06 2022] PUT /identity/v3/projects/9102d9b054c5451e88b9dabd019f2c69/users/b2a3eeb6417b4c72ab0a8faecbb48609/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:06.467355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:06.530906 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2305/4641] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:06.602635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda44a1a-dd33-43cb-8342-3f4f7839eada admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.608418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.609218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.609508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.609785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.610525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.612214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.628987 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2337/4642] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:06.634865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d35ce-6473-48e4-b67c-6578d7aa203d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:06.670591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:06.675095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:06.677483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:06.748741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d35ce-6473-48e4-b67c-6578d7aa203d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.755000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f338045-b97c-4ac2-b5d6-d765d11a8752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.755970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338045-b97c-4ac2-b5d6-d765d11a8752 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.756250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338045-b97c-4ac2-b5d6-d765d11a8752 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.756522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338045-b97c-4ac2-b5d6-d765d11a8752 admin admin] PATH_INFO: `/v3/projects/9102d9b054c5451e88b9dabd019f2c69/users/b2a3eeb6417b4c72ab0a8faecbb48609/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.761192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f338045-b97c-4ac2-b5d6-d765d11a8752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9102d9b054c5451e88b9dabd019f2c69, user_id=b2a3eeb6417b4c72ab0a8faecbb48609, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:06.762315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f338045-b97c-4ac2-b5d6-d765d11a8752 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:06.797082 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2306/4643] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:06 2022] PUT /identity/v3/projects/9102d9b054c5451e88b9dabd019f2c69/users/b2a3eeb6417b4c72ab0a8faecbb48609/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:06.806744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a54df-a75b-470c-a9ea-d38989bc1b0f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.807071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a54df-a75b-470c-a9ea-d38989bc1b0f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.807350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a54df-a75b-470c-a9ea-d38989bc1b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:06.847130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8b1a54df-a75b-470c-a9ea-d38989bc1b0f None None] MFA Rules not processed for user `b2a3eeb6417b4c72ab0a8faecbb48609`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:06.853024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b1a54df-a75b-470c-a9ea-d38989bc1b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:06.858376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b542c-c0ce-4170-9a92-9c81dd010669 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:06.966417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:06.967414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:06.967921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:06.968713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.031519 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2307/4644] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:07.034797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:07.037519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a54df-a75b-470c-a9ea-d38989bc1b0f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.064482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a54df-a75b-470c-a9ea-d38989bc1b0f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:07.085463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:07.086339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:07.086657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:07.094468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.094759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.100427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.117394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.121719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.128805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2308/4645] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:19:07 2022] POST /identity/v3/domains => generated 276 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:07.132707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.167995 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2338/4646] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:19:07.168896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.170321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:07.258464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e742-c4bb-44c9-96aa-6fac91c7daca tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:07.271046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:07.272294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:07.273199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:07.273560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.274473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.280600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.304912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1399b-a0f8-4ac2-a887-4eb7c27aab56 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:07.326939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:07.349248 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2309/4647] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:07 2022] POST /identity/v3/projects => generated 402 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:07.362351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.389516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:07.391230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:07.391652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:07.392351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] PATH_INFO: `/v3/users/eb2d051325e2465b8eb1fa505770857c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.394107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2d051325e2465b8eb1fa505770857c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.396503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.464205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5af1e-3fdc-4cb3-bff5-c91b6c97ada8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:07.478046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:07.478917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:07.479167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:07.479511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.480404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.482718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.491125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2d051325e2465b8eb1fa505770857c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:07.494667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2d051325e2465b8eb1fa505770857c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:07.517747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2d051325e2465b8eb1fa505770857c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:07.519213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2d051325e2465b8eb1fa505770857c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:07.530434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2d051325e2465b8eb1fa505770857c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:07.536567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:07.541598 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2310/4648] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:07 2022] POST /identity/v3/groups => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:07.546116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.547626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:07.561582 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2339/4649] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:07 2022] DELETE /identity/v3/users/eb2d051325e2465b8eb1fa505770857c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:07.568968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326fff1-3b1c-4148-99b0-01f0dd44025d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:07.721220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:07.721921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:07.722095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:07.722372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.723166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.725121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.788876 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2311/4650] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:07 2022] POST /identity/v3/users => generated 445 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:07.793701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.813778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad39984-5a88-43ac-bae8-fe71c7a304c9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:07.826883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:07.827602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:07.827891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:07.828176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.833362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.837555 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:07.837555 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:07.837555 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:07.839245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.877526 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2340/4651] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:07 2022] POST /identity/v3/roles => generated 240 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:07.882005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.896035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839b91-0f34-4ccc-aa97-03441355ce2e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:07.908439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46459b-0d69-452e-b5f5-48c69bcb2946 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:07.909511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46459b-0d69-452e-b5f5-48c69bcb2946 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:07.909919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46459b-0d69-452e-b5f5-48c69bcb2946 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:07.910299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46459b-0d69-452e-b5f5-48c69bcb2946 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/groups/b157e39fa6e640ef9c8750550cc805bb/roles/3e3159dc5c37404fa3df6352e26f4f01/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:07.925994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46459b-0d69-452e-b5f5-48c69bcb2946 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c329fdbabd70494b8383525dd07315e4, group_id=b157e39fa6e640ef9c8750550cc805bb, role_id=3e3159dc5c37404fa3df6352e26f4f01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:07.929819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46459b-0d69-452e-b5f5-48c69bcb2946 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:07.960763 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2312/4652] 10.222.0.30 () {60 vars in 1584 bytes} [Sat Jun 18 22:19:07 2022] PUT /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/groups/b157e39fa6e640ef9c8750550cc805bb/roles/3e3159dc5c37404fa3df6352e26f4f01/inherited_to_projects => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:07.964946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:07.977517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62c10e-e7bb-4f43-a016-d207e9d09538 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:08.060306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170683-9fd7-4b0b-87f8-a30e1700d13e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.060686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170683-9fd7-4b0b-87f8-a30e1700d13e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.061004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170683-9fd7-4b0b-87f8-a30e1700d13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.104812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e5170683-9fd7-4b0b-87f8-a30e1700d13e None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:08.106592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5170683-9fd7-4b0b-87f8-a30e1700d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:08.143625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:08.144610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.144941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.145884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/groups/b157e39fa6e640ef9c8750550cc805bb/roles/3e3159dc5c37404fa3df6352e26f4f01/inherited_to_projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.148690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c329fdbabd70494b8383525dd07315e4, group_id=b157e39fa6e640ef9c8750550cc805bb, role_id=3e3159dc5c37404fa3df6352e26f4f01)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:08.150320 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:08.150320 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:08.150320 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:08.152991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:08.167440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2341/4653] 10.222.0.30 () {58 vars in 1566 bytes} [Sat Jun 18 22:19:07 2022] HEAD /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/groups/b157e39fa6e640ef9c8750550cc805bb/roles/3e3159dc5c37404fa3df6352e26f4f01/inherited_to_projects => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:08.169452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:08.171606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:08.238510 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2313/4654] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:08.238510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5170683-9fd7-4b0b-87f8-a30e1700d13e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:08.251637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5170683-9fd7-4b0b-87f8-a30e1700d13e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:08.257381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:08.258614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.259001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.259284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/groups/b157e39fa6e640ef9c8750550cc805bb/roles/3e3159dc5c37404fa3df6352e26f4f01/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.261713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c329fdbabd70494b8383525dd07315e4, group_id=b157e39fa6e640ef9c8750550cc805bb, role_id=3e3159dc5c37404fa3df6352e26f4f01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:08.263517 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:08.263517 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:08.263517 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:08.267036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:08.271072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:08.277445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role 3e3159dc5c37404fa3df6352e26f4f01 was removed from group b157e39fa6e640ef9c8750550cc805bb on project c329fdbabd70494b8383525dd07315e4. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:08.277646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.278994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.295171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd29ad-cfe1-413a-8257-dbeafb2a8e91 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:08.307241 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2314/4655] 10.222.0.30 () {58 vars in 1568 bytes} [Sat Jun 18 22:19:08 2022] DELETE /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/groups/b157e39fa6e640ef9c8750550cc805bb/roles/3e3159dc5c37404fa3df6352e26f4f01/inherited_to_projects => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:08.308636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:08.310750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:08.407310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:08.408220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.408497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.409112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] PATH_INFO: `/v3/projects/691097edd2ac46af9e83a119b87340e8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.410470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691097edd2ac46af9e83a119b87340e8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:08.413203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:08.467923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:08.488496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63574-3ad8-4363-8e42-7fd58cc793b0 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:08.493489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691097edd2ac46af9e83a119b87340e8', 'request_id': 'req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.503456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691097edd2ac46af9e83a119b87340e8', 'request_id': 'req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.517067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691097edd2ac46af9e83a119b87340e8', 'request_id': 'req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.532294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] The token cache is being invalidate because project 691097edd2ac46af9e83a119b87340e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:08.532627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.534188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a0462d-2bef-4ee6-bc4b-ddefe5563f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.535872 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2342/4656] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:08 2022] DELETE /identity/v3/projects/691097edd2ac46af9e83a119b87340e8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:08.543695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8affff-184d-4948-99fd-69e268092c7c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.543983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8affff-184d-4948-99fd-69e268092c7c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.544294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8affff-184d-4948-99fd-69e268092c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.568210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ed8affff-184d-4948-99fd-69e268092c7c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:08.570102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ed8affff-184d-4948-99fd-69e268092c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:08.582532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:08.583762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.584505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.584965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles/3e3159dc5c37404fa3df6352e26f4f01` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.587682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3e3159dc5c37404fa3df6352e26f4f01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:08.589736 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:08.589736 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:08.589736 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:08.594120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:08.679685 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2343/4657] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:08.687766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role 3e3159dc5c37404fa3df6352e26f4f01 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:08.687766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.687766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.689346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09b444-0072-4220-a0f4-70b270f3a897 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.689631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09b444-0072-4220-a0f4-70b270f3a897 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.689912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09b444-0072-4220-a0f4-70b270f3a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.692403 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2315/4658] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:08 2022] DELETE /identity/v3/roles/3e3159dc5c37404fa3df6352e26f4f01 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:08.697447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:08.699713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:08.718217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8e09b444-0072-4220-a0f4-70b270f3a897 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:08.719448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e09b444-0072-4220-a0f4-70b270f3a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:08.804714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa62cf-8c33-42ee-868f-6ae6c24be456 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:08.814599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:08.815386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.815674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.816455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.817003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:08.818490 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:08.818490 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:08.818490 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:08.819339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:08.823293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:08.851116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2316/4659] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:08 2022] POST /identity/v3/roles => generated 237 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:08.851116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:08.855287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:08.857684 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2344/4660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:08.859791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09b444-0072-4220-a0f4-70b270f3a897 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:08.874056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09b444-0072-4220-a0f4-70b270f3a897 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:08.880680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:08.882128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.883921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.884211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/eb0312dadc484cd48de6afa367c57556/inherited_to_projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.891066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee2408-2da2-4a4b-8b47-e71d9ad2c70e tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:08.907557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c329fdbabd70494b8383525dd07315e4, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=eb0312dadc484cd48de6afa367c57556)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:08.907773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:08.908559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:08.908939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:08.909242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] PATH_INFO: `/v3/users/a709d118d06040129e89deacd3a54c10` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:08.911005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a709d118d06040129e89deacd3a54c10)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:08.912271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:08.913019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:08.935344 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2345/4661] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Jun 18 22:19:08 2022] PUT /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/eb0312dadc484cd48de6afa367c57556/inherited_to_projects => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:08.936563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:08.994766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a709d118d06040129e89deacd3a54c10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.995839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a709d118d06040129e89deacd3a54c10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:08.996845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:09.016258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a709d118d06040129e89deacd3a54c10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:09.017351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a709d118d06040129e89deacd3a54c10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:09.036465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a709d118d06040129e89deacd3a54c10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:09.075603 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2317/4662] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:08 2022] DELETE /identity/v3/users/a709d118d06040129e89deacd3a54c10 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:09.076474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.078094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.090327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ca27-f681-4eb4-80f4-1bdcd4b5f6f1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.207482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572e24-381f-4d22-9b39-e088e80e8e07 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.214449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c479b0-3cc3-460c-87f8-0767971232f7 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.215491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c479b0-3cc3-460c-87f8-0767971232f7 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.215838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c479b0-3cc3-460c-87f8-0767971232f7 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.216182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c479b0-3cc3-460c-87f8-0767971232f7 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/eb0312dadc484cd48de6afa367c57556/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.218951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c479b0-3cc3-460c-87f8-0767971232f7 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c329fdbabd70494b8383525dd07315e4, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=eb0312dadc484cd48de6afa367c57556)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.220343 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-56c479b0-3cc3-460c-87f8-0767971232f7 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:09.220343 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:09.220343 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:09.223040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c479b0-3cc3-460c-87f8-0767971232f7 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.236780 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2318/4663] 10.222.0.30 () {58 vars in 1563 bytes} [Sat Jun 18 22:19:09 2022] HEAD /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/eb0312dadc484cd48de6afa367c57556/inherited_to_projects => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:09.239048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.239550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.241001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.272105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:09.274553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.303381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.304614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.304904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.305211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.307169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:09.307786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.309984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.329119 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2346/4664] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:09.330014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.348874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e036-8a08-4190-a4e9-bb0854f19f87 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.366927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.367833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.368700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.369054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/eb0312dadc484cd48de6afa367c57556/inherited_to_projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.372409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c329fdbabd70494b8383525dd07315e4, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=eb0312dadc484cd48de6afa367c57556)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.374579 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:09.374579 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:09.374579 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:09.378373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.389229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role eb0312dadc484cd48de6afa367c57556 was removed from user 3dceb22be0c44e9eb6eee395d20d50f5 on project c329fdbabd70494b8383525dd07315e4. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:09.389663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:09.390412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:09.399686 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2319/4665] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:09.402273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.405825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.432549 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2347/4666] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Jun 18 22:19:09 2022] DELETE /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/eb0312dadc484cd48de6afa367c57556/inherited_to_projects => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:09.437905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.440751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb483f-9d13-4cd0-8dac-e3257588f286 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.441782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.453901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:09.531746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b41e-d607-47e2-a7cd-761f17d5e04a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.534138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.535118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.535670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.536771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.537430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.537824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.538474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.538855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.539313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.541414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.542102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.571907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.574471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.585701 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2320/4667] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:09 2022] POST /identity/v3/projects => generated 395 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:09.586615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.588483 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2348/4668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:09.589456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.592435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.595191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.625448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5250d23-f5ee-4c0e-ac15-b57d3d12223c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.683034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6746-90bb-4c9b-8c0e-bf8029a5a875 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.689899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.690981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.691312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.691594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles/eb0312dadc484cd48de6afa367c57556` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.693898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eb0312dadc484cd48de6afa367c57556)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.695915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.737204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.738653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.739139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.740199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.741616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.745376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.755803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:09.787600 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2349/4669] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:09 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:09.790390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role eb0312dadc484cd48de6afa367c57556 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:09.791446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:09.792148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.794169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.796361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:09.806284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2321/4670] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:09 2022] DELETE /identity/v3/roles/eb0312dadc484cd48de6afa367c57556 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:09.809235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:09.812758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461d5db-de46-4d15-80db-c977b4330b9b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.813376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:09.921500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:09.926583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ef4a-8165-4bb5-926d-23efa7d9d39b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:09.934062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.935628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.936242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.936674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.937972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.941437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.948692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:09.952168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:09.952842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:09.954150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:09.960750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:09.970264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:09.977397 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2322/4671] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:09 2022] POST /identity/v3/roles => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:09.981621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.005891 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2350/4672] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:09 2022] GET /identity/v3/roles => generated 1651 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:10.010353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.015528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162e18c-5930-44e9-94fb-1117b72c8e0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.022035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.024127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.024530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.024926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/2b25a24bb9b043a78e3d0dbea1b5e395/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.027760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, group_id=b157e39fa6e640ef9c8750550cc805bb, role_id=2b25a24bb9b043a78e3d0dbea1b5e395)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.032710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.038953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd4830-cbf5-493f-aae6-952015c68b3b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.051605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.052499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.052755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.056373 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2323/4673] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Jun 18 22:19:09 2022] PUT /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/2b25a24bb9b043a78e3d0dbea1b5e395/inherited_to_projects => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:10.056535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.057309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.059884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.061737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.085090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2351/4674] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:10 2022] GET /identity/v3/roles => generated 1651 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:10.087011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.108300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0acd55-3669-4de0-a3a7-189a6e9531df admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.211495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f12943-4a75-4217-a9e5-da8d89bc58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.213287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12943-4a75-4217-a9e5-da8d89bc58dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.213681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12943-4a75-4217-a9e5-da8d89bc58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.214058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12943-4a75-4217-a9e5-da8d89bc58dc admin admin] PATH_INFO: `/v3/projects/e844852ee0a54325a07962baa9b8551b/users/59876c2e98254d29b51b071f68569602/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.222380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9acf7-1edb-4b32-bf3b-fcb632f6cb05 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.237535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f2b8-820b-46cc-87d5-692cb403ccaa tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.237535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f2b8-820b-46cc-87d5-692cb403ccaa tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.237535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f2b8-820b-46cc-87d5-692cb403ccaa tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.237887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f2b8-820b-46cc-87d5-692cb403ccaa tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.237976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f12943-4a75-4217-a9e5-da8d89bc58dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e844852ee0a54325a07962baa9b8551b, user_id=59876c2e98254d29b51b071f68569602, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.243331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f12943-4a75-4217-a9e5-da8d89bc58dc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.251978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f2b8-820b-46cc-87d5-692cb403ccaa tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, group_id=b157e39fa6e640ef9c8750550cc805bb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.253253 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-7e51f2b8-820b-46cc-87d5-692cb403ccaa tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:10.253253 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:10.253253 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:10.255337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f2b8-820b-46cc-87d5-692cb403ccaa tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.281399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2352/4675] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:10 2022] PUT /identity/v3/projects/e844852ee0a54325a07962baa9b8551b/users/59876c2e98254d29b51b071f68569602/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:10.281399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261f15-db5c-48f1-b631-f2d0b8255312 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.282026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261f15-db5c-48f1-b631-f2d0b8255312 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.282026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261f15-db5c-48f1-b631-f2d0b8255312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.297200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2324/4676] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Jun 18 22:19:10 2022] GET /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/inherited_to_projects => generated 448 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:10.298108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.298396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.301315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.310478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5a261f15-db5c-48f1-b631-f2d0b8255312 None None] MFA Rules not processed for user `ab975e8ffd0448939b2105aed58003fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:10.312043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5a261f15-db5c-48f1-b631-f2d0b8255312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:10.336045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:10.338753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:10.407770 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2353/4677] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:10.407770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261f15-db5c-48f1-b631-f2d0b8255312 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.410374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:10.442074 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2325/4678] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:10.458445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.460643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:10.528295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261f15-db5c-48f1-b631-f2d0b8255312 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.542519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.549132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.549834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.550362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/2b25a24bb9b043a78e3d0dbea1b5e395/inherited_to_projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.558104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, group_id=b157e39fa6e640ef9c8750550cc805bb, role_id=2b25a24bb9b043a78e3d0dbea1b5e395)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.565894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.567503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810467-7eff-4435-bcfa-fdb7e1bf0147 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.577841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.578911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.579527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.579845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.583875 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2354/4679] 10.222.0.30 () {58 vars in 1563 bytes} [Sat Jun 18 22:19:10 2022] HEAD /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/2b25a24bb9b043a78e3d0dbea1b5e395/inherited_to_projects => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:10.585820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.604113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.605756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.614392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51878-1e9a-43cb-86dc-ebb696c33a17 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.621912 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2326/4680] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:10.624720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.625951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.626420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.626800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/2b25a24bb9b043a78e3d0dbea1b5e395/inherited_to_projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.629869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, group_id=b157e39fa6e640ef9c8750550cc805bb, role_id=2b25a24bb9b043a78e3d0dbea1b5e395)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.633106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.639769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role 2b25a24bb9b043a78e3d0dbea1b5e395 was removed from group b157e39fa6e640ef9c8750550cc805bb on domain 62dc9b121d3b48b2809223fe1e1c43bf. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:10.640064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:10.641056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:10.673713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2355/4681] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Jun 18 22:19:10 2022] DELETE /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/groups/b157e39fa6e640ef9c8750550cc805bb/roles/2b25a24bb9b043a78e3d0dbea1b5e395/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:10.678168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.692844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a849ead-ca69-4d24-a406-a7b47b6fd573 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:10.714220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:10.889345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:10.891577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:10.892070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:10.892513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles/2b25a24bb9b043a78e3d0dbea1b5e395` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:10.895690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2b25a24bb9b043a78e3d0dbea1b5e395)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:10.897709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:10.970777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role 2b25a24bb9b043a78e3d0dbea1b5e395 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:10.971079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:10.972112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:10.977613 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2327/4682] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:10 2022] DELETE /identity/v3/roles/2b25a24bb9b043a78e3d0dbea1b5e395 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:10.983041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:10.984942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:11.019721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55217f-0a33-4d6c-8f7d-10f961cc7ad9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.114684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.115807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.116214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.116624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.117857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.119847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:11.143043 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2356/4683] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:10 2022] POST /identity/v3/roles => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:11.147323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:11.149632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:11.165083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:11.167335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86454c1d-565d-4ca5-b0a8-ef7faf947eda tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.167722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:11.172714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.173642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.173932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.174220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/fbaa5f499acd4c52a4d733434826019a/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.176682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=fbaa5f499acd4c52a4d733434826019a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.179501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:11.213214 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2328/4684] 10.222.0.30 () {60 vars in 1578 bytes} [Sat Jun 18 22:19:11 2022] PUT /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/fbaa5f499acd4c52a4d733434826019a/inherited_to_projects => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:11.218999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:11.308061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf2609-9527-40b0-b41b-3d5cef1a679d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.312502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710c70-8f34-49db-8b81-49a70ec38b99 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.321695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.322165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.322449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.322775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.326681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, user_id=3dceb22be0c44e9eb6eee395d20d50f5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.330254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:11.347437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:11.352164 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2329/4685] 10.222.0.30 () {58 vars in 1460 bytes} [Sat Jun 18 22:19:11 2022] GET /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/inherited_to_projects => generated 447 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:11.356591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:11.385443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bf962-270f-4476-8094-723b6e345cdd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.397222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.397929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.398128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.398414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/fbaa5f499acd4c52a4d733434826019a/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.403234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=fbaa5f499acd4c52a4d733434826019a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.410291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:11.432115 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2330/4686] 10.222.0.30 () {58 vars in 1560 bytes} [Sat Jun 18 22:19:11 2022] HEAD /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/fbaa5f499acd4c52a4d733434826019a/inherited_to_projects => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:11.432201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.432875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:11.434046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.434324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.434594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] PATH_INFO: `/v3/projects/f249362c9ded4f7f80f577091cd7d7aa` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.440527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f249362c9ded4f7f80f577091cd7d7aa)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.442523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:11.458035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea10ed-8d15-4e30-9dae-23ca4dddccc9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.466081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.466984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.469309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.469608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/fbaa5f499acd4c52a4d733434826019a/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.475013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=fbaa5f499acd4c52a4d733434826019a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.479605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:11.487998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role fbaa5f499acd4c52a4d733434826019a was removed from user 3dceb22be0c44e9eb6eee395d20d50f5 on domain 62dc9b121d3b48b2809223fe1e1c43bf. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:11.488307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:11.489109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:11.521884 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2331/4687] 10.222.0.30 () {58 vars in 1562 bytes} [Sat Jun 18 22:19:11 2022] DELETE /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/fbaa5f499acd4c52a4d733434826019a/inherited_to_projects => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:11.523757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:11.526456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:11.534373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f249362c9ded4f7f80f577091cd7d7aa', 'request_id': 'req-f9ad243d-0c08-4933-9435-34c96380539b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:11.555028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f249362c9ded4f7f80f577091cd7d7aa', 'request_id': 'req-f9ad243d-0c08-4933-9435-34c96380539b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:11.571887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f249362c9ded4f7f80f577091cd7d7aa', 'request_id': 'req-f9ad243d-0c08-4933-9435-34c96380539b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:11.588948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] The token cache is being invalidate because project f249362c9ded4f7f80f577091cd7d7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:11.589571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:11.590330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f9ad243d-0c08-4933-9435-34c96380539b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:11.596409 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2357/4688] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:11 2022] DELETE /identity/v3/projects/f249362c9ded4f7f80f577091cd7d7aa => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:11.598951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319f88-a88f-4872-a37c-5e9c2c975abd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.599312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319f88-a88f-4872-a37c-5e9c2c975abd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.599495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319f88-a88f-4872-a37c-5e9c2c975abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.632719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-24319f88-a88f-4872-a37c-5e9c2c975abd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:11.645432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-24319f88-a88f-4872-a37c-5e9c2c975abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:11.648387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:11.751049 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2358/4689] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:11.762533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001128-bd32-4233-8369-80bcb7954259 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.764755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65878d-0528-4e41-a0b1-2caf99d628bc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.765265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65878d-0528-4e41-a0b1-2caf99d628bc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.765928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65878d-0528-4e41-a0b1-2caf99d628bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.830418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9e65878d-0528-4e41-a0b1-2caf99d628bc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:11.835430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9e65878d-0528-4e41-a0b1-2caf99d628bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:11.867297 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2359/4690] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:11.869958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65878d-0528-4e41-a0b1-2caf99d628bc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:11.896690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65878d-0528-4e41-a0b1-2caf99d628bc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:11.921682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.930330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.930654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.930947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.931735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:11.932043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.940339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:11.947645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:11.950273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:11.950778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:11.952177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles/fbaa5f499acd4c52a4d733434826019a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:11.958566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fbaa5f499acd4c52a4d733434826019a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:11.962634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.004821 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2360/4691] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:12.006425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.028585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa154d3-7d2e-4cdf-b8dd-3030f56d8a8c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.048511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role fbaa5f499acd4c52a4d733434826019a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:12.048937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:12.058142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:12.059004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.061201 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2332/4692] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:11 2022] DELETE /identity/v3/roles/fbaa5f499acd4c52a4d733434826019a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:12.062622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.064093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.064643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.066793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.068230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.068338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:12.076313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.167653 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2361/4693] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:12 2022] POST /identity/v3/projects => generated 397 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:12.169581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.171545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:12.188551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:12.209089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f18d4-1759-4cfd-940b-9dfd2875f14d tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.313894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:12.326491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e50e78-5a76-4daa-b759-494c6eff8d44 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.333616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.334748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.335139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.335671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.336496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.339306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.339623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.340327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.340611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.340891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.342228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.345116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.383967 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2333/4694] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:12 2022] POST /identity/v3/roles => generated 240 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:12.390302 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2362/4695] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:12 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:12.394178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.395493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.409695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84964e16-74a6-4154-9d65-887c9448274b tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.419200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5389c-e4ff-4e82-8730-4aa24eb1b483 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.421839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.422544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.423452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.423452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.423901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.426167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.439900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.443875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.445117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.446575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.447554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.451840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.488648 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2363/4696] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:12 2022] GET /identity/v3/roles => generated 1651 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:12.490956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.502827 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2334/4697] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:12 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:12.507416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.518459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466335c3-9b60-43ba-be13-c94e7ac0403e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.638128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d7ca6-5425-435b-bc48-2d84df610998 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.653835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.654739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.655017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.655339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/0bb00595cabc47498b45c0d028442cf8/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.658575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=0bb00595cabc47498b45c0d028442cf8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.661642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.668037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.668767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.669463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.670098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.670910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.680267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.686652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2335/4698] 10.222.0.30 () {60 vars in 1578 bytes} [Sat Jun 18 22:19:12 2022] PUT /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/0bb00595cabc47498b45c0d028442cf8/inherited_to_projects => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:12.691127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.703645 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2364/4699] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:12 2022] GET /identity/v3/roles => generated 1651 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:12.707687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:12.732207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e128b5-daba-4faf-ad60-c8724495c39d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.863148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b16e5-2ea5-4a40-a459-8d10402b52f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.865892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b16e5-2ea5-4a40-a459-8d10402b52f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.866714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b16e5-2ea5-4a40-a459-8d10402b52f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.867184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b16e5-2ea5-4a40-a459-8d10402b52f8 admin admin] PATH_INFO: `/v3/projects/03b29ea7dee449169fd9eb341e78d16c/users/78f3002bcf404d5eb3543d24a4496630/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.902958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93d713-18d1-40be-883f-3fd020eee17a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:12.919276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:12.920137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.920453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.922327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:12.925156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Adding query filter params (scope.project.id=c329fdbabd70494b8383525dd07315e4, user.id=3dceb22be0c44e9eb6eee395d20d50f5) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:12.925568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.926651 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:12.926651 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:12.926651 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:12.927453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b16e5-2ea5-4a40-a459-8d10402b52f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b29ea7dee449169fd9eb341e78d16c, user_id=78f3002bcf404d5eb3543d24a4496630, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:12.928518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.931474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b16e5-2ea5-4a40-a459-8d10402b52f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:12.953424 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2365/4700] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:12 2022] PUT /identity/v3/projects/03b29ea7dee449169fd9eb341e78d16c/users/78f3002bcf404d5eb3543d24a4496630/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:12.967973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:12.967973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:12.970620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.032754 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2336/4701] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:12 2022] GET /identity/v3/role_assignments?scope.project.id=c329fdbabd70494b8383525dd07315e4&user.id=3dceb22be0c44e9eb6eee395d20d50f5&effective => generated 648 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:13.034610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:13.043802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:13.058899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c6043-21ca-40d8-aaa0-a4d024e42813 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:13.062368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] MFA Rules not processed for user `78f3002bcf404d5eb3543d24a4496630`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:13.064182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:13.076917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:13.210512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:13.211201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:13.211664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:13.215146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.216039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Adding query filter params (scope.project.id=3d896e9f5bcd4c3ab7884e59e6facf65, user.id=3dceb22be0c44e9eb6eee395d20d50f5) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:13.217670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:13.220373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:13.252501 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2366/4702] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:13.258590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:13.260529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:13.327032 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2337/4703] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:13 2022] GET /identity/v3/role_assignments?scope.project.id=3d896e9f5bcd4c3ab7884e59e6facf65&user.id=3dceb22be0c44e9eb6eee395d20d50f5&effective => generated 648 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:13.328207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:13.357592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5b669-e1e9-4861-a4b5-435c51639f0c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:13.372388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:13.373888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:13.374005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:13.374665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/0bb00595cabc47498b45c0d028442cf8/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.377368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=62dc9b121d3b48b2809223fe1e1c43bf, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=0bb00595cabc47498b45c0d028442cf8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:13.381345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:13.392680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role 0bb00595cabc47498b45c0d028442cf8 was removed from user 3dceb22be0c44e9eb6eee395d20d50f5 on domain 62dc9b121d3b48b2809223fe1e1c43bf. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:13.393196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:13.394042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:13.431042 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2338/4704] 10.222.0.30 () {58 vars in 1562 bytes} [Sat Jun 18 22:19:13 2022] DELETE /identity/v3/OS-INHERIT/domains/62dc9b121d3b48b2809223fe1e1c43bf/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/0bb00595cabc47498b45c0d028442cf8/inherited_to_projects => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:13.447895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:13.450855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:13.468182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8070ca-b291-4bc1-84ff-449f211ca480 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:13.605169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfad9f-1aee-4230-b28a-8981054abb64 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:13.615716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:13.616421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:13.616709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:13.616991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.617871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Adding query filter params (scope.project.id=c329fdbabd70494b8383525dd07315e4, user.id=3dceb22be0c44e9eb6eee395d20d50f5) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:13.618184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:13.620800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:13.633593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236701-32f2-40ec-81bb-f957dc45dd0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:13.634352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236701-32f2-40ec-81bb-f957dc45dd0f service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:13.634648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236701-32f2-40ec-81bb-f957dc45dd0f service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:13.634937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236701-32f2-40ec-81bb-f957dc45dd0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.644581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6c236701-32f2-40ec-81bb-f957dc45dd0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:13.726253 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2339/4705] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:13 2022] GET /identity/v3/role_assignments?scope.project.id=c329fdbabd70494b8383525dd07315e4&user.id=3dceb22be0c44e9eb6eee395d20d50f5&effective => generated 228 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:13.731391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:13.738050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:13.755293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447acf-992f-4fa6-be3a-2e40b1f4dfe1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:13.773884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:13.774592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:13.774881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:13.775166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.776020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Adding query filter params (scope.project.id=3d896e9f5bcd4c3ab7884e59e6facf65, user.id=3dceb22be0c44e9eb6eee395d20d50f5) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:13.776337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:13.778275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:13.781026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:13.790610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c236701-32f2-40ec-81bb-f957dc45dd0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:13.792350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c236701-32f2-40ec-81bb-f957dc45dd0f service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:13.829375 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2367/4706] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:19:13.914354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:13.914597 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2340/4707] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:13 2022] GET /identity/v3/role_assignments?scope.project.id=3d896e9f5bcd4c3ab7884e59e6facf65&user.id=3dceb22be0c44e9eb6eee395d20d50f5&effective => generated 228 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:13.914692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:13.914769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.918518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:13.935965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] MFA Rules not processed for user `78f3002bcf404d5eb3543d24a4496630`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:13.938594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:13.938790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b05c0-6f30-43e8-ab20-7a6ad84233f9 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:13.947963 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2368/4708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:13.951106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:13.952009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:13.952774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:13.952774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/projects/3d896e9f5bcd4c3ab7884e59e6facf65` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:13.953848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d896e9f5bcd4c3ab7884e59e6facf65)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:13.955846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:14.072416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:14.074412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:14.082997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d896e9f5bcd4c3ab7884e59e6facf65', 'request_id': 'req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:14.094120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d896e9f5bcd4c3ab7884e59e6facf65', 'request_id': 'req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:14.106578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d896e9f5bcd4c3ab7884e59e6facf65', 'request_id': 'req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:14.128369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] The token cache is being invalidate because project 3d896e9f5bcd4c3ab7884e59e6facf65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:14.129218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:14.130159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:14.138323 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2341/4709] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:13 2022] DELETE /identity/v3/projects/3d896e9f5bcd4c3ab7884e59e6facf65 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:14.139361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:14.145851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:14.197424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797be42-3eb8-41ed-90bc-ba3bb06868a3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:14.303578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:14.304347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:14.304699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:14.305063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:14.308210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:14.311593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec388-9cf2-4c07-b722-60fe0b3c73de tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:14.324727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:14.327309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:14.327672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:14.330225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles/0bb00595cabc47498b45c0d028442cf8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:14.333479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0bb00595cabc47498b45c0d028442cf8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:14.335419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:14.441172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role 0bb00595cabc47498b45c0d028442cf8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:14.441451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:14.445653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:14.458675 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2342/4710] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:14 2022] DELETE /identity/v3/roles/0bb00595cabc47498b45c0d028442cf8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:14.459600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:14.463435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:14.475495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:14.478211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:14.478945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:14.498188 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2369/4711] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:14.500932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:14.518776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235f003-82e6-4097-a8c6-8f99b5b05eda service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:14.620926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:14.672281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce6bc6-7b0f-45c4-9f4f-4daf3cfeba85 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:14.680011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:14.683283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:14.683790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:14.685771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:14.687498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:14.694445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:14.700976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:14.701611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:14.701897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:14.702206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:14.716437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:14.777364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2370/4712] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:14 2022] POST /identity/v3/roles => generated 238 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:14.794669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:14.799288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:14.860928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:14.866797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:14.888122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2343/4713] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:14.889531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:14.893727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:14.924652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375b51a-1048-4927-9186-829fb3580a0a service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:14.937627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:14.938321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:14.938602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:14.938876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:14.939624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:14.945063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5aa4e-a984-4f9c-8828-0cd10dc6a241 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:14.948759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:14.974076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:14.981348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:14.982612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:14.982612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] PATH_INFO: `/v3/users/78f3002bcf404d5eb3543d24a4496630` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:14.984221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f3002bcf404d5eb3543d24a4496630)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:14.987181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:15.040283 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2344/4714] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:14 2022] POST /identity/v3/projects => generated 409 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:15.044351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:15.115777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f3002bcf404d5eb3543d24a4496630'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:15.118296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f3002bcf404d5eb3543d24a4496630'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:15.152463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b6ba-46f8-477d-83f3-ee131ace78a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:15.155820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f3002bcf404d5eb3543d24a4496630'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:15.157412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f3002bcf404d5eb3543d24a4496630'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:15.160863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:15.162274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:15.162704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:15.163047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/d7edc4c0d8984002a1ccdadb6aacc7bc/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:15.166697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c329fdbabd70494b8383525dd07315e4, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=d7edc4c0d8984002a1ccdadb6aacc7bc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:15.169990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3fb39faf-1451-4e1d-b96b-b4c6be8ea3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f3002bcf404d5eb3543d24a4496630'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:15.170811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:15.194306 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2371/4715] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:14 2022] DELETE /identity/v3/users/78f3002bcf404d5eb3543d24a4496630 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:15.199829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:15.200120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:15.200401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:15.217529 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2345/4716] 10.222.0.30 () {60 vars in 1581 bytes} [Sat Jun 18 22:19:15 2022] PUT /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/d7edc4c0d8984002a1ccdadb6aacc7bc/inherited_to_projects => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:15.226930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:15.236544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:15.245513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:15.246791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:15.274015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:15.325686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:15.346720 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2372/4717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:15.347951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:15.349817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:15.422642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4651c-6bfa-40f4-afad-622279463427 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:15.487927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ead3d-48fa-4788-8613-cd6c16c85e39 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:15.502252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:15.505541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:15.505971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:15.506354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:15.512079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:15.524272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:15.525998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:15.526416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:15.526773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:15.528004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Adding query filter params (scope.project.id=ad5a2508f03b4f71b0ebda902710aecd, user.id=3dceb22be0c44e9eb6eee395d20d50f5) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:15.528462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:15.530684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:15.543979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:15.546339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:15.604261 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2373/4718] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:15.605408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:15.613265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:15.672450 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2346/4719] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:15 2022] GET /identity/v3/role_assignments?scope.project.id=ad5a2508f03b4f71b0ebda902710aecd&user.id=3dceb22be0c44e9eb6eee395d20d50f5&effective => generated 649 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:15.691090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:15.717418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe5fa-fe2e-4987-8971-049f0513b5dd tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:15.728318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:15.728806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:15.729147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:15.729434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/d7edc4c0d8984002a1ccdadb6aacc7bc/inherited_to_projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:15.733232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c329fdbabd70494b8383525dd07315e4, user_id=3dceb22be0c44e9eb6eee395d20d50f5, role_id=d7edc4c0d8984002a1ccdadb6aacc7bc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:15.737002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:15.743900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role d7edc4c0d8984002a1ccdadb6aacc7bc was removed from user 3dceb22be0c44e9eb6eee395d20d50f5 on project c329fdbabd70494b8383525dd07315e4. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:15.744088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:15.745137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:15.760503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9009b9-d64a-4230-85d5-447fd070e60d service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:15.776882 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2347/4720] 10.222.0.30 () {58 vars in 1565 bytes} [Sat Jun 18 22:19:15 2022] DELETE /identity/v3/OS-INHERIT/projects/c329fdbabd70494b8383525dd07315e4/users/3dceb22be0c44e9eb6eee395d20d50f5/roles/d7edc4c0d8984002a1ccdadb6aacc7bc/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:15.782287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:15.783868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:15.936593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:15.937314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:15.937599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:15.937878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:15.946762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:15.985539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:16.041135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd7549-33ab-4bf8-913b-64ee49b2326a tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:16.077357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:16.078178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:16.078472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:16.078809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:16.079605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Adding query filter params (scope.project.id=ad5a2508f03b4f71b0ebda902710aecd, user.id=3dceb22be0c44e9eb6eee395d20d50f5) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:16.079922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:16.091588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:16.147232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:16.175468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:16.179107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:16.208238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2374/4721] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:16.234873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:16.249441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2348/4722] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:15 2022] GET /identity/v3/role_assignments?scope.project.id=ad5a2508f03b4f71b0ebda902710aecd&user.id=3dceb22be0c44e9eb6eee395d20d50f5&effective => generated 228 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:16.285421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b798d1-4e9e-4d6e-b075-606aff226815 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:16.310327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:16.312169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:16.317643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:16.317939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/projects/ad5a2508f03b4f71b0ebda902710aecd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:16.321582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad5a2508f03b4f71b0ebda902710aecd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:16.324299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:16.478269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5a2508f03b4f71b0ebda902710aecd', 'request_id': 'req-a432ff2f-0ecb-4836-911a-fc16fa24ec49'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:16.487615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5a2508f03b4f71b0ebda902710aecd', 'request_id': 'req-a432ff2f-0ecb-4836-911a-fc16fa24ec49'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:16.503245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5a2508f03b4f71b0ebda902710aecd', 'request_id': 'req-a432ff2f-0ecb-4836-911a-fc16fa24ec49'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:16.520024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] The token cache is being invalidate because project ad5a2508f03b4f71b0ebda902710aecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:16.520587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:16.521640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:16.524202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2375/4723] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:16 2022] DELETE /identity/v3/projects/ad5a2508f03b4f71b0ebda902710aecd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:16.528229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:16.530474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:16.575818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842528-2e3c-4219-a68a-fd92c72bded1 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:16.701024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:16.701930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:16.702214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:16.702496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/roles/d7edc4c0d8984002a1ccdadb6aacc7bc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:16.704364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d7edc4c0d8984002a1ccdadb6aacc7bc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:16.706499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:16.787806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invalidating the token cache because role d7edc4c0d8984002a1ccdadb6aacc7bc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:16.788113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:16.788951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:16.791433 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2349/4724] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:16 2022] DELETE /identity/v3/roles/d7edc4c0d8984002a1ccdadb6aacc7bc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:16.796678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:16.812832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432ff2f-0ecb-4836-911a-fc16fa24ec49 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:16.997970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:16.998896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:16.999180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:16.999457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/users/3dceb22be0c44e9eb6eee395d20d50f5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:17.000940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3dceb22be0c44e9eb6eee395d20d50f5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:17.003244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:17.062255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dceb22be0c44e9eb6eee395d20d50f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.063077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dceb22be0c44e9eb6eee395d20d50f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.093709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dceb22be0c44e9eb6eee395d20d50f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.094504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dceb22be0c44e9eb6eee395d20d50f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.114624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dceb22be0c44e9eb6eee395d20d50f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.116795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:17.145057 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2376/4725] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:16 2022] DELETE /identity/v3/users/3dceb22be0c44e9eb6eee395d20d50f5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:17.158378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:17.158378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:17.174063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463ff1a-de03-4bfa-84b3-aa254405ddea tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:17.334028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:17.343119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:17.343686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:17.344037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/groups/b157e39fa6e640ef9c8750550cc805bb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:17.347599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b157e39fa6e640ef9c8750550cc805bb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:17.350291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:17.374405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:17.432409 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2350/4726] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:19:17 2022] DELETE /identity/v3/groups/b157e39fa6e640ef9c8750550cc805bb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:17.433654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:17.435260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:17.459295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b256429-ff9d-4f26-9073-05e6bdaced92 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:17.623252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:17.625487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:17.648513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:17.649851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:17.650368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:17.651000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/projects/c329fdbabd70494b8383525dd07315e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:17.652532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c329fdbabd70494b8383525dd07315e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:17.654835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:17.768877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c329fdbabd70494b8383525dd07315e4', 'request_id': 'req-7246dae1-554b-4385-8fea-80ab93cab951'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.777102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c329fdbabd70494b8383525dd07315e4', 'request_id': 'req-7246dae1-554b-4385-8fea-80ab93cab951'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.800770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c329fdbabd70494b8383525dd07315e4', 'request_id': 'req-7246dae1-554b-4385-8fea-80ab93cab951'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.819574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] The token cache is being invalidate because project c329fdbabd70494b8383525dd07315e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:17.819885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.821366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:17.826715 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2377/4727] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:17 2022] DELETE /identity/v3/projects/c329fdbabd70494b8383525dd07315e4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:17.831723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:17.834990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:17.859830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4b91d-b9a3-4527-9a1e-d7230a9fbeef tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:17.991749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:17.992757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:17.993179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:17.993546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:17.995537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:17.997901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246dae1-554b-4385-8fea-80ab93cab951 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:18.006789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:18.007700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:18.007989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:18.008266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/domains/62dc9b121d3b48b2809223fe1e1c43bf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:18.012783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:18.014600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:18.016268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=62dc9b121d3b48b2809223fe1e1c43bf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:18.018034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:18.045175 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2351/4728] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:18.086124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.088490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.105341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:18.157798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.158820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.166252 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2378/4729] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:17 2022] PATCH /identity/v3/domains/62dc9b121d3b48b2809223fe1e1c43bf => generated 277 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:18.171557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:18.189958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c61657-feec-47f6-b798-1b170e676b1b service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:18.379587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a3eeb6417b4c72ab0a8faecbb48609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9102d9b054c5451e88b9dabd019f2c69', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:18.380673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:18.381068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:18.381499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] PATH_INFO: `/v3/domains/62dc9b121d3b48b2809223fe1e1c43bf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:18.390378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:18.410964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=62dc9b121d3b48b2809223fe1e1c43bf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:18.412847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:18.475947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.485679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.598712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf', 'request_id': 'req-b330ef75-8eda-498f-8729-436bab9c54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.613925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf', 'request_id': 'req-b330ef75-8eda-498f-8729-436bab9c54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.614135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:18.615739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:18.631231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf', 'request_id': 'req-b330ef75-8eda-498f-8729-436bab9c54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.655963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] The token cache is being invalidate because project 62dc9b121d3b48b2809223fe1e1c43bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:18.656907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.657470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.676847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf', 'request_id': 'req-b330ef75-8eda-498f-8729-436bab9c54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.678390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf', 'request_id': 'req-b330ef75-8eda-498f-8729-436bab9c54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.678972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '62dc9b121d3b48b2809223fe1e1c43bf', 'request_id': 'req-b330ef75-8eda-498f-8729-436bab9c54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:18.700688 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2352/4730] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:18 2022] DELETE /identity/v3/domains/62dc9b121d3b48b2809223fe1e1c43bf => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:18.702781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:18.704507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:18.770406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366ef5f-ae1e-4a5c-aaf5-63d61856ba6c tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:18.867546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:18.871006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:18.872436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:18.873996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] PATH_INFO: `/v3/projects/03b29ea7dee449169fd9eb341e78d16c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:18.877487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b29ea7dee449169fd9eb341e78d16c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:18.880291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330ef75-8eda-498f-8729-436bab9c54a8 tempest-InheritsV3TestJSON-1716598362 tempest-InheritsV3TestJSON-1716598362-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:18.882514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:18.895978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:18.903692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:18.903982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:18.904271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] PATH_INFO: `/v3/users/2fb86acd04b5484c9a256e36c45f4af1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:18.907626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb86acd04b5484c9a256e36c45f4af1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:18.916728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:19.025223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:19.039182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb86acd04b5484c9a256e36c45f4af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.041632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb86acd04b5484c9a256e36c45f4af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.085852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb86acd04b5484c9a256e36c45f4af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.088253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb86acd04b5484c9a256e36c45f4af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.098229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b29ea7dee449169fd9eb341e78d16c', 'request_id': 'req-354771be-ca80-4819-b214-b562752a8f54'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.109456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ed08ca5e-d0c5-4c21-9fda-745b81c6411b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb86acd04b5484c9a256e36c45f4af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.113465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b29ea7dee449169fd9eb341e78d16c', 'request_id': 'req-354771be-ca80-4819-b214-b562752a8f54'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.142787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b29ea7dee449169fd9eb341e78d16c', 'request_id': 'req-354771be-ca80-4819-b214-b562752a8f54'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.148495 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2353/4731] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:18 2022] DELETE /identity/v3/users/2fb86acd04b5484c9a256e36c45f4af1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:19.150431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39d1f-cc5f-4485-bb1f-0bc27c06c55b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.151620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39d1f-cc5f-4485-bb1f-0bc27c06c55b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.152748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39d1f-cc5f-4485-bb1f-0bc27c06c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.161368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] The token cache is being invalidate because project 03b29ea7dee449169fd9eb341e78d16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:19.161800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.163211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-354771be-ca80-4819-b214-b562752a8f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:19.167804 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2379/4732] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:18 2022] DELETE /identity/v3/projects/03b29ea7dee449169fd9eb341e78d16c => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:19.173328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.174613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.174908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.193335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4ca39d1f-cc5f-4485-bb1f-0bc27c06c55b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:19.199237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ca39d1f-cc5f-4485-bb1f-0bc27c06c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:19.221820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:19.225429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:19.274853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:19.332613 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2354/4733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:19.378426 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2380/4734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:19.386566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cdfd1-4362-409a-9033-f6c961f96c81 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.387026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cdfd1-4362-409a-9033-f6c961f96c81 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.387110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cdfd1-4362-409a-9033-f6c961f96c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.389749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:19.391638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:19.460130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-695cdfd1-4362-409a-9033-f6c961f96c81 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:19.461505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-695cdfd1-4362-409a-9033-f6c961f96c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:19.489358 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2355/4735] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:19.493934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cdfd1-4362-409a-9033-f6c961f96c81 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:19.513634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cdfd1-4362-409a-9033-f6c961f96c81 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:19.530037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:19.530780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.531018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.531305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.532083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:19.532392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:19.536094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:19.565833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b057667-ced3-4ee3-b6f2-083da3f0219d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:19.567380 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2356/4736] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:19.571027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:19.582616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:19.583370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.583962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.583962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.603742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47429528-b3ec-469e-bdbb-189457bcc2cd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:19.615580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:19.616803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:19.617880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.620314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.620659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.621416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:19.622036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:19.626012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:19.646502 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2381/4737] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:19.700311 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2357/4738] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:19 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:19.702990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:19.717147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcd439-7383-47a6-b091-2fe97d6de0fe service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:19.853168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:19.855834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.856964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.857807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.858905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:19.862521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:19.912159 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2382/4739] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:19 2022] POST /identity/v3/users => generated 303 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:19.915847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:19.927999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8718323-5a9b-44d3-90cc-9ab91c366bcc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:19.933652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:19.933977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:19.934236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:19.946077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:19.947097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:19.949155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:19.984514 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2358/4740] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:19.988446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:20.000666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843544-ba29-488e-a5f1-96d70438d5cd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:20.007447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c0b65-a6ed-4f60-9a37-c0127a9b2d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:20.008590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c0b65-a6ed-4f60-9a37-c0127a9b2d39 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:20.009025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c0b65-a6ed-4f60-9a37-c0127a9b2d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:20.009555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c0b65-a6ed-4f60-9a37-c0127a9b2d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:20.010558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c0b65-a6ed-4f60-9a37-c0127a9b2d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:20.012539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c0b65-a6ed-4f60-9a37-c0127a9b2d39 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:20.055369 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2383/4741] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:20.056418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:20.070795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e56216-638e-44ba-863e-d6c853f3dfac admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:20.082872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:20.083803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:20.084510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:20.084510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] PATH_INFO: `/v3/projects/8b7881662169425eafcad48b5c31f1ee/users/ff7a45b8c6c7462ab3e3e1e1caeadf65/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:20.126768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7881662169425eafcad48b5c31f1ee, user_id=ff7a45b8c6c7462ab3e3e1e1caeadf65, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:20.129738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:20.171118 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2359/4742] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:20 2022] PUT /identity/v3/projects/8b7881662169425eafcad48b5c31f1ee/users/ff7a45b8c6c7462ab3e3e1e1caeadf65/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:20.176889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:20.177601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:20.177887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:20.215325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:20.216712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:20.308440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:20.360640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2384/4743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:20.400178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:20.403109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:20.540087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:20.563451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1ad68-2b16-4cdd-9fb3-cb233d279a47 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:20.568115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:20.569014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:20.569518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:20.569933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:20.592003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:20.593545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:20.607070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2360/4744] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:20.987847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:20.989760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:21.005195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01e46-d628-4a72-a926-e6d4a9ad18fd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:21.022558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:21.043188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:21.043532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:21.043933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] PATH_INFO: `/v3/projects/7d5468afa95c47368bff1437aa9b3d8d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:21.047794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5468afa95c47368bff1437aa9b3d8d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:21.050012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:21.127664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5468afa95c47368bff1437aa9b3d8d', 'request_id': 'req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.145001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5468afa95c47368bff1437aa9b3d8d', 'request_id': 'req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.155178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5468afa95c47368bff1437aa9b3d8d', 'request_id': 'req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.179174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] The token cache is being invalidate because project 7d5468afa95c47368bff1437aa9b3d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:21.179459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.180309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.182687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2385/4745] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:20 2022] DELETE /identity/v3/projects/7d5468afa95c47368bff1437aa9b3d8d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:21.186790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:21.203219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8ae6-a13b-475a-9a52-713440b45a58 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:21.374433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:21.375366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:21.375612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:21.375887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] PATH_INFO: `/v3/users/b2a3eeb6417b4c72ab0a8faecbb48609` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:21.377401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a3eeb6417b4c72ab0a8faecbb48609)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:21.379614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:21.500497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a3eeb6417b4c72ab0a8faecbb48609'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.502454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a3eeb6417b4c72ab0a8faecbb48609'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.534386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a3eeb6417b4c72ab0a8faecbb48609'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.535014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a3eeb6417b4c72ab0a8faecbb48609'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.572280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7dc23109-f8ce-49a2-83bc-2a919b61207b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a3eeb6417b4c72ab0a8faecbb48609'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:21.620779 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2361/4746] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:21 2022] DELETE /identity/v3/users/b2a3eeb6417b4c72ab0a8faecbb48609 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:22.356739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:22.358744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:22.386060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306b0e4-7ae9-46d2-a5af-d00b445faaaf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:22.468772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:22.470843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:22.471301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:22.471817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] PATH_INFO: `/v3/projects/9102d9b054c5451e88b9dabd019f2c69` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:22.473527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9102d9b054c5451e88b9dabd019f2c69)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:22.477768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:22.564898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9102d9b054c5451e88b9dabd019f2c69', 'request_id': 'req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:22.575287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9102d9b054c5451e88b9dabd019f2c69', 'request_id': 'req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:22.588577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9102d9b054c5451e88b9dabd019f2c69', 'request_id': 'req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:22.597377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:22.602463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] The token cache is being invalidate because project 9102d9b054c5451e88b9dabd019f2c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:22.609501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:22.611374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee1a3de0-d5a2-4f41-a17b-f9aa6bfd7fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:22.613878 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2386/4747] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:22 2022] DELETE /identity/v3/projects/9102d9b054c5451e88b9dabd019f2c69 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:22.619420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d775-d016-4682-a10c-23acb29ece7b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:22.622471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d775-d016-4682-a10c-23acb29ece7b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:22.623212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141d775-d016-4682-a10c-23acb29ece7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:22.655638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3141d775-d016-4682-a10c-23acb29ece7b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:22.657229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3141d775-d016-4682-a10c-23acb29ece7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:22.799767 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2362/4748] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:22.801803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dcef7-f668-4f92-9578-228c2c4ac5d6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:22.802097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dcef7-f668-4f92-9578-228c2c4ac5d6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:22.802383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dcef7-f668-4f92-9578-228c2c4ac5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:22.828560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-db8dcef7-f668-4f92-9578-228c2c4ac5d6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:22.829865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-db8dcef7-f668-4f92-9578-228c2c4ac5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:22.849414 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2387/4749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:22.851189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d775-d016-4682-a10c-23acb29ece7b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:22.861019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:22.866990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141d775-d016-4682-a10c-23acb29ece7b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:22.876096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:22.876993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:22.877553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:22.877832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:22.878626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:22.878927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:22.881867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:22.901104 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2363/4750] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:22.904775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dcef7-f668-4f92-9578-228c2c4ac5d6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:22.919125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dcef7-f668-4f92-9578-228c2c4ac5d6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:22.938948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:22.940596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:22.941932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:22.942362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:22.943265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:22.946033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:22.984232 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2388/4751] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:22 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:22.988466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:23.008742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e801ecc-8820-4368-8e8e-834e9aa44460 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:23.098789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:23.099646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:23.099837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:23.100119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:23.101053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:23.105004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:23.160349 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2364/4752] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:22 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:23.166647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:23.184946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf0d1-e8e7-4faa-b79a-343eb4b002ee admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:23.194660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:23.196042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:23.196400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:23.196741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:23.198195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:23.201130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:23.216699 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2389/4753] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:23.220280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:23.235295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab86f8a-1fc2-4a79-b4cd-70cd2a9ec599 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:23.242793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a935-5c7c-4878-b831-ce117f99d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:23.243721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a935-5c7c-4878-b831-ce117f99d999 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:23.244393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a935-5c7c-4878-b831-ce117f99d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:23.244881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a935-5c7c-4878-b831-ce117f99d999 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:23.245891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5a935-5c7c-4878-b831-ce117f99d999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:23.248512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5a935-5c7c-4878-b831-ce117f99d999 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:23.272712 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2365/4754] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:23.277218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:23.294085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f71de-9be5-412f-9f6c-1a844be7e1f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:23.300846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:23.302729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:23.303007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:23.303280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] PATH_INFO: `/v3/projects/3493ebba29f5473eb82183574c0a2554/users/3d242139b04f44dcbd6c5c88437b560a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:23.331126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3493ebba29f5473eb82183574c0a2554, user_id=3d242139b04f44dcbd6c5c88437b560a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:23.335822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:23.369126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2390/4755] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:23 2022] PUT /identity/v3/projects/3493ebba29f5473eb82183574c0a2554/users/3d242139b04f44dcbd6c5c88437b560a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:23.373085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf10c8-3ec3-44a6-aad0-c1dacde504fa None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:23.373726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf10c8-3ec3-44a6-aad0-c1dacde504fa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:23.374663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf10c8-3ec3-44a6-aad0-c1dacde504fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:23.416590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2cbf10c8-3ec3-44a6-aad0-c1dacde504fa None None] MFA Rules not processed for user `3d242139b04f44dcbd6c5c88437b560a`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:23.418235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2cbf10c8-3ec3-44a6-aad0-c1dacde504fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:23.530570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2366/4756] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:23.535310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:23.676250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd9d2f-0c2e-4a01-99ae-6aed4e7c9fbe admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:23.694558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:23.695838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:23.696973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:23.698430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:23.702619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:23.709318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:23.768687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2391/4757] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:23 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:23.768824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf10c8-3ec3-44a6-aad0-c1dacde504fa None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:23.782838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf10c8-3ec3-44a6-aad0-c1dacde504fa None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:23.897289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:23.898329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:23.898798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:23.899184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:23.900300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:23.902650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:23.915887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:23.990405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:23.992457 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2367/4758] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:23 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:24.004697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522719-fe67-466d-9f6e-1387307f794e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.022248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17112ea5-aceb-42f8-87b1-5aae2fbcaf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.022968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112ea5-aceb-42f8-87b1-5aae2fbcaf26 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.023309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112ea5-aceb-42f8-87b1-5aae2fbcaf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.023589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17112ea5-aceb-42f8-87b1-5aae2fbcaf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.024382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112ea5-aceb-42f8-87b1-5aae2fbcaf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.026150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17112ea5-aceb-42f8-87b1-5aae2fbcaf26 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.052177 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2392/4759] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:24.056965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.079358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e225b8-cee8-47cf-8563-7534ae694e68 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.098945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.099937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.100215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.109478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] PATH_INFO: `/v3/projects/a5c7f6bb6f5847eb9b5493aaf83a3795/users/c0209f4682ec45a1abc4ae13ab671de0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.113830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a5f-ee74-4075-82a9-3c4aee92a484 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.113973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a5f-ee74-4075-82a9-3c4aee92a484 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.114257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a5f-ee74-4075-82a9-3c4aee92a484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.142088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c7f6bb6f5847eb9b5493aaf83a3795, user_id=c0209f4682ec45a1abc4ae13ab671de0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.145098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.145371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d6d27a5f-ee74-4075-82a9-3c4aee92a484 None None] MFA Rules not processed for user `7a41eb42094f418685b83cc0a57852d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:24.146613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d6d27a5f-ee74-4075-82a9-3c4aee92a484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:24.176405 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2368/4760] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:24 2022] PUT /identity/v3/projects/a5c7f6bb6f5847eb9b5493aaf83a3795/users/c0209f4682ec45a1abc4ae13ab671de0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:24.181955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.279421 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2393/4761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:24.350376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4a74-445e-4390-b0d5-912ed31f8ea8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.390259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd93ae2-815f-4049-a9f7-cf017a6b0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.391557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd93ae2-815f-4049-a9f7-cf017a6b0837 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.391557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd93ae2-815f-4049-a9f7-cf017a6b0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.391557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd93ae2-815f-4049-a9f7-cf017a6b0837 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.392624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd93ae2-815f-4049-a9f7-cf017a6b0837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.394292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd93ae2-815f-4049-a9f7-cf017a6b0837 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.426353 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2369/4762] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:24.427623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d27a5f-ee74-4075-82a9-3c4aee92a484 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.440611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d27a5f-ee74-4075-82a9-3c4aee92a484 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.445838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.447274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.447857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.449186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] PATH_INFO: `/v3/projects/a5c7f6bb6f5847eb9b5493aaf83a3795/users/c0209f4682ec45a1abc4ae13ab671de0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.453062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c7f6bb6f5847eb9b5493aaf83a3795, user_id=c0209f4682ec45a1abc4ae13ab671de0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.455957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.469449 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2394/4763] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:24 2022] PUT /identity/v3/projects/a5c7f6bb6f5847eb9b5493aaf83a3795/users/c0209f4682ec45a1abc4ae13ab671de0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:24.481540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a572-e4e3-403b-8bed-6792cb7a2279 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.481540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a572-e4e3-403b-8bed-6792cb7a2279 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.481540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a572-e4e3-403b-8bed-6792cb7a2279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.527798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6b37a572-e4e3-403b-8bed-6792cb7a2279 None None] MFA Rules not processed for user `c0209f4682ec45a1abc4ae13ab671de0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:24.528994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6b37a572-e4e3-403b-8bed-6792cb7a2279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:24.651231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2370/4764] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:24.655790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.662011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:24.668607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cddf96-d586-473b-aa2a-ea60c91bc6fe admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.675315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.676747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.677172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.677578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.678585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.680478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.713661 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2395/4765] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:24 2022] POST /identity/v3/roles => generated 234 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:24.715200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37a572-e4e3-403b-8bed-6792cb7a2279 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.727737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37a572-e4e3-403b-8bed-6792cb7a2279 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.735532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.736497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.736965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.737463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.740649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.743522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.770262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.771735 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2371/4766] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:24 2022] POST /identity/v3/roles => generated 235 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:24.781846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd67ab9-8d52-41c2-b692-bd09cdd2e73c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.787069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.787785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.788304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.788587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.789408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.791177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.815786 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2396/4767] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:24 2022] POST /identity/v3/roles => generated 233 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:24.817667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.835259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040fe6b-1fbd-4989-a07a-074e2c20d4c1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:24.843550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:24.844472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:24.845016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:24.845510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:24.846544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:24.849210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:24.882073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:24.886716 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2372/4768] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:19:24 2022] POST /identity/v3/domains => generated 276 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:24.908014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc5207-1719-4a9b-9e1b-5326b55d1241 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.020887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0d05-015e-45bc-a489-2b34c832f76b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.021826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0d05-015e-45bc-a489-2b34c832f76b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.021949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0d05-015e-45bc-a489-2b34c832f76b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.022197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0d05-015e-45bc-a489-2b34c832f76b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.037373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0d05-015e-45bc-a489-2b34c832f76b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:25.040563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0d05-015e-45bc-a489-2b34c832f76b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:25.094270 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2397/4769] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:24 2022] POST /identity/v3/projects => generated 400 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:25.098394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:25.110201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff144ba2-5e71-4f67-8165-c698dec7a31a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.116875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0b6e-5720-4339-95bd-5c378bc2d02f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.119307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0b6e-5720-4339-95bd-5c378bc2d02f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.121896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0b6e-5720-4339-95bd-5c378bc2d02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.130946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:25.192965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1b6d0b6e-5720-4339-95bd-5c378bc2d02f None None] MFA Rules not processed for user `59876c2e98254d29b51b071f68569602`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:25.195725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1b6d0b6e-5720-4339-95bd-5c378bc2d02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:25.201334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.202041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.202783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.203182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.203917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:25.205931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:25.238648 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2373/4770] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:25 2022] POST /identity/v3/groups => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:25.241607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:25.254849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3682d8-e6af-40f0-8233-f31fa52b1e68 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.264343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.264343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.264673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.264673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.265569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:25.268011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:25.301846 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2374/4771] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:25 2022] POST /identity/v3/roles => generated 235 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:25.302989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:25.315453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652800-824a-4560-813d-59f00b6573fc tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.340055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.341012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.341447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.341839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.342878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:25.345355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:25.396588 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2375/4772] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:25 2022] POST /identity/v3/users => generated 439 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:25.398868 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2398/4773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:25.403726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:25.411273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12e19c-63cd-443d-9d0c-a34ed62989af None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.411581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12e19c-63cd-443d-9d0c-a34ed62989af None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.411866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12e19c-63cd-443d-9d0c-a34ed62989af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.416012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b620a89-4f04-4433-8dd1-cbc23c9d79fb tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.423346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.424117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.424402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.424682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.425731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:25.426777 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:25.426777 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:25.426777 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:25.427685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:25.447223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cf12e19c-63cd-443d-9d0c-a34ed62989af None None] MFA Rules not processed for user `59876c2e98254d29b51b071f68569602`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:25.448532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cf12e19c-63cd-443d-9d0c-a34ed62989af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:25.456730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2399/4774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:25.472260 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2376/4775] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:25 2022] POST /identity/v3/roles => generated 270 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:25.477585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12e19c-63cd-443d-9d0c-a34ed62989af None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:25.492125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12e19c-63cd-443d-9d0c-a34ed62989af None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.500449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.502298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.502740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.503439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/9f9988a615e24facb42dd4d20dabc3b3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.539103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:25.541416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:25.592001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=9f9988a615e24facb42dd4d20dabc3b3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:25.596494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:25.658644 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2400/4776] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:25 2022] PUT /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/9f9988a615e24facb42dd4d20dabc3b3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:25.659598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:25.710093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:25.725437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb329fcf-bfa5-4bb0-9950-e1a61f2eb228 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.824483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6549-34ca-462e-ad62-939107741398 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:25.831837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.832536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.832828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.833151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.834106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Adding query filter params (scope.project.id=a178bb44eb214d6dabbb2be412aa4a44, user.id=4568c0cb55da444bb76a1bd0f1297bff) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:25.834459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:25.844787 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:25.844787 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:25.844787 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:25.846109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:25.886350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:25.887055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:25.887335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:25.887684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:25.898169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:26.032829 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2401/4777] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:25 2022] GET /identity/v3/role_assignments?scope.project.id=a178bb44eb214d6dabbb2be412aa4a44&user.id=4568c0cb55da444bb76a1bd0f1297bff&effective => generated 228 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:26.039616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:26.040429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:26.041512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:26.056112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8adb-e13d-4eb3-817b-896849f91c3f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:26.067512 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2377/4778] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:26.080166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:26.084284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:26.084952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:26.087194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/9f9988a615e24facb42dd4d20dabc3b3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:26.094124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=9f9988a615e24facb42dd4d20dabc3b3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:26.106798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:26.125603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 9f9988a615e24facb42dd4d20dabc3b3 was removed from user 4568c0cb55da444bb76a1bd0f1297bff on project a178bb44eb214d6dabbb2be412aa4a44. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:26.126163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:26.128612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:26.176757 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2402/4779] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Jun 18 22:19:26 2022] DELETE /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/9f9988a615e24facb42dd4d20dabc3b3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:26.181007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:26.198114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2779-d5f3-4ea5-bd4c-da5363a67946 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:26.318401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:26.319311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:26.319593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:26.319872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/9f9988a615e24facb42dd4d20dabc3b3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:26.327586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9f9988a615e24facb42dd4d20dabc3b3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:26.328668 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:26.328668 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:26.328668 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:26.329625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:26.412458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 9f9988a615e24facb42dd4d20dabc3b3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:26.412737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:26.413579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:26.419944 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2378/4780] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:26 2022] DELETE /identity/v3/roles/9f9988a615e24facb42dd4d20dabc3b3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:26.423307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:26.424788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:26.446919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b8b29-a4d1-494a-b423-871d0706ebb5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:26.538058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:26.539327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:26.539761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:26.540184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/fbd69e3ca88149a1aff38234b3064e56` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:26.543056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=fbd69e3ca88149a1aff38234b3064e56)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:26.548375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:26.570364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2403/4781] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:26 2022] PUT /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/fbd69e3ca88149a1aff38234b3064e56 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:26.571909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:26.573619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:26.608205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b4c1-9cf6-4413-a4ab-a173bacf9d67 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:26.808458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:26.813206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:26.813783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:26.815710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:26.821137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:26.824163 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:26.824163 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:26.824163 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:26.836683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:26.871439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:26.923013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2379/4782] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:26 2022] PUT /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 520 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:26.927123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:26.954024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfae8a-bd39-4e61-b3d6-848e491ad04b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:27.135006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:27.184328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:27.185794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:27.185794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:27.186030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:27.187134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Adding query filter params (scope.project.id=a178bb44eb214d6dabbb2be412aa4a44, user.id=4568c0cb55da444bb76a1bd0f1297bff) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:27.187870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:27.192073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:27.376178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2404/4783] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:26 2022] GET /identity/v3/role_assignments?scope.project.id=a178bb44eb214d6dabbb2be412aa4a44&user.id=4568c0cb55da444bb76a1bd0f1297bff&effective => generated 1061 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:27.377974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:27.405322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c874f-5401-4877-ba46-64dc9f7ff7a9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:27.432438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:27.434031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:27.435732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:27.436882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:27.443096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:27.446083 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:27.446083 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:27.446083 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:27.449926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:27.476832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2380/4784] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:27 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:27.481773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:27.502088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f6d38-ef1e-4a94-8fa9-134bd77a4a5c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:27.685764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:27.686706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:27.687283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:27.687691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:27.688656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Adding query filter params (scope.project.id=a178bb44eb214d6dabbb2be412aa4a44, user.id=4568c0cb55da444bb76a1bd0f1297bff) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:27.689109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:27.691157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:27.797729 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2405/4785] 10.222.0.30 () {58 vars in 1355 bytes} [Sat Jun 18 22:19:27 2022] GET /identity/v3/role_assignments?scope.project.id=a178bb44eb214d6dabbb2be412aa4a44&user.id=4568c0cb55da444bb76a1bd0f1297bff&effective => generated 577 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:27.801999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:27.818539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e8894-6024-493f-ae0b-f466718c5007 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:27.825191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:27.826149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:27.826588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:27.826867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:27.828748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:27.831480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4.: keystone.exception.ImpliedRoleNotFound: fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4. Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = query.one() Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._iter().one() Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._only_one_row( Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:27.863170 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jun 18 22:19:27.864237 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jun 18 22:19:27.865132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 18 22:19:27.865132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 18 22:19:27.865132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 18 22:19:27.865132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4. Jun 18 22:19:27.865132 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:27.865132 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2381/4786] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:27 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 137 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:27.869250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:27.891149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bcaa7-77d5-4d5c-a5c6-908e1bbf64a0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:27.900502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:27.901552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:27.901836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:27.902307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/fbd69e3ca88149a1aff38234b3064e56` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:27.905651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=fbd69e3ca88149a1aff38234b3064e56)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:27.909678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:27.931865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role fbd69e3ca88149a1aff38234b3064e56 was removed from user 4568c0cb55da444bb76a1bd0f1297bff on project a178bb44eb214d6dabbb2be412aa4a44. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:27.934108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:27.936228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:27.973605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2406/4787] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Jun 18 22:19:27 2022] DELETE /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/fbd69e3ca88149a1aff38234b3064e56 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:27.975188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:27.987181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:28.006660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a045171-b6ef-443e-84f5-b36efc0c10e5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:28.151778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:28.152486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:28.152774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:28.153113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:28.154319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:28.156970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:28.186634 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2382/4788] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:27 2022] POST /identity/v3/roles => generated 271 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:28.190913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:28.209610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516cf2-67f5-459e-a83d-818bfb8fd9c5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:28.223064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:28.223951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:28.224345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:28.224733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:28.225723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Adding query filter params (domain_id=a5715277f8f14b4a89eb68ad83b79e87) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:28.226140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:28.227304 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:28.227304 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:28.227304 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:28.229665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:28.255285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2407/4789] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Jun 18 22:19:28 2022] GET /identity/v3/roles?domain_id=a5715277f8f14b4a89eb68ad83b79e87 => generated 408 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:28.259982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:28.274205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f8a6-83a5-4e1c-bb20-67e9ff558b5e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:28.303013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:28.304368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:28.304903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:28.305353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/6f8902c48e224bc99cc1ed84b3494d42` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:28.313794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6f8902c48e224bc99cc1ed84b3494d42)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:28.327108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:28.476846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 6f8902c48e224bc99cc1ed84b3494d42 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:28.477419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:28.478321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:28.483634 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2383/4790] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:28 2022] DELETE /identity/v3/roles/6f8902c48e224bc99cc1ed84b3494d42 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:28.486262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:28.488517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:28.516095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9a34-2f0f-49ee-9173-59c52b80da16 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:28.583256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:28.638208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:28.638996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:28.639287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:28.639615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:28.640369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Adding query filter params (domain_id=a5715277f8f14b4a89eb68ad83b79e87) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:28.640724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:28.643489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:28.651582 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2408/4791] 10.222.0.30 () {58 vars in 1206 bytes} [Sat Jun 18 22:19:28 2022] GET /identity/v3/roles?domain_id=a5715277f8f14b4a89eb68ad83b79e87 => generated 148 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:28.655528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:28.681572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9c05-b95e-4eb5-99b8-8706bd4e3d36 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:28.688315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:28.689377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:28.689692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:28.689979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/6f8902c48e224bc99cc1ed84b3494d42` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:28.714181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Could not find role: 6f8902c48e224bc99cc1ed84b3494d42.: keystone.exception.RoleNotFound: Could not find role: 6f8902c48e224bc99cc1ed84b3494d42. Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jun 18 22:19:28.725715 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:28.726727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 6f8902c48e224bc99cc1ed84b3494d42. Jun 18 22:19:28.727838 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:28.734202 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2384/4792] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:28 2022] DELETE /identity/v3/roles/6f8902c48e224bc99cc1ed84b3494d42 => generated 110 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:28.736406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:28.747052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb34fdc-c817-4c4c-9d2d-cc0be47d6493 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:28.752778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:28.753769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:28.754046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:28.754325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:28.770988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a5715277f8f14b4a89eb68ad83b79e87, group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:28.773884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:28.812931 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2409/4793] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:28 2022] PUT /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:28.815310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:28.832015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1861-9c68-4157-800d-26dda6f055e0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:28.993819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:28.995080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:28.995408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:28.995708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:29.002137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a5715277f8f14b4a89eb68ad83b79e87, group_id=09b453ba84b34d78a1549e47b770433b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:29.004737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:29.038186 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2385/4794] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Jun 18 22:19:28 2022] GET /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles => generated 410 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:29.044072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:29.058965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921ad2c-d76d-49bd-a1d8-e1b2b17f298d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:29.072384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:29.074128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:29.074570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:29.075050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:29.078682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a5715277f8f14b4a89eb68ad83b79e87, group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:29.082040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:29.090672 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2410/4795] 10.222.0.30 () {58 vars in 1464 bytes} [Sat Jun 18 22:19:29 2022] HEAD /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:29.095655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:29.102287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:29.114403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a803564-7bd1-4565-b3b2-22c954804e9e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:29.123473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:29.124303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:29.124592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:29.124875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:29.130943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a5715277f8f14b4a89eb68ad83b79e87, group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:29.133972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:29.153282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 45f60b4aa27c48f9878191da013abcba was removed from group 09b453ba84b34d78a1549e47b770433b on domain a5715277f8f14b4a89eb68ad83b79e87. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:29.153531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:29.159564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:29.199803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:29.201080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2386/4796] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Jun 18 22:19:29 2022] DELETE /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:29.202308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:29.218462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea8312-444a-4081-8d53-adf5e271428c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:29.333419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:29.334511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:29.334937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:29.335388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:29.337892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:29.340924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:29.370821 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2411/4797] 10.222.0.30 () {60 vars in 1485 bytes} [Sat Jun 18 22:19:29 2022] PUT /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:29.375850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:29.427700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d86b0-4bcf-4ca5-8e77-de8a8562805a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:29.552668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e5804-4df8-4783-91e3-8fff4730d1cd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:29.554381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5804-4df8-4783-91e3-8fff4730d1cd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:29.554663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5804-4df8-4783-91e3-8fff4730d1cd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:29.554937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e5804-4df8-4783-91e3-8fff4730d1cd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:29.556835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e5804-4df8-4783-91e3-8fff4730d1cd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_grants(project_id=a178bb44eb214d6dabbb2be412aa4a44, group_id=09b453ba84b34d78a1549e47b770433b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:29.559794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e5804-4df8-4783-91e3-8fff4730d1cd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:29.595200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2387/4798] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Jun 18 22:19:29 2022] GET /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:29.598321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:29.617794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e6452-4092-443e-a8e3-812d8bf9fb4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:29.633943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:29.635613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:29.636139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:29.636654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/groups/09b453ba84b34d78a1549e47b770433b/users/4568c0cb55da444bb76a1bd0f1297bff` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:29.639870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=09b453ba84b34d78a1549e47b770433b, user_id=4568c0cb55da444bb76a1bd0f1297bff)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:29.641889 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:29.641889 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:29.641889 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:29.645897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:29.715137 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2412/4799] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:19:29 2022] PUT /identity/v3/groups/09b453ba84b34d78a1549e47b770433b/users/4568c0cb55da444bb76a1bd0f1297bff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:29.717852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e49-7aaf-42ba-8683-b8d57c06f13b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:29.718148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e49-7aaf-42ba-8683-b8d57c06f13b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:29.718436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e49-7aaf-42ba-8683-b8d57c06f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:29.890108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f1583e49-7aaf-42ba-8683-b8d57c06f13b None None] MFA Rules not processed for user `4568c0cb55da444bb76a1bd0f1297bff`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:29.891379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f1583e49-7aaf-42ba-8683-b8d57c06f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:30.189085 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2388/4800] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:30.193070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.291430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c5fa9-e32a-4e0e-be33-56ae8843aa73 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.299529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.301026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.301650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.302292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.305635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.309108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:30.331842 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2413/4801] 10.222.0.30 () {58 vars in 1467 bytes} [Sat Jun 18 22:19:30 2022] HEAD /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:30.336099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583e49-7aaf-42ba-8683-b8d57c06f13b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.351110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583e49-7aaf-42ba-8683-b8d57c06f13b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.362633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.364750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.365078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.365429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.369514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.372351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:30.383565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 45f60b4aa27c48f9878191da013abcba was removed from group 09b453ba84b34d78a1549e47b770433b on project a178bb44eb214d6dabbb2be412aa4a44. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:30.384190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:30.385411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:30.416556 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2389/4802] 10.222.0.30 () {58 vars in 1469 bytes} [Sat Jun 18 22:19:30 2022] DELETE /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:30.417732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.419799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:30.436371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f4af8-7d91-4d2a-b26d-70fbbaa2b962 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.450894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:30.562187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.563746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.564274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.564558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/groups/09b453ba84b34d78a1549e47b770433b/users/4568c0cb55da444bb76a1bd0f1297bff` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.566596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=09b453ba84b34d78a1549e47b770433b, user_id=4568c0cb55da444bb76a1bd0f1297bff)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.568679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:30.583016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4568c0cb55da444bb76a1bd0f1297bff'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:30.613648 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2414/4803] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:19:30 2022] DELETE /identity/v3/groups/09b453ba84b34d78a1549e47b770433b/users/4568c0cb55da444bb76a1bd0f1297bff => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:30.615232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.631286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37a140-53ab-4367-a768-a03b2730b34e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.660497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:30.761006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.762822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.763334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.764337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.768025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.769613 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:30.769613 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:30.769613 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:30.771301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:30.784257 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2390/4804] 10.222.0.30 () {60 vars in 1380 bytes} [Sat Jun 18 22:19:30 2022] PUT /identity/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:30.790515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.804025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125b31a-7886-484e-adb7-90a270e12a82 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.809373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.810344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.810647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.810925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.812841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=09b453ba84b34d78a1549e47b770433b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.814027 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:30.814027 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:30.814027 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:30.815127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:30.835848 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2415/4805] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:19:30 2022] GET /identity/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles => generated 376 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:30.840048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.857747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facaa8-188e-453e-a7d6-2c26d56be4a3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.866605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.867506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.867794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.868079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.869902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.872047 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:30.872047 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:30.872047 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:30.872956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:30.895191 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2391/4806] 10.222.0.30 () {58 vars in 1362 bytes} [Sat Jun 18 22:19:30 2022] HEAD /identity/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:30.896536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.913255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d558834-f44f-4a52-8b0b-c460d0d54805 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.918249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.919526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.919811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.920090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.922867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=09b453ba84b34d78a1549e47b770433b, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.924129 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:30.924129 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:30.924129 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:30.925071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:30.942837 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2416/4807] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Jun 18 22:19:30 2022] DELETE /identity/v3/system/groups/09b453ba84b34d78a1549e47b770433b/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:30.950885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:30.965570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f04dac-09b7-4490-a2d6-049304c28438 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:30.972326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:30.972537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:30.972777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:30.972963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:30.975526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a5715277f8f14b4a89eb68ad83b79e87, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:30.979741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:31.041122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2392/4808] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Jun 18 22:19:30 2022] PUT /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:31.044926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:31.060463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a50d0-1eb3-4555-bb3f-8b14a13c53e4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:31.158598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:31.159503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:31.160421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:31.160705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:31.163328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a5715277f8f14b4a89eb68ad83b79e87, user_id=4568c0cb55da444bb76a1bd0f1297bff)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:31.164390 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:31.164390 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:31.164390 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:31.167739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:31.192521 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2417/4809] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Jun 18 22:19:31 2022] GET /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles => generated 409 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:31.196761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:31.209571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79036c-4b91-40b3-a65e-e1fa561f985d tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:31.216057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:31.222915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:31.222915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:31.223217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:31.236892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a5715277f8f14b4a89eb68ad83b79e87, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:31.245679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:31.259585 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2393/4810] 10.222.0.30 () {58 vars in 1461 bytes} [Sat Jun 18 22:19:31 2022] HEAD /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:31.264118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:31.294547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b844-6aa4-4423-a6a6-615b76e5211b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:31.307888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:31.325559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:31.326448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:31.327354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:31.333692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a5715277f8f14b4a89eb68ad83b79e87, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:31.341309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:31.348452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 45f60b4aa27c48f9878191da013abcba was removed from user 4568c0cb55da444bb76a1bd0f1297bff on domain a5715277f8f14b4a89eb68ad83b79e87. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:31.350854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:31.352673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:31.389878 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2418/4811] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Jun 18 22:19:31 2022] DELETE /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:31.397297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:31.399279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:31.433544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d5d8-4227-4af4-a8ed-b65ff087838c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:31.569057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:31.573405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:31.574067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:31.574364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:31.582280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:31.585147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:31.621184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2394/4812] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:31 2022] PUT /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:31.626613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:31.642681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579575d-d8ad-4d65-8639-187b2c08e688 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:31.793711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:31.819029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:31.820625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:31.821336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:31.821636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:31.823477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_grants(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:31.852744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:31.892793 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2419/4813] 10.222.0.30 () {58 vars in 1364 bytes} [Sat Jun 18 22:19:31 2022] GET /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles => generated 410 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:31.894109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:31.912543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5f6b6-9f82-4db4-bb92-011c3a8bfdc5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:31.929601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:31.930554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:31.930839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:31.931124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:31.937854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:check_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:31.943194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:31.959580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2395/4814] 10.222.0.30 () {58 vars in 1464 bytes} [Sat Jun 18 22:19:31 2022] HEAD /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:31.963592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:31.978063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2bbd0-ba8a-43f1-bf79-fe617162d40e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:31.984332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:31.985608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:31.985897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:31.986227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:31.988840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a178bb44eb214d6dabbb2be412aa4a44, user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.003154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.044342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 45f60b4aa27c48f9878191da013abcba was removed from user 4568c0cb55da444bb76a1bd0f1297bff on project a178bb44eb214d6dabbb2be412aa4a44. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:32.044695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:32.046705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:32.091412 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2420/4815] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Jun 18 22:19:31 2022] DELETE /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:32.098716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.101914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:32.127798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e75e8-9c7d-4821-8929-6ea7b269d088 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.274475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.275533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.275826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.276109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.278721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.280178 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:32.280178 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:32.280178 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:32.280948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.293854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2396/4816] 10.222.0.30 () {60 vars in 1377 bytes} [Sat Jun 18 22:19:32 2022] PUT /identity/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:32.297793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.313307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534988-80a9-47aa-992e-1c0726b28cb6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.326155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.327640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.327933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.328218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.334839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=4568c0cb55da444bb76a1bd0f1297bff)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.336083 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:32.336083 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:32.336083 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:32.337240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.356207 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2421/4817] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:19:32 2022] GET /identity/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles => generated 375 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:32.357913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.370649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b61d4-5bfc-4d8f-8605-7f4e7572a902 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.375968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.376915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.377768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.377768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.381095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.382158 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:32.382158 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:32.382158 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:32.383133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.385255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:32.393054 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2397/4818] 10.222.0.30 () {58 vars in 1359 bytes} [Sat Jun 18 22:19:32 2022] HEAD /identity/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:32.394720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.407324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd2fe4-d352-4655-a6ff-e98913428cd0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.414194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.415349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.415641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.415968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.418771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=4568c0cb55da444bb76a1bd0f1297bff, role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.419983 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:32.419983 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:32.419983 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:32.421176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.442048 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2422/4819] 10.222.0.30 () {58 vars in 1361 bytes} [Sat Jun 18 22:19:32 2022] DELETE /identity/v3/system/users/4568c0cb55da444bb76a1bd0f1297bff/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:32.449195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.464969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160f38-da62-41e0-9ed5-d193184ef671 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.472977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.474289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.474772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.475243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.476824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.478835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.523447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.526160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2398/4820] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:32 2022] POST /identity/v3/roles => generated 269 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:32.539423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b396db-811d-44cd-bab4-35e3a898fd4a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.548190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.549372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.549839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.550360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.551345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.553534 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:32.553534 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:32.553534 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:32.555606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.580907 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2423/4821] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:32 2022] POST /identity/v3/roles => generated 270 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:32.581826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.594381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2c4f9-2315-4766-ac0c-bbfc13b42a01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.602902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.605838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.606294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.606750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/266f1291868d4b7eb19b8854ce4c21d7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.608854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ca6ad722015746c585e5d6ae02d6af3c, implied_role_id=266f1291868d4b7eb19b8854ce4c21d7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.612297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.662352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2399/4822] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:32 2022] PUT /identity/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/266f1291868d4b7eb19b8854ce4c21d7 => generated 530 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:32.666378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.683858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01de05-c9bb-444a-9f80-445bc9cc9f43 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:32.781669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:32.782584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:32.783102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:32.783529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:32.785507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:32.793720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:32.830426 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2424/4823] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:19:32 2022] POST /identity/v3/domains => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:32.834173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:32.855543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afba01a-30bd-4177-8f9c-bdf336eaf948 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:33.040579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:33.041413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:33.041659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:33.041940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:33.047120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:33.048921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:33.078005 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2400/4824] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:32 2022] POST /identity/v3/roles => generated 270 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:33.083445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:33.112979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6ebd-903d-431c-ae6b-5dcb77a47f01 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:33.157483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:33.158999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:33.160523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:33.162350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/e40abda00a004885b700b691b37e92f1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:33.166800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ca6ad722015746c585e5d6ae02d6af3c, implied_role_id=e40abda00a004885b700b691b37e92f1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:33.167976 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:33.167976 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:33.167976 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:33.169653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:33.216897 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2425/4825] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:33 2022] PUT /identity/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/e40abda00a004885b700b691b37e92f1 => generated 530 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:33.221165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:33.234162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca346c-123d-458f-a51f-e5cdd3f9edd5 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:33.335902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:33.336545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:33.336545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:33.336712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:33.338371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ca6ad722015746c585e5d6ae02d6af3c, implied_role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:33.340039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:33.377145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2401/4826] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:33 2022] PUT /identity/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/45f60b4aa27c48f9878191da013abcba => generated 525 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:33.377957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:33.397675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ace3b-9f03-4004-b414-67c39c6fb98f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:33.531789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:33.550419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:33.551376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:33.551666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:33.551954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/45f60b4aa27c48f9878191da013abcba/implies/ca6ad722015746c585e5d6ae02d6af3c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:33.556217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=45f60b4aa27c48f9878191da013abcba, implied_role_id=ca6ad722015746c585e5d6ae02d6af3c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:33.562273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] ca6ad722015746c585e5d6ae02d6af3c cannot be an implied roles.: keystone.exception.InvalidImpliedRole: ca6ad722015746c585e5d6ae02d6af3c cannot be an implied roles. Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jun 18 22:19:33.618859 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jun 18 22:19:33.619799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:33.619799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:33.619799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jun 18 22:19:33.619799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jun 18 22:19:33.619799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: ca6ad722015746c585e5d6ae02d6af3c cannot be an implied roles. Jun 18 22:19:33.619799 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:33.624475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:33.637307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b2c1-4b22-4477-aa86-3d82e3043c8f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:33.640744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2426/4827] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:33 2022] PUT /identity/v3/roles/45f60b4aa27c48f9878191da013abcba/implies/ca6ad722015746c585e5d6ae02d6af3c => generated 116 bytes in 257 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:33.649990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:33.650903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:33.651192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:33.651471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:33.660395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ca6ad722015746c585e5d6ae02d6af3c, implied_role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:33.662184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:33.684382 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2402/4828] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:33 2022] DELETE /identity/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:33.688749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:33.703176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b847-820c-4885-91eb-1883a7fcee18 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:33.907897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:33.909372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:33.909997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:33.910289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/e40abda00a004885b700b691b37e92f1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:33.912138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ca6ad722015746c585e5d6ae02d6af3c, implied_role_id=e40abda00a004885b700b691b37e92f1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:33.913633 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:33.913633 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:33.913633 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:33.914538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:33.944141 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2427/4829] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:33 2022] DELETE /identity/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/e40abda00a004885b700b691b37e92f1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:33.948945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:33.966304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751389c0-7a8c-4124-bb27-aa54227a9376 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:34.008850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:34.077876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:34.078362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:34.078717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:34.079198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/e40abda00a004885b700b691b37e92f1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:34.081633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=e40abda00a004885b700b691b37e92f1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:34.086957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:34.144904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role e40abda00a004885b700b691b37e92f1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:34.145264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.146307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.152250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:34.153226 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2403/4830] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:33 2022] DELETE /identity/v3/roles/e40abda00a004885b700b691b37e92f1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:34.154169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:34.168493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed80de-1ef9-4732-b9b3-f535fd778611 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:34.370447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:34.372267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:34.372712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:34.374386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/d93811343e2c40c6bddabeeb6c1393b5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:34.408159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d93811343e2c40c6bddabeeb6c1393b5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:34.412622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:34.438988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.439847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.479197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.481623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.493334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:34.504752 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2428/4831] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:34 2022] PATCH /identity/v3/domains/d93811343e2c40c6bddabeeb6c1393b5 => generated 276 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:34.506066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34f91-259b-4b96-8e31-6ffc0a5c423c tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:34.591904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:34.593274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:34.593565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:34.593887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/d93811343e2c40c6bddabeeb6c1393b5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:34.607605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d93811343e2c40c6bddabeeb6c1393b5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:34.609490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:34.639972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.644031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.716241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5', 'request_id': 'req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.735316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5', 'request_id': 'req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.738337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:34.745983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5', 'request_id': 'req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.763063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] The token cache is being invalidate because project d93811343e2c40c6bddabeeb6c1393b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:34.763815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.765436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.776606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5', 'request_id': 'req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.777458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5', 'request_id': 'req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.778056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd93811343e2c40c6bddabeeb6c1393b5', 'request_id': 'req-3e2e5d0e-2d39-4962-b268-4138fa7f2ee3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:34.790762 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2404/4832] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:34 2022] DELETE /identity/v3/domains/d93811343e2c40c6bddabeeb6c1393b5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:34.793430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:34.794925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:34.832073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528814-1840-4763-b101-67416564cbac tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:34.880113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:34.919203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633443f-8f12-410a-b32a-3f8da7bea551 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:34.919726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633443f-8f12-410a-b32a-3f8da7bea551 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:34.920222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633443f-8f12-410a-b32a-3f8da7bea551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:34.926187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:34.927324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:34.927725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:34.928065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/266f1291868d4b7eb19b8854ce4c21d7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:34.931208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ca6ad722015746c585e5d6ae02d6af3c, implied_role_id=266f1291868d4b7eb19b8854ce4c21d7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:34.933222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:34.949622 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2429/4833] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:34 2022] DELETE /identity/v3/roles/ca6ad722015746c585e5d6ae02d6af3c/implies/266f1291868d4b7eb19b8854ce4c21d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:34.950636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d633443f-8f12-410a-b32a-3f8da7bea551 None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:34.952555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:34.955920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d633443f-8f12-410a-b32a-3f8da7bea551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:34.957783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:35.021175 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2405/4834] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:35.060922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d08e5-cb08-4bb1-8635-8f340a070fa0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:35.066384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:35.067869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:35.068406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:35.068857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/266f1291868d4b7eb19b8854ce4c21d7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:35.070572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=266f1291868d4b7eb19b8854ce4c21d7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:35.071768 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:35.071768 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:35.071768 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:35.072933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:35.144785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba85834-42a1-4fe7-8ac1-89c0137183ea None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:35.145141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba85834-42a1-4fe7-8ac1-89c0137183ea None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:35.145960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba85834-42a1-4fe7-8ac1-89c0137183ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:35.213652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 266f1291868d4b7eb19b8854ce4c21d7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:35.213980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:35.214911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:35.221920 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2430/4835] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:34 2022] DELETE /identity/v3/roles/266f1291868d4b7eb19b8854ce4c21d7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:35.223298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:35.223801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fba85834-42a1-4fe7-8ac1-89c0137183ea None None] MFA Rules not processed for user `ff7a45b8c6c7462ab3e3e1e1caeadf65`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:35.225144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fba85834-42a1-4fe7-8ac1-89c0137183ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:35.227085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:35.349351 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2406/4836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:35.377860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbc31e-3c26-4890-8174-5ee36a674914 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:35.383642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:35.384639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:35.384994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:35.385366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/ca6ad722015746c585e5d6ae02d6af3c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:35.386698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ca6ad722015746c585e5d6ae02d6af3c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:35.388436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:35.442231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role ca6ad722015746c585e5d6ae02d6af3c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:35.442846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:35.443460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:35.449464 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2431/4837] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:35 2022] DELETE /identity/v3/roles/ca6ad722015746c585e5d6ae02d6af3c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:35.451415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba85834-42a1-4fe7-8ac1-89c0137183ea None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:35.467717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba85834-42a1-4fe7-8ac1-89c0137183ea None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:35.542918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:35.544295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:35.544295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:35.544773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:35.547093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:35.548879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:35.550621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:35.597918 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2407/4838] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:35 2022] PUT /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 520 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:35.601630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:35.603407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:35.625485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:35.639070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fec45-fcaf-4c3b-b2ff-509280952656 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:35.731507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:35.732929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:35.733390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:35.734071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:35.743607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:35.744955 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:35.744955 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:35.744955 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:35.746013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:35.747064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:35.747993 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:35.747993 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:35.747993 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:35.749194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:35.761794 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2432/4839] 10.222.0.30 () {58 vars in 1344 bytes} [Sat Jun 18 22:19:35 2022] HEAD /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:35.763458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:35.774701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b649c-7efe-483a-8aa1-3620ca777a58 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:35.779624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:35.780632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:35.781209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:35.781399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:35.784425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:35.785650 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:35.785650 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:35.785650 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:35.786727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:35.797089 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2408/4840] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:19:35 2022] GET /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 520 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:35.798409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:35.814204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493dc8-96eb-4be3-92b2-634d29511f9a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:35.819827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:35.824096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:35.824459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:35.824811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:35.827742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:35.829793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:35.849319 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2433/4841] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:35 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:35.853423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:35.868588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a360b7-93a2-4fe9-ba4e-1980db3f7fc6 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.043390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.044478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.044883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.045256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.047479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.049677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4.: keystone.exception.ImpliedRoleNotFound: fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4. Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = query.one() Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._iter().one() Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._only_one_row( Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:36.086216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 18 22:19:36.087165 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 18 22:19:36.088007 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 18 22:19:36.088007 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4. Jun 18 22:19:36.088007 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:36.091902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.093584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2409/4842] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:19:35 2022] GET /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 137 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 18 22:19:36.117622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef125a0-fe68-47cf-8148-1dac650d5ec7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.127787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.128895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.129438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.129822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.131738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.133714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4.: keystone.exception.ImpliedRoleNotFound: fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4. Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = query.one() Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._iter().one() Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._only_one_row( Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:36.166175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jun 18 22:19:36.167354 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jun 18 22:19:36.168373 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jun 18 22:19:36.168373 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jun 18 22:19:36.168373 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jun 18 22:19:36.168373 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: fbd69e3ca88149a1aff38234b3064e56 does not imply 794bb1cbbd62436fa3a748a27da4d9e4. Jun 18 22:19:36.168373 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:36.168373 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2434/4843] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:36 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 137 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:36.173537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.198384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811dad-716f-4f26-bcd4-c03d18282b55 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.208309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.209532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.209996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.210308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.212158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.214364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.225653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.228297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:36.300910 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2410/4844] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:36 2022] PUT /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 520 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:36.302943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.378665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e25f8-0802-4c5e-bf6d-a2bc7bc78ab9 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.428276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0960d04-bc0d-4ff9-965f-71f05496e329 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.433957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.435112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.435420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.435731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.437679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=f2b3d4558cf34aa188ebba7830fa0c9c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.439961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.480057 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2411/4845] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:36 2022] PUT /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c => generated 518 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:36.486280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.500949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.504013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.504302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.504575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.507558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:36.539197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:36.543847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:36.609003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda399-822a-4d5a-955a-2eae612b901f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.620103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.621662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.622371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.622655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.625841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f2b3d4558cf34aa188ebba7830fa0c9c, implied_role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.628134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.665571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.666457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.682314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2435/4847] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:36 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:36.685149 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2412/4847] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:36 2022] PUT /identity/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba => generated 519 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:36.686093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.696601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca034e-2b87-4d56-975c-1156157e724c service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.762086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.762759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.763043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.763318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.763959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.764985 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:36.764985 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:36.764985 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:36.765942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.788742 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2436/4848] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:19:36 2022] GET /identity/v3/role_inferences => generated 1603 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:36.793680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.819315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e3b7-ac48-4f6c-aab8-66ac90b8a816 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.837923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.839155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.839155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.839483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.841291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f2b3d4558cf34aa188ebba7830fa0c9c, implied_role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.842863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.858678 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2413/4849] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:36 2022] DELETE /identity/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:36.863745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:36.877989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197e44-4608-44f1-b19e-f3bfc2dfe0db tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:36.961335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:36.962301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:36.962637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:36.962913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:36.964701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=f2b3d4558cf34aa188ebba7830fa0c9c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:36.966796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:36.981500 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2437/4850] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:36 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:36.988221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.014029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a829926-6e17-4358-86ce-6cbd707b89a2 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.115746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.116701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.117021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.117303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.119034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.120689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.133135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2414/4851] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:36 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:37.136491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.148608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53436196-54bb-4948-8135-d32030833248 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.199739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:37.224848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.225851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.226280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.226691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.227560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.230867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.249553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2438/4852] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:37 2022] GET /identity/v3/roles => generated 2321 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:37.255283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.271601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dafe4-20f0-4a3f-be41-e06e24e65986 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.277466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.278156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.278572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.278854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.279600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.281621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.316837 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2415/4853] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:37 2022] POST /identity/v3/roles => generated 235 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:37.317640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.335045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae575150-1145-4f1f-a6ad-9ca40cd4437b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.345539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.346847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.347079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.347363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/86f01167153c4e10a8563fd72a2d2268` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.350012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:update_role(role_id=86f01167153c4e10a8563fd72a2d2268)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.351115 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:37.351115 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:37.351115 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:37.354164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.398229 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2439/4854] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Jun 18 22:19:37 2022] PATCH /identity/v3/roles/86f01167153c4e10a8563fd72a2d2268 => generated 237 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:37.401879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.442733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d34b8-9e26-47e7-b8d6-ebd0567d5b04 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.449687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.451177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.451520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.451803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/86f01167153c4e10a8563fd72a2d2268` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.477204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:get_role(role_id=86f01167153c4e10a8563fd72a2d2268)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.478419 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:37.478419 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:37.478419 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:37.479335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.484640 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2416/4855] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:19:37 2022] GET /identity/v3/roles/86f01167153c4e10a8563fd72a2d2268 => generated 237 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:37.488682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.501750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0fcb-e65a-42b7-a610-067ad9215a63 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.507556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.507830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.508209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.508490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.510208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.512068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.536550 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2440/4856] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:37 2022] GET /identity/v3/roles => generated 2549 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:37.539926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.552564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaad4f-6240-4b2b-8458-09745e77f9de tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.561564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.562899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.563605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.564206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/86f01167153c4e10a8563fd72a2d2268` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.567347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_role(role_id=86f01167153c4e10a8563fd72a2d2268)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.569594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.667414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 86f01167153c4e10a8563fd72a2d2268 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:37.668726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:37.670961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:37.681898 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2417/4857] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:37 2022] DELETE /identity/v3/roles/86f01167153c4e10a8563fd72a2d2268 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:37.684936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.687646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:37.707764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc0571-adcd-4773-a849-5d8231952452 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.803426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:37.804926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:37.807909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:37.808459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:37.810895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:37.813741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:37.857758 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2441/4858] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:37 2022] PUT /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 520 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:37.858018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:37.883729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f5323-6c4f-4438-96cc-3fee44d05cf8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:37.964037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:38.042978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.043519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.043881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.044376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.047127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=f2b3d4558cf34aa188ebba7830fa0c9c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:38.052803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:38.095544 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2418/4859] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:37 2022] PUT /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c => generated 518 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:38.102016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:38.116335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b597c4-fe5c-4c4b-bad5-0d2af423960b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:38.208931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.210264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.210770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.211224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.213404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f2b3d4558cf34aa188ebba7830fa0c9c, implied_role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:38.216484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:38.273867 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2442/4860] 10.222.0.30 () {60 vars in 1362 bytes} [Sat Jun 18 22:19:38 2022] PUT /identity/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba => generated 519 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:38.278248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:38.295173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c9887-d67d-40a4-aa02-10dd835a9260 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:38.372227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.373340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.373691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.374061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.375573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=f2b3d4558cf34aa188ebba7830fa0c9c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:38.376900 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:38.376900 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:38.376900 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:38.377972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:38.385918 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2419/4861] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:19:38 2022] GET /identity/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies => generated 488 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:38.390035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:38.409600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8bcc-fc18-4e1a-9bd1-28250881e58e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:38.426625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.427586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.427880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.428320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.431524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=fbd69e3ca88149a1aff38234b3064e56)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:38.432597 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:38.432597 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:38.432597 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:38.433706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:38.435364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:38.452651 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2443/4862] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:19:38 2022] GET /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies => generated 658 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:38.456859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:38.467877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f179dd-463d-44eb-881b-9353992989a4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:38.474399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.475813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.477193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.477725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.479781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f2b3d4558cf34aa188ebba7830fa0c9c, implied_role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:38.481844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:38.499204 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2420/4863] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:38 2022] DELETE /identity/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c/implies/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:38.504073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:38.518782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89cf23-c9f5-4f37-a046-758c9859a415 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:38.652851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.653965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.654291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.654604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.670735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=f2b3d4558cf34aa188ebba7830fa0c9c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:38.673178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:38.700644 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2444/4864] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:38 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/f2b3d4558cf34aa188ebba7830fa0c9c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:38.701953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:38.717912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372423a2-767b-415d-a910-a6332fa2d6c4 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:38.798135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.799124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.799401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.800153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.801965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=fbd69e3ca88149a1aff38234b3064e56, implied_role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:38.804408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:38.821221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2421/4865] 10.222.0.30 () {58 vars in 1346 bytes} [Sat Jun 18 22:19:38 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56/implies/794bb1cbbd62436fa3a748a27da4d9e4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:38.823024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:38.835543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556da454-1cff-49ba-acc7-332947e67f0e tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:38.967361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:38.968442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:38.968890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:38.969212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/d93811343e2c40c6bddabeeb6c1393b5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:38.979012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Could not find domain: d93811343e2c40c6bddabeeb6c1393b5.: keystone.exception.DomainNotFound: Could not find domain: d93811343e2c40c6bddabeeb6c1393b5. Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d93811343e2c40c6bddabeeb6c1393b5. Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:39.019945 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:39.020995 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d93811343e2c40c6bddabeeb6c1393b5. Jun 18 22:19:39.022191 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:39.025737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2445/4866] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:38 2022] PATCH /identity/v3/domains/d93811343e2c40c6bddabeeb6c1393b5 => generated 112 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:39.029524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:39.056626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125c24a-9714-4135-8c41-d622e9fd01c0 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:39.063282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:39.064720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:39.065288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:39.066359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/users/4568c0cb55da444bb76a1bd0f1297bff` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:39.069106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4568c0cb55da444bb76a1bd0f1297bff)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:39.072442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:39.128640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:39.175662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4568c0cb55da444bb76a1bd0f1297bff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:39.177514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4568c0cb55da444bb76a1bd0f1297bff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:39.223914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4568c0cb55da444bb76a1bd0f1297bff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:39.227302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4568c0cb55da444bb76a1bd0f1297bff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:39.249509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4568c0cb55da444bb76a1bd0f1297bff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:39.268106 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2422/4867] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:39 2022] DELETE /identity/v3/users/4568c0cb55da444bb76a1bd0f1297bff => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:39.271859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:39.273771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:39.312849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3b987-6bbf-4d99-acba-8f9b99d19290 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:39.416116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:39.417376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:39.417861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:39.418359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/45f60b4aa27c48f9878191da013abcba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:39.420121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_role(role_id=45f60b4aa27c48f9878191da013abcba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:39.421457 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:39.421457 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:19:39.421457 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:19:39.423746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:39.469749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:39.483191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 45f60b4aa27c48f9878191da013abcba has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:39.483529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:39.484245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:39.491821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:39.493378 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2446/4868] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:39 2022] DELETE /identity/v3/roles/45f60b4aa27c48f9878191da013abcba => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:39.504671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5555d-e495-4844-a89f-0ed157d26d0b tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:39.651572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:39.652599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:39.652925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:39.653210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/groups/09b453ba84b34d78a1549e47b770433b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:39.659908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_group(group_id=09b453ba84b34d78a1549e47b770433b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:39.671569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:39.774338 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2423/4869] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:19:39 2022] DELETE /identity/v3/groups/09b453ba84b34d78a1549e47b770433b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:39.778120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:39.780475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:39.794871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f028f-3454-41b6-9787-d8df3a4e687f tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:39.909580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:39.910643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:39.912475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:39.912912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/projects/a178bb44eb214d6dabbb2be412aa4a44` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:39.914688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a178bb44eb214d6dabbb2be412aa4a44)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:39.917059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:39.997541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a178bb44eb214d6dabbb2be412aa4a44', 'request_id': 'req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.007691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a178bb44eb214d6dabbb2be412aa4a44', 'request_id': 'req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.021603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a178bb44eb214d6dabbb2be412aa4a44', 'request_id': 'req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.037262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] The token cache is being invalidate because project a178bb44eb214d6dabbb2be412aa4a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:40.037560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.038406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.044916 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2447/4870] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:39 2022] DELETE /identity/v3/projects/a178bb44eb214d6dabbb2be412aa4a44 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:40.045147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:40.047894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:40.077667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473066-af2f-4455-9fc2-5b2dc164a3b8 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:40.217827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:40.218951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:40.219295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:40.220027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:40.221453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a5715277f8f14b4a89eb68ad83b79e87)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:40.223902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:40.234996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:40.253601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.254355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.306891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.308012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.317212 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2424/4871] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:40 2022] PATCH /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87 => generated 277 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:40.321540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:40.344233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb34bb-285a-4a1c-a292-ed4c31287fbd tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:40.497738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:40.498986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:40.499447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:40.499878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/domains/a5715277f8f14b4a89eb68ad83b79e87` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:40.522349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a5715277f8f14b4a89eb68ad83b79e87)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:40.524207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:40.594548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.598780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:40.608714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.723834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87', 'request_id': 'req-bc8263b5-68f1-4aec-8986-61c58ea1bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.739478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87', 'request_id': 'req-bc8263b5-68f1-4aec-8986-61c58ea1bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.752886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87', 'request_id': 'req-bc8263b5-68f1-4aec-8986-61c58ea1bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.776445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] The token cache is being invalidate because project a5715277f8f14b4a89eb68ad83b79e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:40.776798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.777554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.789699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87', 'request_id': 'req-bc8263b5-68f1-4aec-8986-61c58ea1bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.790848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87', 'request_id': 'req-bc8263b5-68f1-4aec-8986-61c58ea1bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.792156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a5715277f8f14b4a89eb68ad83b79e87', 'request_id': 'req-bc8263b5-68f1-4aec-8986-61c58ea1bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:40.808280 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2448/4872] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:40 2022] DELETE /identity/v3/domains/a5715277f8f14b4a89eb68ad83b79e87 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:40.810093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:40.811653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:40.834232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d4280-e56d-4124-adce-f63b873659ab tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:40.990031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:40.991504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:40.992167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:40.992889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:40.998105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f2b3d4558cf34aa188ebba7830fa0c9c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:41.000984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:41.079709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role f2b3d4558cf34aa188ebba7830fa0c9c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:41.079709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.080922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.086111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2425/4873] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:40 2022] DELETE /identity/v3/roles/f2b3d4558cf34aa188ebba7830fa0c9c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:41.090207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:41.093613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:41.127854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8263b5-68f1-4aec-8986-61c58ea1bb45 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:41.242776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:41.243768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:41.244129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:41.244475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/794bb1cbbd62436fa3a748a27da4d9e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:41.249577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_role(role_id=794bb1cbbd62436fa3a748a27da4d9e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:41.252257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:41.311945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role 794bb1cbbd62436fa3a748a27da4d9e4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:41.312976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.315013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.318135 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2449/4874] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:41 2022] DELETE /identity/v3/roles/794bb1cbbd62436fa3a748a27da4d9e4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:41.322311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:41.326999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:41.355417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670f083-41bf-418d-9d92-e47b600bbbc1 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:41.441460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0209f4682ec45a1abc4ae13ab671de0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:41.442890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:41.443401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:41.444014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] PATH_INFO: `/v3/roles/fbd69e3ca88149a1aff38234b3064e56` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:41.450955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fbd69e3ca88149a1aff38234b3064e56)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:41.455744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:41.499105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:41.532261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invalidating the token cache because role fbd69e3ca88149a1aff38234b3064e56 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:41.533775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.535754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6360f69e-e0fb-46d2-be70-1cf4ebbc374a tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.544436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:41.545131 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2426/4875] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:41 2022] DELETE /identity/v3/roles/fbd69e3ca88149a1aff38234b3064e56 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:41.547485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:41.607995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:41.661311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a07db-2bcb-41d5-86da-dcb2c60ff8b7 tempest-RolesV3TestJSON-929959031 tempest-RolesV3TestJSON-929959031-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:41.725050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:41.726134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:41.726485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:41.726829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] PATH_INFO: `/v3/users/3d242139b04f44dcbd6c5c88437b560a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:41.728185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d242139b04f44dcbd6c5c88437b560a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:41.730457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:41.810521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d242139b04f44dcbd6c5c88437b560a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.811183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d242139b04f44dcbd6c5c88437b560a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.826830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d242139b04f44dcbd6c5c88437b560a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.827570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d242139b04f44dcbd6c5c88437b560a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.835389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d242139b04f44dcbd6c5c88437b560a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:41.848516 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2450/4876] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:41 2022] DELETE /identity/v3/users/3d242139b04f44dcbd6c5c88437b560a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:41.853335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:41.853803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:41.853893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:41.872058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:41.873304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:41.936945 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2427/4877] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:41.947488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:41.949357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:42.006049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d2803-bc8e-46a5-a70f-281af05a430a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:42.010035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:42.010702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:42.010976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:42.011249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:42.021664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:42.023105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:42.028581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:42.034505 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2451/4878] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:42.333715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:42.335458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:42.361754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b8b35-ec8c-49b6-9dd0-f069aac99c00 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:42.366310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:42.367202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:42.367480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:42.367756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] PATH_INFO: `/v3/projects/3493ebba29f5473eb82183574c0a2554` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:42.369253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3493ebba29f5473eb82183574c0a2554)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:42.371191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:42.421401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3493ebba29f5473eb82183574c0a2554', 'request_id': 'req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.435313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3493ebba29f5473eb82183574c0a2554', 'request_id': 'req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.446140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3493ebba29f5473eb82183574c0a2554', 'request_id': 'req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.468403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] The token cache is being invalidate because project 3493ebba29f5473eb82183574c0a2554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:42.468747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.469525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.475220 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2428/4879] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:42 2022] DELETE /identity/v3/projects/3493ebba29f5473eb82183574c0a2554 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:42.475558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:42.488306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81dd25-2526-4f4d-91c2-df56fb764f5b service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:42.593375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:42.594573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:42.594853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:42.595313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] PATH_INFO: `/v3/users/c0209f4682ec45a1abc4ae13ab671de0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:42.596681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0209f4682ec45a1abc4ae13ab671de0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:42.598826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:42.660999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0209f4682ec45a1abc4ae13ab671de0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.661927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0209f4682ec45a1abc4ae13ab671de0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.688896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0209f4682ec45a1abc4ae13ab671de0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.691321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0209f4682ec45a1abc4ae13ab671de0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.705745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02f00222-5d6a-47d8-8fa8-e6eea788b86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0209f4682ec45a1abc4ae13ab671de0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:42.750085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2452/4880] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:42 2022] DELETE /identity/v3/users/c0209f4682ec45a1abc4ae13ab671de0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:43.284456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:43.286118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:43.300285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d0962-ab45-4df4-bdf7-d96f2caeab9b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:43.379559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:43.380445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.380727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.381047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] PATH_INFO: `/v3/projects/a5c7f6bb6f5847eb9b5493aaf83a3795` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.382307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c7f6bb6f5847eb9b5493aaf83a3795)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:43.384400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:43.414919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:43.463081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'request_id': 'req-60ad1565-8a88-446d-82b5-b148264df9e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:43.472023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'request_id': 'req-60ad1565-8a88-446d-82b5-b148264df9e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:43.483340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c7f6bb6f5847eb9b5493aaf83a3795', 'request_id': 'req-60ad1565-8a88-446d-82b5-b148264df9e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:43.496574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] The token cache is being invalidate because project a5c7f6bb6f5847eb9b5493aaf83a3795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:43.496868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:43.498311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60ad1565-8a88-446d-82b5-b148264df9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:43.501670 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2429/4881] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:43 2022] DELETE /identity/v3/projects/a5c7f6bb6f5847eb9b5493aaf83a3795 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:43.506799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d978f-45d0-4035-ae5c-5379d07ab3e8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.507278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d978f-45d0-4035-ae5c-5379d07ab3e8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.507356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d978f-45d0-4035-ae5c-5379d07ab3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.526777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-862d978f-45d0-4035-ae5c-5379d07ab3e8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:43.528058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-862d978f-45d0-4035-ae5c-5379d07ab3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:43.606386 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2453/4882] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:43.607838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36a86-2a19-4439-972b-d74f23d7ca67 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.608793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36a86-2a19-4439-972b-d74f23d7ca67 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.609113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36a86-2a19-4439-972b-d74f23d7ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.630890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e3a36a86-2a19-4439-972b-d74f23d7ca67 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:43.632193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3a36a86-2a19-4439-972b-d74f23d7ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:43.641111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2430/4883] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:43.645573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d978f-45d0-4035-ae5c-5379d07ab3e8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:43.656347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d978f-45d0-4035-ae5c-5379d07ab3e8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:43.661708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:43.662396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.662680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.662929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.663735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:43.664041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:43.665699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:43.678066 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2454/4884] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:43.682537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36a86-2a19-4439-972b-d74f23d7ca67 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:43.692754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36a86-2a19-4439-972b-d74f23d7ca67 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:43.697874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:43.698981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.699440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.700033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.700998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:43.703108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:43.737503 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2431/4885] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:43 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:43.741447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:43.752263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1247-2184-491a-8c8d-58b9050c5e80 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:43.757985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:43.823189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816889ac-c899-48c3-a535-d93cd3cae7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:43.824324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816889ac-c899-48c3-a535-d93cd3cae7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.824597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816889ac-c899-48c3-a535-d93cd3cae7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.824870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816889ac-c899-48c3-a535-d93cd3cae7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.825618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816889ac-c899-48c3-a535-d93cd3cae7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:43.827555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816889ac-c899-48c3-a535-d93cd3cae7f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:43.854075 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2455/4886] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:43 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:43.855334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:43.871029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53b9be-510e-41ad-a93d-adf014e2c749 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:43.875652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:43.876458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.876738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.877011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.877764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:43.879575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:43.886484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03ac05-8cc8-4d41-97bf-cea665486952 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.886484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03ac05-8cc8-4d41-97bf-cea665486952 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.886484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03ac05-8cc8-4d41-97bf-cea665486952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.893573 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2432/4887] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:43.897199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:43.907254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa3b3d-6a83-43f3-83a1-a55809283ab9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:43.907628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1d03ac05-8cc8-4d41-97bf-cea665486952 None None] MFA Rules not processed for user `59876c2e98254d29b51b071f68569602`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:43.908865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1d03ac05-8cc8-4d41-97bf-cea665486952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:43.912124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:43.913078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.913418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.913726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.915048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:43.917062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:43.930532 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2433/4888] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:43.933879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:43.945243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e38d4f-625d-43d1-be31-0bd6e29d9a2a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:43.950600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e038ff-263c-44ab-8841-ef2bf7491b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:43.951573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e038ff-263c-44ab-8841-ef2bf7491b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:43.951851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e038ff-263c-44ab-8841-ef2bf7491b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:43.952125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e038ff-263c-44ab-8841-ef2bf7491b89 admin admin] PATH_INFO: `/v3/projects/de36ac88f5924ac697032918c47a36b4/users/e04235b9f15242408d07f3d329d44e7e/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:43.969073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e038ff-263c-44ab-8841-ef2bf7491b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de36ac88f5924ac697032918c47a36b4, user_id=e04235b9f15242408d07f3d329d44e7e, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:43.973086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e038ff-263c-44ab-8841-ef2bf7491b89 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:43.983487 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2456/4889] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:44.019635 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2434/4890] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:43 2022] PUT /identity/v3/projects/de36ac88f5924ac697032918c47a36b4/users/e04235b9f15242408d07f3d329d44e7e/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:44.030368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa783744-bd16-4919-a95e-13dd212f897c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.034353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa783744-bd16-4919-a95e-13dd212f897c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.034929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa783744-bd16-4919-a95e-13dd212f897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.070892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70d84-f909-45f3-9f9c-596935b6287e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.071553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70d84-f909-45f3-9f9c-596935b6287e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.072033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70d84-f909-45f3-9f9c-596935b6287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.081393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-aa783744-bd16-4919-a95e-13dd212f897c None None] MFA Rules not processed for user `e04235b9f15242408d07f3d329d44e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:44.083631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aa783744-bd16-4919-a95e-13dd212f897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:44.113575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-61a70d84-f909-45f3-9f9c-596935b6287e None None] MFA Rules not processed for user `59876c2e98254d29b51b071f68569602`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:44.115062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-61a70d84-f909-45f3-9f9c-596935b6287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:44.184352 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2457/4891] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:44.184844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa783744-bd16-4919-a95e-13dd212f897c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:44.201090 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2435/4892] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:44.226320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfee8f-f362-4a65-af92-df367ccd4981 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.228158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfee8f-f362-4a65-af92-df367ccd4981 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.228451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfee8f-f362-4a65-af92-df367ccd4981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.243658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:44.256412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bedfee8f-f362-4a65-af92-df367ccd4981 None None] MFA Rules not processed for user `59876c2e98254d29b51b071f68569602`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:44.257874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bedfee8f-f362-4a65-af92-df367ccd4981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:44.271969 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2436/4893] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:44.301711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de559-098c-4155-a864-f827c327f610 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.302278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de559-098c-4155-a864-f827c327f610 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.302357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6de559-098c-4155-a864-f827c327f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.310776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa783744-bd16-4919-a95e-13dd212f897c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:44.322214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552e041-a70b-44c6-b3fc-32cb12d472fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:44.323000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552e041-a70b-44c6-b3fc-32cb12d472fd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.323354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552e041-a70b-44c6-b3fc-32cb12d472fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.324053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552e041-a70b-44c6-b3fc-32cb12d472fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.324307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-be6de559-098c-4155-a864-f827c327f610 None None] MFA Rules not processed for user `59876c2e98254d29b51b071f68569602`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:44.324959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552e041-a70b-44c6-b3fc-32cb12d472fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:44.325654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-be6de559-098c-4155-a864-f827c327f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:44.328669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552e041-a70b-44c6-b3fc-32cb12d472fd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:44.358305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2437/4894] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:44.370843 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2458/4895] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:44.372047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6de559-098c-4155-a864-f827c327f610 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:44.392588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae4462-041f-4eb4-9bdf-098ba524a98e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.392877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae4462-041f-4eb4-9bdf-098ba524a98e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.393208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae4462-041f-4eb4-9bdf-098ba524a98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.401897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6de559-098c-4155-a864-f827c327f610 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:44.416658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-45ae4462-041f-4eb4-9bdf-098ba524a98e None None] MFA Rules not processed for user `59876c2e98254d29b51b071f68569602`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:44.417447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45ae4462-041f-4eb4-9bdf-098ba524a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:44.439954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:44.495983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:44.496839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.497296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.497715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.498723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:44.500599 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2459/4896] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:44.501210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:44.530487 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2438/4897] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:44.534503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae4462-041f-4eb4-9bdf-098ba524a98e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:44.550922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae4462-041f-4eb4-9bdf-098ba524a98e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:44.570828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:44.571923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.572414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.572930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.574458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:44.576540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:44.607529 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2460/4898] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:44.611903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:44.624860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269b13-b0c8-4ce1-b302-151bad66dd71 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:44.637546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:44.638743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.639588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.640026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] PATH_INFO: `/v3/projects/fe36d54d2b5343f29c9232aa4664a6d6/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.660709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe36d54d2b5343f29c9232aa4664a6d6, user_id=1226a3e3a72c44f18c6b317aaae482b0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:44.666636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:44.683967 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2439/4899] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:44 2022] PUT /identity/v3/projects/fe36d54d2b5343f29c9232aa4664a6d6/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:44.688505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:44.708406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f64ebe-cbe1-49f6-af04-1f463d178c52 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:44.842344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4401f-0f93-4f12-b89b-df576b75af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:44.843407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4401f-0f93-4f12-b89b-df576b75af44 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.843884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4401f-0f93-4f12-b89b-df576b75af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.844361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4401f-0f93-4f12-b89b-df576b75af44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.845366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4401f-0f93-4f12-b89b-df576b75af44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:44.847205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4401f-0f93-4f12-b89b-df576b75af44 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:44.859626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2461/4900] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:44.863794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:44.875093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cde40-e6c6-4187-9263-eee3858f59a0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:44.881630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:44.881981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.882309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.882589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] PATH_INFO: `/v3/projects/fe36d54d2b5343f29c9232aa4664a6d6/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.884710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe36d54d2b5343f29c9232aa4664a6d6, user_id=1226a3e3a72c44f18c6b317aaae482b0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:44.887370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:44.900246 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2440/4901] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:44 2022] PUT /identity/v3/projects/fe36d54d2b5343f29c9232aa4664a6d6/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:44.910878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bab604-0c4e-414f-bf9a-5383ffff02ec None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:44.911238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bab604-0c4e-414f-bf9a-5383ffff02ec None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:44.911596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bab604-0c4e-414f-bf9a-5383ffff02ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:44.944302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-85bab604-0c4e-414f-bf9a-5383ffff02ec None None] MFA Rules not processed for user `1226a3e3a72c44f18c6b317aaae482b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:44.945776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-85bab604-0c4e-414f-bf9a-5383ffff02ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:44.987379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:45.064301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2462/4902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:45.069529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:45.159252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc4fe4-ba0f-43c7-bbe0-82f18e4cdec8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:45.164871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:45.165565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.165843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.166116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.166817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:45.168861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:45.202360 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2441/4903] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:45 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:45.203576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bab604-0c4e-414f-bf9a-5383ffff02ec None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:45.218760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bab604-0c4e-414f-bf9a-5383ffff02ec None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:45.305476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:45.306261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.306545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.306828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.307532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:45.309846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:45.359344 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2463/4904] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:45 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:45.359481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:45.372109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681d1d1-f932-475a-b2fd-89d19d9f5620 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:45.377982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:45.378987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.384622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.385096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.385957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:45.387817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:45.402676 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2442/4905] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:45.403727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:45.415107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17571a7-8907-4cb4-8ffa-b337907a18da admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:45.420196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66acba-0be6-44a5-b5bc-cddc66559eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:45.420884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66acba-0be6-44a5-b5bc-cddc66559eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.421217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66acba-0be6-44a5-b5bc-cddc66559eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.421497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66acba-0be6-44a5-b5bc-cddc66559eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.422231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66acba-0be6-44a5-b5bc-cddc66559eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:45.423957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66acba-0be6-44a5-b5bc-cddc66559eb5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:45.435953 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2464/4906] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:45.440767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:45.455843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92ca5e-de53-4fc4-8a03-c949aaaa7118 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:45.461407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:45.462323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.462601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.463053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] PATH_INFO: `/v3/projects/5411efaaab974a0882ef6dffba673edb/users/bc9b0b24dc3549a5b11f01359c21c160/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.488459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5411efaaab974a0882ef6dffba673edb, user_id=bc9b0b24dc3549a5b11f01359c21c160, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:45.491873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:45.510733 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2443/4907] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:45 2022] PUT /identity/v3/projects/5411efaaab974a0882ef6dffba673edb/users/bc9b0b24dc3549a5b11f01359c21c160/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:45.523185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ae71-fe90-4f81-a0eb-60ce447fd826 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.523497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ae71-fe90-4f81-a0eb-60ce447fd826 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.523803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034ae71-fe90-4f81-a0eb-60ce447fd826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.573023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6034ae71-fe90-4f81-a0eb-60ce447fd826 None None] MFA Rules not processed for user `bc9b0b24dc3549a5b11f01359c21c160`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:45.575186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6034ae71-fe90-4f81-a0eb-60ce447fd826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:45.692331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2465/4908] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:45.693311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:45.744423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:45.789179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509c66-cdd1-475c-875e-f87ac3575f45 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:45.803281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:45.804113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.805859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.806308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.807370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:45.809758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:45.839967 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2444/4909] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:19:45 2022] POST /identity/v3/domains => generated 276 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:45.842903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ae71-fe90-4f81-a0eb-60ce447fd826 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:45.863744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034ae71-fe90-4f81-a0eb-60ce447fd826 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:45.927186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:45.959546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:45.960260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:45.960547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:45.960829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:45.962220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:45.963438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:45.989113 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2466/4910] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:45 2022] POST /identity/v3/roles => generated 240 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:45.991714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:46.004024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eeb50-ddbc-4e2b-a47a-c52e2639104b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:46.010331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:46.011604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:46.012119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:46.012610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/17a821221038409fa137889522420330/users/bc9b0b24dc3549a5b11f01359c21c160/roles/8f71fd19fd5245b381a1c87259517047` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:46.035645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=17a821221038409fa137889522420330, user_id=bc9b0b24dc3549a5b11f01359c21c160, role_id=8f71fd19fd5245b381a1c87259517047)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:46.041027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:46.066838 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2445/4911] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Jun 18 22:19:45 2022] PUT /identity/v3/domains/17a821221038409fa137889522420330/users/bc9b0b24dc3549a5b11f01359c21c160/roles/8f71fd19fd5245b381a1c87259517047 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:46.071745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:46.114828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135176ce-5467-4e83-8067-1a5c02a5117c tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:46.205738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:46.206999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:46.207507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:46.208006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:46.208986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:46.213335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:46.244915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2467/4912] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:19:46 2022] POST /identity/v3/domains => generated 277 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:46.249121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:46.262786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db37b-8444-4238-8a43-36c7d3d80be8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:46.418165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:46.418908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:46.419299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:46.419591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:46.420376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:46.422603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:46.461290 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2446/4913] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:46 2022] POST /identity/v3/roles => generated 240 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:46.468787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:46.491935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22d14e-1531-42d5-b19b-e94b451f1fa8 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:46.510674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:46.511446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:46.511738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:46.512019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:46.512934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:46.516051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:46.551919 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2468/4914] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:46 2022] POST /identity/v3/groups => generated 326 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:46.556102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:46.571546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57e08-227c-4da1-98d3-f8cae3bf4bd5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:46.578553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:46.580066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:46.580453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:46.580844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups/cfba2f0d765742c2b1a3e984de94e8de/users/bc9b0b24dc3549a5b11f01359c21c160` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:46.590583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=cfba2f0d765742c2b1a3e984de94e8de, user_id=bc9b0b24dc3549a5b11f01359c21c160)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:46.592817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:46.638179 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2447/4915] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:19:46 2022] PUT /identity/v3/groups/cfba2f0d765742c2b1a3e984de94e8de/users/bc9b0b24dc3549a5b11f01359c21c160 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:46.639123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:46.662876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c3843-8b75-44b3-b932-386ae660f089 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:46.735019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:46.736232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:46.736618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:46.737021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/bbffcf740bef4c9893d68f6ad36cafde/groups/cfba2f0d765742c2b1a3e984de94e8de/roles/c67f76d87f2447c2876aef33de25bb41` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:46.740593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bbffcf740bef4c9893d68f6ad36cafde, group_id=cfba2f0d765742c2b1a3e984de94e8de, role_id=c67f76d87f2447c2876aef33de25bb41)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:46.745177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:46.770923 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2469/4916] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:46 2022] PUT /identity/v3/domains/bbffcf740bef4c9893d68f6ad36cafde/groups/cfba2f0d765742c2b1a3e984de94e8de/roles/c67f76d87f2447c2876aef33de25bb41 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:46.773946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:46.793126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541fc97-86e9-49ba-a299-e4d6f6a204f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:46.992003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:46.992979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:46.993451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:46.993933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:46.995403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:46.999720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.024161 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2448/4917] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:19:46 2022] POST /identity/v3/domains => generated 274 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:47.028619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:47.043573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21387cff-9550-4201-af0d-e27f6c99c28a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:47.177708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:47.214568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:47.215707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:47.216338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:47.216598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:47.217683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:47.219584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.258042 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2470/4918] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:47 2022] POST /identity/v3/roles => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:47.259597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:47.266468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:47.293266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da63c5-75f2-4d56-a527-a28bda1a56ea tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:47.308370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:47.311455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:47.313778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:47.314255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/aef13811b75d4771b06d2048e742b11e/users/bc9b0b24dc3549a5b11f01359c21c160/roles/da69c5fdaecf46828456ba1ec8eec223` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:47.344183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=aef13811b75d4771b06d2048e742b11e, user_id=bc9b0b24dc3549a5b11f01359c21c160, role_id=da69c5fdaecf46828456ba1ec8eec223)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:47.358202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.401617 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2449/4919] 10.222.0.30 () {60 vars in 1479 bytes} [Sat Jun 18 22:19:47 2022] PUT /identity/v3/domains/aef13811b75d4771b06d2048e742b11e/users/bc9b0b24dc3549a5b11f01359c21c160/roles/da69c5fdaecf46828456ba1ec8eec223 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:47.408088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:47.420645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a5750-a8f3-4709-bfcc-28f969b627ce tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:47.517764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:47.518611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:47.519124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:47.519802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:47.520694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:47.523254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.545588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2471/4920] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:19:47 2022] POST /identity/v3/domains => generated 275 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:47.549638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:47.561570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb29ff-2a7d-4415-99ec-c41f0b62ebec tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:47.633104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:47.633853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:47.634277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:47.634564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:47.635319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:47.636965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.656492 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2450/4921] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:47 2022] POST /identity/v3/roles => generated 239 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:47.660519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:47.671414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02427f1-a5fd-443b-bee3-a55a54826c72 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:47.677022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:47.678088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:47.678527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:47.678969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:47.679871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:47.682855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.717714 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2472/4922] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:47 2022] POST /identity/v3/groups => generated 326 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:47.722981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:47.741535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4734c67-5228-478b-8466-648c0c7a0e0f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:47.752386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:47.755254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:47.755789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:47.756329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups/bfe12e2cad294b99b7703347c31c88b9/users/bc9b0b24dc3549a5b11f01359c21c160` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:47.765578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bfe12e2cad294b99b7703347c31c88b9, user_id=bc9b0b24dc3549a5b11f01359c21c160)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:47.768473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.804282 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2451/4923] 10.222.0.30 () {60 vars in 1359 bytes} [Sat Jun 18 22:19:47 2022] PUT /identity/v3/groups/bfe12e2cad294b99b7703347c31c88b9/users/bc9b0b24dc3549a5b11f01359c21c160 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:47.808663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:47.820687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06481aee-76ba-400d-865a-fd0058b706dc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:47.918415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:47.919365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:47.920329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:47.920329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/7c1683098a30464789e1c993395d53bf/groups/bfe12e2cad294b99b7703347c31c88b9/roles/1d8f8d60142d40b3b8f4cbf36bf122a5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:47.922456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=7c1683098a30464789e1c993395d53bf, group_id=bfe12e2cad294b99b7703347c31c88b9, role_id=1d8f8d60142d40b3b8f4cbf36bf122a5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:47.926491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:47.944242 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2473/4924] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:47 2022] PUT /identity/v3/domains/7c1683098a30464789e1c993395d53bf/groups/bfe12e2cad294b99b7703347c31c88b9/roles/1d8f8d60142d40b3b8f4cbf36bf122a5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:47.948316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:48.068573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330805f9-0dc4-4b99-b08a-61d89f9e2339 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:48.100328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:48.161786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc9b0b24dc3549a5b11f01359c21c160', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5411efaaab974a0882ef6dffba673edb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:48.162456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:48.162739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:48.163235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] PATH_INFO: `/v3/auth/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:48.163871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:48.164977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:48.258503 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2452/4925] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:19:47 2022] GET /identity/v3/auth/domains => generated 1170 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:48.263286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:48.327537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:48.365023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3012f-9ca0-430f-9506-d8e7967a5ab1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:48.372855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:48.373853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:48.374134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:48.374408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/7c1683098a30464789e1c993395d53bf/groups/bfe12e2cad294b99b7703347c31c88b9/roles/1d8f8d60142d40b3b8f4cbf36bf122a5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:48.377218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=7c1683098a30464789e1c993395d53bf, group_id=bfe12e2cad294b99b7703347c31c88b9, role_id=1d8f8d60142d40b3b8f4cbf36bf122a5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:48.389854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:48.397331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role 1d8f8d60142d40b3b8f4cbf36bf122a5 was removed from group bfe12e2cad294b99b7703347c31c88b9 on domain 7c1683098a30464789e1c993395d53bf. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:48.397686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:48.399051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:48.427737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2474/4926] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Jun 18 22:19:48 2022] DELETE /identity/v3/domains/7c1683098a30464789e1c993395d53bf/groups/bfe12e2cad294b99b7703347c31c88b9/roles/1d8f8d60142d40b3b8f4cbf36bf122a5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:48.432367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:48.434205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:48.450974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e9c52-fbf2-483a-bcd9-3d93bd8a6935 tempest-TokensV3TestJSON-1603243085 tempest-TokensV3TestJSON-1603243085-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:48.524204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:48.525397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:48.525542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:48.526377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups/bfe12e2cad294b99b7703347c31c88b9/users/bc9b0b24dc3549a5b11f01359c21c160` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:48.528396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=bfe12e2cad294b99b7703347c31c88b9, user_id=bc9b0b24dc3549a5b11f01359c21c160)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:48.529506 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:19:48.529506 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:19:48.529506 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:19:48.530874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:48.540814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc9b0b24dc3549a5b11f01359c21c160'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:48.564715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2453/4927] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:19:48 2022] DELETE /identity/v3/groups/bfe12e2cad294b99b7703347c31c88b9/users/bc9b0b24dc3549a5b11f01359c21c160 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:48.569089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:48.581529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b559b5b-4f76-4762-bc91-f8fb52625733 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:48.653968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:48.654962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:48.655459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:48.655748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups/bfe12e2cad294b99b7703347c31c88b9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:48.657132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bfe12e2cad294b99b7703347c31c88b9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:48.659308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:48.733085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2475/4928] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:19:48 2022] DELETE /identity/v3/groups/bfe12e2cad294b99b7703347c31c88b9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:48.734684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:48.781890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73664a4-d10d-4309-9bcf-2668c68d9e75 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:48.828283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:48.872761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:48.876414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:48.876414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:48.876414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles/1d8f8d60142d40b3b8f4cbf36bf122a5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:48.878167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:48.883895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1d8f8d60142d40b3b8f4cbf36bf122a5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:48.885778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:48.886524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:48.970411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role 1d8f8d60142d40b3b8f4cbf36bf122a5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:48.970925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:48.971851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:48.975424 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2454/4929] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:48 2022] DELETE /identity/v3/roles/1d8f8d60142d40b3b8f4cbf36bf122a5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:48.980462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:48.989196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.046294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4760-0410-4aa8-9f01-a6addaad4883 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:49.089334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:49.115199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe9d9b-40f2-4d59-bf29-ab6559622fa0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:49.120095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:49.121063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.121446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.121786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/7c1683098a30464789e1c993395d53bf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.123166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7c1683098a30464789e1c993395d53bf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:49.124833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:49.127800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:49.129350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.129732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.130188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] PATH_INFO: `/v3/users/ff7a45b8c6c7462ab3e3e1e1caeadf65` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.131839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7a45b8c6c7462ab3e3e1e1caeadf65)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:49.136681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:49.149207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7c1683098a30464789e1c993395d53bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.149951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7c1683098a30464789e1c993395d53bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.178887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7c1683098a30464789e1c993395d53bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.180011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7c1683098a30464789e1c993395d53bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.185809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2455/4930] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:48 2022] PATCH /identity/v3/domains/7c1683098a30464789e1c993395d53bf => generated 276 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:49.186811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:49.190152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.202427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7a45b8c6c7462ab3e3e1e1caeadf65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.203816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7a45b8c6c7462ab3e3e1e1caeadf65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.218851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7a45b8c6c7462ab3e3e1e1caeadf65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.219693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7a45b8c6c7462ab3e3e1e1caeadf65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.229661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7a45b8c6c7462ab3e3e1e1caeadf65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.246687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2476/4931] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:48 2022] DELETE /identity/v3/users/ff7a45b8c6c7462ab3e3e1e1caeadf65 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:49.267356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69973a6-331f-4411-9836-59d06475e46f tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:49.273783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:49.338534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:49.339428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.339717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.339997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/7c1683098a30464789e1c993395d53bf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.351772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7c1683098a30464789e1c993395d53bf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:49.353471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:49.377431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7c1683098a30464789e1c993395d53bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.381250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7c1683098a30464789e1c993395d53bf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.447081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1683098a30464789e1c993395d53bf', 'request_id': 'req-8780864f-b47a-49e1-b42f-114f94a54bfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.450570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:49.452249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.458469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1683098a30464789e1c993395d53bf', 'request_id': 'req-8780864f-b47a-49e1-b42f-114f94a54bfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.473059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1683098a30464789e1c993395d53bf', 'request_id': 'req-8780864f-b47a-49e1-b42f-114f94a54bfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.489308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] The token cache is being invalidate because project 7c1683098a30464789e1c993395d53bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:49.489744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.491186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.500893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7c1683098a30464789e1c993395d53bf', 'request_id': 'req-8780864f-b47a-49e1-b42f-114f94a54bfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.501925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7c1683098a30464789e1c993395d53bf', 'request_id': 'req-8780864f-b47a-49e1-b42f-114f94a54bfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.503284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7c1683098a30464789e1c993395d53bf', 'request_id': 'req-8780864f-b47a-49e1-b42f-114f94a54bfa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.517683 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2456/4932] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:49 2022] DELETE /identity/v3/domains/7c1683098a30464789e1c993395d53bf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:49.519783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:49.521183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.581930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc81f0-adb1-452a-80ad-1619f055971e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:49.612169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:49.646723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780864f-b47a-49e1-b42f-114f94a54bfa tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:49.661053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:49.662089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.662436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.662770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/aef13811b75d4771b06d2048e742b11e/users/bc9b0b24dc3549a5b11f01359c21c160/roles/da69c5fdaecf46828456ba1ec8eec223` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.674859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=aef13811b75d4771b06d2048e742b11e, user_id=bc9b0b24dc3549a5b11f01359c21c160, role_id=da69c5fdaecf46828456ba1ec8eec223)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:49.677834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:49.686058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:49.687667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.687667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.687667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] PATH_INFO: `/v3/projects/8b7881662169425eafcad48b5c31f1ee` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.689381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7881662169425eafcad48b5c31f1ee)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:49.691422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:49.692094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role da69c5fdaecf46828456ba1ec8eec223 was removed from user bc9b0b24dc3549a5b11f01359c21c160 on domain aef13811b75d4771b06d2048e742b11e. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:49.692094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.693092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.695197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:49.721093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2457/4933] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Jun 18 22:19:49 2022] DELETE /identity/v3/domains/aef13811b75d4771b06d2048e742b11e/users/bc9b0b24dc3549a5b11f01359c21c160/roles/da69c5fdaecf46828456ba1ec8eec223 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:49.724068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:49.728033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.777016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7881662169425eafcad48b5c31f1ee', 'request_id': 'req-2a1348a6-185f-41d4-b030-28660061b3a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.777016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7881662169425eafcad48b5c31f1ee', 'request_id': 'req-2a1348a6-185f-41d4-b030-28660061b3a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.784726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7881662169425eafcad48b5c31f1ee', 'request_id': 'req-2a1348a6-185f-41d4-b030-28660061b3a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.800914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] The token cache is being invalidate because project 8b7881662169425eafcad48b5c31f1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:49.801259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.802320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2a1348a6-185f-41d4-b030-28660061b3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.804501 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2477/4934] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:49 2022] DELETE /identity/v3/projects/8b7881662169425eafcad48b5c31f1ee => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:49.809683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5b32-4d92-4085-a5cd-b6504dbf6103 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.809965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5b32-4d92-4085-a5cd-b6504dbf6103 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.810243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db5b32-4d92-4085-a5cd-b6504dbf6103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.833334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89e56e-e1a0-450b-8626-18583ae0596b tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:49.834154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d8db5b32-4d92-4085-a5cd-b6504dbf6103 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:49.836002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d8db5b32-4d92-4085-a5cd-b6504dbf6103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.911788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:49.912943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.913991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.913991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles/da69c5fdaecf46828456ba1ec8eec223` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.915086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=da69c5fdaecf46828456ba1ec8eec223)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:49.916708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:49.919834 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2478/4935] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:49.928307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4cf5d-634c-433e-9ec6-35eb90287713 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:49.928593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4cf5d-634c-433e-9ec6-35eb90287713 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:49.928873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4cf5d-634c-433e-9ec6-35eb90287713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:49.953396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ac4cf5d-634c-433e-9ec6-35eb90287713 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:49.954651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ac4cf5d-634c-433e-9ec6-35eb90287713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.961872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role da69c5fdaecf46828456ba1ec8eec223 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:49.962194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.964415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2479/4936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:19:49.965453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:49.968801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4cf5d-634c-433e-9ec6-35eb90287713 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:49.973942 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2458/4937] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:49 2022] DELETE /identity/v3/roles/da69c5fdaecf46828456ba1ec8eec223 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:49.974629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:49.976698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:49.979367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4cf5d-634c-433e-9ec6-35eb90287713 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.067869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:50.075037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.075914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.076260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.076538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.080033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:50.080356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.085155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.088846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfb128-8b86-43c0-b34e-a829e3521c0d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.101677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.102779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.103458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.103829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/aef13811b75d4771b06d2048e742b11e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.106110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=aef13811b75d4771b06d2048e742b11e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.108844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.113093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2480/4938] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:50.117299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.122229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.133642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'aef13811b75d4771b06d2048e742b11e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.134692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'aef13811b75d4771b06d2048e742b11e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.161337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74880a-3c62-4252-88e2-b05c5199e25c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.196669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:50.208749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'aef13811b75d4771b06d2048e742b11e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.209426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'aef13811b75d4771b06d2048e742b11e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.238130 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2459/4939] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:49 2022] PATCH /identity/v3/domains/aef13811b75d4771b06d2048e742b11e => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:50.239363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.242225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.300428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.301155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.301436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.301715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.302413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.304351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.358059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fe768-26ea-4f8b-9504-27ffe7393bf6 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.364821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.365310 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2481/4940] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:50 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:50.369461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.369860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.370153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.370468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/aef13811b75d4771b06d2048e742b11e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.378715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.392823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=aef13811b75d4771b06d2048e742b11e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.394514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.422412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'aef13811b75d4771b06d2048e742b11e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.425862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'aef13811b75d4771b06d2048e742b11e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.468442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac0b9-c805-4823-b025-79d46e44e39f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.490201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef13811b75d4771b06d2048e742b11e', 'request_id': 'req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.502569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef13811b75d4771b06d2048e742b11e', 'request_id': 'req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.518403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef13811b75d4771b06d2048e742b11e', 'request_id': 'req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.533014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] The token cache is being invalidate because project aef13811b75d4771b06d2048e742b11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:50.533695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.534705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.543123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:50.543595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.544566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.544687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'aef13811b75d4771b06d2048e742b11e', 'request_id': 'req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.544878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.545351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.545909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'aef13811b75d4771b06d2048e742b11e', 'request_id': 'req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.546298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.546830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'aef13811b75d4771b06d2048e742b11e', 'request_id': 'req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.548427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.562242 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2460/4941] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:50 2022] DELETE /identity/v3/domains/aef13811b75d4771b06d2048e742b11e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:50.563791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.566445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.572301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2482/4942] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:50 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:50.576575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.578542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.591597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305807c8-d473-475b-8f1f-321918f06851 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.597934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.598663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.598935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.599218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.599957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.601940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.616510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2483/4943] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:50 2022] GET /identity/v3/roles => generated 1882 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:19:50.617455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.628696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1ddc2-00db-4dd9-b4e8-cd71bf4173c9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.634138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.634821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.635106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.636090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.636955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.638642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.650450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b10b7d-a9b1-4424-beb9-a4d6f22b1649 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.651663 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2484/4944] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:50 2022] GET /identity/v3/roles => generated 1882 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:50.655586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.655715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.656508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.656801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.657119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/bbffcf740bef4c9893d68f6ad36cafde/groups/cfba2f0d765742c2b1a3e984de94e8de/roles/c67f76d87f2447c2876aef33de25bb41` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.659502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bbffcf740bef4c9893d68f6ad36cafde, group_id=cfba2f0d765742c2b1a3e984de94e8de, role_id=c67f76d87f2447c2876aef33de25bb41)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.662243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.666651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804471c3-477d-4b34-b184-4544e9ec3a1f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.668255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role c67f76d87f2447c2876aef33de25bb41 was removed from group cfba2f0d765742c2b1a3e984de94e8de on domain bbffcf740bef4c9893d68f6ad36cafde. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:50.668555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.669250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.674001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba30aa-e684-4bd9-bf03-cf3685d58917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.674001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba30aa-e684-4bd9-bf03-cf3685d58917 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.674001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba30aa-e684-4bd9-bf03-cf3685d58917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.674342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba30aa-e684-4bd9-bf03-cf3685d58917 admin admin] PATH_INFO: `/v3/projects/73290d4cb44c40ffa3a0a8f1e553f2e6/users/277319873f994c44831e0840ef111b8f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.687612 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2461/4945] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Jun 18 22:19:50 2022] DELETE /identity/v3/domains/bbffcf740bef4c9893d68f6ad36cafde/groups/cfba2f0d765742c2b1a3e984de94e8de/roles/c67f76d87f2447c2876aef33de25bb41 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:50.691916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.693340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.697936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba30aa-e684-4bd9-bf03-cf3685d58917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73290d4cb44c40ffa3a0a8f1e553f2e6, user_id=277319873f994c44831e0840ef111b8f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.701674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba30aa-e684-4bd9-bf03-cf3685d58917 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.706396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:50.728898 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2485/4946] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:50 2022] PUT /identity/v3/projects/73290d4cb44c40ffa3a0a8f1e553f2e6/users/277319873f994c44831e0840ef111b8f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:50.730965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.731605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.731605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.752672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:50.754598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.770427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d9160-ed7b-4e40-945a-931e2d1e1f20 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:50.842297 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2486/4947] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:50.864852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:50.866055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:50.866923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:50.867214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups/cfba2f0d765742c2b1a3e984de94e8de/users/bc9b0b24dc3549a5b11f01359c21c160` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:50.869101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=cfba2f0d765742c2b1a3e984de94e8de, user_id=bc9b0b24dc3549a5b11f01359c21c160)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:50.871264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:50.880891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc9b0b24dc3549a5b11f01359c21c160'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:50.884658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.886459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:50.924789 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2462/4948] 10.222.0.30 () {58 vars in 1343 bytes} [Sat Jun 18 22:19:50 2022] DELETE /identity/v3/groups/cfba2f0d765742c2b1a3e984de94e8de/users/bc9b0b24dc3549a5b11f01359c21c160 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:50.929273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:50.955253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:51.026186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05ddb9-f939-4d97-97a5-257112978d39 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:51.031698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb631b-e4e1-4837-82ed-e198ced15865 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:51.050623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a806-39e6-4a49-95ca-8010971f776a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:51.053156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a806-39e6-4a49-95ca-8010971f776a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:51.053631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a806-39e6-4a49-95ca-8010971f776a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:51.053933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a806-39e6-4a49-95ca-8010971f776a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/groups/cfba2f0d765742c2b1a3e984de94e8de` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:51.055595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a806-39e6-4a49-95ca-8010971f776a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cfba2f0d765742c2b1a3e984de94e8de)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:51.057825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a806-39e6-4a49-95ca-8010971f776a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:51.100906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:51.101627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:51.101906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:51.102183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:51.122081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2463/4949] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:19:50 2022] DELETE /identity/v3/groups/cfba2f0d765742c2b1a3e984de94e8de => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:51.124203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929defcc-ee7c-4ec9-b8a1-3d64623abf49 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:51.124840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929defcc-ee7c-4ec9-b8a1-3d64623abf49 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:51.125379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929defcc-ee7c-4ec9-b8a1-3d64623abf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:51.151710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-929defcc-ee7c-4ec9-b8a1-3d64623abf49 None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:51.153292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-929defcc-ee7c-4ec9-b8a1-3d64623abf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:51.168901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:51.170906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:51.183270 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2487/4950] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:51.184039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:51.189652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:51.200344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960abdd-3279-4a7a-8dd6-996e05ac0f96 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:51.239213 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2464/4951] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:51.326672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:51.328384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:51.328767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:51.329196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles/c67f76d87f2447c2876aef33de25bb41` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:51.332425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c67f76d87f2447c2876aef33de25bb41)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:51.334240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:51.383745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role c67f76d87f2447c2876aef33de25bb41 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:51.384123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.384955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.390183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2488/4952] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:51 2022] DELETE /identity/v3/roles/c67f76d87f2447c2876aef33de25bb41 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:51.393630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929defcc-ee7c-4ec9-b8a1-3d64623abf49 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:51.410748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929defcc-ee7c-4ec9-b8a1-3d64623abf49 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:51.521014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:51.524463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:51.524769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:51.525077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/bbffcf740bef4c9893d68f6ad36cafde` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:51.528134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bbffcf740bef4c9893d68f6ad36cafde)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:51.530825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:51.561443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.562465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.568209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:51.607155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.607872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.612764 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2465/4953] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:51 2022] PATCH /identity/v3/domains/bbffcf740bef4c9893d68f6ad36cafde => generated 278 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:51.616662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:51.619496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:51.635292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d3604-565d-4739-a4e9-24fc5d4abbbd tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:51.715880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:51.717014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:51.718456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:51.718850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/bbffcf740bef4c9893d68f6ad36cafde` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:51.733691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bbffcf740bef4c9893d68f6ad36cafde)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:51.736851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:51.770437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.774475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.852696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:51.870549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde', 'request_id': 'req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.881953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde', 'request_id': 'req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.894911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde', 'request_id': 'req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.911249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] The token cache is being invalidate because project bbffcf740bef4c9893d68f6ad36cafde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:51.911624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.912197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.922538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde', 'request_id': 'req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.923460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde', 'request_id': 'req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.924109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bbffcf740bef4c9893d68f6ad36cafde', 'request_id': 'req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:51.937839 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2489/4954] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:51 2022] DELETE /identity/v3/domains/bbffcf740bef4c9893d68f6ad36cafde => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:51.942103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:51.943643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:51.963446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df212b18-3aee-4c93-b231-c5a19ef52be0 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:52.055064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:52.055064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:52.055571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:52.055862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/17a821221038409fa137889522420330/users/bc9b0b24dc3549a5b11f01359c21c160/roles/8f71fd19fd5245b381a1c87259517047` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:52.060554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=17a821221038409fa137889522420330, user_id=bc9b0b24dc3549a5b11f01359c21c160, role_id=8f71fd19fd5245b381a1c87259517047)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:52.064762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:52.073282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role 8f71fd19fd5245b381a1c87259517047 was removed from user bc9b0b24dc3549a5b11f01359c21c160 on domain 17a821221038409fa137889522420330. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:52.074052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.075286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.100209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2466/4955] 10.222.0.30 () {58 vars in 1463 bytes} [Sat Jun 18 22:19:51 2022] DELETE /identity/v3/domains/17a821221038409fa137889522420330/users/bc9b0b24dc3549a5b11f01359c21c160/roles/8f71fd19fd5245b381a1c87259517047 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:52.101578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:52.103255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:52.117841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d1339-9fa1-4885-8d0a-0ef40980abd7 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:52.198869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:52.199972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:52.200373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:52.200748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles/8f71fd19fd5245b381a1c87259517047` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:52.202973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8f71fd19fd5245b381a1c87259517047)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:52.204997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:52.258475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role 8f71fd19fd5245b381a1c87259517047 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:52.258960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.259750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.262305 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2490/4956] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:52 2022] DELETE /identity/v3/roles/8f71fd19fd5245b381a1c87259517047 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:52.266586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:52.268070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:52.289228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aa91b-d5fc-4e4f-8971-b9a7216668bc tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:52.370628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:52.371813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:52.372279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:52.372632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/17a821221038409fa137889522420330` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:52.374172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=17a821221038409fa137889522420330)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:52.375953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:52.401042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '17a821221038409fa137889522420330'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.401943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '17a821221038409fa137889522420330'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.440525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '17a821221038409fa137889522420330'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.441339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '17a821221038409fa137889522420330'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.446087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2467/4957] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:52 2022] PATCH /identity/v3/domains/17a821221038409fa137889522420330 => generated 277 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:52.450534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:52.452267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:52.466141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e817f-90d3-461e-bbcc-a0486a3f1067 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:52.539699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:52.540771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:52.541199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:52.541913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/17a821221038409fa137889522420330` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:52.556537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=17a821221038409fa137889522420330)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:52.558351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:52.561640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:52.617470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '17a821221038409fa137889522420330'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.622223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '17a821221038409fa137889522420330'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.714628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a821221038409fa137889522420330', 'request_id': 'req-5d06f2b4-68f5-41f0-9776-1980d5310b33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.728115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a821221038409fa137889522420330', 'request_id': 'req-5d06f2b4-68f5-41f0-9776-1980d5310b33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.748914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a821221038409fa137889522420330', 'request_id': 'req-5d06f2b4-68f5-41f0-9776-1980d5310b33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.763020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] The token cache is being invalidate because project 17a821221038409fa137889522420330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:52.763334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.764617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.777163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '17a821221038409fa137889522420330', 'request_id': 'req-5d06f2b4-68f5-41f0-9776-1980d5310b33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.778430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '17a821221038409fa137889522420330', 'request_id': 'req-5d06f2b4-68f5-41f0-9776-1980d5310b33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.779131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '17a821221038409fa137889522420330', 'request_id': 'req-5d06f2b4-68f5-41f0-9776-1980d5310b33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:52.806331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2491/4958] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:19:52 2022] DELETE /identity/v3/domains/17a821221038409fa137889522420330 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:52.807514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:52.809107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:52.857424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1face-6cbc-4f64-a309-82561b185788 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:53.018862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:53.098728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:53.100263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:53.100518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:53.101704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:53.103875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:53.107426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:53.155217 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2468/4959] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:53.158562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:53.161903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:53.182523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06f2b4-68f5-41f0-9776-1980d5310b33 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:53.190242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:53.191640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:53.191980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:53.192267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects/de36ac88f5924ac697032918c47a36b4/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:53.194511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de36ac88f5924ac697032918c47a36b4, user_id=1226a3e3a72c44f18c6b317aaae482b0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:53.200580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:53.225858 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2492/4960] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:53 2022] PUT /identity/v3/projects/de36ac88f5924ac697032918c47a36b4/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:53.229858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:53.249651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1010-d183-402b-8ac3-b38fecb9c93d tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:53.353828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:53.354847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:53.356071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:53.356511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:53.357446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:53.359441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:53.427808 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2469/4961] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:19:53 2022] GET /identity/v3/auth/projects => generated 826 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:19:53.429252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:53.452132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392653-f7a0-45b0-8900-88c86cdb09af tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:53.458617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:53.459939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:53.460812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:53.461344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects/de36ac88f5924ac697032918c47a36b4/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:53.464860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=de36ac88f5924ac697032918c47a36b4, user_id=1226a3e3a72c44f18c6b317aaae482b0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:53.468009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:53.480250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role 94ce583da5f6409cb8f3ec3771a2da17 was removed from user 1226a3e3a72c44f18c6b317aaae482b0 on project de36ac88f5924ac697032918c47a36b4. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:53.482707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:53.484754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:53.543739 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2493/4962] 10.222.0.30 () {58 vars in 1466 bytes} [Sat Jun 18 22:19:53 2022] DELETE /identity/v3/projects/de36ac88f5924ac697032918c47a36b4/users/1226a3e3a72c44f18c6b317aaae482b0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:53.549599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:53.551529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:53.566473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15feb18-ee20-4439-b759-e2f9ac12af62 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:53.655157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:53.655925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:53.656213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:53.656598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:53.657924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:53.660579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:53.697345 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2470/4963] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:53 2022] POST /identity/v3/users => generated 321 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:53.700928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:53.731712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92150e1-9d4a-4dea-9050-b5ca5c8314f9 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:53.737871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:53.738618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:53.739088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:53.739373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:53.740075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:53.744355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:53.790138 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2494/4964] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:53 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:53.795994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:53.811896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa00ff-12fd-4cf9-aa7e-b6a3b6c0e4d1 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:53.857270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:53.921236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:53.922243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:53.922678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:53.923349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:53.924472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:53.926948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:53.973193 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2471/4965] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:53 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:19:53.977577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:53.993618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8c94c-cb74-47ae-a9ae-11710a22a00a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:54.123836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:54.145075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:54.145977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.147154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.147592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.148701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:54.150763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:54.177097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2495/4966] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:19:53 2022] POST /identity/v3/roles => generated 240 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:54.180827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:54.194471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60eb27-f786-4b23-ad4c-1fbd068880e4 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:54.200755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b131c-45ab-4484-9b67-fd5d606a5743 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:54.202317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b131c-45ab-4484-9b67-fd5d606a5743 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.202750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b131c-45ab-4484-9b67-fd5d606a5743 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.203188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b131c-45ab-4484-9b67-fd5d606a5743 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects/3ab215920b0d480fbed4368c4f7d5f97/users/0264b26d64e64caabf8b273a4cdf0dca/roles/71ffbae5ddcc4f36af85de47db64f95f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.227753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b131c-45ab-4484-9b67-fd5d606a5743 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ab215920b0d480fbed4368c4f7d5f97, user_id=0264b26d64e64caabf8b273a4cdf0dca, role_id=71ffbae5ddcc4f36af85de47db64f95f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:54.231660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b131c-45ab-4484-9b67-fd5d606a5743 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:54.273874 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2472/4967] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:54 2022] PUT /identity/v3/projects/3ab215920b0d480fbed4368c4f7d5f97/users/0264b26d64e64caabf8b273a4cdf0dca/roles/71ffbae5ddcc4f36af85de47db64f95f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:54.277851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:54.299518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5b8da-af42-486a-83a1-b95981f17909 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:54.412518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6d985-32f5-44a3-9864-a629fd208b29 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:54.413931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d985-32f5-44a3-9864-a629fd208b29 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.414540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d985-32f5-44a3-9864-a629fd208b29 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.415787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6d985-32f5-44a3-9864-a629fd208b29 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects/ce57dd0d21fc4aff872514bcd2aa0d02/users/0264b26d64e64caabf8b273a4cdf0dca/roles/71ffbae5ddcc4f36af85de47db64f95f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.418542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d985-32f5-44a3-9864-a629fd208b29 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ce57dd0d21fc4aff872514bcd2aa0d02, user_id=0264b26d64e64caabf8b273a4cdf0dca, role_id=71ffbae5ddcc4f36af85de47db64f95f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:54.421754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6d985-32f5-44a3-9864-a629fd208b29 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:54.452184 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2496/4968] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:54 2022] PUT /identity/v3/projects/ce57dd0d21fc4aff872514bcd2aa0d02/users/0264b26d64e64caabf8b273a4cdf0dca/roles/71ffbae5ddcc4f36af85de47db64f95f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:54.459025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.461509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.462091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.553532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] MFA Rules not processed for user `0264b26d64e64caabf8b273a4cdf0dca`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:54.557442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:54.573104 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2473/4969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:54 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:19:54.578728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.579410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.579693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.615346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] MFA Rules not processed for user `0264b26d64e64caabf8b273a4cdf0dca`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:54.619339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:54.661519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:54.663228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:54.791913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f07719-871b-48e9-b537-df76378dc194 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:54.795183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2497/4970] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:54 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jun 18 22:19:54.795183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:54.795384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:54.798266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:54.799013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.799365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.799727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.801647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:54.814334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:54.816044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:54.827960 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2474/4971] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:19:54.828954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:54.909481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffc67d-b4ad-4224-8ffc-af8885a08cf6 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:54.915622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647a50-d87c-4a9c-8fab-84e80e5e6044 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:54.916967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647a50-d87c-4a9c-8fab-84e80e5e6044 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.918226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647a50-d87c-4a9c-8fab-84e80e5e6044 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.918755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647a50-d87c-4a9c-8fab-84e80e5e6044 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.927407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c8321-2e28-47e7-bf33-38a736d754a3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:54.931556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:54.932601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:54.933450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.933732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.934005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] PATH_INFO: `/v3/users/59876c2e98254d29b51b071f68569602` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.935126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647a50-d87c-4a9c-8fab-84e80e5e6044 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:54.935647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] RBAC: Authorizing `identity:delete_user(user_id=59876c2e98254d29b51b071f68569602)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:54.937412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:54.938485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647a50-d87c-4a9c-8fab-84e80e5e6044 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:54.962249 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2475/4972] 10.222.0.30 () {56 vars in 1307 bytes} [Sat Jun 18 22:19:54 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:54.966318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91856d2-45cb-4005-a0db-8202d96badef None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:54.966598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91856d2-45cb-4005-a0db-8202d96badef None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:54.966873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91856d2-45cb-4005-a0db-8202d96badef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:54.977705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f91856d2-45cb-4005-a0db-8202d96badef None None] MFA Rules not processed for user `0264b26d64e64caabf8b273a4cdf0dca`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:54.978724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f91856d2-45cb-4005-a0db-8202d96badef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:54.983004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:55.010494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59876c2e98254d29b51b071f68569602'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.011521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59876c2e98254d29b51b071f68569602'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.028632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59876c2e98254d29b51b071f68569602'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.030110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59876c2e98254d29b51b071f68569602'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.041200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59876c2e98254d29b51b071f68569602'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.052682 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2476/4973] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:54 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jun 18 22:19:55.057579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91856d2-45cb-4005-a0db-8202d96badef None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:55.061012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2498/4974] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:54 2022] DELETE /identity/v3/users/59876c2e98254d29b51b071f68569602 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:55.074757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91856d2-45cb-4005-a0db-8202d96badef None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:55.160007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:55.161741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.162099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.162451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/roles/71ffbae5ddcc4f36af85de47db64f95f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.164258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_role(role_id=71ffbae5ddcc4f36af85de47db64f95f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:55.166279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:55.245917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invalidating the token cache because role 71ffbae5ddcc4f36af85de47db64f95f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:55.247005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.247847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.253889 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2477/4975] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:55 2022] DELETE /identity/v3/roles/71ffbae5ddcc4f36af85de47db64f95f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:55.262066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:55.263827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:55.283863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6510-d9b7-438a-9a61-016119ab30df admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:55.305964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:55.307886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:55.410240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:55.411133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.411420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.411701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects/ce57dd0d21fc4aff872514bcd2aa0d02` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.412951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce57dd0d21fc4aff872514bcd2aa0d02)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:55.414536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:55.414927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:55.426902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad8879-6f14-4592-aeb6-24e02655b7ad tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:55.433874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:55.435263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.435875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.436354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] PATH_INFO: `/v3/projects/e844852ee0a54325a07962baa9b8551b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.438234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e844852ee0a54325a07962baa9b8551b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:55.440901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:55.504251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce57dd0d21fc4aff872514bcd2aa0d02', 'request_id': 'req-58a14343-2f1a-4ca9-bb15-2baa48085d1a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.518057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce57dd0d21fc4aff872514bcd2aa0d02', 'request_id': 'req-58a14343-2f1a-4ca9-bb15-2baa48085d1a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.525810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e844852ee0a54325a07962baa9b8551b', 'request_id': 'req-5c93aec7-fce7-4b9a-8de6-86c902576c84'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.535935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce57dd0d21fc4aff872514bcd2aa0d02', 'request_id': 'req-58a14343-2f1a-4ca9-bb15-2baa48085d1a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.540083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e844852ee0a54325a07962baa9b8551b', 'request_id': 'req-5c93aec7-fce7-4b9a-8de6-86c902576c84'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.553285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] The token cache is being invalidate because project ce57dd0d21fc4aff872514bcd2aa0d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:55.553526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e844852ee0a54325a07962baa9b8551b', 'request_id': 'req-5c93aec7-fce7-4b9a-8de6-86c902576c84'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.553623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.554245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.556576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2499/4976] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:55 2022] DELETE /identity/v3/projects/ce57dd0d21fc4aff872514bcd2aa0d02 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:55.562356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:55.571290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:55.580683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] The token cache is being invalidate because project e844852ee0a54325a07962baa9b8551b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:55.581650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.582751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5c93aec7-fce7-4b9a-8de6-86c902576c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:55.585359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2478/4977] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:55 2022] DELETE /identity/v3/projects/e844852ee0a54325a07962baa9b8551b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:19:55.594255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc34d-ee9e-423f-922c-4536eaca41f3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.594593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc34d-ee9e-423f-922c-4536eaca41f3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.595033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dc34d-ee9e-423f-922c-4536eaca41f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.631049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4c3dc34d-ee9e-423f-922c-4536eaca41f3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:55.633695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c3dc34d-ee9e-423f-922c-4536eaca41f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:55.647424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:55.705720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14343-2f1a-4ca9-bb15-2baa48085d1a tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:55.764905 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2479/4978] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:55.774983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ea66-e6e8-46b7-add8-5b1144ccb19a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.775468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ea66-e6e8-46b7-add8-5b1144ccb19a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.775882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ea66-e6e8-46b7-add8-5b1144ccb19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.805244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9182ea66-e6e8-46b7-add8-5b1144ccb19a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:55.806582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9182ea66-e6e8-46b7-add8-5b1144ccb19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:55.818530 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2480/4979] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:55.822879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182ea66-e6e8-46b7-add8-5b1144ccb19a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:55.825315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:55.826451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.827885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.828273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects/ce57dd0d21fc4aff872514bcd2aa0d02` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.835216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182ea66-e6e8-46b7-add8-5b1144ccb19a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:55.840222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:55.841191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.841478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.841814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.842802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:19:55.843165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:55.845224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:55.849781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce57dd0d21fc4aff872514bcd2aa0d02)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:55.851810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:55.860424 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2481/4980] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:19:55.866759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:55.893508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc879-63b0-4438-8666-35ccabe347a7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:55.910351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:55.913074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.913374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Could not find project: ce57dd0d21fc4aff872514bcd2aa0d02.: keystone.exception.ProjectNotFound: Could not find project: ce57dd0d21fc4aff872514bcd2aa0d02. Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 18 22:19:55.914175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ce57dd0d21fc4aff872514bcd2aa0d02. Jun 18 22:19:55.915195 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:19:55.915887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.916034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:55.920087 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2500/4981] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:55 2022] DELETE /identity/v3/projects/ce57dd0d21fc4aff872514bcd2aa0d02 => generated 113 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 18 22:19:55.920240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:55.921909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:55.924364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:55.961113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8da28-e6af-4626-99de-db41a0649677 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:55.975858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:55.977234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:55.977930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:55.979295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/projects/3ab215920b0d480fbed4368c4f7d5f97` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:55.980879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ab215920b0d480fbed4368c4f7d5f97)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:55.983026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:55.989414 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2482/4982] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:19:55 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:55.992221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.079730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab215920b0d480fbed4368c4f7d5f97', 'request_id': 'req-491b19ec-b418-4a8d-92aa-d1a26f4e42da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.090067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab215920b0d480fbed4368c4f7d5f97', 'request_id': 'req-491b19ec-b418-4a8d-92aa-d1a26f4e42da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.102570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab215920b0d480fbed4368c4f7d5f97', 'request_id': 'req-491b19ec-b418-4a8d-92aa-d1a26f4e42da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.110210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:56.120930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] The token cache is being invalidate because project 3ab215920b0d480fbed4368c4f7d5f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:56.121569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.122723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.125481 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2501/4983] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:55 2022] DELETE /identity/v3/projects/3ab215920b0d480fbed4368c4f7d5f97 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:56.140575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.144572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:56.150175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2655234-0256-4036-aa09-fb90a9c7244a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.290986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b19ec-b418-4a8d-92aa-d1a26f4e42da tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.308244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.309191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.309617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.309901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/users/0264b26d64e64caabf8b273a4cdf0dca` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.311424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0264b26d64e64caabf8b273a4cdf0dca)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:56.313650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:56.315600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:56.330193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.331081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.331467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.331898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.333044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:56.341545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:56.401899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2483/4984] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:19:55 2022] POST /identity/v3/users => generated 290 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:19:56.407562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.409653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0264b26d64e64caabf8b273a4cdf0dca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.410675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:56.410971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0264b26d64e64caabf8b273a4cdf0dca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.436915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844eb3-e3eb-48c1-8726-ad860f9635b7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.437330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0264b26d64e64caabf8b273a4cdf0dca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.438210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0264b26d64e64caabf8b273a4cdf0dca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.448926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0264b26d64e64caabf8b273a4cdf0dca'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:56.455782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.456565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.456875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.459308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.460084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:56.462054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:56.472124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2502/4985] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:56 2022] DELETE /identity/v3/users/0264b26d64e64caabf8b273a4cdf0dca => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:56.478115 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2484/4986] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:56.481953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.482365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.483940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:56.484318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:56.510764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c34d4-0fa1-4a48-a20b-7929114573a4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.594667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645f8dc-aedd-4364-98fa-5f1e1cbf4ed5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.603407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.604605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.604890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.605336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/7c1683098a30464789e1c993395d53bf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.616090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:56.617567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Could not find domain: 7c1683098a30464789e1c993395d53bf.: keystone.exception.DomainNotFound: Could not find domain: 7c1683098a30464789e1c993395d53bf. Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7c1683098a30464789e1c993395d53bf. Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:56.629889 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:56.630935 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7c1683098a30464789e1c993395d53bf. Jun 18 22:19:56.631901 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.632925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.632925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.632925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.633179 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2485/4987] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:56 2022] PATCH /identity/v3/domains/7c1683098a30464789e1c993395d53bf => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:56.633253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:56.634969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:56.645644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.649585 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2503/4988] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:19:56.651874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.667884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a629-1fc2-4552-ba94-43109f7cf4cb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.671973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412f88-5f11-4748-85a7-49991b85e258 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.679422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfebaf-462f-4bd5-9024-54a85fb7ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.680191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.680876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfebaf-462f-4bd5-9024-54a85fb7ddcb admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.681192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfebaf-462f-4bd5-9024-54a85fb7ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.681486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfebaf-462f-4bd5-9024-54a85fb7ddcb admin admin] PATH_INFO: `/v3/projects/113eb5bc0323404bb64b87dbff50b96d/users/5a1fc3fc3ccf40fb89b17836ee1a29d9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.682761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.683467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.684001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/aef13811b75d4771b06d2048e742b11e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.699294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:56.704254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfebaf-462f-4bd5-9024-54a85fb7ddcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=113eb5bc0323404bb64b87dbff50b96d, user_id=5a1fc3fc3ccf40fb89b17836ee1a29d9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:56.708957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfebaf-462f-4bd5-9024-54a85fb7ddcb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Could not find domain: aef13811b75d4771b06d2048e742b11e.: keystone.exception.DomainNotFound: Could not find domain: aef13811b75d4771b06d2048e742b11e. Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: aef13811b75d4771b06d2048e742b11e. Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:56.714020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:56.715004 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: aef13811b75d4771b06d2048e742b11e. Jun 18 22:19:56.715899 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.716817 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2486/4989] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:56 2022] PATCH /identity/v3/domains/aef13811b75d4771b06d2048e742b11e => generated 112 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:56.720420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.733479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9547f4-ba91-4f61-8548-539e3677cc57 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.742746 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2504/4990] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:19:56 2022] PUT /identity/v3/projects/113eb5bc0323404bb64b87dbff50b96d/users/5a1fc3fc3ccf40fb89b17836ee1a29d9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:56.745607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.746039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.746418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.771597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:56.773551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:56.839169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.840231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.840666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.840956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/bbffcf740bef4c9893d68f6ad36cafde` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.842423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:56.846181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:56.853674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Could not find domain: bbffcf740bef4c9893d68f6ad36cafde.: keystone.exception.DomainNotFound: Could not find domain: bbffcf740bef4c9893d68f6ad36cafde. Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bbffcf740bef4c9893d68f6ad36cafde. Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:56.873445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:56.874452 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bbffcf740bef4c9893d68f6ad36cafde. Jun 18 22:19:56.875382 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.876419 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2487/4991] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:56 2022] PATCH /identity/v3/domains/bbffcf740bef4c9893d68f6ad36cafde => generated 112 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:56.883585 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2505/4992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:56.886142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.892761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.894678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:56.927808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ff1ff-2ff7-4f95-a74a-5716d0eabe88 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:56.938307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1226a3e3a72c44f18c6b317aaae482b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe36d54d2b5343f29c9232aa4664a6d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:56.940017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:56.940304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:56.940581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] PATH_INFO: `/v3/domains/17a821221038409fa137889522420330` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:56.959332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Could not find domain: 17a821221038409fa137889522420330.: keystone.exception.DomainNotFound: Could not find domain: 17a821221038409fa137889522420330. Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 17a821221038409fa137889522420330. Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:19:56.978209 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:19:56.979481 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 17a821221038409fa137889522420330. Jun 18 22:19:56.980391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:19:56.981350 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2488/4993] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:19:56 2022] PATCH /identity/v3/domains/17a821221038409fa137889522420330 => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:19:56.984773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:56.986692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:57.040239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bb506-240b-4dff-972f-ff6eb51293a5 tempest-TokensV3TestJSON-2106421998 tempest-TokensV3TestJSON-2106421998-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:57.063452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:57.064588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:57.067024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:57.067390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] PATH_INFO: `/v3/users/e04235b9f15242408d07f3d329d44e7e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:57.068800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e629-d51a-45ad-ac1c-f07d74efc003 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:57.069201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04235b9f15242408d07f3d329d44e7e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:57.071388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:57.078758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bc08f-d38f-4fb3-98bc-47d30333ac6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:57.079528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bc08f-d38f-4fb3-98bc-47d30333ac6b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:57.079876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bc08f-d38f-4fb3-98bc-47d30333ac6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:57.080160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bc08f-d38f-4fb3-98bc-47d30333ac6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:57.094299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bc08f-d38f-4fb3-98bc-47d30333ac6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:57.095690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bc08f-d38f-4fb3-98bc-47d30333ac6b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:57.108710 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2506/4994] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:19:57.173611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04235b9f15242408d07f3d329d44e7e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:57.174339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04235b9f15242408d07f3d329d44e7e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:57.202945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04235b9f15242408d07f3d329d44e7e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:57.203732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04235b9f15242408d07f3d329d44e7e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:57.213893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04235b9f15242408d07f3d329d44e7e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:57.240736 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2489/4995] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:56 2022] DELETE /identity/v3/users/e04235b9f15242408d07f3d329d44e7e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:57.246775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:57.247301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:57.247681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:57.267132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:19:57.269488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:57.359765 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2507/4996] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:19:57.374987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:57.377310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:57.462985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949549a7-ec29-44cd-959c-03a6142c1ebb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:57.468607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:57.469307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:57.469765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:57.470241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:57.484153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:57.487202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:57.529524 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2490/4997] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:57.944263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:57.945851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:57.967024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e9d4d-b73b-42ed-b20f-ac0ca539bcdb None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:58.001447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:58.006919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:58.006919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:58.007578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] PATH_INFO: `/v3/projects/de36ac88f5924ac697032918c47a36b4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:58.010303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de36ac88f5924ac697032918c47a36b4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:58.012785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:58.094389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de36ac88f5924ac697032918c47a36b4', 'request_id': 'req-49575ca4-193b-4347-8ca8-d30174794875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.102544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de36ac88f5924ac697032918c47a36b4', 'request_id': 'req-49575ca4-193b-4347-8ca8-d30174794875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.112660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de36ac88f5924ac697032918c47a36b4', 'request_id': 'req-49575ca4-193b-4347-8ca8-d30174794875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.129578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] The token cache is being invalidate because project de36ac88f5924ac697032918c47a36b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:58.130146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.130885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.132877 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2508/4998] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:57 2022] DELETE /identity/v3/projects/de36ac88f5924ac697032918c47a36b4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:58.136947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:58.147570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca468-c307-4947-b358-152f64d2b486 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:58.219189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:58.220576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:58.221103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:58.221362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] PATH_INFO: `/v3/users/1226a3e3a72c44f18c6b317aaae482b0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:58.223077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1226a3e3a72c44f18c6b317aaae482b0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:58.225326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:58.235240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:58.292037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1226a3e3a72c44f18c6b317aaae482b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.292704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1226a3e3a72c44f18c6b317aaae482b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.317607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1226a3e3a72c44f18c6b317aaae482b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.318419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1226a3e3a72c44f18c6b317aaae482b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.328099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1226a3e3a72c44f18c6b317aaae482b0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:58.344912 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2491/4999] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:58 2022] DELETE /identity/v3/users/1226a3e3a72c44f18c6b317aaae482b0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:58.829111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:58.831871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:58.855157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575ca4-193b-4347-8ca8-d30174794875 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:58.880735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:58.942800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:58.943739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:58.944000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:58.944286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] PATH_INFO: `/v3/projects/fe36d54d2b5343f29c9232aa4664a6d6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:58.945648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe36d54d2b5343f29c9232aa4664a6d6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:58.948045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:59.007219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe36d54d2b5343f29c9232aa4664a6d6', 'request_id': 'req-eae2be4b-e26f-4fbc-bdff-514078489542'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.014386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe36d54d2b5343f29c9232aa4664a6d6', 'request_id': 'req-eae2be4b-e26f-4fbc-bdff-514078489542'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.034619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe36d54d2b5343f29c9232aa4664a6d6', 'request_id': 'req-eae2be4b-e26f-4fbc-bdff-514078489542'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.050137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] The token cache is being invalidate because project fe36d54d2b5343f29c9232aa4664a6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:19:59.050511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.051791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.055862 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2509/5000] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:58 2022] DELETE /identity/v3/projects/fe36d54d2b5343f29c9232aa4664a6d6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:19:59.060058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:19:59.062663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:19:59.091223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88667c-11e4-4e08-9857-24c315be657d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:19:59.178446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:19:59.179264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:19:59.179403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:19:59.179776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] PATH_INFO: `/v3/users/bc9b0b24dc3549a5b11f01359c21c160` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:19:59.181494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9b0b24dc3549a5b11f01359c21c160)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:19:59.183691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:19:59.263394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9b0b24dc3549a5b11f01359c21c160'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.264173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9b0b24dc3549a5b11f01359c21c160'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.284266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9b0b24dc3549a5b11f01359c21c160'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.285327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9b0b24dc3549a5b11f01359c21c160'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.295683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-712957fc-0257-46b2-805b-6d07ba1839b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9b0b24dc3549a5b11f01359c21c160'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:19:59.317740 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2492/5001] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:19:59 2022] DELETE /identity/v3/users/bc9b0b24dc3549a5b11f01359c21c160 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:00.552481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:00.554523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:00.575820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2be4b-e26f-4fbc-bdff-514078489542 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:00.690044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:00.690968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:00.691252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:00.691698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] PATH_INFO: `/v3/projects/5411efaaab974a0882ef6dffba673edb` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:00.693069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5411efaaab974a0882ef6dffba673edb)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:00.695111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:00.781856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5411efaaab974a0882ef6dffba673edb', 'request_id': 'req-44eb1a5f-5264-48b3-864b-d13c00682db0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:00.783182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:00.790464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5411efaaab974a0882ef6dffba673edb', 'request_id': 'req-44eb1a5f-5264-48b3-864b-d13c00682db0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:00.805555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5411efaaab974a0882ef6dffba673edb', 'request_id': 'req-44eb1a5f-5264-48b3-864b-d13c00682db0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:00.825861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] The token cache is being invalidate because project 5411efaaab974a0882ef6dffba673edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:00.826163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:00.827084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44eb1a5f-5264-48b3-864b-d13c00682db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:00.833875 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2510/5002] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:00 2022] DELETE /identity/v3/projects/5411efaaab974a0882ef6dffba673edb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:00.835536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054da45-0064-4927-9c07-b1e1884e1e32 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:00.836008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054da45-0064-4927-9c07-b1e1884e1e32 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:00.836099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054da45-0064-4927-9c07-b1e1884e1e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:00.848937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:00.863692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d054da45-0064-4927-9c07-b1e1884e1e32 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:00.865406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d054da45-0064-4927-9c07-b1e1884e1e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:00.967296 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2493/5003] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:00.975339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7953b7-0877-4c4d-9cad-ea6990fab7f8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:00.975638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7953b7-0877-4c4d-9cad-ea6990fab7f8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:00.976148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7953b7-0877-4c4d-9cad-ea6990fab7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:00.996660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8e7953b7-0877-4c4d-9cad-ea6990fab7f8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:00.998060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e7953b7-0877-4c4d-9cad-ea6990fab7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:01.007811 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2511/5004] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:01.012341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054da45-0064-4927-9c07-b1e1884e1e32 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.028814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054da45-0064-4927-9c07-b1e1884e1e32 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.029295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.029994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.030295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.030705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.031604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:01.032004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.033644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.050786 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2494/5005] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:01.052228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7953b7-0877-4c4d-9cad-ea6990fab7f8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.064742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7953b7-0877-4c4d-9cad-ea6990fab7f8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.069686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.070630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.070909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.071300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.072210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.074595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.105558 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2512/5006] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:01 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:01.106775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.118598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b6583-f00b-4c14-9cf5-f92d76dbf9d1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.191801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.192555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.192865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.193170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.194125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.196022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.223962 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2495/5007] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:01 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:20:01.225268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.236124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6488-de23-4c7b-bad7-f1f11e0b896b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.241823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.242371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.242756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.243192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.244038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.245803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.262226 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2513/5008] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:01.266449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.280735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d869cf-1b3c-404d-a979-d2679d6b6cdc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.287086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb24505-453a-4ea3-bc52-c63f354441a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.287782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24505-453a-4ea3-bc52-c63f354441a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.288072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24505-453a-4ea3-bc52-c63f354441a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.288347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24505-453a-4ea3-bc52-c63f354441a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.289167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb24505-453a-4ea3-bc52-c63f354441a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.290795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb24505-453a-4ea3-bc52-c63f354441a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.306516 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2496/5009] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:01.311331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.332254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0e63f-cf25-48a6-9781-0eeffcdd82bf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.340484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.341930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.342372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.342661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] PATH_INFO: `/v3/projects/4b8200e150c44db49e70dc2387be2342/users/e472d4853fbe45e887bf615885d21092/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.362533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8200e150c44db49e70dc2387be2342, user_id=e472d4853fbe45e887bf615885d21092, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.365791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.379065 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2514/5010] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:01 2022] PUT /identity/v3/projects/4b8200e150c44db49e70dc2387be2342/users/e472d4853fbe45e887bf615885d21092/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:01.390671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dc995-a2b3-4481-a4d5-6caeb72c172a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.391054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dc995-a2b3-4481-a4d5-6caeb72c172a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.392014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dc995-a2b3-4481-a4d5-6caeb72c172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.425356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-559dc995-a2b3-4481-a4d5-6caeb72c172a None None] MFA Rules not processed for user `e472d4853fbe45e887bf615885d21092`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:01.426593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-559dc995-a2b3-4481-a4d5-6caeb72c172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:01.512754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:01.527549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.528171 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2497/5011] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:01.544527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a6a73-0416-4bab-ab8e-f4f6c9e497e0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.549234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606545f-3f49-4864-b186-fbfab20477dc tempest-DefaultDomainTestJSON-124931142 tempest-DefaultDomainTestJSON-124931142-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e472d4853fbe45e887bf615885d21092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b8200e150c44db49e70dc2387be2342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.550053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606545f-3f49-4864-b186-fbfab20477dc tempest-DefaultDomainTestJSON-124931142 tempest-DefaultDomainTestJSON-124931142-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.550365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606545f-3f49-4864-b186-fbfab20477dc tempest-DefaultDomainTestJSON-124931142 tempest-DefaultDomainTestJSON-124931142-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.550645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606545f-3f49-4864-b186-fbfab20477dc tempest-DefaultDomainTestJSON-124931142 tempest-DefaultDomainTestJSON-124931142-project] PATH_INFO: `/v3/domains/default` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.551890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606545f-3f49-4864-b186-fbfab20477dc tempest-DefaultDomainTestJSON-124931142 tempest-DefaultDomainTestJSON-124931142-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.553669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606545f-3f49-4864-b186-fbfab20477dc tempest-DefaultDomainTestJSON-124931142 tempest-DefaultDomainTestJSON-124931142-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.555340 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2515/5012] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:01.560465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dc995-a2b3-4481-a4d5-6caeb72c172a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.639917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dc995-a2b3-4481-a4d5-6caeb72c172a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:01.646197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:01.651650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.652019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.652627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] PATH_INFO: `/v3/users/e472d4853fbe45e887bf615885d21092` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.659572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e472d4853fbe45e887bf615885d21092)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:01.661666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:01.728204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e472d4853fbe45e887bf615885d21092'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:01.728897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e472d4853fbe45e887bf615885d21092'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:01.747933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e472d4853fbe45e887bf615885d21092'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:01.748708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e472d4853fbe45e887bf615885d21092'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:01.761453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e472d4853fbe45e887bf615885d21092'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:01.781286 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2498/5013] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:20:01 2022] DELETE /identity/v3/users/e472d4853fbe45e887bf615885d21092 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:01.783201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:01.783497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:01.783822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:01.806914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:01.808319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:01.914823 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2516/5014] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:20:01.926795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:01.928158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:02.014648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4674-68ea-4c1f-a1f1-caff27c2a5d9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:02.018901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224e3e1-03ad-4077-9ed0-40b852e3d4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:02.020190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e3e1-03ad-4077-9ed0-40b852e3d4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:02.020483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e3e1-03ad-4077-9ed0-40b852e3d4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:02.020956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e3e1-03ad-4077-9ed0-40b852e3d4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:02.042678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224e3e1-03ad-4077-9ed0-40b852e3d4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:02.044933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224e3e1-03ad-4077-9ed0-40b852e3d4c5 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:02.056410 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2499/5015] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:02.819743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:02.821404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:02.835376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd598c7-0d47-4cc0-9c33-6f857f013c4d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:02.840815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:02.841852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:02.842345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:02.842740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] PATH_INFO: `/v3/projects/4b8200e150c44db49e70dc2387be2342` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:02.844128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8200e150c44db49e70dc2387be2342)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:02.846341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:02.918809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8200e150c44db49e70dc2387be2342', 'request_id': 'req-23ec0947-84ed-449d-b32e-b09ba4097e70'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:02.925713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8200e150c44db49e70dc2387be2342', 'request_id': 'req-23ec0947-84ed-449d-b32e-b09ba4097e70'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:02.933709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8200e150c44db49e70dc2387be2342', 'request_id': 'req-23ec0947-84ed-449d-b32e-b09ba4097e70'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:02.938694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:02.949277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] The token cache is being invalidate because project 4b8200e150c44db49e70dc2387be2342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:02.949879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:02.951202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23ec0947-84ed-449d-b32e-b09ba4097e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:02.956592 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2517/5016] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:02 2022] DELETE /identity/v3/projects/4b8200e150c44db49e70dc2387be2342 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:02.958693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d489d-09b6-4390-9cb0-b07ec6bdef81 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:02.959066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d489d-09b6-4390-9cb0-b07ec6bdef81 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:02.959377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d489d-09b6-4390-9cb0-b07ec6bdef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.021288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a45d489d-09b6-4390-9cb0-b07ec6bdef81 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:03.027821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a45d489d-09b6-4390-9cb0-b07ec6bdef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:03.068944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:03.123081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2500/5017] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:03.136174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7bbd-de26-4379-8c1a-1bc9a4f88651 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.136846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7bbd-de26-4379-8c1a-1bc9a4f88651 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.137421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b7bbd-de26-4379-8c1a-1bc9a4f88651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.166973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d84b7bbd-de26-4379-8c1a-1bc9a4f88651 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:03.166973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d84b7bbd-de26-4379-8c1a-1bc9a4f88651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:03.178075 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2518/5018] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:03.180263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d489d-09b6-4390-9cb0-b07ec6bdef81 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.193089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d489d-09b6-4390-9cb0-b07ec6bdef81 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.197950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.199281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.199626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.199965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.200816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:03.201362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.203055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:03.225009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2501/5019] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:03.226239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b7bbd-de26-4379-8c1a-1bc9a4f88651 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.235858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b7bbd-de26-4379-8c1a-1bc9a4f88651 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.240669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.241500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.241821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.242156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.242912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.244904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:03.280690 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2519/5020] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:03 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:03.282211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.299114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9df08f-191a-4ef5-b9ae-2bae11d5f661 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.364411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.365136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.365422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.365859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.369933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.371978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:03.395754 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2502/5021] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:03 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:03.400061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.411122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320695e9-764a-4fce-9ce8-c8108607e76b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.416747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.417619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.418012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.418354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.419167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.420842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:03.433233 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2520/5022] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:03.437952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.448980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b6123-6d4b-4bb6-8d8a-20dbc44fd05e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.453773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.454673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.454953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.455230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] PATH_INFO: `/v3/projects/569ebed5bca64138850dc221aafd2106/users/01f69a7a619641198fbef918d244a1e8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.472577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] RBAC: Authorizing `identity:create_grant(project_id=569ebed5bca64138850dc221aafd2106, user_id=01f69a7a619641198fbef918d244a1e8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.475295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:03.489630 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2503/5023] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:03 2022] PUT /identity/v3/projects/569ebed5bca64138850dc221aafd2106/users/01f69a7a619641198fbef918d244a1e8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:03.493780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.504799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5345d-5a85-496c-be56-5d166576de65 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.569398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9276a-24fd-4c91-acc1-47b305926f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.570796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9276a-24fd-4c91-acc1-47b305926f3e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.570796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9276a-24fd-4c91-acc1-47b305926f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.570957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9276a-24fd-4c91-acc1-47b305926f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.571624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9276a-24fd-4c91-acc1-47b305926f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.573965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9276a-24fd-4c91-acc1-47b305926f3e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:03.586453 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2521/5024] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:03.590862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.602283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3bce9-dd30-4c8e-87ef-0a83fb1d076e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.608321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1aac81-efc3-4cfa-bdef-a5ad135e5309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.609308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aac81-efc3-4cfa-bdef-a5ad135e5309 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.609593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aac81-efc3-4cfa-bdef-a5ad135e5309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.610043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1aac81-efc3-4cfa-bdef-a5ad135e5309 admin admin] PATH_INFO: `/v3/projects/569ebed5bca64138850dc221aafd2106/users/01f69a7a619641198fbef918d244a1e8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.612626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1aac81-efc3-4cfa-bdef-a5ad135e5309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569ebed5bca64138850dc221aafd2106, user_id=01f69a7a619641198fbef918d244a1e8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.615615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1aac81-efc3-4cfa-bdef-a5ad135e5309 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:03.630841 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2504/5025] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:03 2022] PUT /identity/v3/projects/569ebed5bca64138850dc221aafd2106/users/01f69a7a619641198fbef918d244a1e8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:03.641957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0255b-5758-478e-b51f-1b4bd68307c4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.642282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0255b-5758-478e-b51f-1b4bd68307c4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.642574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0255b-5758-478e-b51f-1b4bd68307c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.645573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bc88-d772-465f-9092-e6addd012e80 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.645864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bc88-d772-465f-9092-e6addd012e80 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.646140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54bc88-d772-465f-9092-e6addd012e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.675596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ccc0255b-5758-478e-b51f-1b4bd68307c4 None None] MFA Rules not processed for user `01f69a7a619641198fbef918d244a1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:03.677542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ccc0255b-5758-478e-b51f-1b4bd68307c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:03.681787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ae54bc88-d772-465f-9092-e6addd012e80 None None] MFA Rules not processed for user `277319873f994c44831e0840ef111b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:03.683012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ae54bc88-d772-465f-9092-e6addd012e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:03.797214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:03.805934 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2522/5026] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:03.810221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0255b-5758-478e-b51f-1b4bd68307c4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.836650 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2505/5027] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:03.838382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.838735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.839078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.885918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] MFA Rules not processed for user `277319873f994c44831e0840ef111b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:03.887838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:03.902657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:03.916968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2506/5028] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:03.931934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:03.935690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:03.944111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0255b-5758-478e-b51f-1b4bd68307c4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:03.949807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:03.950509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:03.950794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:03.951052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:03.951785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:03.953913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:04.010806 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2523/5029] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:03 2022] POST /identity/v3/projects => generated 393 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:04.012771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:04.137585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ad645-7d4d-4ec4-8b2d-c0144c13ba5b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:04.186636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7feff9-1830-4c5b-ac2f-68f69f0b43a3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:04.193801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:04.195806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:04.196156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:04.197227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:04.197951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:04.200824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:04.245305 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2524/5030] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:04 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:04.249021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:04.290170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1310a-9fcb-410d-839e-9f7c97947a18 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:04.301353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:04.302798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:04.304204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:04.304536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f501f-d40b-403c-b8ca-31a5b4bc9b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:04.305979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:04.306813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:04.308663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f501f-d40b-403c-b8ca-31a5b4bc9b09 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:04.309134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f501f-d40b-403c-b8ca-31a5b4bc9b09 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:04.309501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f501f-d40b-403c-b8ca-31a5b4bc9b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:04.311370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:04.339810 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2525/5031] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:04.340807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:04.366582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea902d-a747-44e3-876a-72710db525dd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:04.376016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:04.376733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:04.377223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:04.377514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:04.378257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:04.379907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:04.400620 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2526/5032] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:04.405302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:04.415022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f501f-d40b-403c-b8ca-31a5b4bc9b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:04.417994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f501f-d40b-403c-b8ca-31a5b4bc9b09 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:04.428605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90643c04-67a4-439f-beb5-4bded45f0852 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:04.438911 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2507/5033] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:04.444952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:04.445897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:04.446177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:04.446454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] PATH_INFO: `/v3/projects/2b10b898a24a4d2fafab4bcaae2b2303/users/b7878bac04c34517bc950c6b752b7a1c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:04.473741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b10b898a24a4d2fafab4bcaae2b2303, user_id=b7878bac04c34517bc950c6b752b7a1c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:04.477199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:04.503876 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2527/5034] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:04 2022] PUT /identity/v3/projects/2b10b898a24a4d2fafab4bcaae2b2303/users/b7878bac04c34517bc950c6b752b7a1c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:04.518185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41a53-02bb-4717-8537-5de619604d20 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:04.518584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41a53-02bb-4717-8537-5de619604d20 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:04.519612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41a53-02bb-4717-8537-5de619604d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:04.562669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4ed41a53-02bb-4717-8537-5de619604d20 None None] MFA Rules not processed for user `b7878bac04c34517bc950c6b752b7a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:04.564699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ed41a53-02bb-4717-8537-5de619604d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:04.589196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:04.667238 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2508/5035] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:20:04.681140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:04.684862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:04.777839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6c6d0-63a9-4be0-a979-5f836a26a130 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:04.783626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ea26f-c447-4874-aa5a-a43cc3dfa896 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:04.784796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea26f-c447-4874-aa5a-a43cc3dfa896 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:04.785346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea26f-c447-4874-aa5a-a43cc3dfa896 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:04.785832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ea26f-c447-4874-aa5a-a43cc3dfa896 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:04.815076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:04.934123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ea26f-c447-4874-aa5a-a43cc3dfa896 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:04.935782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ea26f-c447-4874-aa5a-a43cc3dfa896 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:04.947834 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2528/5036] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:06.186128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41a53-02bb-4717-8537-5de619604d20 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:06.405411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41a53-02bb-4717-8537-5de619604d20 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:06.419437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:06.420431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:06.420716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:06.425447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] PATH_INFO: `/v3/users/01f69a7a619641198fbef918d244a1e8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:06.426285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f69a7a619641198fbef918d244a1e8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:06.428245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:06.572427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f69a7a619641198fbef918d244a1e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:06.573760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f69a7a619641198fbef918d244a1e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:06.618235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f69a7a619641198fbef918d244a1e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:06.619037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f69a7a619641198fbef918d244a1e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:06.629523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f69a7a619641198fbef918d244a1e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:06.674806 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2509/5037] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:20:06 2022] DELETE /identity/v3/users/01f69a7a619641198fbef918d244a1e8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:06.676689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:06.677224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:06.677573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:06.719714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:06.730072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:07.009257 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2529/5038] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:07.010281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:07.011854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:07.109549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:07.173638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a491b0d-a523-427f-a8e0-b0fa954b193c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:07.185312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:07.186005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:07.186289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:07.186836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:07.214882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:07.216369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:07.246008 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2510/5039] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:20:07.889269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:07.891743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:07.935312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb54980-59b2-4070-b4ee-0bcfb0fe7965 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:07.943754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:07.945073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:07.945718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:07.946193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] PATH_INFO: `/v3/projects/569ebed5bca64138850dc221aafd2106` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:07.951706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569ebed5bca64138850dc221aafd2106)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:07.955363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:08.049329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569ebed5bca64138850dc221aafd2106', 'request_id': 'req-82378172-9fa6-4bc6-ae76-d7315cf71385'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.057683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569ebed5bca64138850dc221aafd2106', 'request_id': 'req-82378172-9fa6-4bc6-ae76-d7315cf71385'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.070893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569ebed5bca64138850dc221aafd2106', 'request_id': 'req-82378172-9fa6-4bc6-ae76-d7315cf71385'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.095678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] The token cache is being invalidate because project 569ebed5bca64138850dc221aafd2106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:08.095978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.096659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.103736 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2530/5040] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:07 2022] DELETE /identity/v3/projects/569ebed5bca64138850dc221aafd2106 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:08.107743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:08.131609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864393e8-1baf-4794-a549-b5dd494e462e service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:08.325637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:08.329474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:08.330192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:08.331602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] PATH_INFO: `/v3/users/b7878bac04c34517bc950c6b752b7a1c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:08.337771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7878bac04c34517bc950c6b752b7a1c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:08.359192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:08.494913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7878bac04c34517bc950c6b752b7a1c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.497894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7878bac04c34517bc950c6b752b7a1c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.530314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7878bac04c34517bc950c6b752b7a1c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.533790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7878bac04c34517bc950c6b752b7a1c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.555386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a5ded062-70d4-4ae5-9854-3770ee5aa396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7878bac04c34517bc950c6b752b7a1c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:08.587046 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2511/5041] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:20:08 2022] DELETE /identity/v3/users/b7878bac04c34517bc950c6b752b7a1c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:09.785118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:09.789149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:09.872355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378172-9fa6-4bc6-ae76-d7315cf71385 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:09.964922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:10.037203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adbac-e214-4038-b1f2-fb503c21e324 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.037203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adbac-e214-4038-b1f2-fb503c21e324 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.037203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adbac-e214-4038-b1f2-fb503c21e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.053174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:10.054354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.054634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.054980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] PATH_INFO: `/v3/projects/2b10b898a24a4d2fafab4bcaae2b2303` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.056376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b10b898a24a4d2fafab4bcaae2b2303)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:10.063198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:10.097456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fc4adbac-e214-4038-b1f2-fb503c21e324 None None] MFA Rules not processed for user `5a1fc3fc3ccf40fb89b17836ee1a29d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:10.099361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fc4adbac-e214-4038-b1f2-fb503c21e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:10.187100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b10b898a24a4d2fafab4bcaae2b2303', 'request_id': 'req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:10.202141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b10b898a24a4d2fafab4bcaae2b2303', 'request_id': 'req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:10.218580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b10b898a24a4d2fafab4bcaae2b2303', 'request_id': 'req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:10.223100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:10.235140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] The token cache is being invalidate because project 2b10b898a24a4d2fafab4bcaae2b2303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:10.235479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:10.238363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f97c20bc-f15d-4ed8-8a0d-97371a0a40b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:10.239991 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2531/5042] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:09 2022] DELETE /identity/v3/projects/2b10b898a24a4d2fafab4bcaae2b2303 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:10.245128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c524-7c51-483d-a92f-c7ea55582986 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.245789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c524-7c51-483d-a92f-c7ea55582986 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.246846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c524-7c51-483d-a92f-c7ea55582986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.274160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2512/5043] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:20:10.285197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f06a0-891a-4e92-9432-72fac1a9c45d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.286007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f06a0-891a-4e92-9432-72fac1a9c45d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.286379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f06a0-891a-4e92-9432-72fac1a9c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.290881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b030c524-7c51-483d-a92f-c7ea55582986 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:10.292311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b030c524-7c51-483d-a92f-c7ea55582986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:10.371975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-779f06a0-891a-4e92-9432-72fac1a9c45d None None] MFA Rules not processed for user `5a1fc3fc3ccf40fb89b17836ee1a29d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:10.373737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-779f06a0-891a-4e92-9432-72fac1a9c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:10.391889 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2532/5044] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:20:10.400558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9305ee-e3d0-4c78-b13f-ce3a071b41be None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.401191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9305ee-e3d0-4c78-b13f-ce3a071b41be None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.401654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9305ee-e3d0-4c78-b13f-ce3a071b41be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.435973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2b9305ee-e3d0-4c78-b13f-ce3a071b41be None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:10.438193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b9305ee-e3d0-4c78-b13f-ce3a071b41be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:10.451962 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2533/5045] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:10.456178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9305ee-e3d0-4c78-b13f-ce3a071b41be None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:10.471723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9305ee-e3d0-4c78-b13f-ce3a071b41be None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:10.471990 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2513/5046] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:10.479436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:10.480735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.481345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.481627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.482376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:10.482681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:10.484386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:10.499243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2534/5047] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:10.503544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f06a0-891a-4e92-9432-72fac1a9c45d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:10.520759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f06a0-891a-4e92-9432-72fac1a9c45d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:10.525870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:10.526671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.527053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.527421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.528229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:10.530584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:10.585825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:10.589545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:10.619923 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2514/5048] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:10 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:10.621162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:10.694351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:10.732656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662139a-60e8-4978-82bb-a35343f8ffdf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:10.763983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d3ddc-5c86-4718-bef6-87ec6e292bb6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:10.777472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:10.778458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.778750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.779029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.779744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:10.781863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:10.824999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:10.826173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.826173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.826477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.833217 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2515/5049] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:10 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:10.837380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:10.858390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429dd54-13e4-467c-8d85-66206211c20c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:10.870300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:10.871008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.871295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.871575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.872328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:10.881288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:10.900631 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2516/5050] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:20:10.904686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:10.925487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c250793-ba6b-4fc6-a4c1-ea28e62627ca admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:10.941217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd18c1-4075-4f6f-8097-e3d560b1b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:10.941927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd18c1-4075-4f6f-8097-e3d560b1b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:10.942214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd18c1-4075-4f6f-8097-e3d560b1b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:10.942494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd18c1-4075-4f6f-8097-e3d560b1b4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:10.943236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd18c1-4075-4f6f-8097-e3d560b1b4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:10.943512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:10.944922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd18c1-4075-4f6f-8097-e3d560b1b4f5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:10.945803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:10.958637 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2535/5051] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:20:10.970435 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2517/5052] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:20:10.974292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:10.992484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a0ea-bd60-4614-b948-e25991fc8056 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:10.999545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:11.000822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:11.001375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:11.002004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] PATH_INFO: `/v3/projects/ed1fe16412f84983b267390594464328/users/ead96a9af8b04aa9a59bb95cfa6a2d2e/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:11.029057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1fe16412f84983b267390594464328, user_id=ead96a9af8b04aa9a59bb95cfa6a2d2e, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:11.029057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:11.053257 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2536/5053] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:10 2022] PUT /identity/v3/projects/ed1fe16412f84983b267390594464328/users/ead96a9af8b04aa9a59bb95cfa6a2d2e/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:11.062507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a31b98-d72d-4378-86f2-49618750b286 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:11.063741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a31b98-d72d-4378-86f2-49618750b286 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:11.064274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a31b98-d72d-4378-86f2-49618750b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:11.107094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-65a31b98-d72d-4378-86f2-49618750b286 None None] MFA Rules not processed for user `ead96a9af8b04aa9a59bb95cfa6a2d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:11.108328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65a31b98-d72d-4378-86f2-49618750b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:11.137951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:11.208104 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2518/5054] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:11.219922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:11.231087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:11.354321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62622b-3ed8-409f-adbf-5a51e915fdd1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:11.359025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:11.360379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:11.360991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:11.361478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:11.371894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:11.373485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:11.388627 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2537/5055] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:11.735926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:11.736297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:11.736678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:11.757610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:11.759171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:11.902843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:11.909178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:11.917839 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2519/5056] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:20:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:11.996541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:11.998581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:12.082716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47fdd2-5cb3-4ee4-acab-f5a4620229ae service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:12.098147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:12.099152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:12.099472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:12.100078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] PATH_INFO: `/v3/users/ead96a9af8b04aa9a59bb95cfa6a2d2e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:12.101686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead96a9af8b04aa9a59bb95cfa6a2d2e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:12.104681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:12.174090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a4525-5709-4a85-b578-86a1e8ffb5e4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:12.188900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e440846-6c2c-4969-b900-4a52530e69b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:12.189888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440846-6c2c-4969-b900-4a52530e69b2 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:12.190371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440846-6c2c-4969-b900-4a52530e69b2 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:12.190844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e440846-6c2c-4969-b900-4a52530e69b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:12.208211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead96a9af8b04aa9a59bb95cfa6a2d2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:12.208865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead96a9af8b04aa9a59bb95cfa6a2d2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:12.214433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e440846-6c2c-4969-b900-4a52530e69b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:12.217509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e440846-6c2c-4969-b900-4a52530e69b2 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:12.234337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead96a9af8b04aa9a59bb95cfa6a2d2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:12.235367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead96a9af8b04aa9a59bb95cfa6a2d2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:12.247380 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2520/5057] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:20:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:20:12.251878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead96a9af8b04aa9a59bb95cfa6a2d2e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:12.293376 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2538/5058] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:20:11 2022] DELETE /identity/v3/users/ead96a9af8b04aa9a59bb95cfa6a2d2e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:12.298468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:12.299033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:12.299539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:12.391220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:12.397895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:12.484916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:12.502663 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2521/5059] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:12.517856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:12.519906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:12.597668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe65feb-4921-44b1-95c4-21611760c485 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:12.607351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec3782-7db6-410b-b494-2de86e0ba542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:12.608308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3782-7db6-410b-b494-2de86e0ba542 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:12.608748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3782-7db6-410b-b494-2de86e0ba542 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:12.609242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3782-7db6-410b-b494-2de86e0ba542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:12.634626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec3782-7db6-410b-b494-2de86e0ba542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:12.640033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec3782-7db6-410b-b494-2de86e0ba542 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:12.666345 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2539/5060] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:13.493889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:13.496055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:13.532951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdc2c5-b770-45ae-bc44-19821bf9f73a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:13.546524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:13.547781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:13.550781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:13.551255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] PATH_INFO: `/v3/projects/ed1fe16412f84983b267390594464328` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:13.553796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1fe16412f84983b267390594464328)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:13.555984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:13.701513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1fe16412f84983b267390594464328', 'request_id': 'req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:13.710306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1fe16412f84983b267390594464328', 'request_id': 'req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:13.734282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1fe16412f84983b267390594464328', 'request_id': 'req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:13.771417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] The token cache is being invalidate because project ed1fe16412f84983b267390594464328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:13.771852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:13.775525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3377841c-c89e-4cfc-8dbb-dbd5b01f5146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:13.777746 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2522/5061] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:13 2022] DELETE /identity/v3/projects/ed1fe16412f84983b267390594464328 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:13.783647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56625991-c418-4bd6-88fe-b51a18e7808b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:13.784223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56625991-c418-4bd6-88fe-b51a18e7808b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:13.784532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56625991-c418-4bd6-88fe-b51a18e7808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:13.818885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-56625991-c418-4bd6-88fe-b51a18e7808b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:13.846631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56625991-c418-4bd6-88fe-b51a18e7808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:13.912140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:14.042915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2540/5062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:14.051908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a299f-3818-45eb-a017-a4af90dad5f6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.052424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a299f-3818-45eb-a017-a4af90dad5f6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.053858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a299f-3818-45eb-a017-a4af90dad5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:14.084265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-588a299f-3818-45eb-a017-a4af90dad5f6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:14.088940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-588a299f-3818-45eb-a017-a4af90dad5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:14.102352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2523/5063] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:14.103821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56625991-c418-4bd6-88fe-b51a18e7808b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:14.131816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56625991-c418-4bd6-88fe-b51a18e7808b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:14.151409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:14.152103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.152382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.152653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:14.153420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:14.153721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:14.155391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:14.188564 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2541/5064] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:14.189766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a299f-3818-45eb-a017-a4af90dad5f6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:14.201636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a299f-3818-45eb-a017-a4af90dad5f6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:14.214566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:14.215646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.216471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.217856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:14.220875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:14.226582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:14.309848 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2524/5065] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:14 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:14.313373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:14.330339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a87d5-e09c-4bc9-9e35-90def744c969 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:14.579644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:14.580282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.580570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.580893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:14.582558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:14.589070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:14.642589 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2542/5066] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:14 2022] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:14.647376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:14.661337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ec511-6572-4d06-b047-4bf8d5506842 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:14.672892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:14.674086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.674086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.674261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:14.674929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:14.682278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:14.710932 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2525/5067] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:14.714026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:14.735178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb48cc2-bb15-45a1-920b-2a5cada96385 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:14.751364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bcba8-8a23-4414-9b91-b4c055223d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:14.752777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bcba8-8a23-4414-9b91-b4c055223d4c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.753551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bcba8-8a23-4414-9b91-b4c055223d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.754314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bcba8-8a23-4414-9b91-b4c055223d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:14.756630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bcba8-8a23-4414-9b91-b4c055223d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:14.761024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bcba8-8a23-4414-9b91-b4c055223d4c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:14.788562 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2543/5068] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:20:14.793638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:14.810566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35b0b4-9b04-4aaa-b995-31804a6a854d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:14.829123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:14.830415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.831656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.834620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] PATH_INFO: `/v3/projects/1d0507e84bd84b2ea8fdbeefea72f317/users/b1492914eace4de98e4b8b00a080c466/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:14.895286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0507e84bd84b2ea8fdbeefea72f317, user_id=b1492914eace4de98e4b8b00a080c466, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:14.901306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:14.936628 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2526/5069] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:14 2022] PUT /identity/v3/projects/1d0507e84bd84b2ea8fdbeefea72f317/users/b1492914eace4de98e4b8b00a080c466/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:14.948302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad2890-817c-49b2-b785-493b78213e96 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:14.948874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad2890-817c-49b2-b785-493b78213e96 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:14.949396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad2890-817c-49b2-b785-493b78213e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:15.033891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-62ad2890-817c-49b2-b785-493b78213e96 None None] MFA Rules not processed for user `b1492914eace4de98e4b8b00a080c466`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:15.036636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-62ad2890-817c-49b2-b785-493b78213e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:15.239525 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2544/5070] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:15.243778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:15.331271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b42553-21f4-4828-ad1d-24fd501091cd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:15.338770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:15.339471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:15.339807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:15.340092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:15.340961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:15.350139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:15.385002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:15.412870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad2890-817c-49b2-b785-493b78213e96 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:15.413237 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2527/5071] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:15 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:15.432499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad2890-817c-49b2-b785-493b78213e96 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:15.472398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:15.607478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:15.608427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:15.608719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:15.611486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:15.612282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:15.614323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:15.668669 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2545/5072] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:15 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:20:15.670322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:15.685814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40899360-00e4-4fb7-af93-3f00de35e005 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:15.719828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:15.721384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:15.721793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:15.722174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:15.723285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:15.724782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:15.756627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2528/5073] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:15.758388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:15.777099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c3581-b363-4a7f-a3ea-5b4b6c40a2ec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:15.786275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:15.791239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:15.791929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:15.791929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] PATH_INFO: `/v3/projects/a1b44a7ea14442e5bbbfd22a30ac3270/users/56111c5742bb41c6b273e2aa6f1c5475/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:15.820531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b44a7ea14442e5bbbfd22a30ac3270, user_id=56111c5742bb41c6b273e2aa6f1c5475, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:15.825373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:15.859511 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2546/5074] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:15 2022] PUT /identity/v3/projects/a1b44a7ea14442e5bbbfd22a30ac3270/users/56111c5742bb41c6b273e2aa6f1c5475/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:15.863875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:15.887977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d8243-0e1a-429b-9ec1-b62be36a883e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:16.016594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6d05e-9222-4000-a466-b0966d9e3979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:16.017761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6d05e-9222-4000-a466-b0966d9e3979 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:16.018353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6d05e-9222-4000-a466-b0966d9e3979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:16.019400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6d05e-9222-4000-a466-b0966d9e3979 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:16.020491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6d05e-9222-4000-a466-b0966d9e3979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:16.022736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6d05e-9222-4000-a466-b0966d9e3979 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:16.064144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2529/5075] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:16.065906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:16.083295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73cd65-b82c-4125-853a-09e85d4d253b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:16.090581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:16.091615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:16.092067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:16.092453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] PATH_INFO: `/v3/projects/a1b44a7ea14442e5bbbfd22a30ac3270/users/56111c5742bb41c6b273e2aa6f1c5475/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:16.100946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b44a7ea14442e5bbbfd22a30ac3270, user_id=56111c5742bb41c6b273e2aa6f1c5475, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:16.104450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:16.137114 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2547/5076] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:16 2022] PUT /identity/v3/projects/a1b44a7ea14442e5bbbfd22a30ac3270/users/56111c5742bb41c6b273e2aa6f1c5475/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:16.151447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468bc26-080d-4352-bc08-6a07e70d483d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:16.152034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468bc26-080d-4352-bc08-6a07e70d483d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:16.152468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468bc26-080d-4352-bc08-6a07e70d483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:16.232813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9468bc26-080d-4352-bc08-6a07e70d483d None None] MFA Rules not processed for user `56111c5742bb41c6b273e2aa6f1c5475`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:16.240130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9468bc26-080d-4352-bc08-6a07e70d483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:16.409385 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2530/5077] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:16.433758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:16.437748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:16.541270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498017-88b7-4bfb-a4b6-ca76e0dbf757 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:16.546754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae763899-cdc0-48a1-8cb0-b1d52cc905bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:16.547146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae763899-cdc0-48a1-8cb0-b1d52cc905bf service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:16.547438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae763899-cdc0-48a1-8cb0-b1d52cc905bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:16.547715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae763899-cdc0-48a1-8cb0-b1d52cc905bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:16.559724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae763899-cdc0-48a1-8cb0-b1d52cc905bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:16.561525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae763899-cdc0-48a1-8cb0-b1d52cc905bf service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:16.583368 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2548/5078] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:26.399820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=68 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:26.569487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:27.957886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3c6c-9d84-469b-bc44-970d3c0e7a28 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:27.958377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3c6c-9d84-469b-bc44-970d3c0e7a28 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:27.958541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3c6c-9d84-469b-bc44-970d3c0e7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:28.014041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-421a3c6c-9d84-469b-bc44-970d3c0e7a28 None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:28.016768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-421a3c6c-9d84-469b-bc44-970d3c0e7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:28.214639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2531/5079] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:29.986261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9bd41-e86c-408c-b511-4057a23e547d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:29.986713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9bd41-e86c-408c-b511-4057a23e547d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:29.987459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9bd41-e86c-408c-b511-4057a23e547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:30.066123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e1b9bd41-e86c-408c-b511-4057a23e547d None None] MFA Rules not processed for user `caa130c208d44d798cb0a5ba41193976`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:30.071862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e1b9bd41-e86c-408c-b511-4057a23e547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:30.350288 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2549/5080] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:32.585832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a3c6c-9d84-469b-bc44-970d3c0e7a28 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:32.604491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a3c6c-9d84-469b-bc44-970d3c0e7a28 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:32.610553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56111c5742bb41c6b273e2aa6f1c5475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1b44a7ea14442e5bbbfd22a30ac3270', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:32.611474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:32.611936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:32.612497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:32.613395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:32.613934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:32.631247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:32.673355 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2532/5081] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:32.677214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9bd41-e86c-408c-b511-4057a23e547d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:32.692985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9bd41-e86c-408c-b511-4057a23e547d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:32.713794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56111c5742bb41c6b273e2aa6f1c5475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1b44a7ea14442e5bbbfd22a30ac3270', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:32.714518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:32.714884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:32.715076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:32.716025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:32.718214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:32.813670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2550/5082] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:32 2022] POST /identity/v3/projects => generated 348 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:32.815401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:32.836117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a74a7-c407-4a36-b143-d0b9133898c3 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:32.958748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56111c5742bb41c6b273e2aa6f1c5475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1b44a7ea14442e5bbbfd22a30ac3270', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:32.959604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:32.960764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:32.962493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:32.963406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:32.964869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:32.968654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:33.023785 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2533/5083] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:20:34.106543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:34.136297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1231e38-26b3-4da7-bad4-4a159c08cc32 tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:34.145699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56111c5742bb41c6b273e2aa6f1c5475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1b44a7ea14442e5bbbfd22a30ac3270', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:34.147153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:34.147755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:34.148442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] PATH_INFO: `/v3/projects/ec00e919b27443d88a105e10daa2e2e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:34.150304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec00e919b27443d88a105e10daa2e2e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:34.154382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:34.232234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec00e919b27443d88a105e10daa2e2e4', 'request_id': 'req-f6fd33a6-b390-4981-9204-e059137c7ebb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:34.241057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec00e919b27443d88a105e10daa2e2e4', 'request_id': 'req-f6fd33a6-b390-4981-9204-e059137c7ebb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:34.255561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec00e919b27443d88a105e10daa2e2e4', 'request_id': 'req-f6fd33a6-b390-4981-9204-e059137c7ebb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:34.272516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] The token cache is being invalidate because project ec00e919b27443d88a105e10daa2e2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:34.272821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:34.273620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:34.276379 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2551/5084] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:34 2022] DELETE /identity/v3/projects/ec00e919b27443d88a105e10daa2e2e4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:34.292213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:34.295147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:34.420691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9bf0b-6630-4ef5-9c7a-a0d1181e737d tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:34.476380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:34.491581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:34.492612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:34.493190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:34.493566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:34.496192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:34.566292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:34.568177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:34.580297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2534/5085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:40.099199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:40.100805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:40.177069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd33a6-b390-4981-9204-e059137c7ebb tempest-RoutersIpV6AdminTest-1549231150 tempest-RoutersIpV6AdminTest-1549231150-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:40.181941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:40.182838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:40.183147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:40.183424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] PATH_INFO: `/v3/users/277319873f994c44831e0840ef111b8f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:40.184630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=277319873f994c44831e0840ef111b8f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:40.186630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:40.192437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:40.240981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277319873f994c44831e0840ef111b8f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.241786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277319873f994c44831e0840ef111b8f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.255710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277319873f994c44831e0840ef111b8f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.256439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277319873f994c44831e0840ef111b8f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.264166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-76f57640-1924-4de5-a119-e156c4943fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277319873f994c44831e0840ef111b8f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.279968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2552/5086] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:20:40 2022] DELETE /identity/v3/users/277319873f994c44831e0840ef111b8f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:40.512282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:40.535030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a11e3-6c9e-48c7-a22d-d65949e841fd service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:40.639948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:40.640846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:40.641224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:40.641501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] PATH_INFO: `/v3/projects/73290d4cb44c40ffa3a0a8f1e553f2e6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:40.643170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=73290d4cb44c40ffa3a0a8f1e553f2e6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:40.645253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:40.714656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'request_id': 'req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.722831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'request_id': 'req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.745249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'request_id': 'req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.780615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] The token cache is being invalidate because project 73290d4cb44c40ffa3a0a8f1e553f2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:40.786849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.787848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fca599d8-d476-45e2-b4f3-e61c2ffe85dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:40.789851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2535/5087] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:40 2022] DELETE /identity/v3/projects/73290d4cb44c40ffa3a0a8f1e553f2e6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:40.794722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab525-7df7-4349-8950-987383cb1522 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:40.795012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab525-7df7-4349-8950-987383cb1522 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:40.795296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ab525-7df7-4349-8950-987383cb1522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:40.817361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-860ab525-7df7-4349-8950-987383cb1522 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:40.818584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-860ab525-7df7-4349-8950-987383cb1522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:40.903446 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2553/5088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:40.911437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50326-a2cb-4853-8b8b-14408fa21f1b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:40.911437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50326-a2cb-4853-8b8b-14408fa21f1b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:40.911724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d50326-a2cb-4853-8b8b-14408fa21f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:40.937590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-91d50326-a2cb-4853-8b8b-14408fa21f1b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:40.938845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-91d50326-a2cb-4853-8b8b-14408fa21f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:40.951959 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2536/5089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:40.956424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ab525-7df7-4349-8950-987383cb1522 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:40.967006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ab525-7df7-4349-8950-987383cb1522 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:40.972431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:40.973138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:40.973417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:40.973689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:40.974431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:40.974731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:40.976369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:40.996995 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2554/5090] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:40.998231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d50326-a2cb-4853-8b8b-14408fa21f1b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.008837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d50326-a2cb-4853-8b8b-14408fa21f1b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.015661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.016505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.016790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.017241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.017946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.019861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.056437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:41.069297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2537/5091] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:20:41.071197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.093677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa189f88-1a2f-44be-9cbc-a674752987e0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.152820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.155940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:41.211034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.211830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.212306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.212740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.213499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.215483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.230367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec952a-e97b-4b20-8e51-0fb2abba9562 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.235033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed3c07-e40d-483b-88e1-da686c9a0e1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.235758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3c07-e40d-483b-88e1-da686c9a0e1b service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.236034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3c07-e40d-483b-88e1-da686c9a0e1b service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.236306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3c07-e40d-483b-88e1-da686c9a0e1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.238274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0aed3c07-e40d-483b-88e1-da686c9a0e1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:41.242801 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2555/5092] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:41 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:41.247202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.252941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:41.260728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef03e79-01bb-4c35-899b-e5359c4c0e35 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.267846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.269089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.269626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.270353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.271166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.272900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.289536 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2556/5093] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:41.290813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.302455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c139d-38ba-4afd-bb60-b82635f14252 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.307512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.308209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.308628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.309270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.310136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.312012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.317872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed3c07-e40d-483b-88e1-da686c9a0e1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.319341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed3c07-e40d-483b-88e1-da686c9a0e1b service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.325152 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2557/5094] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:41.329682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.340428 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2538/5095] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:41.340667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697404a7-42e5-439c-8da7-356453674fef admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.346467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.347374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.347855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.348120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] PATH_INFO: `/v3/projects/5cc2ac33206d4b3499ce139b0ecdf356/users/21a7cd29a3044c0d8eb886d1e3ea3bbb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.369429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc2ac33206d4b3499ce139b0ecdf356, user_id=21a7cd29a3044c0d8eb886d1e3ea3bbb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.373609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.401080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2558/5096] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:41 2022] PUT /identity/v3/projects/5cc2ac33206d4b3499ce139b0ecdf356/users/21a7cd29a3044c0d8eb886d1e3ea3bbb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:20:41.404172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a6854-93ca-4aeb-b11e-d1879a5908d2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.404469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a6854-93ca-4aeb-b11e-d1879a5908d2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.404787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a6854-93ca-4aeb-b11e-d1879a5908d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.425716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-416a6854-93ca-4aeb-b11e-d1879a5908d2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:41.426258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-416a6854-93ca-4aeb-b11e-d1879a5908d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:41.434333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.438350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:41.499446 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2539/5097] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:41.510547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a6854-93ca-4aeb-b11e-d1879a5908d2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.516178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c194a-1d23-4b47-8a8c-7268d60b87ed admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.521533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.522201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.522487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.522759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.524229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a6854-93ca-4aeb-b11e-d1879a5908d2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.524687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:41.528945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670ef59-6b70-47bf-aa70-817fcc9d78cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.530049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670ef59-6b70-47bf-aa70-817fcc9d78cf service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.530628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670ef59-6b70-47bf-aa70-817fcc9d78cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.530976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670ef59-6b70-47bf-aa70-817fcc9d78cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.536170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.537712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.545897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670ef59-6b70-47bf-aa70-817fcc9d78cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.547316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670ef59-6b70-47bf-aa70-817fcc9d78cf service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.551632 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2559/5098] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:41.560696 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2540/5099] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:20:41.688835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:41.690524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:41.705726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12458a-f8e3-4e6d-a38f-465f625c8f02 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:41.710447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c95f65-84ed-47fd-b897-f81cf7229884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:41.711197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c95f65-84ed-47fd-b897-f81cf7229884 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:41.711471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c95f65-84ed-47fd-b897-f81cf7229884 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:41.711752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c95f65-84ed-47fd-b897-f81cf7229884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:41.721817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-39c95f65-84ed-47fd-b897-f81cf7229884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:41.810510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c95f65-84ed-47fd-b897-f81cf7229884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:41.812056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c95f65-84ed-47fd-b897-f81cf7229884 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:41.828962 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2560/5100] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:42.411146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00487d-a4c5-43d5-a940-b4886d283bc1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:42.411905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00487d-a4c5-43d5-a940-b4886d283bc1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:42.412397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00487d-a4c5-43d5-a940-b4886d283bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:42.456487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bd00487d-a4c5-43d5-a940-b4886d283bc1 None None] MFA Rules not processed for user `21a7cd29a3044c0d8eb886d1e3ea3bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:42.458391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bd00487d-a4c5-43d5-a940-b4886d283bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:42.481716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:42.600875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2541/5101] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:42.605567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:42.606115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:42.606328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:42.664853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] MFA Rules not processed for user `21a7cd29a3044c0d8eb886d1e3ea3bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:42.672641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:42.690200 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2561/5102] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:42.703407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cafa9-1e6e-4c1f-8324-a083472b3c43 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:42.703721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cafa9-1e6e-4c1f-8324-a083472b3c43 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:42.704082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cafa9-1e6e-4c1f-8324-a083472b3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:42.737621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-913cafa9-1e6e-4c1f-8324-a083472b3c43 None None] MFA Rules not processed for user `21a7cd29a3044c0d8eb886d1e3ea3bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:42.739079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-913cafa9-1e6e-4c1f-8324-a083472b3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:42.752054 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2542/5103] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:42.759796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:42.761538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:42.780560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f777e-feaf-4cbc-9f07-278bbba1bff9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:42.789015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282d0d-4e49-4028-9ca9-7adc26eb3da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:42.791152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282d0d-4e49-4028-9ca9-7adc26eb3da7 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:42.791596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282d0d-4e49-4028-9ca9-7adc26eb3da7 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:42.792021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282d0d-4e49-4028-9ca9-7adc26eb3da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:42.807095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282d0d-4e49-4028-9ca9-7adc26eb3da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:42.809286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282d0d-4e49-4028-9ca9-7adc26eb3da7 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:42.837575 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2562/5104] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:20:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:20:45.163712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:45.166668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:45.167275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:45.245216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] MFA Rules not processed for user `21a7cd29a3044c0d8eb886d1e3ea3bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:45.250865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:45.283180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2543/5105] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:47.103255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759900f-e928-4379-8485-753bfe363f53 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:47.104190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759900f-e928-4379-8485-753bfe363f53 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:47.104615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759900f-e928-4379-8485-753bfe363f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:47.127279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4759900f-e928-4379-8485-753bfe363f53 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:47.128755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4759900f-e928-4379-8485-753bfe363f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:47.155230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:47.252020 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2563/5106] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:20:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:47.270826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:47.272323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:47.484638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec4153-171d-4423-9fb9-7ca6f78c0f66 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:47.497230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:47.497918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:47.498196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:47.498466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:47.515157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:47.517980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:47.534314 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2544/5107] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:20:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:20:49.806755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6b64-8687-4c26-a46c-102e9fc0508a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:49.807342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6b64-8687-4c26-a46c-102e9fc0508a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:49.807342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6b64-8687-4c26-a46c-102e9fc0508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:49.859442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5e1a6b64-8687-4c26-a46c-102e9fc0508a None None] MFA Rules not processed for user `21a7cd29a3044c0d8eb886d1e3ea3bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:49.860751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5e1a6b64-8687-4c26-a46c-102e9fc0508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:49.893199 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2564/5108] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:56.746514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:56.748078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:56.839189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e58e-40cf-4097-8193-d80301a29d8a service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:56.868065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:56.868990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:56.869305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:56.870211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] PATH_INFO: `/v3/users/5a1fc3fc3ccf40fb89b17836ee1a29d9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:56.872272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1fc3fc3ccf40fb89b17836ee1a29d9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:56.874330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:57.008521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1fc3fc3ccf40fb89b17836ee1a29d9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:57.010000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1fc3fc3ccf40fb89b17836ee1a29d9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:57.042996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1fc3fc3ccf40fb89b17836ee1a29d9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:57.053935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1fc3fc3ccf40fb89b17836ee1a29d9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:57.061953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8f6a324a-b0fd-47d1-9f7a-931f8ef05808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1fc3fc3ccf40fb89b17836ee1a29d9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:57.092331 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2545/5109] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:20:56 2022] DELETE /identity/v3/users/5a1fc3fc3ccf40fb89b17836ee1a29d9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:58.835906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6b64-8687-4c26-a46c-102e9fc0508a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:58.851331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6b64-8687-4c26-a46c-102e9fc0508a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:58.923741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:58.925223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:58.925729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:58.926194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] PATH_INFO: `/v3/projects/113eb5bc0323404bb64b87dbff50b96d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:58.929021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=113eb5bc0323404bb64b87dbff50b96d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:58.931425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:59.043633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113eb5bc0323404bb64b87dbff50b96d', 'request_id': 'req-647b5cae-acf1-4c27-b8da-e6711df119bd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:59.054007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113eb5bc0323404bb64b87dbff50b96d', 'request_id': 'req-647b5cae-acf1-4c27-b8da-e6711df119bd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:59.073358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113eb5bc0323404bb64b87dbff50b96d', 'request_id': 'req-647b5cae-acf1-4c27-b8da-e6711df119bd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:59.119578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] The token cache is being invalidate because project 113eb5bc0323404bb64b87dbff50b96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:20:59.119873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:59.120550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-647b5cae-acf1-4c27-b8da-e6711df119bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:20:59.129377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada014-2173-4e28-8b5a-775551f7407d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.129951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada014-2173-4e28-8b5a-775551f7407d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.129951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada014-2173-4e28-8b5a-775551f7407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.131459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2565/5110] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:20:58 2022] DELETE /identity/v3/projects/113eb5bc0323404bb64b87dbff50b96d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:59.140032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:59.154569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eeada014-2173-4e28-8b5a-775551f7407d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:59.156285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eeada014-2173-4e28-8b5a-775551f7407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:59.263652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2546/5111] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:59.272493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664abd-ecf1-4cbc-93af-b22e14149571 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.273508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664abd-ecf1-4cbc-93af-b22e14149571 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.273906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664abd-ecf1-4cbc-93af-b22e14149571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.296127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-da664abd-ecf1-4cbc-93af-b22e14149571 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:20:59.297003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-da664abd-ecf1-4cbc-93af-b22e14149571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:20:59.312331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2566/5112] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:20:59.312846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeada014-2173-4e28-8b5a-775551f7407d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:59.326513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeada014-2173-4e28-8b5a-775551f7407d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:59.348888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:59.349671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.352301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.352858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.355838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:20:59.361172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:59.364904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:59.399376 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2547/5113] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:20:59.404533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664abd-ecf1-4cbc-93af-b22e14149571 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:59.421137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664abd-ecf1-4cbc-93af-b22e14149571 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:59.440242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:59.440941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.441363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.441535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.442229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:59.444518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:59.498286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2567/5114] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:20:59 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:20:59.502777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:59.517536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716bf1-3c68-479f-a5d1-04dfe34885fc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:59.719124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:59.719877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.720571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.720861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.721660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:59.725791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:59.766912 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2548/5115] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:20:59 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:20:59.771734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:59.783487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157154-e48d-4ba1-b3eb-ed152dd2c80a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:59.793674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:59.795061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.795448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.795728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.796480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:59.809578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:59.824166 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2568/5116] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:59.828463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:59.841803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007304-fc1f-490f-9262-5c49553709fd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:59.852865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadb7e1-0712-457c-bc06-76c4666a153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:59.853609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb7e1-0712-457c-bc06-76c4666a153f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.853949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb7e1-0712-457c-bc06-76c4666a153f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.854231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadb7e1-0712-457c-bc06-76c4666a153f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.855141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadb7e1-0712-457c-bc06-76c4666a153f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:59.856952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadb7e1-0712-457c-bc06-76c4666a153f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:59.877970 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2549/5117] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:20:59.879301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:20:59.894461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d75dde-80ae-4ffd-8bc0-7afe974ac06d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:20:59.900319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe73f4d-cf79-47c9-9182-a982659cd149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:20:59.901291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe73f4d-cf79-47c9-9182-a982659cd149 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.901574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe73f4d-cf79-47c9-9182-a982659cd149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.901857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe73f4d-cf79-47c9-9182-a982659cd149 admin admin] PATH_INFO: `/v3/projects/66c346c784cb4027a7c412b200d749ab/users/7780fd767b13484cb1a536802ad3c168/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:20:59.928314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:59.940075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe73f4d-cf79-47c9-9182-a982659cd149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c346c784cb4027a7c412b200d749ab, user_id=7780fd767b13484cb1a536802ad3c168, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:20:59.944884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe73f4d-cf79-47c9-9182-a982659cd149 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:20:59.980194 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2569/5118] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:20:59 2022] PUT /identity/v3/projects/66c346c784cb4027a7c412b200d749ab/users/7780fd767b13484cb1a536802ad3c168/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:20:59.993790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:20:59.994176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:20:59.996430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:00.057432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] MFA Rules not processed for user `7780fd767b13484cb1a536802ad3c168`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:00.058760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:00.171158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:00.176063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2550/5119] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:20:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:00.220786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a7e5-334c-4f4c-a990-be6d7e41cf5b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:00.223731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a7e5-334c-4f4c-a990-be6d7e41cf5b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:00.224251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a7e5-334c-4f4c-a990-be6d7e41cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:00.256777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1196a7e5-334c-4f4c-a990-be6d7e41cf5b None None] MFA Rules not processed for user `7a41eb42094f418685b83cc0a57852d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:00.259058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1196a7e5-334c-4f4c-a990-be6d7e41cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:00.396365 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2570/5120] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:01.094335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:01.095792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:01.303427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcbb71-cc28-4b48-9d45-2d6e3be02a78 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:01.312830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67766f9f-56d7-47bd-8421-b92ff345a30a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:01.313556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67766f9f-56d7-47bd-8421-b92ff345a30a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:01.314072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67766f9f-56d7-47bd-8421-b92ff345a30a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:01.314522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67766f9f-56d7-47bd-8421-b92ff345a30a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:01.334347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67766f9f-56d7-47bd-8421-b92ff345a30a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:01.335981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67766f9f-56d7-47bd-8421-b92ff345a30a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:01.372356 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2551/5121] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:02.021671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:02.022152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:02.022269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:02.055876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] MFA Rules not processed for user `20c4f7872035427d9bfb6a6ecfb7a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:02.057329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:02.147792 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2571/5122] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:07.928491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915120c-f741-4fc2-85f9-71728abefa16 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:07.929081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915120c-f741-4fc2-85f9-71728abefa16 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:07.929081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915120c-f741-4fc2-85f9-71728abefa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:07.953664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4915120c-f741-4fc2-85f9-71728abefa16 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:07.955265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4915120c-f741-4fc2-85f9-71728abefa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:08.061778 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2552/5123] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:21:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:08.076484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:08.078113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:08.310408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cec2c-d717-453b-9fdb-c59f34afa2e1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:08.328825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ac8d9-6269-4373-b8de-47481dd17e97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:08.329942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ac8d9-6269-4373-b8de-47481dd17e97 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:08.330383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ac8d9-6269-4373-b8de-47481dd17e97 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:08.330815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ac8d9-6269-4373-b8de-47481dd17e97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:08.348567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ac8d9-6269-4373-b8de-47481dd17e97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:08.352901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ac8d9-6269-4373-b8de-47481dd17e97 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:08.378603 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2572/5124] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:11.144147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915120c-f741-4fc2-85f9-71728abefa16 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:11.275625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:11.291092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915120c-f741-4fc2-85f9-71728abefa16 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:11.297141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:11.298294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:11.298676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:11.299074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] PATH_INFO: `/v3/users/7780fd767b13484cb1a536802ad3c168` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:11.300514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=7780fd767b13484cb1a536802ad3c168)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:11.302631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:11.361606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7780fd767b13484cb1a536802ad3c168'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:11.362417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7780fd767b13484cb1a536802ad3c168'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:11.377134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7780fd767b13484cb1a536802ad3c168'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:11.388690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7780fd767b13484cb1a536802ad3c168'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:11.401594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7780fd767b13484cb1a536802ad3c168'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:11.418142 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2553/5125] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:11 2022] DELETE /identity/v3/users/7780fd767b13484cb1a536802ad3c168 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:11.422847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:11.423431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:11.423518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:11.472484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:11.485773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:11.487062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:11.558296 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2573/5126] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:11.568327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:11.570601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:11.637164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2a346-d18b-43fb-8e88-b7eb3792d4da admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:11.641424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efea01-af14-40db-a061-fdd3c945ab01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:11.642182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efea01-af14-40db-a061-fdd3c945ab01 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:11.642606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efea01-af14-40db-a061-fdd3c945ab01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:11.642910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efea01-af14-40db-a061-fdd3c945ab01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:11.653816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efea01-af14-40db-a061-fdd3c945ab01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:11.655350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efea01-af14-40db-a061-fdd3c945ab01 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:11.666464 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2554/5127] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:12.125621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:12.127136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:12.152760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad14c9-972b-4d34-a96d-d7c945b58652 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:12.163978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:12.175019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.175594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.176853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] PATH_INFO: `/v3/projects/66c346c784cb4027a7c412b200d749ab` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.178630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c346c784cb4027a7c412b200d749ab)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:12.181742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:12.264810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c346c784cb4027a7c412b200d749ab', 'request_id': 'req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:12.273710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c346c784cb4027a7c412b200d749ab', 'request_id': 'req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:12.283939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c346c784cb4027a7c412b200d749ab', 'request_id': 'req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:12.299717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] The token cache is being invalidate because project 66c346c784cb4027a7c412b200d749ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:12.300350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:12.301301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ae226a16-ea0c-4ada-bf31-e9a12fb22b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:12.303628 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2574/5128] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:12 2022] DELETE /identity/v3/projects/66c346c784cb4027a7c412b200d749ab => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:12.308523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe16cb-1401-45b4-9153-367c2a04c054 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.309497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe16cb-1401-45b4-9153-367c2a04c054 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.309797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe16cb-1401-45b4-9153-367c2a04c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.383079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0fbe16cb-1401-45b4-9153-367c2a04c054 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:12.385616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0fbe16cb-1401-45b4-9153-367c2a04c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:12.463247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:12.477911 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2555/5129] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:12.486032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49197-3799-4aab-a3f8-f95069da814a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.486533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49197-3799-4aab-a3f8-f95069da814a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.486731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49197-3799-4aab-a3f8-f95069da814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.506927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-30e49197-3799-4aab-a3f8-f95069da814a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:12.508217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30e49197-3799-4aab-a3f8-f95069da814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:12.522391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2575/5130] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:12.523399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe16cb-1401-45b4-9153-367c2a04c054 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:12.534297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe16cb-1401-45b4-9153-367c2a04c054 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:12.540920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:12.541758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.542038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.542317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.543061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:12.543367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:12.545321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:12.558510 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2556/5131] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:12.562968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e49197-3799-4aab-a3f8-f95069da814a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:12.573184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e49197-3799-4aab-a3f8-f95069da814a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:12.579797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:12.580768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.581790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.582309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.583192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:12.585383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:12.625847 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2576/5132] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:12 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:12.634609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:12.661248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cd7b1-9532-4822-bb68-830bf13743b8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:12.732548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:12.733446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.733829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.734555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.735380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:12.737505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:12.763385 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2557/5133] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:12 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:12.768776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:12.780550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbead0-ca4e-4a89-9bd1-5b08a294dd02 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:12.787149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:12.787989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.788360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.789099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.790521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:12.792262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:12.811285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2577/5134] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:12.812497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:12.824861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1b70f-7a34-46c9-a8b8-e9dd7608e468 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:12.830214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7f8ae-2e82-4fc7-a8ca-87fd045c725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:12.831375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f8ae-2e82-4fc7-a8ca-87fd045c725e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.832023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f8ae-2e82-4fc7-a8ca-87fd045c725e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.832023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f8ae-2e82-4fc7-a8ca-87fd045c725e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.832673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7f8ae-2e82-4fc7-a8ca-87fd045c725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:12.834424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7f8ae-2e82-4fc7-a8ca-87fd045c725e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:12.850924 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2558/5135] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:12.852259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:12.863125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc9034-f768-44ba-9654-ac8bb0cd9a48 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:12.868768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:12.869707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.869992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.870268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] PATH_INFO: `/v3/projects/ffa35dcd0dba49e6a30001bc4133388c/users/23d4d72745e84806b66c80e9609374f2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.890227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa35dcd0dba49e6a30001bc4133388c, user_id=23d4d72745e84806b66c80e9609374f2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:12.894238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:12.936233 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2578/5136] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:12 2022] PUT /identity/v3/projects/ffa35dcd0dba49e6a30001bc4133388c/users/23d4d72745e84806b66c80e9609374f2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:12.951294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:12.951733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:12.952088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:12.987785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] MFA Rules not processed for user `23d4d72745e84806b66c80e9609374f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:12.989292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:13.064709 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2559/5137] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:13.078761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:13.081932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:13.110141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:13.147075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55148d3-75a1-4ee7-aaca-ab32764d260a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:13.152490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:13.153293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:13.153730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:13.154239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:13.164651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:13.166210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:13.175775 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2579/5138] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:17.326526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:17.327754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:17.422239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:17.505417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aed9c-5a30-459f-941f-40c6e422aca5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:17.510674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:17.511418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:17.511883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:17.512408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:17.515012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:17.669297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:17.678570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:17.708207 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2560/5139] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:19.635208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:19.677651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f20b3-e902-4fe8-b03b-bedc9fcdaf78 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:19.687131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e85d4-5115-45d1-af0c-f6f3e8dd0e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:19.688268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e85d4-5115-45d1-af0c-f6f3e8dd0e1e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:19.688654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e85d4-5115-45d1-af0c-f6f3e8dd0e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:19.690436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e85d4-5115-45d1-af0c-f6f3e8dd0e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:19.693558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-496e85d4-5115-45d1-af0c-f6f3e8dd0e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:19.726808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e85d4-5115-45d1-af0c-f6f3e8dd0e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:19.729069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e85d4-5115-45d1-af0c-f6f3e8dd0e1e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:19.749568 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2580/5140] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:22.488276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:22.557779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ddacc-1bb4-4b45-8287-f4e93cfc5a88 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:22.562964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:22.563872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:22.564208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:22.564472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] PATH_INFO: `/v3/users/23d4d72745e84806b66c80e9609374f2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:22.565655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d4d72745e84806b66c80e9609374f2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:22.578215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:22.645205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d4d72745e84806b66c80e9609374f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:22.645898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d4d72745e84806b66c80e9609374f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:22.655783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:22.662052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d4d72745e84806b66c80e9609374f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:22.663015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d4d72745e84806b66c80e9609374f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:22.670857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d4d72745e84806b66c80e9609374f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:22.697507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2561/5141] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:22 2022] DELETE /identity/v3/users/23d4d72745e84806b66c80e9609374f2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:22.703904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:22.704396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:22.704589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:22.726467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:22.727700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:22.805596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2581/5142] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:22.828790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:22.830339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:22.920801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c363e-7a1e-4593-a01d-1ced3dc11a8b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:22.924745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e28f4d-6aca-421a-a3b9-0477f3e6ad71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:22.925466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28f4d-6aca-421a-a3b9-0477f3e6ad71 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:22.925753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28f4d-6aca-421a-a3b9-0477f3e6ad71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:22.926032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28f4d-6aca-421a-a3b9-0477f3e6ad71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:22.937703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e28f4d-6aca-421a-a3b9-0477f3e6ad71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:22.939195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e28f4d-6aca-421a-a3b9-0477f3e6ad71 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:22.955425 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2562/5143] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:23.755344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:23.756987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:23.770720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2254a-47b9-4a00-8f6b-b8642471dd02 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:23.782289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:23.783431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:23.783879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:23.784606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] PATH_INFO: `/v3/projects/ffa35dcd0dba49e6a30001bc4133388c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:23.789663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa35dcd0dba49e6a30001bc4133388c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:23.800577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:23.866075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa35dcd0dba49e6a30001bc4133388c', 'request_id': 'req-fa5298ed-048e-4e6a-969d-369b4749f9bb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:23.873220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa35dcd0dba49e6a30001bc4133388c', 'request_id': 'req-fa5298ed-048e-4e6a-969d-369b4749f9bb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:23.882883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa35dcd0dba49e6a30001bc4133388c', 'request_id': 'req-fa5298ed-048e-4e6a-969d-369b4749f9bb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:23.896503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] The token cache is being invalidate because project ffa35dcd0dba49e6a30001bc4133388c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:23.896786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:23.897697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fa5298ed-048e-4e6a-969d-369b4749f9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:23.899600 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2582/5144] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:23 2022] DELETE /identity/v3/projects/ffa35dcd0dba49e6a30001bc4133388c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:23.908501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea5c0-b54b-4114-bb10-baacd44c06ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:23.909023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea5c0-b54b-4114-bb10-baacd44c06ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:23.909189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea5c0-b54b-4114-bb10-baacd44c06ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:23.939440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f8aea5c0-b54b-4114-bb10-baacd44c06ff None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:23.940648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f8aea5c0-b54b-4114-bb10-baacd44c06ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:24.008227 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2563/5145] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:24.024781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab077e-3ac2-4a9e-a41a-6de4e2b1199f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.029576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab077e-3ac2-4a9e-a41a-6de4e2b1199f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.029576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab077e-3ac2-4a9e-a41a-6de4e2b1199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.067843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d1ab077e-3ac2-4a9e-a41a-6de4e2b1199f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:24.069516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1ab077e-3ac2-4a9e-a41a-6de4e2b1199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:24.081884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2583/5146] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:24.086406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aea5c0-b54b-4114-bb10-baacd44c06ff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.105690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aea5c0-b54b-4114-bb10-baacd44c06ff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:24.110557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:24.111244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.111542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.111945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.112704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:24.113011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:24.114646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:24.132223 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2564/5147] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:24.135093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab077e-3ac2-4a9e-a41a-6de4e2b1199f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.156636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab077e-3ac2-4a9e-a41a-6de4e2b1199f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:24.163727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:24.164758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.165238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.165578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.166684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:24.169521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:24.195864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:24.217395 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2584/5148] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:24 2022] POST /identity/v3/projects => generated 403 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:24.219925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.234398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f17672-b6c8-4346-9cda-5676d32f0687 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:24.307138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:24.316704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:24.318955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.320749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.321632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.323206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:24.325912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:24.360294 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2565/5149] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:24 2022] POST /identity/v3/users => generated 302 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:24.361529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.373751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f17ff1-550f-4558-a5ea-d80feeb8bfc7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:24.383438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:24.384196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.384589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.384954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.385977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:24.389003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:24.405273 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2585/5150] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:24.407986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.421361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e61a8-4bbe-49b1-b6ab-c9eb8760ce83 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:24.426461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f962436-9df2-4df9-8450-df3ce25753f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:24.427258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962436-9df2-4df9-8450-df3ce25753f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.427644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962436-9df2-4df9-8450-df3ce25753f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.428021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962436-9df2-4df9-8450-df3ce25753f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.428856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f962436-9df2-4df9-8450-df3ce25753f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:24.431381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f962436-9df2-4df9-8450-df3ce25753f2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:24.445086 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2566/5151] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:24.449294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.459600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f339dc-2c8a-4850-8d9f-39cb2ab88818 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:24.465210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:24.466726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.467052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.467335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] PATH_INFO: `/v3/projects/096b92d0f4bb4242b6689a9c3af0c7d5/users/15ca80e959e545478bf70181e45c8571/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.485228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096b92d0f4bb4242b6689a9c3af0c7d5, user_id=15ca80e959e545478bf70181e45c8571, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:24.488799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:24.511202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2586/5152] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:24 2022] PUT /identity/v3/projects/096b92d0f4bb4242b6689a9c3af0c7d5/users/15ca80e959e545478bf70181e45c8571/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:24.521981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7e32-8413-4828-988e-b4b3f55d39dc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.522320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7e32-8413-4828-988e-b4b3f55d39dc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.522630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7e32-8413-4828-988e-b4b3f55d39dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.581979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d27c7e32-8413-4828-988e-b4b3f55d39dc None None] MFA Rules not processed for user `15ca80e959e545478bf70181e45c8571`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:24.583331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d27c7e32-8413-4828-988e-b4b3f55d39dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:24.673585 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2567/5153] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:24.678612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.782293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1605-554a-463a-89f0-faf28b05ae30 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:24.791243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:24.792660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:24.793149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:24.794495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:24.795907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:24.798963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:24.883496 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2587/5154] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:24 2022] POST /identity/v3/projects => generated 401 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:24.888671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7e32-8413-4828-988e-b4b3f55d39dc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:24.906190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7e32-8413-4828-988e-b4b3f55d39dc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.054290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.058480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.059065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.061283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.062188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.064465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:25.108745 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2568/5155] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:24 2022] POST /identity/v3/users => generated 307 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:25.110112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:25.124497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bd8d6-3da1-4be3-81eb-09b12add94b6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.132736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.133472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.134621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.134906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.135663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.137340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:25.156787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:25.157234 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2588/5156] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:25.168144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a132-d63e-4fcf-b466-40e7ac2f82cc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.175622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.177442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.181380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.181983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] PATH_INFO: `/v3/projects/e425301fddd3452ba09d4a906c40311b/users/b5c44e6598634f6ab01db2200c8c936d/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.206508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e425301fddd3452ba09d4a906c40311b, user_id=b5c44e6598634f6ab01db2200c8c936d, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.217066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:25.237860 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2569/5157] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:25 2022] PUT /identity/v3/projects/e425301fddd3452ba09d4a906c40311b/users/b5c44e6598634f6ab01db2200c8c936d/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:25.243346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:25.261657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cef96-4155-4298-a622-b84d76900a50 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.334933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97675eb6-0303-4904-a935-0f8582ecf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.335821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675eb6-0303-4904-a935-0f8582ecf64b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.336623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675eb6-0303-4904-a935-0f8582ecf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.336623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675eb6-0303-4904-a935-0f8582ecf64b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.337118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97675eb6-0303-4904-a935-0f8582ecf64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.338786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97675eb6-0303-4904-a935-0f8582ecf64b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:25.357404 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2589/5158] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:25.358043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:25.369047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9f2ff-060c-429e-8e4d-ccebb23f2403 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.374771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.375670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.376344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.376344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] PATH_INFO: `/v3/projects/e425301fddd3452ba09d4a906c40311b/users/b5c44e6598634f6ab01db2200c8c936d/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.378491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e425301fddd3452ba09d4a906c40311b, user_id=b5c44e6598634f6ab01db2200c8c936d, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.381296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:25.398439 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2570/5159] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:25 2022] PUT /identity/v3/projects/e425301fddd3452ba09d4a906c40311b/users/b5c44e6598634f6ab01db2200c8c936d/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:25.481200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380af3f-6896-4424-9fce-b3c1991b37b5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.481494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380af3f-6896-4424-9fce-b3c1991b37b5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.481920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380af3f-6896-4424-9fce-b3c1991b37b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.523642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1380af3f-6896-4424-9fce-b3c1991b37b5 None None] MFA Rules not processed for user `b5c44e6598634f6ab01db2200c8c936d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:25.524832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1380af3f-6896-4424-9fce-b3c1991b37b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:25.573637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:25.657459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2590/5160] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:25.657959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:25.669380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ebf8c-bb2b-4b94-84fe-c419600f4e00 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.674573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c44e6598634f6ab01db2200c8c936d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e425301fddd3452ba09d4a906c40311b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.675410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.675692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.675966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.676722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.678371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:25.702042 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2571/5161] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:21:25 2022] POST /identity/v3/roles => generated 239 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:25.703600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380af3f-6896-4424-9fce-b3c1991b37b5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:25.715214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380af3f-6896-4424-9fce-b3c1991b37b5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.720831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905bba7-c172-40b1-9663-dd120d15e768 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c44e6598634f6ab01db2200c8c936d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e425301fddd3452ba09d4a906c40311b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.722159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905bba7-c172-40b1-9663-dd120d15e768 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.722621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905bba7-c172-40b1-9663-dd120d15e768 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.723349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905bba7-c172-40b1-9663-dd120d15e768 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] PATH_INFO: `/v3/projects/096b92d0f4bb4242b6689a9c3af0c7d5/users/15ca80e959e545478bf70181e45c8571/roles/b007cbe069364aceb6424a69c9a974a2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.725968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905bba7-c172-40b1-9663-dd120d15e768 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: Authorizing `identity:create_grant(project_id=096b92d0f4bb4242b6689a9c3af0c7d5, user_id=15ca80e959e545478bf70181e45c8571, role_id=b007cbe069364aceb6424a69c9a974a2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.729766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905bba7-c172-40b1-9663-dd120d15e768 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:25.760477 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2591/5162] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:25 2022] PUT /identity/v3/projects/096b92d0f4bb4242b6689a9c3af0c7d5/users/15ca80e959e545478bf70181e45c8571/roles/b007cbe069364aceb6424a69c9a974a2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:25.764782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:25.776099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:25.859752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fb258-4e65-43dd-b070-5fde5454a941 tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:25.929672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ca80e959e545478bf70181e45c8571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '096b92d0f4bb4242b6689a9c3af0c7d5', 'project_domain_id': 'default', 'roles': ['tempest-test_role-199484349', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:25.930582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:25.930867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:25.931145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] PATH_INFO: `/v3/users/15ca80e959e545478bf70181e45c8571/application_credentials` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:25.931891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] RBAC: Authorizing `identity:create_application_credential(user_id=15ca80e959e545478bf70181e45c8571)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:25.933117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:26.020764 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2572/5163] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Jun 18 22:21:25 2022] POST /identity/v3/users/15ca80e959e545478bf70181e45c8571/application_credentials => generated 659 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:26.025696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c40f-5a59-4a2e-b772-dfa703e0da97 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:26.025696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c40f-5a59-4a2e-b772-dfa703e0da97 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:26.026245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c40f-5a59-4a2e-b772-dfa703e0da97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:26.052905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ee45c40f-5a59-4a2e-b772-dfa703e0da97 None None] MFA Rules not processed for user `15ca80e959e545478bf70181e45c8571`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:26.054280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ee45c40f-5a59-4a2e-b772-dfa703e0da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:26.167731 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2592/5164] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:26 2022] POST /identity/v3/auth/tokens => generated 3386 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jun 18 22:21:26.172424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:26.182859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcc22-9970-4524-862f-6a969aa4cc4f tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:26.187883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ca80e959e545478bf70181e45c8571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '096b92d0f4bb4242b6689a9c3af0c7d5', 'project_domain_id': 'default', 'roles': ['tempest-test_role-199484349', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:26.188904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:26.189225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:26.189505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] PATH_INFO: `/v3/users/15ca80e959e545478bf70181e45c8571/application_credentials/4779e075196544a1ae4444aaa833cf36` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:26.190745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] RBAC: Authorizing `identity:delete_application_credential(user_id=15ca80e959e545478bf70181e45c8571, application_credential_id=4779e075196544a1ae4444aaa833cf36)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:26.192267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:26.218316 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2573/5165] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:21:26 2022] DELETE /identity/v3/users/15ca80e959e545478bf70181e45c8571/application_credentials/4779e075196544a1ae4444aaa833cf36 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:26.222641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c40f-5a59-4a2e-b772-dfa703e0da97 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:26.271303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:26.290200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c40f-5a59-4a2e-b772-dfa703e0da97 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:26.295863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c44e6598634f6ab01db2200c8c936d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e425301fddd3452ba09d4a906c40311b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:26.296771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:26.297062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:26.297347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] PATH_INFO: `/v3/roles/b007cbe069364aceb6424a69c9a974a2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:26.298994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b007cbe069364aceb6424a69c9a974a2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:26.300681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:26.343279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] Invalidating the token cache because role b007cbe069364aceb6424a69c9a974a2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:26.344259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:26.345185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5f5966db-ab8b-4215-81e4-40714e0c939f tempest-ApplicationCredentialsV3AdminTest-885474836 tempest-ApplicationCredentialsV3AdminTest-885474836-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:26.347985 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2593/5166] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:26 2022] DELETE /identity/v3/roles/b007cbe069364aceb6424a69c9a974a2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:26.353654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:26.355701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:26.390813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:26.431516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b819ec5-3a73-4a73-8aa3-ca32b46b9bbe tempest-ApplicationCredentialsV3AdminTest-1460221589 tempest-ApplicationCredentialsV3AdminTest-1460221589-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:26.489696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:26.490618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:26.490893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:26.491168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] PATH_INFO: `/v3/users/15ca80e959e545478bf70181e45c8571` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:26.492397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ca80e959e545478bf70181e45c8571)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:26.494393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:26.549092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ca80e959e545478bf70181e45c8571'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:26.549821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ca80e959e545478bf70181e45c8571'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:26.562772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ca80e959e545478bf70181e45c8571'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:26.563463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ca80e959e545478bf70181e45c8571'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:26.571232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ca80e959e545478bf70181e45c8571'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:26.587352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2574/5167] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:26 2022] DELETE /identity/v3/users/15ca80e959e545478bf70181e45c8571 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:26.592464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:26.592736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:26.593020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:26.612600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:26.613848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:26.677862 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2594/5168] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:26.688019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:26.689574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:26.750573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19586d-9e47-4140-ad90-d0adcaddc888 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:26.754367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:26.755025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:26.755307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:26.755583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:26.765273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:26.766728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:26.770766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:26.785496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2575/5169] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:27.627011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:27.629042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:27.651851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b14b31-9207-4d77-a2f2-d75b25132637 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:27.657159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:27.658389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:27.658674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:27.658949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] PATH_INFO: `/v3/projects/096b92d0f4bb4242b6689a9c3af0c7d5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:27.662152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096b92d0f4bb4242b6689a9c3af0c7d5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:27.664949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:27.736908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096b92d0f4bb4242b6689a9c3af0c7d5', 'request_id': 'req-03b8ab76-58d9-4af3-988e-e312f61e9bf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.744109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096b92d0f4bb4242b6689a9c3af0c7d5', 'request_id': 'req-03b8ab76-58d9-4af3-988e-e312f61e9bf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.753016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096b92d0f4bb4242b6689a9c3af0c7d5', 'request_id': 'req-03b8ab76-58d9-4af3-988e-e312f61e9bf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.765470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] The token cache is being invalidate because project 096b92d0f4bb4242b6689a9c3af0c7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:27.765753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.766687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.768507 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2595/5170] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:27 2022] DELETE /identity/v3/projects/096b92d0f4bb4242b6689a9c3af0c7d5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:27.772588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:27.783615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e64e1-90bd-465d-9940-3e542d6b8ca0 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:27.851576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:27.852654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:27.853064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:27.853464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] PATH_INFO: `/v3/users/b5c44e6598634f6ab01db2200c8c936d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:27.854953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c44e6598634f6ab01db2200c8c936d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:27.857201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:27.915446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c44e6598634f6ab01db2200c8c936d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.916107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c44e6598634f6ab01db2200c8c936d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.935492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c44e6598634f6ab01db2200c8c936d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.936428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c44e6598634f6ab01db2200c8c936d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.946593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-52d7a1b9-0531-4390-8cbd-9ee1d5ce17a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c44e6598634f6ab01db2200c8c936d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:27.967471 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2576/5171] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:27 2022] DELETE /identity/v3/users/b5c44e6598634f6ab01db2200c8c936d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:28.483356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:28.485376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:28.504055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8ab76-58d9-4af3-988e-e312f61e9bf4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:28.596973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:28.635184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:28.637883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:28.639037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:28.639425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] PATH_INFO: `/v3/projects/e425301fddd3452ba09d4a906c40311b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:28.642444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e425301fddd3452ba09d4a906c40311b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:28.644583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:28.780692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e425301fddd3452ba09d4a906c40311b', 'request_id': 'req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:28.790102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e425301fddd3452ba09d4a906c40311b', 'request_id': 'req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:28.806024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e425301fddd3452ba09d4a906c40311b', 'request_id': 'req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:28.820619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] The token cache is being invalidate because project e425301fddd3452ba09d4a906c40311b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:28.821389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:28.822454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9bd2c5ea-d589-4f62-83da-a506e38b4a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:28.828269 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2596/5172] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:28 2022] DELETE /identity/v3/projects/e425301fddd3452ba09d4a906c40311b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:28.830138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe044-522c-428b-8cbc-215ca80e21f8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:28.830623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe044-522c-428b-8cbc-215ca80e21f8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:28.830892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe044-522c-428b-8cbc-215ca80e21f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:28.853713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-85cbe044-522c-428b-8cbc-215ca80e21f8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:28.855097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85cbe044-522c-428b-8cbc-215ca80e21f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:28.929902 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2577/5173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:28.937812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba1f87-cc26-480e-8f7c-95dd07354bed None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:28.938003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba1f87-cc26-480e-8f7c-95dd07354bed None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:28.938126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba1f87-cc26-480e-8f7c-95dd07354bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:28.959596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-90ba1f87-cc26-480e-8f7c-95dd07354bed None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:28.960938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-90ba1f87-cc26-480e-8f7c-95dd07354bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:28.969290 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2597/5174] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:28.973588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe044-522c-428b-8cbc-215ca80e21f8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:28.984312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe044-522c-428b-8cbc-215ca80e21f8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:28.989707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:28.990397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:28.990665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:28.991146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:28.991920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:28.992354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:28.994021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.008443 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2578/5175] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:29.013537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba1f87-cc26-480e-8f7c-95dd07354bed None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.024185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba1f87-cc26-480e-8f7c-95dd07354bed None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.028894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.029610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.029887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.030156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.030877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.032937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.069797 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2598/5176] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:29 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:29.071242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.080854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:29.087013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404a44-d4fd-4cf4-a1ff-0a2c351beb94 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.176173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.176885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.177196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.177471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.178167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.180081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.204707 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2579/5177] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:29 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:29.206382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.216854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e71b2-6249-48de-9b4a-322e56f0b461 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.221776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.222543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.222896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.223250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.224068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.225781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.239454 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2599/5178] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:29.240925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.251385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566cda-c1a8-453c-99b3-becc6bd1a255 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.255961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f34c6-aa1a-444f-b062-8732dc36abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.256648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f34c6-aa1a-444f-b062-8732dc36abe1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.256923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f34c6-aa1a-444f-b062-8732dc36abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.257226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f34c6-aa1a-444f-b062-8732dc36abe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.257956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f34c6-aa1a-444f-b062-8732dc36abe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.259567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f34c6-aa1a-444f-b062-8732dc36abe1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.269939 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2580/5179] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:29.274423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.284759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f5a5-a51a-4cd2-a86e-a1199d9f1859 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.289732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.290665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.290939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.291215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] PATH_INFO: `/v3/projects/10e3c3ab752649ce8ac1238fcc27915b/users/0e7210731cfe4405a42dcf85d66ee5bc/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.306163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e3c3ab752649ce8ac1238fcc27915b, user_id=0e7210731cfe4405a42dcf85d66ee5bc, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.308967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.323902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2600/5180] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:29 2022] PUT /identity/v3/projects/10e3c3ab752649ce8ac1238fcc27915b/users/0e7210731cfe4405a42dcf85d66ee5bc/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:29.335748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dfb10-6ff9-4a4c-b0cd-5a4280bff1be None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.336032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dfb10-6ff9-4a4c-b0cd-5a4280bff1be None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.336331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dfb10-6ff9-4a4c-b0cd-5a4280bff1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.363522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-527dfb10-6ff9-4a4c-b0cd-5a4280bff1be None None] MFA Rules not processed for user `0e7210731cfe4405a42dcf85d66ee5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:29.364718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-527dfb10-6ff9-4a4c-b0cd-5a4280bff1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:29.432465 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2581/5181] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:29.437544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.533941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdec1a-b1c9-4824-b0e3-3d9b82fd53de admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.541850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.543346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.543904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.544527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.545989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.550449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.558725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:29.599130 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2601/5182] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:29 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:29.603392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dfb10-6ff9-4a4c-b0cd-5a4280bff1be None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.620015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dfb10-6ff9-4a4c-b0cd-5a4280bff1be None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.707049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.707677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.707956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.708228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.708918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.710887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.735001 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2582/5183] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:29 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:29.739148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.754848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0ade7-82bf-4436-a864-91b1eb4bb0a1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.760131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.760704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.760986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.761361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.762095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.763892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.776187 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2602/5184] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:29.781746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.788261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:29.794334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19572-eeaa-42d7-a94c-351ca65e858b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.800748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.801820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.802020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.802299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] PATH_INFO: `/v3/projects/80180ed8e076443998d4b9953b5aadf7/users/ba59450db9a245fca1ae1f9246760562/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.819726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80180ed8e076443998d4b9953b5aadf7, user_id=ba59450db9a245fca1ae1f9246760562, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.822935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.837721 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2583/5185] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:29 2022] PUT /identity/v3/projects/80180ed8e076443998d4b9953b5aadf7/users/ba59450db9a245fca1ae1f9246760562/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:29.842052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.852869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5725bef-1f84-467c-82f1-fc62a16cd70b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.921159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5db76-b724-46e2-b149-dffabdedc2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.921933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5db76-b724-46e2-b149-dffabdedc2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.923453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5db76-b724-46e2-b149-dffabdedc2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.923893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5db76-b724-46e2-b149-dffabdedc2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.925388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5db76-b724-46e2-b149-dffabdedc2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.927377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5db76-b724-46e2-b149-dffabdedc2c2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.941271 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2603/5186] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:29.945761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:29.958642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd843c-0572-417d-8cbb-f99b698cbef6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:29.963648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:29.964611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.964813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.965128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] PATH_INFO: `/v3/projects/80180ed8e076443998d4b9953b5aadf7/users/ba59450db9a245fca1ae1f9246760562/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:29.967151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=80180ed8e076443998d4b9953b5aadf7, user_id=ba59450db9a245fca1ae1f9246760562, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:29.969846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:29.988628 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2584/5187] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:29 2022] PUT /identity/v3/projects/80180ed8e076443998d4b9953b5aadf7/users/ba59450db9a245fca1ae1f9246760562/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:29.992447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1aec9-80c2-4c3f-b3c2-11695c590267 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:29.992741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1aec9-80c2-4c3f-b3c2-11695c590267 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:29.993068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1aec9-80c2-4c3f-b3c2-11695c590267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.023429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-26d1aec9-80c2-4c3f-b3c2-11695c590267 None None] MFA Rules not processed for user `ba59450db9a245fca1ae1f9246760562`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:30.024646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-26d1aec9-80c2-4c3f-b3c2-11695c590267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:30.098626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2604/5188] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:30.103544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.116023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473e7fd-2c15-4d78-bff6-3416dc5231ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.122050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.122750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.123059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.123340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.124098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.125158 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.125158 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:30.125158 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:30.126048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.146887 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2585/5189] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:30 2022] POST /identity/v3/services => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:30.148323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1aec9-80c2-4c3f-b3c2-11695c590267 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.158876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1aec9-80c2-4c3f-b3c2-11695c590267 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.176782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.177564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.177849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.178309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.179060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.180195 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.180195 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:30.180195 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:30.181118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.193230 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2605/5190] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Jun 18 22:21:30 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:30.198313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.209675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944655c1-69b1-4329-90fc-02e09fe76392 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.214510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.215198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.215476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.215752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.216594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.218283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.235728 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2586/5191] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:30 2022] POST /identity/v3/services => generated 289 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:30.240099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.251367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01e813-04ee-46c8-84db-20054044deb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.271360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.272012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.272297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.272563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.273337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.274956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.284986 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2606/5192] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Jun 18 22:21:30 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:30.289233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.301100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96708537-9009-4611-aedd-c3bc27642887 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.305975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.306652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.306931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.307203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.307912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.308939 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.308939 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:30.308939 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:30.310037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.321221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2587/5193] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Jun 18 22:21:30 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:30.322853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.333647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc584a0-9516-4451-9d12-9bea7261b5b9 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.338930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.339894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.340248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.340563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.341395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3153307218164e62a56d5d29fba932d3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.342404 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.342404 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:30.342404 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:30.343333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.353755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2607/5194] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Jun 18 22:21:30 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3 => generated 333 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:30.355104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.365606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e33ab6-f333-4ba7-8ff7-0f26732f3568 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.370726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.371592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.371866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.372150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.372873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3153307218164e62a56d5d29fba932d3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.373925 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.373925 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:30.373925 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:30.374810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.381306 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2588/5195] 10.222.0.30 () {58 vars in 1290 bytes} [Sat Jun 18 22:21:30 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 18 22:21:30.385813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.396921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4efb4-14a0-41dd-8537-e70f3c9875c1 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.402102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.403155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.403508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.403834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.404511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3153307218164e62a56d5d29fba932d3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.405849 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.405849 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:30.405849 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:30.406722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.411769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:30.419603 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2608/5196] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:30.423939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.433957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51369999-3600-4894-9807-458a1263f929 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.439231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.440013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.440403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.440761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.441671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.443418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.450222 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2589/5197] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Jun 18 22:21:30 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:30.454814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.465502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd61c84-21e1-4ed9-b023-3d75e60dae63 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.470533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.471392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.471694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.471956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.472654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3153307218164e62a56d5d29fba932d3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.474302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Could not find Endpoint Group: 3153307218164e62a56d5d29fba932d3.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3153307218164e62a56d5d29fba932d3. Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jun 18 22:21:30.498135 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jun 18 22:21:30.499792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jun 18 22:21:30.499792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jun 18 22:21:30.499792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jun 18 22:21:30.499792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jun 18 22:21:30.499792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3153307218164e62a56d5d29fba932d3. Jun 18 22:21:30.499792 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:30.499792 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2609/5198] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3153307218164e62a56d5d29fba932d3 => generated 120 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:21:30.503788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.514207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883606fd-bdeb-444b-9d10-5aca4ec26d70 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.519006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.519885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.520171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.520447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services/11c6ebdcf5304fbe9171068408ce57a5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.521135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_service(service_id=11c6ebdcf5304fbe9171068408ce57a5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.522158 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.522158 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:30.522158 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:30.523037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.550414 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2590/5199] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/services/11c6ebdcf5304fbe9171068408ce57a5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:30.556393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.568873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235feb7-525b-43ff-b535-130621e77505 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.594518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.595298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.595729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.596070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.596876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.598158 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.598158 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:30.598158 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:30.599614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.620169 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2610/5200] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:30 2022] POST /identity/v3/services => generated 288 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:30.622125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.634762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464be14-c84e-4660-b745-4093324aae17 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.652313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.652978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.653295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.653610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.654359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.655403 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.655403 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:30.655403 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:30.656367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.675960 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2591/5201] 10.222.0.30 () {60 vars in 1212 bytes} [Sat Jun 18 22:21:30 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:30.677197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.688476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c964b8f-165e-442c-806c-efc7512d8be8 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.693365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.694036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.694735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.700050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.700845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.702515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.735596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2611/5202] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:30 2022] POST /identity/v3/services => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:30.736940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.748035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60281f-3c75-49b4-909d-cf932665ae86 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.765458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.766426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.766779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.767143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f62d6be433bb4c6eb7ea16a05ce51b0a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.767950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=f62d6be433bb4c6eb7ea16a05ce51b0a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.769063 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.769063 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:30.769063 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:30.770120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.782695 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2592/5203] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Jun 18 22:21:30 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/f62d6be433bb4c6eb7ea16a05ce51b0a => generated 333 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:30.788049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.800282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674513a-a249-4c74-852c-b7e3605b13d4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.805844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.807115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.807564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.807845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services/8a1cd5f08b8a414da0642aa3131696c2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.808726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8a1cd5f08b8a414da0642aa3131696c2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.809564 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.809564 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:30.809564 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:30.810510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.850812 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2612/5204] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/services/8a1cd5f08b8a414da0642aa3131696c2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:30.852034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.862372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861493-8bd6-49cb-a299-44e8c2edeeb4 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.876932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.878487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.878770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.879045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f62d6be433bb4c6eb7ea16a05ce51b0a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.879697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f62d6be433bb4c6eb7ea16a05ce51b0a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.880722 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:30.880722 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:30.880722 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:30.881918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.893624 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2593/5205] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f62d6be433bb4c6eb7ea16a05ce51b0a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:30.897716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.908705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f84cc8-cd62-4e25-bc0d-eb01c3e17c1c tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.913471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.914330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.914621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.914902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services/a050a706b17943bb9ed98ee455b3dfda` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.915559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a050a706b17943bb9ed98ee455b3dfda)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.917224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.940633 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2613/5206] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/services/a050a706b17943bb9ed98ee455b3dfda => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:30.945682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:30.956749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27544-5949-4800-8852-41ca4a20fcf6 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:30.972689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:30.973600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:30.973881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:30.974165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/ff2a14b02b16414abee09daec30b6ce7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:30.974803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=ff2a14b02b16414abee09daec30b6ce7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:30.976447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:30.987466 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2594/5207] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/ff2a14b02b16414abee09daec30b6ce7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:30.992367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:31.004700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d57ad-596d-4c15-bfe0-e5999462c45f tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:31.009579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b2976-ca3b-4be5-a794-8d5469ac5093 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba59450db9a245fca1ae1f9246760562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80180ed8e076443998d4b9953b5aadf7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:31.010439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b2976-ca3b-4be5-a794-8d5469ac5093 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:31.010728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b2976-ca3b-4be5-a794-8d5469ac5093 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:31.011011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b2976-ca3b-4be5-a794-8d5469ac5093 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] PATH_INFO: `/v3/services/bc791337694b4ff9bb46e26acf02aaa1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:31.011675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b2976-ca3b-4be5-a794-8d5469ac5093 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bc791337694b4ff9bb46e26acf02aaa1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:31.013518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b2976-ca3b-4be5-a794-8d5469ac5093 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:31.038572 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2614/5208] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:30 2022] DELETE /identity/v3/services/bc791337694b4ff9bb46e26acf02aaa1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:31.043012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:31.075490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:31.124289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfce31d-bf72-4e52-a6b7-1ba68bb31728 tempest-EndPointGroupsTest-301476174 tempest-EndPointGroupsTest-301476174-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:31.139059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:31.139981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:31.140255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:31.140525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] PATH_INFO: `/v3/users/0e7210731cfe4405a42dcf85d66ee5bc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:31.141792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7210731cfe4405a42dcf85d66ee5bc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:31.143830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:31.192039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7210731cfe4405a42dcf85d66ee5bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.192718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7210731cfe4405a42dcf85d66ee5bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.205211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7210731cfe4405a42dcf85d66ee5bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.205922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7210731cfe4405a42dcf85d66ee5bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.217731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7210731cfe4405a42dcf85d66ee5bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.234489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2595/5209] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:31 2022] DELETE /identity/v3/users/0e7210731cfe4405a42dcf85d66ee5bc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:31.239508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:31.239849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:31.240244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:31.258965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:31.260175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:31.322806 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2615/5210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:31.334800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:31.336371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:31.425928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc858b3-32e5-436f-8f95-7999914763e1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:31.430489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:31.431393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:31.431805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:31.432221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:31.444762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:31.446457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:31.460997 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2596/5211] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:31.841720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:31.843964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:31.860596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6006dc-4166-49d6-b9d7-977ddb6e4e09 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:31.867072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:31.868212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:31.868497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:31.868772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] PATH_INFO: `/v3/projects/10e3c3ab752649ce8ac1238fcc27915b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:31.870047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e3c3ab752649ce8ac1238fcc27915b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:31.872060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:31.931254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:31.958533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e3c3ab752649ce8ac1238fcc27915b', 'request_id': 'req-35627430-056a-49de-a5df-33c70ec53b9d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.965322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e3c3ab752649ce8ac1238fcc27915b', 'request_id': 'req-35627430-056a-49de-a5df-33c70ec53b9d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.978829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e3c3ab752649ce8ac1238fcc27915b', 'request_id': 'req-35627430-056a-49de-a5df-33c70ec53b9d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.996669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] The token cache is being invalidate because project 10e3c3ab752649ce8ac1238fcc27915b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:31.996972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:31.997749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.000066 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2616/5212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:31 2022] DELETE /identity/v3/projects/10e3c3ab752649ce8ac1238fcc27915b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:32.004001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:32.030311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896db709-70aa-45b4-8ea2-98b36c7a4e75 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:32.071005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:32.122713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:32.123613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:32.123896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:32.124172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] PATH_INFO: `/v3/users/ba59450db9a245fca1ae1f9246760562` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:32.125443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba59450db9a245fca1ae1f9246760562)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:32.127363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:32.181306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba59450db9a245fca1ae1f9246760562'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.181959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba59450db9a245fca1ae1f9246760562'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.195366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba59450db9a245fca1ae1f9246760562'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.196100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba59450db9a245fca1ae1f9246760562'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.205640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ceeb1d-02aa-4235-b4a8-77b531946483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba59450db9a245fca1ae1f9246760562'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.219897 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2597/5213] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:32 2022] DELETE /identity/v3/users/ba59450db9a245fca1ae1f9246760562 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:32.509602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:32.511425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:32.525938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627430-056a-49de-a5df-33c70ec53b9d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:32.588489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:32.589426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:32.589699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:32.589972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] PATH_INFO: `/v3/projects/80180ed8e076443998d4b9953b5aadf7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:32.591239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80180ed8e076443998d4b9953b5aadf7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:32.593239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:32.644692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80180ed8e076443998d4b9953b5aadf7', 'request_id': 'req-ec039827-966d-4506-ad0c-095a25173316'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.651628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80180ed8e076443998d4b9953b5aadf7', 'request_id': 'req-ec039827-966d-4506-ad0c-095a25173316'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.661123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80180ed8e076443998d4b9953b5aadf7', 'request_id': 'req-ec039827-966d-4506-ad0c-095a25173316'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.672060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] The token cache is being invalidate because project 80180ed8e076443998d4b9953b5aadf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:32.672350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.673004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ec039827-966d-4506-ad0c-095a25173316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:32.674649 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2617/5214] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:32 2022] DELETE /identity/v3/projects/80180ed8e076443998d4b9953b5aadf7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:32.679615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75911-b7b8-49b5-941c-13937dbb3373 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:32.679901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75911-b7b8-49b5-941c-13937dbb3373 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:32.680174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b75911-b7b8-49b5-941c-13937dbb3373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:32.699251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-43b75911-b7b8-49b5-941c-13937dbb3373 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:32.700530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-43b75911-b7b8-49b5-941c-13937dbb3373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:32.760962 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2598/5215] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:32.769110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc11c2-8c6b-4199-9b44-b72106180c6d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:32.769399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc11c2-8c6b-4199-9b44-b72106180c6d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:32.769677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc11c2-8c6b-4199-9b44-b72106180c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:32.789215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-25cc11c2-8c6b-4199-9b44-b72106180c6d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:32.790357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-25cc11c2-8c6b-4199-9b44-b72106180c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:32.799971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2618/5216] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:32.804151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75911-b7b8-49b5-941c-13937dbb3373 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:32.814097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b75911-b7b8-49b5-941c-13937dbb3373 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:32.818901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:32.819569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:32.819845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:32.820143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:32.820875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:32.821208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:32.823188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:32.837135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2599/5217] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:32.841324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc11c2-8c6b-4199-9b44-b72106180c6d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:32.850893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc11c2-8c6b-4199-9b44-b72106180c6d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:32.856035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:32.856754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:32.857050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:32.857353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:32.858081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:32.860021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:32.891284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2619/5218] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:32 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:32.896942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:32.911939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f4f20-2477-4b52-8c26-94e1fd8d0745 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:32.948735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:32.993130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:32.994365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:32.994980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:32.995465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:32.996525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:32.998644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.040262 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2600/5219] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:32 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:33.042456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.054489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61945-9df7-4864-9db6-b51860750521 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.059379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.060226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.060539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.060817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.061599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.063226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.083027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.083279 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2620/5220] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:33.107529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463a818-5185-485d-b74c-38f1d7831329 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.117920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94e5cf-eeae-44af-bc23-6e8b334a8979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.118980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e5cf-eeae-44af-bc23-6e8b334a8979 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.119477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e5cf-eeae-44af-bc23-6e8b334a8979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.119807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e5cf-eeae-44af-bc23-6e8b334a8979 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.120736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e5cf-eeae-44af-bc23-6e8b334a8979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.122587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e5cf-eeae-44af-bc23-6e8b334a8979 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.134321 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2601/5221] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:33.139545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.152053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb5219-0ad0-4611-8a6c-e9e530fe2596 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.165869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.167778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.167778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.167778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] PATH_INFO: `/v3/projects/6b885436ee834d29a2a5181564ce3296/users/49676b8adcfd4742a1af38846dea0600/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.193110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:33.197822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b885436ee834d29a2a5181564ce3296, user_id=49676b8adcfd4742a1af38846dea0600, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.203711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.224304 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2621/5222] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:33 2022] PUT /identity/v3/projects/6b885436ee834d29a2a5181564ce3296/users/49676b8adcfd4742a1af38846dea0600/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:33.236558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce08e-6ef9-4c9b-8b56-9b057afc86be None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.237183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce08e-6ef9-4c9b-8b56-9b057afc86be None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.237680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ce08e-6ef9-4c9b-8b56-9b057afc86be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.269694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-021ce08e-6ef9-4c9b-8b56-9b057afc86be None None] MFA Rules not processed for user `49676b8adcfd4742a1af38846dea0600`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:33.270983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-021ce08e-6ef9-4c9b-8b56-9b057afc86be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:33.367686 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2602/5223] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:33.372253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.452850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e90d1-447d-48aa-8228-88f6fa0947e4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.458722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.459562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.459945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.460879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.468923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.468923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.562243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2622/5224] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:33 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:33.564165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ce08e-6ef9-4c9b-8b56-9b057afc86be None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.582010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ce08e-6ef9-4c9b-8b56-9b057afc86be None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.657769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.658566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.658941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.659310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.660114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.662268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.694656 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2603/5225] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:33 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:33.699987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.728845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68208c-ba53-43a4-84fa-368b5d7d59b6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.743754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.747645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.747927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.748201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.754714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.761221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.785853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.786027 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2623/5226] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:33.798231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802955-653e-431d-a388-d41f621441e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.808474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.810201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.811913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.812290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] PATH_INFO: `/v3/projects/b83ac3bb37884ff9a79a99b2475a54db/users/9558d25c2f334254944ffa0841f97732/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.832455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83ac3bb37884ff9a79a99b2475a54db, user_id=9558d25c2f334254944ffa0841f97732, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.835684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.858425 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2604/5227] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:33 2022] PUT /identity/v3/projects/b83ac3bb37884ff9a79a99b2475a54db/users/9558d25c2f334254944ffa0841f97732/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:33.862261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:33.892312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291e96c-23bf-4a7a-98df-a762fa49c26c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:33.975522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcd7ac-edc6-438a-936d-99ca0fb92dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:33.976243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcd7ac-edc6-438a-936d-99ca0fb92dca admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:33.976573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcd7ac-edc6-438a-936d-99ca0fb92dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:33.977096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcd7ac-edc6-438a-936d-99ca0fb92dca admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:33.978819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcd7ac-edc6-438a-936d-99ca0fb92dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:33.982846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcd7ac-edc6-438a-936d-99ca0fb92dca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:33.999035 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2624/5228] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:34.000372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.007110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:34.013990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540300f1-6009-41de-ab9e-e5422c4994ac admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.029598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.030623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.031004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.031374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] PATH_INFO: `/v3/projects/b83ac3bb37884ff9a79a99b2475a54db/users/9558d25c2f334254944ffa0841f97732/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.039647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83ac3bb37884ff9a79a99b2475a54db, user_id=9558d25c2f334254944ffa0841f97732, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.051139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.084059 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2605/5229] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:33 2022] PUT /identity/v3/projects/b83ac3bb37884ff9a79a99b2475a54db/users/9558d25c2f334254944ffa0841f97732/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:34.095583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572f1d-7d62-43b4-b406-abffb924896b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.096278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572f1d-7d62-43b4-b406-abffb924896b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.097313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572f1d-7d62-43b4-b406-abffb924896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.126385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-49572f1d-7d62-43b4-b406-abffb924896b None None] MFA Rules not processed for user `9558d25c2f334254944ffa0841f97732`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:34.127713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-49572f1d-7d62-43b4-b406-abffb924896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:34.191942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:34.229677 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2625/5230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:34.234405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.249970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a913c-1ea1-48da-901d-363ca3fc1212 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.256466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.257278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.257575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.258121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.259106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.260862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.278917 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2606/5231] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:34 2022] POST /identity/v3/services => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:34.284323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572f1d-7d62-43b4-b406-abffb924896b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.295990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572f1d-7d62-43b4-b406-abffb924896b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.315737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.316452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.316740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.317098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.317829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.318865 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:34.318865 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:34.318865 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:34.319781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: On instance['enabled']: Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: On instance['enabled']: Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: 'False' Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise error Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application 'False' Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.343549 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:21:34.349813 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application 'False' Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.351055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2626/5232] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:21:34 2022] POST /identity/v3/endpoints => generated 283 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 18 22:21:34.351767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.362755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b9ac8-3466-4b7f-a6a1-11f2e0724f66 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.372141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.373208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.374836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.375311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.376089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.377824 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:34.377824 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:34.377824 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:34.379212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: On instance['enabled']: Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: On instance['enabled']: Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: 'True' Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise error Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application 'True' Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:34.387403 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:21:34.388974 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application 'True' Jun 18 22:21:34.390369 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:34.393470 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2607/5233] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:21:34 2022] POST /identity/v3/endpoints => generated 281 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 18 22:21:34.394403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.408247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b6456-5083-4d44-9d57-76ec3b87402e tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.414915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.416375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.416667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.416945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.418353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.420044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.458467 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-134440118. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:21:34.458467 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:21:34.458467 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:34.495500 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2627/5234] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:21:34 2022] POST /identity/v3/endpoints => generated 358 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:34.496643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.509754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23daf23-97a5-4913-b098-3bebeaa4030f tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.530726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.531571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.531857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.532184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/regions/tempest-region-134440118` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.532852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-134440118)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.533979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.538965 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2608/5235] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Jun 18 22:21:34 2022] GET /identity/v3/regions/tempest-region-134440118 => generated 178 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:34.540423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.551322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d94c2-5810-4056-8ea0-b4ce427556d3 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.558447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.558447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.558447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.558741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints/9e2c496ff2784a9a9e1afb988e80c83d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.567376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=9e2c496ff2784a9a9e1afb988e80c83d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.568923 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:34.568923 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:34.568923 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:34.569377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: On instance['enabled']: Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: On instance['enabled']: Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: 'False' Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise error Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application 'False' Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.580500 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:21:34.585955 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application 'False' Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.586937 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2628/5236] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Jun 18 22:21:34 2022] PATCH /identity/v3/endpoints/9e2c496ff2784a9a9e1afb988e80c83d => generated 283 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 18 22:21:34.587618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.598599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07f297-4a3f-4724-9528-f9f06fae4f77 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.604205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.607323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.607323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.607323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints/9e2c496ff2784a9a9e1afb988e80c83d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.607323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9e2c496ff2784a9a9e1afb988e80c83d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.608321 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:34.608321 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:21:34.608321 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:21:34.609531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.623347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9e2c496ff2784a9a9e1afb988e80c83d', 'request_id': 'req-fe2000ed-4882-4a7e-babe-522b4d9f045c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:34.634721 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2609/5237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:34 2022] DELETE /identity/v3/endpoints/9e2c496ff2784a9a9e1afb988e80c83d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:34.639017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.642344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.643987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:34.653846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34754666-2d94-44f0-a51a-b37a1f701003 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.670871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.671976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.672263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.672539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/regions/tempest-region-134440118` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.673231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-134440118)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.674312 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:34.674312 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:34.674312 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:34.675140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.710650 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2629/5238] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Jun 18 22:21:34 2022] DELETE /identity/v3/regions/tempest-region-134440118 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:34.712000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.736651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2000ed-4882-4a7e-babe-522b4d9f045c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.752992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeb181-33c9-46b4-960f-aab641ab204c tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.754504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.755408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.755841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.756193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] PATH_INFO: `/v3/users/b1492914eace4de98e4b8b00a080c466` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.757620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1492914eace4de98e4b8b00a080c466)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.759601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.762343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.764750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.766393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.767147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.768815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.770797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.791760 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1174680261. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:21:34.791760 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:21:34.791760 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:34.827879 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2630/5239] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:21:34 2022] POST /identity/v3/endpoints => generated 360 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:34.831556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.834531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1492914eace4de98e4b8b00a080c466'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:34.835234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1492914eace4de98e4b8b00a080c466'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:34.848967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1492914eace4de98e4b8b00a080c466'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:34.850703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1492914eace4de98e4b8b00a080c466'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:34.856272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3adb1c-58b2-4ce5-9ba6-b5d42ecbaf55 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.861771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.862755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.863349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.864067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/regions/tempest-region-1174680261` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.864827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1174680261)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.866006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.866561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d645060f-c3c2-4aa0-bb10-f1d0292e29af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1492914eace4de98e4b8b00a080c466'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:34.868434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2631/5240] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Jun 18 22:21:34 2022] GET /identity/v3/regions/tempest-region-1174680261 => generated 180 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:21:34.872863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.875004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:34.881952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:34.888610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2610/5241] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:34 2022] DELETE /identity/v3/users/b1492914eace4de98e4b8b00a080c466 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:34.888982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754e18d-ab3a-4627-afea-70f439145938 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:34.892594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.893094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.893572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.916662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:34.918038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:34.954277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:34.964021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:34.965312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:34.965611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:34.966370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints/088b0890d3844f65bbb51fd488f05020` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:34.975710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=088b0890d3844f65bbb51fd488f05020)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:34.977408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: On instance['enabled']: Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: On instance['enabled']: Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: 'True' Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise error Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application 'True' Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.988185 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:21:34.989864 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['enabled']: Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application 'True' Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:21:34.991055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2632/5242] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Jun 18 22:21:34 2022] PATCH /identity/v3/endpoints/088b0890d3844f65bbb51fd488f05020 => generated 281 bytes in 117 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 18 22:21:34.993716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:34.995455 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2611/5243] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:34 2022] POST /identity/v3/auth/tokens => generated 3543 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:35.004403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a94a-e585-4151-a6c7-c6f84a4193b7 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.006538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:35.009847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:35.009976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.010813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.011124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.011498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/endpoints/088b0890d3844f65bbb51fd488f05020` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.013428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=088b0890d3844f65bbb51fd488f05020)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.014453 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:21:35.014453 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:21:35.014453 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:21:35.015515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:35.034913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '088b0890d3844f65bbb51fd488f05020', 'request_id': 'req-713a915d-c3fd-452f-96ca-9481b6fedd52'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.049205 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2633/5244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:34 2022] DELETE /identity/v3/endpoints/088b0890d3844f65bbb51fd488f05020 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:35.053177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:35.077280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a915d-c3fd-452f-96ca-9481b6fedd52 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.084036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.085213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.085654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.085943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/regions/tempest-region-1174680261` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.086742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1174680261)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.088748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:35.089908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31cf76-3554-49c6-b5e2-ff33aad587cd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.109750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.110570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.110881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.111217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.120900 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2634/5245] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:21:35 2022] DELETE /identity/v3/regions/tempest-region-1174680261 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:35.123103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:35.124982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.126470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:35.148485 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2612/5246] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:35 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:21:35.160106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47b02f-a4c2-4c20-866f-11a089e80bf8 tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.171091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8663a0-c4f6-4b81-91d5-102a7e907bce tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9558d25c2f334254944ffa0841f97732', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83ac3bb37884ff9a79a99b2475a54db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.172039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8663a0-c4f6-4b81-91d5-102a7e907bce tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.172329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8663a0-c4f6-4b81-91d5-102a7e907bce tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.172609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8663a0-c4f6-4b81-91d5-102a7e907bce tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] PATH_INFO: `/v3/services/5123a75d12574cb4ac4cc4ed0cd40a5d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.173959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8663a0-c4f6-4b81-91d5-102a7e907bce tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5123a75d12574cb4ac4cc4ed0cd40a5d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.176292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8663a0-c4f6-4b81-91d5-102a7e907bce tempest-EndpointsNegativeTestJSON-654791062 tempest-EndpointsNegativeTestJSON-654791062-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:35.203303 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2635/5247] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:35 2022] DELETE /identity/v3/services/5123a75d12574cb4ac4cc4ed0cd40a5d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:35.207818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:35.209561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:35.225343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac06b1-6299-491b-8283-6a2adabfe22d service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.242460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.243277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.243551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.243822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] PATH_INFO: `/v3/users/49676b8adcfd4742a1af38846dea0600` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.246907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49676b8adcfd4742a1af38846dea0600)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.249809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:35.313570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49676b8adcfd4742a1af38846dea0600'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.314496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49676b8adcfd4742a1af38846dea0600'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.322439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:35.332774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49676b8adcfd4742a1af38846dea0600'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.333573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49676b8adcfd4742a1af38846dea0600'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.343916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49676b8adcfd4742a1af38846dea0600'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.367432 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2613/5248] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:35 2022] DELETE /identity/v3/users/49676b8adcfd4742a1af38846dea0600 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:35.371541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.371837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.372284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.391873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:35.393109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:35.461365 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2636/5249] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:35.468697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:35.470206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:35.656613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31ee1-7afc-4979-8433-f59ffe7a215a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.660919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.661806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.662133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.662414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.675095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:35.677164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:35.679436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.683187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:35.700500 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2614/5250] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:35.707664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ca109-cb81-4901-a812-ce33ce0f41e9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.732882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.734421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.734732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.735010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] PATH_INFO: `/v3/projects/1d0507e84bd84b2ea8fdbeefea72f317` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.737208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d0507e84bd84b2ea8fdbeefea72f317)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.741828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:35.837686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d0507e84bd84b2ea8fdbeefea72f317', 'request_id': 'req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.849698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d0507e84bd84b2ea8fdbeefea72f317', 'request_id': 'req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.863538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d0507e84bd84b2ea8fdbeefea72f317', 'request_id': 'req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.872122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:35.882861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] The token cache is being invalidate because project 1d0507e84bd84b2ea8fdbeefea72f317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:35.883779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.885427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:35.890045 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2637/5251] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:35 2022] DELETE /identity/v3/projects/1d0507e84bd84b2ea8fdbeefea72f317 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:35.894266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:35.916254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332941c4-d6f9-4e6a-bbb1-e171ed8ec537 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:35.985246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:35.986138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:35.986414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:35.986684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] PATH_INFO: `/v3/users/56111c5742bb41c6b273e2aa6f1c5475` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:35.988274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56111c5742bb41c6b273e2aa6f1c5475)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:35.989845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.061226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.062972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:36.069728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56111c5742bb41c6b273e2aa6f1c5475'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.070475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56111c5742bb41c6b273e2aa6f1c5475'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.080575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd4fa-7b35-4cff-8c5f-1b467dfa9078 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.086891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.088582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.089206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.089660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] PATH_INFO: `/v3/projects/6b885436ee834d29a2a5181564ce3296` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.090925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56111c5742bb41c6b273e2aa6f1c5475'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.091564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b885436ee834d29a2a5181564ce3296)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.092180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56111c5742bb41c6b273e2aa6f1c5475'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.093557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.095147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:36.107701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56111c5742bb41c6b273e2aa6f1c5475'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.123949 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2615/5252] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:35 2022] DELETE /identity/v3/users/56111c5742bb41c6b273e2aa6f1c5475 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:36.157781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b885436ee834d29a2a5181564ce3296', 'request_id': 'req-8585aac2-0196-4da6-8cb2-d430b8c8668d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.166200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b885436ee834d29a2a5181564ce3296', 'request_id': 'req-8585aac2-0196-4da6-8cb2-d430b8c8668d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.175899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b885436ee834d29a2a5181564ce3296', 'request_id': 'req-8585aac2-0196-4da6-8cb2-d430b8c8668d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.190232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] The token cache is being invalidate because project 6b885436ee834d29a2a5181564ce3296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:36.190662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.191353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.193069 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2638/5253] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:36 2022] DELETE /identity/v3/projects/6b885436ee834d29a2a5181564ce3296 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:36.197734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.199650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:36.279055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b560481-9755-4954-8610-87aef9280465 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.321177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.323058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:36.358611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.359505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.359784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.360251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] PATH_INFO: `/v3/users/9558d25c2f334254944ffa0841f97732` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.361531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9558d25c2f334254944ffa0841f97732)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.364484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.413674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585aac2-0196-4da6-8cb2-d430b8c8668d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.419593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.420707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.421118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.421436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] PATH_INFO: `/v3/projects/a1b44a7ea14442e5bbbfd22a30ac3270` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.423027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b44a7ea14442e5bbbfd22a30ac3270)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.425072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.426840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9558d25c2f334254944ffa0841f97732'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.427973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9558d25c2f334254944ffa0841f97732'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.443327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9558d25c2f334254944ffa0841f97732'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.444081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9558d25c2f334254944ffa0841f97732'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.452742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b963441b-1529-4f74-aae7-a65429a325c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9558d25c2f334254944ffa0841f97732'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.469114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2616/5254] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:36 2022] DELETE /identity/v3/users/9558d25c2f334254944ffa0841f97732 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:36.482506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b44a7ea14442e5bbbfd22a30ac3270', 'request_id': 'req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.492800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b44a7ea14442e5bbbfd22a30ac3270', 'request_id': 'req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.504506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b44a7ea14442e5bbbfd22a30ac3270', 'request_id': 'req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.519682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] The token cache is being invalidate because project a1b44a7ea14442e5bbbfd22a30ac3270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:36.519998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.520904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e16294d7-e1bb-471c-8ad2-a88e040a6ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:36.531416 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2639/5255] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:36 2022] DELETE /identity/v3/projects/a1b44a7ea14442e5bbbfd22a30ac3270 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:36.531636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34190be-ca4b-415a-bd83-05b410e4aa36 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.531636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34190be-ca4b-415a-bd83-05b410e4aa36 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.531636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34190be-ca4b-415a-bd83-05b410e4aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.563309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d34190be-ca4b-415a-bd83-05b410e4aa36 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:36.564557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d34190be-ca4b-415a-bd83-05b410e4aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:36.579982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:36.662934 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2617/5256] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:36.671808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3614-f39e-4281-89ff-06e8dc8ba47b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.672285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3614-f39e-4281-89ff-06e8dc8ba47b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.672595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3614-f39e-4281-89ff-06e8dc8ba47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.702355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-836e3614-f39e-4281-89ff-06e8dc8ba47b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:36.703774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-836e3614-f39e-4281-89ff-06e8dc8ba47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:36.714829 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2640/5257] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:36.719754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34190be-ca4b-415a-bd83-05b410e4aa36 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.731529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34190be-ca4b-415a-bd83-05b410e4aa36 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.738403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.739191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.739610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.739986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.741232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:36.741232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.743010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.758556 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2618/5258] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:36.763007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3614-f39e-4281-89ff-06e8dc8ba47b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.767678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:36.774075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3614-f39e-4281-89ff-06e8dc8ba47b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.781891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.782991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.782991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.783227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.783826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.786046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.829016 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2641/5259] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:36 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:36.830889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.847313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.847523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024f0b7-4247-4341-af52-78a9ad204edf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.847618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:36.909821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.910505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.910790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.911067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.911763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.913760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.933490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611eaad-c292-48b8-b646-af49cf17b46b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.939369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.940803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.940948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.941263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] PATH_INFO: `/v3/projects/b83ac3bb37884ff9a79a99b2475a54db` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.942955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83ac3bb37884ff9a79a99b2475a54db)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.944970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.945435 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2619/5260] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:36 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:36.949668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.960497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cc066-dfb7-464f-a5b8-ae722c92175b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:36.966090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:36.966767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:36.967050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:36.967327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:36.968067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:36.969721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:36.980448 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2620/5261] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:36.985130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:36.998593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d9291-1814-4872-95f2-79fc47cf5e72 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.003219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83ac3bb37884ff9a79a99b2475a54db', 'request_id': 'req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:37.009992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83ac3bb37884ff9a79a99b2475a54db', 'request_id': 'req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:37.019091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83ac3bb37884ff9a79a99b2475a54db', 'request_id': 'req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:37.041973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] The token cache is being invalidate because project b83ac3bb37884ff9a79a99b2475a54db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:37.042271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:37.043177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21b2fc01-5b7a-4fab-b2db-9ae10fec792b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:37.045071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2642/5262] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:36 2022] DELETE /identity/v3/projects/b83ac3bb37884ff9a79a99b2475a54db => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:37.051075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16ea0-d673-4661-ad16-468f6aaa95b1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.051475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16ea0-d673-4661-ad16-468f6aaa95b1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.051827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b16ea0-d673-4661-ad16-468f6aaa95b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.072412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-92b16ea0-d673-4661-ad16-468f6aaa95b1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:37.073460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.073837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-92b16ea0-d673-4661-ad16-468f6aaa95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.074305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.074676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.075046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.075849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.077550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.090950 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2643/5263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:37.091264 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2621/5264] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:37.094236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90f57-e553-4d7e-a2b3-dbf35fd32b7d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.094691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90f57-e553-4d7e-a2b3-dbf35fd32b7d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.095116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90f57-e553-4d7e-a2b3-dbf35fd32b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.097885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.101714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.119318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc757fc2-4e7d-47ef-abb7-00fdf4487236 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.119604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4dc90f57-e553-4d7e-a2b3-dbf35fd32b7d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:37.120806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4dc90f57-e553-4d7e-a2b3-dbf35fd32b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.124909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190092f-a0c1-4d26-94d3-ba4cf685ae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.125514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190092f-a0c1-4d26-94d3-ba4cf685ae0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.125796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190092f-a0c1-4d26-94d3-ba4cf685ae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.126071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190092f-a0c1-4d26-94d3-ba4cf685ae0a admin admin] PATH_INFO: `/v3/projects/2233a4d6e803414fa4f54ad04e66a077/users/d268540c4310408b82d0997a45727183/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.132196 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2644/5265] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:37.133261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90f57-e553-4d7e-a2b3-dbf35fd32b7d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.139285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:37.143349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190092f-a0c1-4d26-94d3-ba4cf685ae0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2233a4d6e803414fa4f54ad04e66a077, user_id=d268540c4310408b82d0997a45727183, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.144006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90f57-e553-4d7e-a2b3-dbf35fd32b7d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.146496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190092f-a0c1-4d26-94d3-ba4cf685ae0a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.149189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.150073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.150428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.150884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.151718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:37.152185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.154212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.163617 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2622/5266] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:37 2022] PUT /identity/v3/projects/2233a4d6e803414fa4f54ad04e66a077/users/d268540c4310408b82d0997a45727183/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:37.173825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.177337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.177509 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2645/5267] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:37.177618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.178523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.191045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71980515-f78d-4052-9ad0-469ae4493cb8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.203981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] MFA Rules not processed for user `d268540c4310408b82d0997a45727183`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:37.205257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.238346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:37.256240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.256999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.257370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.257715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.258509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.260516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.276971 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2623/5268] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:37.289008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.291061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.291864 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2646/5269] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/projects => generated 359 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:37.296500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.354384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb49e0-e7a3-45ad-a9f4-9f041610b989 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.368240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205dbba-eeda-423b-b72c-048cba984405 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.373874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.374536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.374821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.375097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.375792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.377881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.401983 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2647/5270] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/users => generated 280 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:37.406308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.414922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646277e-6cd8-438f-9413-4aca4bfd2c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.415799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646277e-6cd8-438f-9413-4aca4bfd2c29 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.416155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646277e-6cd8-438f-9413-4aca4bfd2c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.416500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646277e-6cd8-438f-9413-4aca4bfd2c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.418087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bbff4-792d-4c4d-8a48-145f5f899f5d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.424205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.424874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.425303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.425738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.426469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.428963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.442905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2648/5271] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:37.447059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.458408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d195c61-2d5e-4872-a479-a30a7dae1821 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.463144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.463934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.464344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.464620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.466591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.468676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.473456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:37.482597 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2649/5272] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:37.486285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646277e-6cd8-438f-9413-4aca4bfd2c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.487921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.488123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646277e-6cd8-438f-9413-4aca4bfd2c29 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.498139 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2624/5273] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:37.498800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53ab70-c4d0-47e9-b9f0-23bd1bf9f041 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.503559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93c568-0f12-467b-863e-1640df1587e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.504707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93c568-0f12-467b-863e-1640df1587e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.504802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93c568-0f12-467b-863e-1640df1587e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.505083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93c568-0f12-467b-863e-1640df1587e2 admin admin] PATH_INFO: `/v3/projects/94b1119af3cf41368a780da5052f2b65/users/f20ee6ec34bc4e4db3b04f40fed2831f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.521256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93c568-0f12-467b-863e-1640df1587e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b1119af3cf41368a780da5052f2b65, user_id=f20ee6ec34bc4e4db3b04f40fed2831f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.524882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93c568-0f12-467b-863e-1640df1587e2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.541398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2650/5274] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:37 2022] PUT /identity/v3/projects/94b1119af3cf41368a780da5052f2b65/users/f20ee6ec34bc4e4db3b04f40fed2831f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:37.553061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ab00-a398-46a9-ac59-8bc2e4af6e09 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.553362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ab00-a398-46a9-ac59-8bc2e4af6e09 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.553639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ab00-a398-46a9-ac59-8bc2e4af6e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.581357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-efe2ab00-a398-46a9-ac59-8bc2e4af6e09 None None] MFA Rules not processed for user `f20ee6ec34bc4e4db3b04f40fed2831f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:37.582668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-efe2ab00-a398-46a9-ac59-8bc2e4af6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.654126 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2625/5275] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:37.659157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95d926-415a-4937-8a95-e23e5a96f0da None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.659799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95d926-415a-4937-8a95-e23e5a96f0da None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.660130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95d926-415a-4937-8a95-e23e5a96f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.678614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4f95d926-415a-4937-8a95-e23e5a96f0da None None] MFA Rules not processed for user `f20ee6ec34bc4e4db3b04f40fed2831f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:37.680495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4f95d926-415a-4937-8a95-e23e5a96f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.685150 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2651/5276] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:21:37.689882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ecfc1-d3fa-4b44-bb06-f7efe9b5f69e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.690308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ecfc1-d3fa-4b44-bb06-f7efe9b5f69e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.690516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ecfc1-d3fa-4b44-bb06-f7efe9b5f69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.710501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d97ecfc1-d3fa-4b44-bb06-f7efe9b5f69e None None] MFA Rules not processed for user `f20ee6ec34bc4e4db3b04f40fed2831f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:37.711561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d97ecfc1-d3fa-4b44-bb06-f7efe9b5f69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.718315 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2626/5277] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:21:37.719999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95d926-415a-4937-8a95-e23e5a96f0da None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.733954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95d926-415a-4937-8a95-e23e5a96f0da None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.740093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20ee6ec34bc4e4db3b04f40fed2831f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94b1119af3cf41368a780da5052f2b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.740797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] REQUEST_METHOD: `HEAD` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.741117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.741421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.751234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorizing `identity:check_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.751931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.758793 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2652/5278] 10.222.0.30 () {56 vars in 1263 bytes} [Sat Jun 18 22:21:37 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jun 18 22:21:37.762839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ecfc1-d3fa-4b44-bb06-f7efe9b5f69e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.775090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ecfc1-d3fa-4b44-bb06-f7efe9b5f69e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.779750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20ee6ec34bc4e4db3b04f40fed2831f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94b1119af3cf41368a780da5052f2b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.780227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.780505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.780785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.798566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.800484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.809068 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2627/5279] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Jun 18 22:21:37 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:37.813040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.824413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f72ff-c084-4100-bbfe-1fd64e3525e4 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.828882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289642b-d85b-4872-92f1-6565191c77dd tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20ee6ec34bc4e4db3b04f40fed2831f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94b1119af3cf41368a780da5052f2b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.829652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289642b-d85b-4872-92f1-6565191c77dd tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.830003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289642b-d85b-4872-92f1-6565191c77dd tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.830362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289642b-d85b-4872-92f1-6565191c77dd tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.838646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289642b-d85b-4872-92f1-6565191c77dd tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:37.840254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289642b-d85b-4872-92f1-6565191c77dd tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:37.858976 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2653/5280] 10.222.0.30 () {56 vars in 1265 bytes} [Sat Jun 18 22:21:37 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:37.863148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.875558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305849f-13d7-40f0-aa1c-ba132d21551e tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.886365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20ee6ec34bc4e4db3b04f40fed2831f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94b1119af3cf41368a780da5052f2b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.887194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.887517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.887810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.889838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jun 18 22:21:37.942098 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 18 22:21:37.943288 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 18 22:21:37.944296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:37.944296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:37.944296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 18 22:21:37.944296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 18 22:21:37.944296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 18 22:21:37.944296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:37.944296 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2628/5281] 10.222.0.30 () {56 vars in 1263 bytes} [Sat Jun 18 22:21:37 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jun 18 22:21:37.951638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee003-92ac-4e9b-b21e-a0b4f5ad47b3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:37.952235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee003-92ac-4e9b-b21e-a0b4f5ad47b3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:37.952610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee003-92ac-4e9b-b21e-a0b4f5ad47b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:37.971473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-747ee003-92ac-4e9b-b21e-a0b4f5ad47b3 None None] MFA Rules not processed for user `f20ee6ec34bc4e4db3b04f40fed2831f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:37.972929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-747ee003-92ac-4e9b-b21e-a0b4f5ad47b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:37.976629 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2654/5282] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:37 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:21:37.980835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:37.993732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8fffb-d6a3-40eb-93e0-66144138c562 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:37.999035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20ee6ec34bc4e4db3b04f40fed2831f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94b1119af3cf41368a780da5052f2b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:37.999828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:38.000231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:38.000755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:38.009959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:38.013234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:38.021976 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2629/5283] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Jun 18 22:21:37 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:38.029597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ee003-92ac-4e9b-b21e-a0b4f5ad47b3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:38.044587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ee003-92ac-4e9b-b21e-a0b4f5ad47b3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:38.049822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20ee6ec34bc4e4db3b04f40fed2831f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94b1119af3cf41368a780da5052f2b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:38.050777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:38.050982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:38.051257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:38.059615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:38.061424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:38.082941 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2655/5284] 10.222.0.30 () {56 vars in 1265 bytes} [Sat Jun 18 22:21:38 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:38.087966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:38.099786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72302ab-8922-4284-938d-d6cdaf23ceb7 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:38.105511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b37180-405c-4e51-9a80-e82ddd823192 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20ee6ec34bc4e4db3b04f40fed2831f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94b1119af3cf41368a780da5052f2b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:38.106186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37180-405c-4e51-9a80-e82ddd823192 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:38.106564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37180-405c-4e51-9a80-e82ddd823192 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:38.106875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37180-405c-4e51-9a80-e82ddd823192 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:38.108925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f2b37180-405c-4e51-9a80-e82ddd823192 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f2b37180-405c-4e51-9a80-e82ddd823192 tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 18 22:21:38.123769 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 18 22:21:38.124921 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 18 22:21:38.125936 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:21:38.125936 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:21:38.125936 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 18 22:21:38.125936 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 18 22:21:38.125936 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 18 22:21:38.125936 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:21:38.125936 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2630/5285] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Jun 18 22:21:38 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:21:38.130494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:38.143602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:38.227680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb26961-c069-4fbd-9fb7-94f4c36bda9a tempest-TokensV3Test-572954604 tempest-TokensV3Test-572954604-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:38.232475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:38.233424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:38.233700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:38.234672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] PATH_INFO: `/v3/users/f20ee6ec34bc4e4db3b04f40fed2831f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:38.236319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20ee6ec34bc4e4db3b04f40fed2831f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:38.238287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:38.296394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20ee6ec34bc4e4db3b04f40fed2831f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:38.298116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20ee6ec34bc4e4db3b04f40fed2831f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:38.324894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20ee6ec34bc4e4db3b04f40fed2831f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:38.326536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20ee6ec34bc4e4db3b04f40fed2831f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:38.340047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20ee6ec34bc4e4db3b04f40fed2831f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:38.368850 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2656/5286] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:38 2022] DELETE /identity/v3/users/f20ee6ec34bc4e4db3b04f40fed2831f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:38.373360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:38.373637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:38.373954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:38.400089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:38.402447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:38.496343 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2631/5287] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:38.507106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:38.508807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:38.591976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c167a6-396c-45cf-845d-28d8b54f5d2e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:38.595588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:38.596259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:38.596543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:38.596820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:38.606718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:38.614696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:38.631852 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2657/5288] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:39.100961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.102769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:39.119181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e14e-f33a-4b26-964e-f2fe65f45ed9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.131409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.132385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.132739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.133142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] PATH_INFO: `/v3/projects/94b1119af3cf41368a780da5052f2b65` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.134451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b1119af3cf41368a780da5052f2b65)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.136842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.169326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:39.199813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.201582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:39.207946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b1119af3cf41368a780da5052f2b65', 'request_id': 'req-d807a551-ac4b-407a-8230-36232a20936c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:39.220257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b1119af3cf41368a780da5052f2b65', 'request_id': 'req-d807a551-ac4b-407a-8230-36232a20936c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:39.234457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b1119af3cf41368a780da5052f2b65', 'request_id': 'req-d807a551-ac4b-407a-8230-36232a20936c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:39.260286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] The token cache is being invalidate because project 94b1119af3cf41368a780da5052f2b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:39.261092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:39.263977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d807a551-ac4b-407a-8230-36232a20936c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:39.271488 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2632/5289] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:39 2022] DELETE /identity/v3/projects/94b1119af3cf41368a780da5052f2b65 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:39.273575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e937-02d7-4ba5-a474-b13e9c0fcb7e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.273999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e937-02d7-4ba5-a474-b13e9c0fcb7e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.274278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e937-02d7-4ba5-a474-b13e9c0fcb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.279388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:39.298540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40c2e937-02d7-4ba5-a474-b13e9c0fcb7e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:39.299748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40c2e937-02d7-4ba5-a474-b13e9c0fcb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:39.373649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a405d4e-56d6-4521-a184-40d675ecf6ae service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.378149 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2633/5290] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:39.386225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c50b16-6d09-4e3d-aad9-e7b5b623bd92 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.386712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c50b16-6d09-4e3d-aad9-e7b5b623bd92 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.387213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c50b16-6d09-4e3d-aad9-e7b5b623bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.432196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a8c50b16-6d09-4e3d-aad9-e7b5b623bd92 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:39.433492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a8c50b16-6d09-4e3d-aad9-e7b5b623bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:39.456903 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2634/5291] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:39.458395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c50b16-6d09-4e3d-aad9-e7b5b623bd92 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.471350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c50b16-6d09-4e3d-aad9-e7b5b623bd92 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.476819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.477874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.478204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.478527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.478949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.479089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.479446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.479788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.480677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:39.480989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.481854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:39.483381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.498715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.500676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.504287 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2635/5292] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:39.507185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.519484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65838dd8-9e44-45fb-b448-6e29ca88c555 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.535228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.536126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.536733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.537220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.538096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.538263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2658/5293] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:39.540006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.576570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2636/5294] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:39 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:39.577842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.594952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a5ae-dca3-4aab-8008-f0d4d5740736 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.677539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.678492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.679352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.679352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.680295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.682714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.710245 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2659/5295] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:39 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:39.714417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.726441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf88b7f-2ae3-4d0e-8714-e306b5591125 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.731523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.732216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.732771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.732771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.733544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.735186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.747629 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2637/5296] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:39.751776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.763281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c080c-e6fa-4700-bad8-51944f536bea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.768383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.769452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.769736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.770105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] PATH_INFO: `/v3/projects/cb0bf5dd73a3490c83fa9aa946ae39ba/users/0dc7cb88067a46829777c16c5a3f32a8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.787725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0bf5dd73a3490c83fa9aa946ae39ba, user_id=0dc7cb88067a46829777c16c5a3f32a8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.791890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.824358 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2660/5297] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:39 2022] PUT /identity/v3/projects/cb0bf5dd73a3490c83fa9aa946ae39ba/users/0dc7cb88067a46829777c16c5a3f32a8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:39.826169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.840066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485cdce-b2fb-4d9d-b077-cbde408dbd1f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.915242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f8c80-5cab-4451-a9db-db598c8a39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.915937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f8c80-5cab-4451-a9db-db598c8a39f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.916252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f8c80-5cab-4451-a9db-db598c8a39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.916492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f8c80-5cab-4451-a9db-db598c8a39f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.917256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f8c80-5cab-4451-a9db-db598c8a39f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.918926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f8c80-5cab-4451-a9db-db598c8a39f4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.920821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:39.943238 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2638/5298] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:39.948199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:39.962191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd3a88-47d9-45d0-a0ef-76935801443f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:39.970010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:39.971349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:39.972263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:39.972557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] PATH_INFO: `/v3/projects/cb0bf5dd73a3490c83fa9aa946ae39ba/users/0dc7cb88067a46829777c16c5a3f32a8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:39.975077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0bf5dd73a3490c83fa9aa946ae39ba, user_id=0dc7cb88067a46829777c16c5a3f32a8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:39.977995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:39.982099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:39.998272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2661/5299] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:39 2022] PUT /identity/v3/projects/cb0bf5dd73a3490c83fa9aa946ae39ba/users/0dc7cb88067a46829777c16c5a3f32a8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:40.013504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9fed-f0c6-4d00-9e7b-499c2f50ccc6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.014454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9fed-f0c6-4d00-9e7b-499c2f50ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.015163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9fed-f0c6-4d00-9e7b-499c2f50ccc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.052788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-312b9fed-f0c6-4d00-9e7b-499c2f50ccc6 None None] MFA Rules not processed for user `0dc7cb88067a46829777c16c5a3f32a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:40.054328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-312b9fed-f0c6-4d00-9e7b-499c2f50ccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:40.154163 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2639/5300] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:40.156357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:40.244595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10212be-a2f8-425f-a339-667398d25528 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:40.249753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:40.250433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.250713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.250989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.251838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:40.255179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:40.292662 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2662/5301] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:40.296967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b9fed-f0c6-4d00-9e7b-499c2f50ccc6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:40.308372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b9fed-f0c6-4d00-9e7b-499c2f50ccc6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:40.373689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:40.374433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.374850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.375127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.375826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:40.377792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:40.401805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2640/5302] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:40 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:40.406290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:40.420398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365d7c4-be13-43de-a35b-9f99a19cb2ec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:40.427506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:40.428269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.428557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.428832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.429615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:40.431568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:40.446499 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2663/5303] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:40.451296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:40.462821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938d917-7300-4a06-a261-1540f6cc6700 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:40.468892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d25b0-9fd7-402c-b9f0-6a00d8bd346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:40.469648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d25b0-9fd7-402c-b9f0-6a00d8bd346b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.469938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d25b0-9fd7-402c-b9f0-6a00d8bd346b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.470214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d25b0-9fd7-402c-b9f0-6a00d8bd346b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.470972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d25b0-9fd7-402c-b9f0-6a00d8bd346b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:40.472818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d25b0-9fd7-402c-b9f0-6a00d8bd346b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:40.489163 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2641/5304] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:40.491221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:40.503923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bdc5b-6330-4335-bcd9-d75dc50f78b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:40.509867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:40.511442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.511729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.512151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] PATH_INFO: `/v3/projects/8436e049d0a24a00ae28766ec5c080c7/users/0b59f714a17b4deaa2212e3f217a4e01/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.537874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8436e049d0a24a00ae28766ec5c080c7, user_id=0b59f714a17b4deaa2212e3f217a4e01, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:40.541314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:40.573174 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2664/5305] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:40 2022] PUT /identity/v3/projects/8436e049d0a24a00ae28766ec5c080c7/users/0b59f714a17b4deaa2212e3f217a4e01/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:40.578983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595395a-a15d-4561-9878-d231148353b7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.579311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595395a-a15d-4561-9878-d231148353b7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.579558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595395a-a15d-4561-9878-d231148353b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.617412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d595395a-a15d-4561-9878-d231148353b7 None None] MFA Rules not processed for user `0b59f714a17b4deaa2212e3f217a4e01`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:40.620752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d595395a-a15d-4561-9878-d231148353b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:40.678819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:40.705385 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2642/5306] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:40.713727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:40.715493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:40.792571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ca833-e145-4648-b80c-5600bde9e137 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:40.796672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbbb1e-6a61-4812-b20e-1d8fdf0f91b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:40.797360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbbb1e-6a61-4812-b20e-1d8fdf0f91b1 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:40.797640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbbb1e-6a61-4812-b20e-1d8fdf0f91b1 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:40.797911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbbb1e-6a61-4812-b20e-1d8fdf0f91b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:40.853899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:40.872569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbbb1e-6a61-4812-b20e-1d8fdf0f91b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:40.874130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbbb1e-6a61-4812-b20e-1d8fdf0f91b1 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:40.885059 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2665/5307] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:41.559075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595395a-a15d-4561-9878-d231148353b7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:41.661542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595395a-a15d-4561-9878-d231148353b7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:41.666470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:41.668338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:41.668849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:41.669479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] PATH_INFO: `/v3/users/0dc7cb88067a46829777c16c5a3f32a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:41.671676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc7cb88067a46829777c16c5a3f32a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:41.674463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:41.740578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc7cb88067a46829777c16c5a3f32a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:41.741373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc7cb88067a46829777c16c5a3f32a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:41.755520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc7cb88067a46829777c16c5a3f32a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:41.756233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc7cb88067a46829777c16c5a3f32a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:41.763332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc7cb88067a46829777c16c5a3f32a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:41.777926 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2643/5308] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:41 2022] DELETE /identity/v3/users/0dc7cb88067a46829777c16c5a3f32a8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:41.782611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:41.783094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:41.783192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:41.802135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:41.803595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:41.867379 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2666/5309] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:41.877540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:41.879318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:41.954100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc375bae-2fa6-4287-85f6-b62b1c2e424e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:41.958310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:41.959118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:41.959469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:41.959833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:41.969592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:41.971038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:41.980805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2644/5310] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:42.274593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:42.276311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:42.291574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ebe35-1146-4586-9ec7-f546f3985346 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:42.297200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:42.298270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:42.298556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:42.298832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] PATH_INFO: `/v3/projects/cb0bf5dd73a3490c83fa9aa946ae39ba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:42.304768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0bf5dd73a3490c83fa9aa946ae39ba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:42.306841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:42.371045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0bf5dd73a3490c83fa9aa946ae39ba', 'request_id': 'req-ce6e6200-1c5b-4af1-b384-0245ff311d95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.382356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0bf5dd73a3490c83fa9aa946ae39ba', 'request_id': 'req-ce6e6200-1c5b-4af1-b384-0245ff311d95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.398260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0bf5dd73a3490c83fa9aa946ae39ba', 'request_id': 'req-ce6e6200-1c5b-4af1-b384-0245ff311d95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.425190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] The token cache is being invalidate because project cb0bf5dd73a3490c83fa9aa946ae39ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:42.425802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.426995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.429194 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2667/5311] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:42 2022] DELETE /identity/v3/projects/cb0bf5dd73a3490c83fa9aa946ae39ba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:42.433000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:42.442906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a4f8-1de4-4f43-bc3b-e770c7c6e9a6 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:42.453222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:42.536008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:42.537101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:42.537934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:42.538805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] PATH_INFO: `/v3/users/0b59f714a17b4deaa2212e3f217a4e01` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:42.539674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b59f714a17b4deaa2212e3f217a4e01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:42.541765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:42.627660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b59f714a17b4deaa2212e3f217a4e01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.629555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b59f714a17b4deaa2212e3f217a4e01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.649986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b59f714a17b4deaa2212e3f217a4e01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.650740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b59f714a17b4deaa2212e3f217a4e01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.659761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a71f388f-e7d6-4388-bbd8-dd727bd78dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b59f714a17b4deaa2212e3f217a4e01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:42.681113 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2645/5312] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:42 2022] DELETE /identity/v3/users/0b59f714a17b4deaa2212e3f217a4e01 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:43.335715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:43.337253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:43.358004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e6200-1c5b-4af1-b384-0245ff311d95 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:43.570350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:43.572023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:43.572409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:43.572788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] PATH_INFO: `/v3/projects/8436e049d0a24a00ae28766ec5c080c7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:43.576293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8436e049d0a24a00ae28766ec5c080c7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:43.579901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:43.606658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:43.661637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8436e049d0a24a00ae28766ec5c080c7', 'request_id': 'req-b60d3d7a-4db8-4068-806e-4023c5168f20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:43.671259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8436e049d0a24a00ae28766ec5c080c7', 'request_id': 'req-b60d3d7a-4db8-4068-806e-4023c5168f20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:43.685743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8436e049d0a24a00ae28766ec5c080c7', 'request_id': 'req-b60d3d7a-4db8-4068-806e-4023c5168f20'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:43.708495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] The token cache is being invalidate because project 8436e049d0a24a00ae28766ec5c080c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:43.708495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:43.708999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b60d3d7a-4db8-4068-806e-4023c5168f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:43.718605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2668/5313] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:43 2022] DELETE /identity/v3/projects/8436e049d0a24a00ae28766ec5c080c7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:43.725192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc6ef-8465-4bd0-a232-bca94835f094 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:43.725758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc6ef-8465-4bd0-a232-bca94835f094 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:43.725857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fc6ef-8465-4bd0-a232-bca94835f094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:43.744473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d29fc6ef-8465-4bd0-a232-bca94835f094 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:43.745808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d29fc6ef-8465-4bd0-a232-bca94835f094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:43.845292 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2646/5314] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:43.853167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0a9a-e3e3-4ca0-90da-a1a3a5ae0048 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:43.853502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0a9a-e3e3-4ca0-90da-a1a3a5ae0048 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:43.853816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0a9a-e3e3-4ca0-90da-a1a3a5ae0048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:43.878238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-883b0a9a-e3e3-4ca0-90da-a1a3a5ae0048 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:43.879516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-883b0a9a-e3e3-4ca0-90da-a1a3a5ae0048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:43.891992 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2669/5315] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:43.896393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc6ef-8465-4bd0-a232-bca94835f094 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:43.908528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fc6ef-8465-4bd0-a232-bca94835f094 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:43.920529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:43.922091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:43.923039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:43.923490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:43.924431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:43.924678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:43.926364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:43.940926 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2647/5316] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:43.945992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0a9a-e3e3-4ca0-90da-a1a3a5ae0048 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:43.956697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0a9a-e3e3-4ca0-90da-a1a3a5ae0048 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:43.961592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:43.962343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:43.962707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:43.963299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:43.963900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:43.966992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.009510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2670/5317] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:43 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:44.010437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.027800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061afb53-dee4-4e15-9286-a9411efc49d8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.071280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:44.136291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.137341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.137886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.139868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.140995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.144662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.173915 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2648/5318] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:44 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:44.179996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.189215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995550b9-eecb-472e-9340-c2093a8a54c1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.194356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.195061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.195413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.195648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.196410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.199507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.215539 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2671/5319] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:44.219772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.231253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c12a9-8124-4483-8e87-6eef52f68bfe admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.237137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056ed3d-5bd4-4689-9a7d-5ea7c463a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.237948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ed3d-5bd4-4689-9a7d-5ea7c463a278 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.238392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ed3d-5bd4-4689-9a7d-5ea7c463a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.238777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ed3d-5bd4-4689-9a7d-5ea7c463a278 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.239614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056ed3d-5bd4-4689-9a7d-5ea7c463a278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.242230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056ed3d-5bd4-4689-9a7d-5ea7c463a278 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.257159 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2649/5320] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:44.258992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.269729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ed72e-a615-4c3b-ac79-d89a218c3581 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.277114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.278256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.278400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.278613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] PATH_INFO: `/v3/projects/881a39254da74497824af8a9bfac996b/users/bdac31bb5b9b4ea7b31e65637c7d77e1/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.295715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881a39254da74497824af8a9bfac996b, user_id=bdac31bb5b9b4ea7b31e65637c7d77e1, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.298537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.315935 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2672/5321] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:44 2022] PUT /identity/v3/projects/881a39254da74497824af8a9bfac996b/users/bdac31bb5b9b4ea7b31e65637c7d77e1/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:44.328149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561e14-3f62-4d12-8bac-31f2151b592e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.328431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561e14-3f62-4d12-8bac-31f2151b592e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.328709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561e14-3f62-4d12-8bac-31f2151b592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.357791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-af561e14-3f62-4d12-8bac-31f2151b592e None None] MFA Rules not processed for user `bdac31bb5b9b4ea7b31e65637c7d77e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:44.358765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-af561e14-3f62-4d12-8bac-31f2151b592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:44.468856 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2650/5322] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:44.469085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.644600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deb014-31cb-4b3b-938b-d37027bf5117 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.650814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.651662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.651941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.652325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.653135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.655363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.698411 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2673/5323] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:44 2022] POST /identity/v3/projects => generated 365 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:44.705004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af561e14-3f62-4d12-8bac-31f2151b592e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.721137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af561e14-3f62-4d12-8bac-31f2151b592e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.825864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.826682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.827418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.828182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.829863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.832040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.879321 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2651/5324] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:44 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:44.884789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.897023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f2a0-d386-4329-a741-112a2159b4d8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.902937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.903910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.904247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.904480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.905256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.906904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.930181 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2674/5325] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:44.931602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.942972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244b586-3f9c-42c9-8e05-d95c76b7c8a3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:44.954571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fc45a-cee3-4636-a77d-fbab5af151f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:44.955650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fc45a-cee3-4636-a77d-fbab5af151f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:44.956315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fc45a-cee3-4636-a77d-fbab5af151f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:44.956847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fc45a-cee3-4636-a77d-fbab5af151f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:44.957891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fc45a-cee3-4636-a77d-fbab5af151f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:44.959814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fc45a-cee3-4636-a77d-fbab5af151f7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:44.973452 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2652/5326] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:44.977367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:44.996275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71e134-fe43-4658-bce6-11d718e84329 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:45.020910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:45.022245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:45.023116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:45.023357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] PATH_INFO: `/v3/projects/11c8cd7a70d2430ab23a6f63cc5e2aea/users/4436f342b3c84484bcae51885fe31a54/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:45.040865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:45.075111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c8cd7a70d2430ab23a6f63cc5e2aea, user_id=4436f342b3c84484bcae51885fe31a54, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:45.078442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:45.126773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afaed7-d319-4e03-aed6-486c243d4587 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:45.127298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afaed7-d319-4e03-aed6-486c243d4587 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:45.127733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afaed7-d319-4e03-aed6-486c243d4587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:45.129411 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2675/5327] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:44 2022] PUT /identity/v3/projects/11c8cd7a70d2430ab23a6f63cc5e2aea/users/4436f342b3c84484bcae51885fe31a54/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:45.135821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:45.160169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a1afaed7-d319-4e03-aed6-486c243d4587 None None] MFA Rules not processed for user `4436f342b3c84484bcae51885fe31a54`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:45.161957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1afaed7-d319-4e03-aed6-486c243d4587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:45.246486 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2653/5328] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:45.261967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:45.264047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:45.339333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a94c7-85fd-4fcf-be9c-a8e2e2197d1b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:45.343601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:45.344289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:45.344696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:45.344989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:45.416746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:45.418542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:45.441283 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2676/5329] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:45.582891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afaed7-d319-4e03-aed6-486c243d4587 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:45.596501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afaed7-d319-4e03-aed6-486c243d4587 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:45.605749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faca914-ed34-4fa0-92cb-8a526f5ee121 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:45.608594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca914-ed34-4fa0-92cb-8a526f5ee121 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:45.617518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca914-ed34-4fa0-92cb-8a526f5ee121 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:45.618801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca914-ed34-4fa0-92cb-8a526f5ee121 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:45.646068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faca914-ed34-4fa0-92cb-8a526f5ee121 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:45.649544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faca914-ed34-4fa0-92cb-8a526f5ee121 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:45.679102 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2654/5330] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:47.573792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:47.685775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d5223-e15e-4fe6-a14e-cd049472fd05 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:47.708044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:47.709294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:47.709736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:47.710297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] PATH_INFO: `/v3/users/bdac31bb5b9b4ea7b31e65637c7d77e1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:47.711871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdac31bb5b9b4ea7b31e65637c7d77e1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:47.714086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:47.800493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:47.808471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdac31bb5b9b4ea7b31e65637c7d77e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:47.810277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdac31bb5b9b4ea7b31e65637c7d77e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:47.848963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdac31bb5b9b4ea7b31e65637c7d77e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:47.849763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdac31bb5b9b4ea7b31e65637c7d77e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:47.884585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdac31bb5b9b4ea7b31e65637c7d77e1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:47.913486 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2677/5331] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:47 2022] DELETE /identity/v3/users/bdac31bb5b9b4ea7b31e65637c7d77e1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:47.918416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cecccb-1bf7-4689-b82d-1f501e8b7c53 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:47.918994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cecccb-1bf7-4689-b82d-1f501e8b7c53 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:47.918994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cecccb-1bf7-4689-b82d-1f501e8b7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:47.970115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-37cecccb-1bf7-4689-b82d-1f501e8b7c53 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:47.977311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-37cecccb-1bf7-4689-b82d-1f501e8b7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:48.106595 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2655/5332] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:48.171197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:48.173121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:48.295364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a411c5-9cb0-47eb-a701-6e4e7d6a73ca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:48.305286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:48.306039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:48.306328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:48.306607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:48.317938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:48.319409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:48.333665 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2678/5333] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:48.968627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cecccb-1bf7-4689-b82d-1f501e8b7c53 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:48.982245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cecccb-1bf7-4689-b82d-1f501e8b7c53 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:48.988056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:48.989739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:48.990039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:48.990314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:49.000695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:49.034448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:49.036167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:49.056554 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2656/5334] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:50.331097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:50.332323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:50.364909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f94b35-89f8-49f9-82fa-d75be8ec24aa service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:50.378098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:50.379247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:50.379529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:50.380274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] PATH_INFO: `/v3/projects/881a39254da74497824af8a9bfac996b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:50.382339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=881a39254da74497824af8a9bfac996b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:50.385731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:50.487914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881a39254da74497824af8a9bfac996b', 'request_id': 'req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.497589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881a39254da74497824af8a9bfac996b', 'request_id': 'req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.520807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881a39254da74497824af8a9bfac996b', 'request_id': 'req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.536374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] The token cache is being invalidate because project 881a39254da74497824af8a9bfac996b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:50.537388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.539514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.547608 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2679/5335] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:50 2022] DELETE /identity/v3/projects/881a39254da74497824af8a9bfac996b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:50.548619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:50.568139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ae05-57a2-4472-a090-465346379f84 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:50.661844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:50.662758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:50.663041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:50.663321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] PATH_INFO: `/v3/users/4436f342b3c84484bcae51885fe31a54` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:50.665436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4436f342b3c84484bcae51885fe31a54)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:50.667400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:50.684443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:50.767766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4436f342b3c84484bcae51885fe31a54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.768859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4436f342b3c84484bcae51885fe31a54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.807781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4436f342b3c84484bcae51885fe31a54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.808657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4436f342b3c84484bcae51885fe31a54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.819818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4436f342b3c84484bcae51885fe31a54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:50.840350 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2657/5336] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:50 2022] DELETE /identity/v3/users/4436f342b3c84484bcae51885fe31a54 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:51.714797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:51.717511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:51.742420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ebe5-34d3-487a-ac72-4e64fb4fb11b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:51.846935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:51.883599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:51.886220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:51.886723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:51.888265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:51.888616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:51.888909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] PATH_INFO: `/v3/users/d268540c4310408b82d0997a45727183` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:51.890837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d268540c4310408b82d0997a45727183)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:51.894108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:51.915931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7aa36-c442-467b-b128-70c61ca0d4f1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:51.929350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:51.931336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:51.931842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:51.934511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] PATH_INFO: `/v3/projects/11c8cd7a70d2430ab23a6f63cc5e2aea` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:51.948724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c8cd7a70d2430ab23a6f63cc5e2aea)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:51.953139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.013987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd268540c4310408b82d0997a45727183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.017825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd268540c4310408b82d0997a45727183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.058586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd268540c4310408b82d0997a45727183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.059683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd268540c4310408b82d0997a45727183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.069766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bb3c1b0-8b5b-482f-84e9-031275abcb1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd268540c4310408b82d0997a45727183'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.105344 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2680/5337] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:51 2022] DELETE /identity/v3/users/d268540c4310408b82d0997a45727183 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:52.111588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.113211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.113776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.114548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c8cd7a70d2430ab23a6f63cc5e2aea', 'request_id': 'req-c9fc1839-524a-4190-afa6-b479e353526b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.129950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c8cd7a70d2430ab23a6f63cc5e2aea', 'request_id': 'req-c9fc1839-524a-4190-afa6-b479e353526b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.151376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c8cd7a70d2430ab23a6f63cc5e2aea', 'request_id': 'req-c9fc1839-524a-4190-afa6-b479e353526b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.171602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] The token cache is being invalidate because project 11c8cd7a70d2430ab23a6f63cc5e2aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:52.172026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.173404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c9fc1839-524a-4190-afa6-b479e353526b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:52.173571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:52.175286 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2658/5338] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:51 2022] DELETE /identity/v3/projects/11c8cd7a70d2430ab23a6f63cc5e2aea => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:52.175994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:52.184633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00984-d9e5-4a0b-b64f-3529670cdbec None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.185191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00984-d9e5-4a0b-b64f-3529670cdbec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.185658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a00984-d9e5-4a0b-b64f-3529670cdbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.226936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b0a00984-d9e5-4a0b-b64f-3529670cdbec None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:52.228202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b0a00984-d9e5-4a0b-b64f-3529670cdbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:52.306592 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2681/5339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:52.327885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.329844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:52.339836 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2659/5340] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:52.341503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331b30-44f8-4532-9871-2b04985d5f76 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.341800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331b30-44f8-4532-9871-2b04985d5f76 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.342083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331b30-44f8-4532-9871-2b04985d5f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.368585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-aa331b30-44f8-4532-9871-2b04985d5f76 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:52.370402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aa331b30-44f8-4532-9871-2b04985d5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:52.386015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2660/5341] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:52.387131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331b30-44f8-4532-9871-2b04985d5f76 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.393964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:52.401238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331b30-44f8-4532-9871-2b04985d5f76 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.414361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.415184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.416382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.418013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.420071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:52.421947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.424599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.498789 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2661/5342] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:52.500287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.501543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9405d1a-1c97-4496-9e5c-9e3f26a7380d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.507603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.508522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.508902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.509299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.516396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617eb4f-beb0-4c84-a2ea-a5abb956f013 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.527493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.528499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.530713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.531307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.532347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.533200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.535050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.537276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.568067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2682/5343] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:21:52.622589 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2662/5344] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:52 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:52.623603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.636156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e22f07-a085-446a-b9c8-1c06ba1cfa9d service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.641975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:52.729557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.730259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.733096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.733481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.736299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.739382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.775868 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2683/5345] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:52 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:21:52.780633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.796633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6668c-f43f-4e04-bade-404e66e8fb7b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.804244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.805224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.805515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.805800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.806610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.808527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.825649 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2663/5346] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:52.827171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.838933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb74b1-c30f-4bf9-8834-1f99afbeda2e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.845656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.846603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.846854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.847136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.847932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.849609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.868645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.869892 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2684/5347] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:52.885219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc0924-9cbe-4558-9ab1-3c4bac5f8f5e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.895437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518eb15-25ca-4953-a98e-cbcf99e43468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.897149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518eb15-25ca-4953-a98e-cbcf99e43468 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.897496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518eb15-25ca-4953-a98e-cbcf99e43468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.898047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518eb15-25ca-4953-a98e-cbcf99e43468 admin admin] PATH_INFO: `/v3/projects/260ff9647d6040e7873ec040ce917805/users/d3ae6a1d9647444ab352cd662139fb8d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.910606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:52.912639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:52.936873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518eb15-25ca-4953-a98e-cbcf99e43468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260ff9647d6040e7873ec040ce917805, user_id=d3ae6a1d9647444ab352cd662139fb8d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.940359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275741d-bff1-436d-8eac-bee7185fdb70 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:52.940533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518eb15-25ca-4953-a98e-cbcf99e43468 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.948026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:52.949298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.949587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.949827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] PATH_INFO: `/v3/projects/2233a4d6e803414fa4f54ad04e66a077` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:52.951280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2233a4d6e803414fa4f54ad04e66a077)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:52.953728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:52.965195 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2664/5348] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:52 2022] PUT /identity/v3/projects/260ff9647d6040e7873ec040ce917805/users/d3ae6a1d9647444ab352cd662139fb8d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:52.975218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:52.975556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:52.975959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.010557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] MFA Rules not processed for user `d3ae6a1d9647444ab352cd662139fb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:53.012089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:53.057084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2233a4d6e803414fa4f54ad04e66a077', 'request_id': 'req-dc81b660-30cd-4f86-a0aa-cc36a20e3060'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:53.065921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2233a4d6e803414fa4f54ad04e66a077', 'request_id': 'req-dc81b660-30cd-4f86-a0aa-cc36a20e3060'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:53.077532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2233a4d6e803414fa4f54ad04e66a077', 'request_id': 'req-dc81b660-30cd-4f86-a0aa-cc36a20e3060'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:53.097824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] The token cache is being invalidate because project 2233a4d6e803414fa4f54ad04e66a077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:53.098379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:53.100192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dc81b660-30cd-4f86-a0aa-cc36a20e3060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:53.103821 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2685/5349] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:52 2022] DELETE /identity/v3/projects/2233a4d6e803414fa4f54ad04e66a077 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:21:53.108537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeaeb7-56e6-4b94-8e8c-6f333776c0d5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.108979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeaeb7-56e6-4b94-8e8c-6f333776c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.109289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeaeb7-56e6-4b94-8e8c-6f333776c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.134050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cadeaeb7-56e6-4b94-8e8c-6f333776c0d5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:53.135312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cadeaeb7-56e6-4b94-8e8c-6f333776c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:53.154893 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2665/5350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:53.166142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:53.168567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:53.229954 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2686/5351] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:53.239405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f028-edd4-41d1-8671-59a41f9ee3c7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.239868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f028-edd4-41d1-8671-59a41f9ee3c7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.240974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f028-edd4-41d1-8671-59a41f9ee3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.270055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cea6f028-edd4-41d1-8671-59a41f9ee3c7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:53.271516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cea6f028-edd4-41d1-8671-59a41f9ee3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:53.285273 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2687/5352] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:53.286368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f028-edd4-41d1-8671-59a41f9ee3c7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:53.292490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:53.301088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f028-edd4-41d1-8671-59a41f9ee3c7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:53.308178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:53.309420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.309982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.311010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.312033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:53.312598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:53.314988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:53.330874 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2688/5353] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:53.335574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1500-8ede-490b-82a9-71547a8006f7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:53.335883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:53.350865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19c795-ed58-4893-ae6f-9cd8ab3d5edd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:53.356349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:53.357665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.358055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.359382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.360212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:53.362349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:53.427840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2689/5354] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:53 2022] POST /identity/v3/projects => generated 359 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:53.429499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:53.435169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:53.463518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:53.464228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.464585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.464886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.562309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296f62a-1e41-4bed-8d81-29c540b80790 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:53.572179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:53.578355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.578784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.579179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.579906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:53.582844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:53.620941 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2690/5355] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:53 2022] POST /identity/v3/users => generated 280 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:53.626266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:53.627960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:53.630145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:53.639972 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2666/5356] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:21:53.643454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda1ca7-a842-415e-aa81-e55cab1b1726 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:53.650208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:53.650947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.651227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.651497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.652680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:53.655202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:53.672676 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2691/5357] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:53.677245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:53.692851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487f92b-40c9-4e99-bdc3-c52217ec09b8 service glance] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:53.710567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f13de6-ad49-42b9-8fa6-5361d2e67cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:53.711291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13de6-ad49-42b9-8fa6-5361d2e67cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.711604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13de6-ad49-42b9-8fa6-5361d2e67cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.711869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13de6-ad49-42b9-8fa6-5361d2e67cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.713339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f13de6-ad49-42b9-8fa6-5361d2e67cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:53.715077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f13de6-ad49-42b9-8fa6-5361d2e67cf5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:53.731013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2667/5358] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:53.735524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:53.766532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c26aa-2292-4b07-b5a9-ef361fdbdbd6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:53.780506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:53.782885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.783249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.783619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] PATH_INFO: `/v3/projects/029e41b7560f4b50baa181a6edef5af4/users/d9ed35ae53db4614b84e7078e52269eb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.820372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] RBAC: Authorizing `identity:create_grant(project_id=029e41b7560f4b50baa181a6edef5af4, user_id=d9ed35ae53db4614b84e7078e52269eb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:53.824168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:53.845392 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2692/5359] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:53 2022] PUT /identity/v3/projects/029e41b7560f4b50baa181a6edef5af4/users/d9ed35ae53db4614b84e7078e52269eb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:53.858354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:53.858721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:53.859009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:53.913414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] MFA Rules not processed for user `d9ed35ae53db4614b84e7078e52269eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:53.914727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:54.065261 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2668/5360] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:53 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:54.072586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:54.078259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:54.200268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cddc4-80cb-4899-8b4c-a33a6a21811e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:54.209316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f3515-9c1b-467d-b343-bb46b426bf02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:54.212659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f3515-9c1b-467d-b343-bb46b426bf02 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:54.214121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f3515-9c1b-467d-b343-bb46b426bf02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:54.215517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f3515-9c1b-467d-b343-bb46b426bf02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:54.237707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f3515-9c1b-467d-b343-bb46b426bf02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:54.241354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f3515-9c1b-467d-b343-bb46b426bf02 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:54.255387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2693/5361] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:54.673299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:54.676449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:54.861655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8fe8d-7bc3-484d-b894-9bb32b776beb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:54.876709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:54.877810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:54.878199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:54.878379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] PATH_INFO: `/v3/users/d3ae6a1d9647444ab352cd662139fb8d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:54.880242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ae6a1d9647444ab352cd662139fb8d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:54.882283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:54.912800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:54.991858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ae6a1d9647444ab352cd662139fb8d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:54.993096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ae6a1d9647444ab352cd662139fb8d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:55.026356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ae6a1d9647444ab352cd662139fb8d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:55.028705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ae6a1d9647444ab352cd662139fb8d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:55.046950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ae6a1d9647444ab352cd662139fb8d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:55.077643 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2669/5362] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:21:54 2022] DELETE /identity/v3/users/d3ae6a1d9647444ab352cd662139fb8d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:55.084274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:55.084768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:55.084881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:55.128218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:55.132378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:55.172333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:55.252242 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2694/5363] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:55.278449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:55.286519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:55.506266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edff9f-dc2d-419f-97a0-e9fdd57ec164 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:55.523393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abef49-61fa-4994-bf5e-009477898c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:55.524406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abef49-61fa-4994-bf5e-009477898c0e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:55.524867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abef49-61fa-4994-bf5e-009477898c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:55.525289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abef49-61fa-4994-bf5e-009477898c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:55.548353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abef49-61fa-4994-bf5e-009477898c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:55.548353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abef49-61fa-4994-bf5e-009477898c0e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:55.600459 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2670/5364] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:56.551011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:56.553495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:56.583403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2539bc-8087-4771-a5b8-d606ccfdbdc8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:56.589857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:56.591529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:56.594020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:56.594556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] PATH_INFO: `/v3/projects/260ff9647d6040e7873ec040ce917805` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:56.596338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260ff9647d6040e7873ec040ce917805)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:56.599617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:56.706371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260ff9647d6040e7873ec040ce917805', 'request_id': 'req-10d44a69-fbe6-4414-b092-3f88ccde3a53'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:56.737830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260ff9647d6040e7873ec040ce917805', 'request_id': 'req-10d44a69-fbe6-4414-b092-3f88ccde3a53'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:56.797109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260ff9647d6040e7873ec040ce917805', 'request_id': 'req-10d44a69-fbe6-4414-b092-3f88ccde3a53'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:56.818931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] The token cache is being invalidate because project 260ff9647d6040e7873ec040ce917805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:21:56.820508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:56.822625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-10d44a69-fbe6-4414-b092-3f88ccde3a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:21:56.825270 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2695/5365] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:21:56 2022] DELETE /identity/v3/projects/260ff9647d6040e7873ec040ce917805 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:56.831788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a4e64-1847-4389-9f1a-52dbe88043b7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:56.833601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a4e64-1847-4389-9f1a-52dbe88043b7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:56.833988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a4e64-1847-4389-9f1a-52dbe88043b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:56.871752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df572f-9ffc-4cb0-82af-e6e4fcf6e405 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:56.872232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df572f-9ffc-4cb0-82af-e6e4fcf6e405 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:56.872608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df572f-9ffc-4cb0-82af-e6e4fcf6e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:56.878851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e66a4e64-1847-4389-9f1a-52dbe88043b7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:56.880353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e66a4e64-1847-4389-9f1a-52dbe88043b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:56.931534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-41df572f-9ffc-4cb0-82af-e6e4fcf6e405 None None] MFA Rules not processed for user `caa130c208d44d798cb0a5ba41193976`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:56.933399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-41df572f-9ffc-4cb0-82af-e6e4fcf6e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:57.034843 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2671/5366] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:57.051148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2ca9-47ed-47f9-8a6f-a126bb35992c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.051622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2ca9-47ed-47f9-8a6f-a126bb35992c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.052151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2ca9-47ed-47f9-8a6f-a126bb35992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.086446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e30a2ca9-47ed-47f9-8a6f-a126bb35992c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:57.090665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e30a2ca9-47ed-47f9-8a6f-a126bb35992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:57.124706 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2696/5367] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:57.129231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2672/5368] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:57.147869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df572f-9ffc-4cb0-82af-e6e4fcf6e405 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:57.183860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df572f-9ffc-4cb0-82af-e6e4fcf6e405 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:57.199747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:57.201467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.203150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.203543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.206221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:21:57.206750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:57.209310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:57.226570 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2697/5369] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:21:57.230997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2ca9-47ed-47f9-8a6f-a126bb35992c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:57.241808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2ca9-47ed-47f9-8a6f-a126bb35992c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:57.251581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:57.252406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.252684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.253103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.254983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:57.256287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:57.307198 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2673/5370] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:57 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:57.311606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:57.329407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1980fe9-d04e-41c9-b370-ecc24b7c1f31 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:57.397280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:57.450384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:57.451177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.451538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.451904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.452847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:57.455197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:57.483113 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2698/5371] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:57 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:57.487127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:57.505739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1ca89-10dc-4b5e-8277-6eb1c25570aa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:57.513788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:57.517569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.521874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.522716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.524919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:57.531674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:57.534415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:57.552494 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2674/5372] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:57.556028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:57.577385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b2cd0-a2ca-4fa9-9dcf-7de707c3e8b8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:57.583366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697ad2b-7ed9-4ed1-9544-1233d69f8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:57.584529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ad2b-7ed9-4ed1-9544-1233d69f8513 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.585337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ad2b-7ed9-4ed1-9544-1233d69f8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.585744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ad2b-7ed9-4ed1-9544-1233d69f8513 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.586547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697ad2b-7ed9-4ed1-9544-1233d69f8513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:57.590482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697ad2b-7ed9-4ed1-9544-1233d69f8513 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:57.621178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2699/5373] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:21:57.628197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:57.641485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a8ec0-8c1a-464d-936b-ed74589e8deb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:57.655049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:57.655972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.656249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.656520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] PATH_INFO: `/v3/projects/5918f213b5994b7ab21f98b8fd5c6b2b/users/45b3686e3c5b4fc9aedf6820e8da8f64/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.688742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5918f213b5994b7ab21f98b8fd5c6b2b, user_id=45b3686e3c5b4fc9aedf6820e8da8f64, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:57.695598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:57.726262 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2675/5374] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:57 2022] PUT /identity/v3/projects/5918f213b5994b7ab21f98b8fd5c6b2b/users/45b3686e3c5b4fc9aedf6820e8da8f64/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:57.737647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7801-662e-4c92-9b77-65c54f477ba8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:57.738278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7801-662e-4c92-9b77-65c54f477ba8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:57.738624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7801-662e-4c92-9b77-65c54f477ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:57.774718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-099a7801-662e-4c92-9b77-65c54f477ba8 None None] MFA Rules not processed for user `45b3686e3c5b4fc9aedf6820e8da8f64`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:57.776786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-099a7801-662e-4c92-9b77-65c54f477ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:57.876902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2700/5375] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:21:57.878154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:57.996776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e2c43-8c9d-4b51-a6e2-474b5f006656 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:58.004560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:58.005740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:58.006180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:58.006897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:58.008131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:58.010375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:58.091178 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2676/5376] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:21:57 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:58.096065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7801-662e-4c92-9b77-65c54f477ba8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:58.115917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7801-662e-4c92-9b77-65c54f477ba8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:58.232590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:58.233596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:58.234412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:58.234698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:58.235400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:58.237397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:58.272776 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2701/5377] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:21:58 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:21:58.276431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:58.296608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0a0f8-85aa-4f61-83fe-d735c3544c3e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:58.309850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:58.311960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:58.312423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:58.313166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:58.317152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:58.319780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:58.335359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2677/5378] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:58.340238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:58.358232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74502960-bc98-47ad-a6a2-cb0f2cd37670 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:58.365525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:58.366851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:58.367371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:58.367852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] PATH_INFO: `/v3/projects/396aae7db4a8440ebe7670c591f44223/users/311dcc88ee0c409d992fdaf3c3dc092b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:58.423900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396aae7db4a8440ebe7670c591f44223, user_id=311dcc88ee0c409d992fdaf3c3dc092b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:58.428051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:58.461999 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2702/5379] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:58 2022] PUT /identity/v3/projects/396aae7db4a8440ebe7670c591f44223/users/311dcc88ee0c409d992fdaf3c3dc092b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:58.466043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:58.481617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f19e3-ea70-4aa4-b413-f24d4ce7fd04 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:58.573110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd664870-49b2-4864-8c86-80367417b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:58.574675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd664870-49b2-4864-8c86-80367417b034 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:58.575156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd664870-49b2-4864-8c86-80367417b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:58.576440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd664870-49b2-4864-8c86-80367417b034 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:58.578066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd664870-49b2-4864-8c86-80367417b034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:58.580279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd664870-49b2-4864-8c86-80367417b034 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:58.618541 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2678/5380] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:21:58.620932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:58.632342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:58.637829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc736d-e92a-4846-94c6-dface0acbb21 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:58.644799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:58.645836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:58.646177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:58.646511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] PATH_INFO: `/v3/projects/396aae7db4a8440ebe7670c591f44223/users/311dcc88ee0c409d992fdaf3c3dc092b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:58.648762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396aae7db4a8440ebe7670c591f44223, user_id=311dcc88ee0c409d992fdaf3c3dc092b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:58.652090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:58.664078 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2703/5381] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:21:58 2022] PUT /identity/v3/projects/396aae7db4a8440ebe7670c591f44223/users/311dcc88ee0c409d992fdaf3c3dc092b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:21:58.675655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:58.676073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:58.676448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:58.753044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] MFA Rules not processed for user `311dcc88ee0c409d992fdaf3c3dc092b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:58.755417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:58.825650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:58.932220 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2679/5382] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:21:58.971257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:58.973474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:58.982110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:21:58.984824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:59.154198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae26ce-172e-4449-852f-e411fe501995 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:59.170707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705689c2-b9bd-4e44-9f25-cb10bdf556bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:59.171506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705689c2-b9bd-4e44-9f25-cb10bdf556bd service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:59.171926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705689c2-b9bd-4e44-9f25-cb10bdf556bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:59.172278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705689c2-b9bd-4e44-9f25-cb10bdf556bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:59.183319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9d856-fb9f-4c41-92b6-9474f87a1d21 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:21:59.193860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705689c2-b9bd-4e44-9f25-cb10bdf556bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:59.196031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:21:59.196211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705689c2-b9bd-4e44-9f25-cb10bdf556bd service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:59.197747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:59.198111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:59.198507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:59.202492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:59.222200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:21:59.224960 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2680/5383] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:59.228432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:21:59.267811 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2704/5384] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:21:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:21:59.695383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94168385-375a-49bd-a441-26cd7af3a8e7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:21:59.695877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94168385-375a-49bd-a441-26cd7af3a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:21:59.696181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94168385-375a-49bd-a441-26cd7af3a8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:21:59.727953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-94168385-375a-49bd-a441-26cd7af3a8e7 None None] MFA Rules not processed for user `8d81ad22e9434bff9b01fb434231428f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:21:59.729693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-94168385-375a-49bd-a441-26cd7af3a8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:21:59.839585 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2681/5385] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:21:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:04.828069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:04.830532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:05.074763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf080f4-b286-4c25-98d9-760c3282af53 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:05.081911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:05.082785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:05.083331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:05.083612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:05.085627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:05.103299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:05.105717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:05.125537 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2705/5386] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:09.826197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=70 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:12.816423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94168385-375a-49bd-a441-26cd7af3a8e7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:12.856069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94168385-375a-49bd-a441-26cd7af3a8e7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:12.880124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311dcc88ee0c409d992fdaf3c3dc092b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396aae7db4a8440ebe7670c591f44223', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:12.880833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:12.889922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:12.890245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:12.891030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:22:12.891344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:12.898685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:12.934976 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2682/5387] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:22:12.938779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:12.954532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6991e-151d-4f52-a7ce-a01cf2f3fd9d service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:12.968609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311dcc88ee0c409d992fdaf3c3dc092b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396aae7db4a8440ebe7670c591f44223', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:12.969326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:12.969613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:12.969892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:12.970604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:12.972514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:13.015314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2706/5388] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:22:12 2022] POST /identity/v3/projects => generated 348 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:22:13.019508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:13.034627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb97a0b-2525-4550-91d2-0b6c85e80b0d tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:13.143206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311dcc88ee0c409d992fdaf3c3dc092b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396aae7db4a8440ebe7670c591f44223', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:13.143896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:13.144182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:13.144465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:13.146294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:22:13.146617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:13.148382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:13.163484 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2683/5389] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:22:13.881798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:13.898090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf49c5-11ec-41c1-a039-f29cdc101bbd tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:13.908053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311dcc88ee0c409d992fdaf3c3dc092b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396aae7db4a8440ebe7670c591f44223', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:13.909455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:13.909881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:13.910395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] PATH_INFO: `/v3/projects/a872b34f439446a69e6e643fb281054f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:13.912029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a872b34f439446a69e6e643fb281054f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:13.914931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:13.963065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:14.119156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a872b34f439446a69e6e643fb281054f', 'request_id': 'req-12fa34d7-8005-44fd-8b83-1d036c34bad7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:14.129017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a872b34f439446a69e6e643fb281054f', 'request_id': 'req-12fa34d7-8005-44fd-8b83-1d036c34bad7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:14.142369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a872b34f439446a69e6e643fb281054f', 'request_id': 'req-12fa34d7-8005-44fd-8b83-1d036c34bad7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:14.159254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] The token cache is being invalidate because project a872b34f439446a69e6e643fb281054f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:22:14.159548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:14.160263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:14.168919 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2707/5390] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:22:13 2022] DELETE /identity/v3/projects/a872b34f439446a69e6e643fb281054f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:22:14.188618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:14.191488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:14.358132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb7d75-1af2-4011-be6d-bae2d131da9b tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:14.421335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:14.423000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:14.471456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:14.473350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:14.473638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:14.474777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:14.479049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:14.592101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:14.611540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:14.616143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:14.616351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa34d7-8005-44fd-8b83-1d036c34bad7 tempest-RoutersAdminTest-1097803674 tempest-RoutersAdminTest-1097803674-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:14.639464 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2684/5391] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:14.641223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:14.641910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:14.642177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:14.642444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:14.644323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:14.666209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:14.668103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:14.689088 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2708/5392] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:22:19.242004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:19.246222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:19.419269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9975a-115a-40b5-af18-62793492f682 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:19.423912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:19.424872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:19.425278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:19.425791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] PATH_INFO: `/v3/users/20c4f7872035427d9bfb6a6ecfb7a0da` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:19.427701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c4f7872035427d9bfb6a6ecfb7a0da)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:19.430200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:19.497359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c4f7872035427d9bfb6a6ecfb7a0da'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:19.498047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c4f7872035427d9bfb6a6ecfb7a0da'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:19.512306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c4f7872035427d9bfb6a6ecfb7a0da'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:19.513016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c4f7872035427d9bfb6a6ecfb7a0da'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:19.519989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-866571a7-d544-468d-95a5-1d8987c54dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c4f7872035427d9bfb6a6ecfb7a0da'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:19.534126 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2685/5393] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:22:19 2022] DELETE /identity/v3/users/20c4f7872035427d9bfb6a6ecfb7a0da => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:22:19.759518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:19.778091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45498d6b-6f10-43c7-9c30-d8761d01e6a4 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:19.890309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:19.891213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:19.891497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:19.891780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] PATH_INFO: `/v3/projects/28c54796fc944347a190465d4c0732a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:19.893002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c54796fc944347a190465d4c0732a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:19.894962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:19.978557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:20.016600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c54796fc944347a190465d4c0732a8', 'request_id': 'req-768c4f54-603d-4909-ba47-5c7d50bb7262'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:20.035539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c54796fc944347a190465d4c0732a8', 'request_id': 'req-768c4f54-603d-4909-ba47-5c7d50bb7262'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:20.051037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c54796fc944347a190465d4c0732a8', 'request_id': 'req-768c4f54-603d-4909-ba47-5c7d50bb7262'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:20.071754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] The token cache is being invalidate because project 28c54796fc944347a190465d4c0732a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:22:20.072672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:20.075234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-768c4f54-603d-4909-ba47-5c7d50bb7262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:20.077844 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2709/5394] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:22:19 2022] DELETE /identity/v3/projects/28c54796fc944347a190465d4c0732a8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:22:20.083099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875a13-5744-4847-bad4-86e6d74b9c9e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.083620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875a13-5744-4847-bad4-86e6d74b9c9e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.084149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875a13-5744-4847-bad4-86e6d74b9c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.118842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6f875a13-5744-4847-bad4-86e6d74b9c9e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:20.121363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6f875a13-5744-4847-bad4-86e6d74b9c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:20.244739 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2686/5395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:20.252088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e93b4-c04e-4a0c-98f4-5ff2038c55f6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.252384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e93b4-c04e-4a0c-98f4-5ff2038c55f6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.252665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e93b4-c04e-4a0c-98f4-5ff2038c55f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.275222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-231e93b4-c04e-4a0c-98f4-5ff2038c55f6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:20.276500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-231e93b4-c04e-4a0c-98f4-5ff2038c55f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:20.287331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2710/5396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:20.292463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875a13-5744-4847-bad4-86e6d74b9c9e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:20.307092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875a13-5744-4847-bad4-86e6d74b9c9e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:20.317113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:20.318209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.319400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.319799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.320790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:22:20.321593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:20.324791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:20.336865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:20.345978 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2687/5397] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:22:20.354335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e93b4-c04e-4a0c-98f4-5ff2038c55f6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:20.370767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e93b4-c04e-4a0c-98f4-5ff2038c55f6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:20.376984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:20.377803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.378787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.379070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.379790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:20.381836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:20.451029 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2711/5398] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:22:20 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:22:20.470531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:20.485971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7837cd8-a66b-473f-857f-84247f67d1c3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:20.604853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:20.605516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.605803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.606087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.606821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:20.608775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:20.640670 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2688/5399] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:22:20 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:22:20.645039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:20.662429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8dea4-6527-47b6-af2e-5da967cbb91c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:20.668143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:20.669070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.669070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.669259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.671516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:20.671761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:20.691851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:20.693224 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2712/5400] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:22:20.706660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8e0e-86d7-443f-b3f5-f85717e5dc20 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:20.712444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea19d6-30d1-4498-a784-52bd5ae69837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:20.713349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea19d6-30d1-4498-a784-52bd5ae69837 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.713631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea19d6-30d1-4498-a784-52bd5ae69837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.713892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea19d6-30d1-4498-a784-52bd5ae69837 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.714909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea19d6-30d1-4498-a784-52bd5ae69837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:20.716630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea19d6-30d1-4498-a784-52bd5ae69837 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:20.728072 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2689/5401] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:22:20.732684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:20.743199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc10cb-46d3-4c0b-95cb-4434e88d5d6c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:20.751670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:20.753671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.754206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.754754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] PATH_INFO: `/v3/projects/a88cba0e44af4875b05d6c3546cf0543/users/719d3fb4f7f44c239e03b5f7076edcc8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.773654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88cba0e44af4875b05d6c3546cf0543, user_id=719d3fb4f7f44c239e03b5f7076edcc8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:20.776835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:20.797737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2713/5402] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:22:20 2022] PUT /identity/v3/projects/a88cba0e44af4875b05d6c3546cf0543/users/719d3fb4f7f44c239e03b5f7076edcc8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:22:20.800650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:20.800951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:20.801274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:20.823705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:20.825016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:20.913959 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2690/5403] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:20.957323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:20.961730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:21.086044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b324-2bc1-4478-a4c7-546e1ae344a0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:21.091380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:21.092109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:21.092563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:21.092853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:21.124080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:21.125876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:21.138765 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2714/5404] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:21.246689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:21.257824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:21.282116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148756d7-f730-48d5-bd75-fdba2073c6ea None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:21.287670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:21.288644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:21.289216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:21.289829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:21.292255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:21.320469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:21.323230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:21.334646 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2691/5405] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:22.851380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:22.852967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:22.882514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05005a9-7bff-422e-8614-8e28157dd005 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:22.892122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:22.894432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:22.895897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:22.896880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] PATH_INFO: `/v3/users/21a7cd29a3044c0d8eb886d1e3ea3bbb` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:22.901463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a7cd29a3044c0d8eb886d1e3ea3bbb)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:22.907209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:23.082561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a7cd29a3044c0d8eb886d1e3ea3bbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:23.083425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a7cd29a3044c0d8eb886d1e3ea3bbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:23.086331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:23.107256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a7cd29a3044c0d8eb886d1e3ea3bbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:23.108365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a7cd29a3044c0d8eb886d1e3ea3bbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:23.124641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9c08bb0a-09ef-4d46-b1bd-71f520f3c771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a7cd29a3044c0d8eb886d1e3ea3bbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:23.156884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2715/5406] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:22:22 2022] DELETE /identity/v3/users/21a7cd29a3044c0d8eb886d1e3ea3bbb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:22:24.798590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:24.816894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b210-d172-4cf7-97f8-f10900693fb8 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:24.986770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:24.988195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:24.988853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:24.992243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] PATH_INFO: `/v3/projects/5cc2ac33206d4b3499ce139b0ecdf356` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:24.995119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc2ac33206d4b3499ce139b0ecdf356)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:24.997797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:25.006718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:25.109498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc2ac33206d4b3499ce139b0ecdf356', 'request_id': 'req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:25.124858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc2ac33206d4b3499ce139b0ecdf356', 'request_id': 'req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:25.138710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc2ac33206d4b3499ce139b0ecdf356', 'request_id': 'req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:25.208623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] The token cache is being invalidate because project 5cc2ac33206d4b3499ce139b0ecdf356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:22:25.208623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:25.209608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3c3aa0a9-b4e3-4516-a66a-541592e4b8dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:22:25.211611 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2692/5407] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:22:24 2022] DELETE /identity/v3/projects/5cc2ac33206d4b3499ce139b0ecdf356 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:22:25.217847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715470-67e6-40ea-8e32-31a958fa345c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.220206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715470-67e6-40ea-8e32-31a958fa345c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.220733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715470-67e6-40ea-8e32-31a958fa345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.281879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-33715470-67e6-40ea-8e32-31a958fa345c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:25.283678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-33715470-67e6-40ea-8e32-31a958fa345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:25.403430 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2716/5408] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:25.411566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc9df9-7164-472e-baf3-d5b077877831 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.411909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc9df9-7164-472e-baf3-d5b077877831 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.412378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc9df9-7164-472e-baf3-d5b077877831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.447535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f6cc9df9-7164-472e-baf3-d5b077877831 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:25.448568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f6cc9df9-7164-472e-baf3-d5b077877831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:25.465441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2693/5409] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:22:25.469780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33715470-67e6-40ea-8e32-31a958fa345c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:25.485039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33715470-67e6-40ea-8e32-31a958fa345c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:25.497588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:25.499042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.499329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.499601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.503483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:22:25.503809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:25.507919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:25.536701 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2717/5410] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:22:25.541384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc9df9-7164-472e-baf3-d5b077877831 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:25.557820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc9df9-7164-472e-baf3-d5b077877831 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:25.568542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:25.569643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.570000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.570344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.571612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:25.574628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:25.619312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2694/5411] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:22:25 2022] POST /identity/v3/projects => generated 399 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:22:25.623644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:25.640374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58a679-55d2-4d25-9e28-579942cf2b08 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:25.730529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:25.730529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.730881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.731313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.732380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:25.735267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:25.770114 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2718/5412] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:22:25 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:22:25.771384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:25.787362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0c83a-7bde-49dd-b938-46af8ee3d1d0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:25.802066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:25.802789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.802789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.802999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.803740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:25.805536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:25.825447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2695/5413] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:22:25.830142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:25.842710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d959e-9864-4572-9d5f-ebd6cdf22f41 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:25.848806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656464a-ef13-4381-8732-bbf9476b8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:25.849842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656464a-ef13-4381-8732-bbf9476b8943 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.850476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656464a-ef13-4381-8732-bbf9476b8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.851877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656464a-ef13-4381-8732-bbf9476b8943 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.852886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656464a-ef13-4381-8732-bbf9476b8943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:25.854946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656464a-ef13-4381-8732-bbf9476b8943 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:25.868875 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2719/5414] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:22:25.873287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:25.886082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bb4a-bfe1-4222-b154-5b2afc8b715b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:25.892143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:25.893653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.894221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.894771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] PATH_INFO: `/v3/projects/7dc17b4ab1a149728470cc0d7d1ff38f/users/247bbe467782453385f5d7b687597fee/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.917699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc17b4ab1a149728470cc0d7d1ff38f, user_id=247bbe467782453385f5d7b687597fee, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:25.921241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:25.948645 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2696/5415] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:22:25 2022] PUT /identity/v3/projects/7dc17b4ab1a149728470cc0d7d1ff38f/users/247bbe467782453385f5d7b687597fee/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:22:25.955679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01f23-ba9d-4fa7-8a1e-b3aefb3eb047 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:25.956171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01f23-ba9d-4fa7-8a1e-b3aefb3eb047 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:25.956740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01f23-ba9d-4fa7-8a1e-b3aefb3eb047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:25.982183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e9b01f23-ba9d-4fa7-8a1e-b3aefb3eb047 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:25.983555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e9b01f23-ba9d-4fa7-8a1e-b3aefb3eb047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:26.042191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:26.095889 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2720/5416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:26.143636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:26.145775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:26.304155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb7f8-c8f1-4276-9a4a-50daa17b0381 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:26.311981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f80b87-8980-4396-bfe9-ab5a62d4c04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:26.313599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80b87-8980-4396-bfe9-ab5a62d4c04a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:26.314008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80b87-8980-4396-bfe9-ab5a62d4c04a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:26.314425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80b87-8980-4396-bfe9-ab5a62d4c04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:26.328564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80b87-8980-4396-bfe9-ab5a62d4c04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:26.330524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80b87-8980-4396-bfe9-ab5a62d4c04a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:26.352289 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2697/5417] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:27.262962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0967bd-db8b-4574-a323-1fe684e1a7d5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:27.264059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0967bd-db8b-4574-a323-1fe684e1a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:27.264595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0967bd-db8b-4574-a323-1fe684e1a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:27.302022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8e0967bd-db8b-4574-a323-1fe684e1a7d5 None None] MFA Rules not processed for user `ab975e8ffd0448939b2105aed58003fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:27.306385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e0967bd-db8b-4574-a323-1fe684e1a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:27.415884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2721/5418] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:36.339659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:37.411786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=41 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:38.815980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:38.816533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:38.816739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:38.879960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:38.881357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:38.978073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2698/5419] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:39.052126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:39.052673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:39.052921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:39.084469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:39.091834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:39.112016 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2722/5420] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:39.120539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:39.122370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:39.252241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751f96d-1e7c-41c1-a09b-9b5fe890a69a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:39.259242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:39.259930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:39.260255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:39.260538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:39.271996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:39.273695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:39.286491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2699/5421] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:39.841356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:39.843148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:39.858694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:39.860194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:39.880607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547af040-71ab-423e-b74d-22260a1ff53a service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:39.890444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac4d45-1ba9-4bca-a4e7-4f6aab0ec6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:39.891518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d45-1ba9-4bca-a4e7-4f6aab0ec6ba service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:39.891518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d45-1ba9-4bca-a4e7-4f6aab0ec6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:39.891702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d45-1ba9-4bca-a4e7-4f6aab0ec6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:39.902074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-29ac4d45-1ba9-4bca-a4e7-4f6aab0ec6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:39.908915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d5ce9-284d-464b-a6ee-d58cc2a07951 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:39.924705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac4d45-1ba9-4bca-a4e7-4f6aab0ec6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:39.926272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac4d45-1ba9-4bca-a4e7-4f6aab0ec6ba service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:39.928271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e67a6-22d2-41b6-b670-5891dc5c3b54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:39.929001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e67a6-22d2-41b6-b670-5891dc5c3b54 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:39.929790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e67a6-22d2-41b6-b670-5891dc5c3b54 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:39.929790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e67a6-22d2-41b6-b670-5891dc5c3b54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:39.943969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-351e67a6-22d2-41b6-b670-5891dc5c3b54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:39.950747 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2700/5422] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:40.061302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e67a6-22d2-41b6-b670-5891dc5c3b54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:40.066161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e67a6-22d2-41b6-b670-5891dc5c3b54 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:40.091721 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2723/5423] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:40.168678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6697-655f-4bac-acc2-620ef8c436fc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:40.169089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6697-655f-4bac-acc2-620ef8c436fc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:40.169288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6697-655f-4bac-acc2-620ef8c436fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:40.221744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9a5e6697-655f-4bac-acc2-620ef8c436fc None None] MFA Rules not processed for user `247bbe467782453385f5d7b687597fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:40.223136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a5e6697-655f-4bac-acc2-620ef8c436fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:40.362308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:40.417296 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2701/5424] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:40.428810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750102a2-595d-476f-b57c-b00d28f46a82 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:40.428810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750102a2-595d-476f-b57c-b00d28f46a82 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:40.429107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750102a2-595d-476f-b57c-b00d28f46a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:40.461390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-750102a2-595d-476f-b57c-b00d28f46a82 None None] MFA Rules not processed for user `247bbe467782453385f5d7b687597fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:40.462948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-750102a2-595d-476f-b57c-b00d28f46a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:40.479696 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2724/5425] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:22:40.492234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6697-655f-4bac-acc2-620ef8c436fc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:22:40.513775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6697-655f-4bac-acc2-620ef8c436fc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:22:40.527975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:22:40.528656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:40.528935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:40.529250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:40.547770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:22:40.549868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:22:40.577748 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2702/5426] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:22:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:22:50.444526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=38 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:50.557728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:52.112152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558cc9-5bb4-4e28-92ea-cfe1e07db97b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:22:52.112620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558cc9-5bb4-4e28-92ea-cfe1e07db97b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:22:52.112704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558cc9-5bb4-4e28-92ea-cfe1e07db97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:22:52.146906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e1558cc9-5bb4-4e28-92ea-cfe1e07db97b None None] MFA Rules not processed for user `ab975e8ffd0448939b2105aed58003fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:22:52.148526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e1558cc9-5bb4-4e28-92ea-cfe1e07db97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:22:52.157977 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2725/5427] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:22:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:00.855020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:00.856606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:00.871500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9dd60-671e-4c7d-9eb0-8c17e8c54507 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:00.877116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:00.878021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:00.878307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:00.878589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] PATH_INFO: `/v3/users/d9ed35ae53db4614b84e7078e52269eb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:00.879928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ed35ae53db4614b84e7078e52269eb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:00.882321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:00.944258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ed35ae53db4614b84e7078e52269eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:00.944928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ed35ae53db4614b84e7078e52269eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:00.961369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ed35ae53db4614b84e7078e52269eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:00.962127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ed35ae53db4614b84e7078e52269eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:00.970357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ed35ae53db4614b84e7078e52269eb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:00.987901 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2703/5428] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:23:00 2022] DELETE /identity/v3/users/d9ed35ae53db4614b84e7078e52269eb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:00.992589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b819946-b46f-4b18-94fb-d67b99c974e2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:00.993109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b819946-b46f-4b18-94fb-d67b99c974e2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:00.993309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b819946-b46f-4b18-94fb-d67b99c974e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:01.012965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6b819946-b46f-4b18-94fb-d67b99c974e2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:01.014470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6b819946-b46f-4b18-94fb-d67b99c974e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:01.117475 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2726/5429] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:23:01.139229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:01.141398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:01.263704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde76a4-ddbe-4aa8-a572-b431fce82bae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:01.268182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:01.268855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:01.269262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:01.269694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:01.304963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:01.306626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:01.318583 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2704/5430] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:01.574475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4f0f9-9086-4ca8-9d7a-b0bade3cee86 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:01.574758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4f0f9-9086-4ca8-9d7a-b0bade3cee86 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:01.575427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4f0f9-9086-4ca8-9d7a-b0bade3cee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:01.599680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cec4f0f9-9086-4ca8-9d7a-b0bade3cee86 None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:01.601235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cec4f0f9-9086-4ca8-9d7a-b0bade3cee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:01.680407 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2727/5431] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:01.826530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:01.829161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:01.848226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f8520-c383-4ff2-b736-e5aadd56297f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:01.857859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:01.858965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:01.881610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:01.881899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] PATH_INFO: `/v3/projects/029e41b7560f4b50baa181a6edef5af4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:01.883991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029e41b7560f4b50baa181a6edef5af4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:01.885432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:01.946282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029e41b7560f4b50baa181a6edef5af4', 'request_id': 'req-26d7d592-53db-436d-b93e-c08846880dc7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:01.957720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029e41b7560f4b50baa181a6edef5af4', 'request_id': 'req-26d7d592-53db-436d-b93e-c08846880dc7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:01.967920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029e41b7560f4b50baa181a6edef5af4', 'request_id': 'req-26d7d592-53db-436d-b93e-c08846880dc7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:01.975421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:01.980941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] The token cache is being invalidate because project 029e41b7560f4b50baa181a6edef5af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:23:01.981929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:01.982654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-26d7d592-53db-436d-b93e-c08846880dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:01.988799 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2705/5432] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:23:01 2022] DELETE /identity/v3/projects/029e41b7560f4b50baa181a6edef5af4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:01.990268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fe3e-3442-4248-b394-599a456db3f8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:01.990560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fe3e-3442-4248-b394-599a456db3f8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:01.990840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fe3e-3442-4248-b394-599a456db3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.042664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d855fe3e-3442-4248-b394-599a456db3f8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:02.044387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d855fe3e-3442-4248-b394-599a456db3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:02.107866 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2728/5433] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:02.116017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d60778-a2f8-4074-8c1f-c081583530c8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.116308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d60778-a2f8-4074-8c1f-c081583530c8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.116589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d60778-a2f8-4074-8c1f-c081583530c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.139139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-49d60778-a2f8-4074-8c1f-c081583530c8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:02.140581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-49d60778-a2f8-4074-8c1f-c081583530c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:02.148929 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2706/5434] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:02.153500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fe3e-3442-4248-b394-599a456db3f8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:02.163983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fe3e-3442-4248-b394-599a456db3f8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:02.169470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:02.170159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.172353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.172653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.173771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:23:02.174085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:02.177512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:02.191397 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2729/5435] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:23:02.194681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d60778-a2f8-4074-8c1f-c081583530c8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:02.206709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d60778-a2f8-4074-8c1f-c081583530c8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:02.214704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:02.215660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.215660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.215905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.216641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:02.218594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:02.253841 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2707/5436] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:23:02 2022] POST /identity/v3/projects => generated 359 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:02.255903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:02.266708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aded24-5b24-4014-8778-a1ccc4a60ef5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:02.293600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:02.326775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:02.327456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.327737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.328010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.328695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:02.330663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:02.352398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2730/5437] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:23:02 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:02.356660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:02.367602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a24e2-3c57-4437-8ad5-0dfdd39c0a39 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:02.372952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:02.373881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.374034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.374275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.375009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:02.376596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:02.388024 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2708/5438] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:02.392362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:02.402873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfc3be-7dc6-4338-8cbe-db20326ca0b1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:02.407876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4c128-d3db-4e51-8b34-fae257996714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:02.408530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4c128-d3db-4e51-8b34-fae257996714 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.408808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4c128-d3db-4e51-8b34-fae257996714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.409105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4c128-d3db-4e51-8b34-fae257996714 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.409826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4c128-d3db-4e51-8b34-fae257996714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:02.411506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4c128-d3db-4e51-8b34-fae257996714 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:02.422803 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2731/5439] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:02.427115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:02.439716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcc5f1-eb8c-485f-bf70-aab3961569df admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:02.445067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:02.446368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.446688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.446958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] PATH_INFO: `/v3/projects/6d185d9006174eae89b8abdede1c5d7a/users/98cf2ccdb6eb46e1924eff0bfdcb1483/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.462489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d185d9006174eae89b8abdede1c5d7a, user_id=98cf2ccdb6eb46e1924eff0bfdcb1483, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:02.465174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:02.480724 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2709/5440] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:23:02 2022] PUT /identity/v3/projects/6d185d9006174eae89b8abdede1c5d7a/users/98cf2ccdb6eb46e1924eff0bfdcb1483/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:02.491444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030687d-1b85-4b70-a00f-4a31b764ca94 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.491849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030687d-1b85-4b70-a00f-4a31b764ca94 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.492229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030687d-1b85-4b70-a00f-4a31b764ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.521631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c030687d-1b85-4b70-a00f-4a31b764ca94 None None] MFA Rules not processed for user `98cf2ccdb6eb46e1924eff0bfdcb1483`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:02.523092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c030687d-1b85-4b70-a00f-4a31b764ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:02.595320 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2732/5441] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:02 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:23:02.607284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:02.609059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:02.693008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d94c6-3ba8-4e87-b36f-b1f471c9d79b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:02.697211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986fd45-5b01-4220-921b-399ad0e11fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:02.697980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fd45-5b01-4220-921b-399ad0e11fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:02.698271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fd45-5b01-4220-921b-399ad0e11fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:02.698547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fd45-5b01-4220-921b-399ad0e11fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:02.707608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986fd45-5b01-4220-921b-399ad0e11fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:02.709080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986fd45-5b01-4220-921b-399ad0e11fb0 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:02.718298 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2710/5442] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:02 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:05.586548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:05.587236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:05.587505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:05.628450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] MFA Rules not processed for user `7a41eb42094f418685b83cc0a57852d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:05.633739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:05.777025 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2733/5443] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:12.714125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:14.384564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef09de7-ff30-47d3-bf96-d41fa722129d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:14.385255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef09de7-ff30-47d3-bf96-d41fa722129d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:14.385357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef09de7-ff30-47d3-bf96-d41fa722129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:14.580266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eef09de7-ff30-47d3-bf96-d41fa722129d None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:14.583092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eef09de7-ff30-47d3-bf96-d41fa722129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:14.709145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2711/5444] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:23:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:14.782027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:14.785927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:14.905831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:15.004968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cc335-88f6-4757-bda6-10ae2e92dfea None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:15.011498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:15.012280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:15.012906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:15.013640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:15.029949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:15.035185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:15.062482 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2734/5445] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:23:17.274751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:17.275320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:17.275513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:17.316319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:17.317764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:17.327599 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2712/5446] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:23:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:17.342793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:17.376897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83b4cd-b48f-441c-84d7-b280347f2d3f service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:17.396324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79cf81-f424-48f0-bf81-5e3c28befd3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:17.402230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79cf81-f424-48f0-bf81-5e3c28befd3a service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:17.402498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79cf81-f424-48f0-bf81-5e3c28befd3a service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:17.402771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79cf81-f424-48f0-bf81-5e3c28befd3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:17.439987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79cf81-f424-48f0-bf81-5e3c28befd3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:17.441877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79cf81-f424-48f0-bf81-5e3c28befd3a service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:17.497446 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2735/5447] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:23:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:23:18.599384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:18.602873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:18.805594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96093659-3b9c-45cd-8ddd-acd7b6177f5a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:18.831849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:18.833257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:18.834396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:18.836377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] PATH_INFO: `/v3/users/caa130c208d44d798cb0a5ba41193976` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:18.839284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa130c208d44d798cb0a5ba41193976)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:18.846411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:19.009616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa130c208d44d798cb0a5ba41193976'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:19.011442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa130c208d44d798cb0a5ba41193976'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:19.067401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:19.083679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa130c208d44d798cb0a5ba41193976'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:19.091800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa130c208d44d798cb0a5ba41193976'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:19.115286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa130c208d44d798cb0a5ba41193976'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:19.146681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2713/5448] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:23:18 2022] DELETE /identity/v3/users/caa130c208d44d798cb0a5ba41193976 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:19.151358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:19.152346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:19.152857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:19.191968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:19.193677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:19.357612 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2736/5449] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:19.454782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:19.457676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:19.611244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8614d39-64c1-40ab-817c-fa5e6286ffb5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:19.624293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:19.641826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:19.642983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:19.643478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:19.693554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:19.698112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:19.756749 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2714/5450] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:20.399317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:20.402076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:20.424581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc2017-9469-4834-8e4e-f04ce3ff3069 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:20.449713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:20.450972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:20.451368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:20.451865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] PATH_INFO: `/v3/projects/970d8031a4b149188d5a2bee95524169` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:20.453892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970d8031a4b149188d5a2bee95524169)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:20.459213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:20.585972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970d8031a4b149188d5a2bee95524169', 'request_id': 'req-ce8bcad6-5132-468d-9f28-f86b3eb52310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:20.604189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970d8031a4b149188d5a2bee95524169', 'request_id': 'req-ce8bcad6-5132-468d-9f28-f86b3eb52310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:20.635698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970d8031a4b149188d5a2bee95524169', 'request_id': 'req-ce8bcad6-5132-468d-9f28-f86b3eb52310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:20.657395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] The token cache is being invalidate because project 970d8031a4b149188d5a2bee95524169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:23:20.658101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:20.661009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:20.673738 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2737/5451] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:23:20 2022] DELETE /identity/v3/projects/970d8031a4b149188d5a2bee95524169 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:20.677914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:20.725314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b6b0a-b16e-47d4-9470-d9140a1ca2d3 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:20.985931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:20.986851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:20.987128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:20.987426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] PATH_INFO: `/v3/users/7346777fd2734ad8a2ea2e80653a0208` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:20.989797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7346777fd2734ad8a2ea2e80653a0208)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:20.991829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:21.139528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7346777fd2734ad8a2ea2e80653a0208'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:21.142770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7346777fd2734ad8a2ea2e80653a0208'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:21.195250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7346777fd2734ad8a2ea2e80653a0208'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:21.196893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7346777fd2734ad8a2ea2e80653a0208'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:21.210383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e125bccb-65ec-4b46-9746-e9f8a49503f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7346777fd2734ad8a2ea2e80653a0208'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:21.247421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:21.254473 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2715/5452] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:23:20 2022] DELETE /identity/v3/users/7346777fd2734ad8a2ea2e80653a0208 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:24.088309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:24.090452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:24.121344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bcad6-5132-468d-9f28-f86b3eb52310 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:24.168054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:24.271890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:24.289214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:24.290002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:24.291278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] PATH_INFO: `/v3/projects/70d6639cf2ab40a0a3e8012708beaab7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:24.298143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d6639cf2ab40a0a3e8012708beaab7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:24.301829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:24.472140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d6639cf2ab40a0a3e8012708beaab7', 'request_id': 'req-324c09ca-c685-4da0-88ee-897f9c729427'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:24.498058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d6639cf2ab40a0a3e8012708beaab7', 'request_id': 'req-324c09ca-c685-4da0-88ee-897f9c729427'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:24.521441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d6639cf2ab40a0a3e8012708beaab7', 'request_id': 'req-324c09ca-c685-4da0-88ee-897f9c729427'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:24.554130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] The token cache is being invalidate because project 70d6639cf2ab40a0a3e8012708beaab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:23:24.554483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:24.562356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-324c09ca-c685-4da0-88ee-897f9c729427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:24.564193 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2738/5453] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:23:24 2022] DELETE /identity/v3/projects/70d6639cf2ab40a0a3e8012708beaab7 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:24.569407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8c5b-946b-4353-9175-ecc492d367d6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:24.570234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8c5b-946b-4353-9175-ecc492d367d6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:24.571093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac8c5b-946b-4353-9175-ecc492d367d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:24.611447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-87ac8c5b-946b-4353-9175-ecc492d367d6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:24.615831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-87ac8c5b-946b-4353-9175-ecc492d367d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:24.851079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2716/5454] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:23:24.859406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c67b33-1298-447b-8063-6217eec12fb0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:24.859769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c67b33-1298-447b-8063-6217eec12fb0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:24.859976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c67b33-1298-447b-8063-6217eec12fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:24.902939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e3c67b33-1298-447b-8063-6217eec12fb0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:24.903563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e3c67b33-1298-447b-8063-6217eec12fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:24.933617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8c5b-946b-4353-9175-ecc492d367d6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:24.941588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2739/5455] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:24.946501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac8c5b-946b-4353-9175-ecc492d367d6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:24.981905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:24.988580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:24.988984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:24.989293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:24.992170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:23:24.992947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:25.001640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:25.044471 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2717/5456] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:23:25.048464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c67b33-1298-447b-8063-6217eec12fb0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:25.070439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c67b33-1298-447b-8063-6217eec12fb0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:25.095477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:25.096364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:25.096539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:25.098605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:25.100396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:25.104625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:25.218813 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2740/5457] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:23:25 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:25.222877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:25.237822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787f52e-f8fb-4b47-b563-2fa97995e02a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:25.396694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:25.405653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:25.406205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:25.406660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:25.407542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:25.409767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:25.457200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2718/5458] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:23:25 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:25.461433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:25.486155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966ec7e-0b3c-4eb3-aeab-ecd288293a62 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:25.496856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:25.497881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:25.498315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:25.501557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:25.502507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:25.505199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:25.538404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:25.545993 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2741/5459] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:25.550372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7da4e-05fb-4c59-b74d-4292d4fddcc3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:25.562736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2d3f4-2520-40fe-98db-f694385b32f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:25.564936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d3f4-2520-40fe-98db-f694385b32f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:25.565507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d3f4-2520-40fe-98db-f694385b32f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:25.565947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d3f4-2520-40fe-98db-f694385b32f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:25.567288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2d3f4-2520-40fe-98db-f694385b32f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:25.573239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2d3f4-2520-40fe-98db-f694385b32f5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:25.595046 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2719/5460] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:23:25.598857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:25.612006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91ac9-d996-424c-babf-08d88c4e4c0c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:25.619962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:25.621217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:25.621654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:25.622112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] PATH_INFO: `/v3/projects/106e2aa0adfd40da9a2d689f3b4653db/users/01ecbaf0e5004723bd6a96296ea135d8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:25.643928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106e2aa0adfd40da9a2d689f3b4653db, user_id=01ecbaf0e5004723bd6a96296ea135d8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:25.646840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:25.687963 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2742/5461] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:23:25 2022] PUT /identity/v3/projects/106e2aa0adfd40da9a2d689f3b4653db/users/01ecbaf0e5004723bd6a96296ea135d8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:25.692944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:25.693634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:25.695098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:25.731282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:25.732585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:25.889558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2720/5462] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:23:25.916777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:25.919013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:26.098456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:26.115176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd3c29-dde3-4672-9bb8-2885356f45f7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:26.127794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:26.129905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:26.130494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:26.131970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:26.163810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:26.165411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:26.188262 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2743/5463] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:27.208834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:27.211952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:27.253989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:27.253989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbb2a-6932-45b0-b32e-902c495f6435 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:27.296471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:27.298728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:27.299930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:27.300789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] PATH_INFO: `/v3/users/247bbe467782453385f5d7b687597fee` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:27.316499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247bbe467782453385f5d7b687597fee)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:27.336692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:27.513380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247bbe467782453385f5d7b687597fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:27.517434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247bbe467782453385f5d7b687597fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:27.561644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247bbe467782453385f5d7b687597fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:27.563099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247bbe467782453385f5d7b687597fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:27.583931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e472ce96-20e4-432f-b8bf-f1c73637c605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247bbe467782453385f5d7b687597fee'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:27.613637 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2721/5464] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:23:27 2022] DELETE /identity/v3/users/247bbe467782453385f5d7b687597fee => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:28.867385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:28.890069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851ef3a-ccbc-4712-9782-d56e581957ee service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:29.068349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:29.070967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:29.071374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:29.071742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] PATH_INFO: `/v3/projects/7dc17b4ab1a149728470cc0d7d1ff38f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:29.073720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc17b4ab1a149728470cc0d7d1ff38f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:29.077920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:29.243042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc17b4ab1a149728470cc0d7d1ff38f', 'request_id': 'req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:29.257658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc17b4ab1a149728470cc0d7d1ff38f', 'request_id': 'req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:29.286862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc17b4ab1a149728470cc0d7d1ff38f', 'request_id': 'req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:29.337391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] The token cache is being invalidate because project 7dc17b4ab1a149728470cc0d7d1ff38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:23:29.339734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:29.344278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bcfbf0f2-9fb6-4de8-b3fc-e51fa2a30795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:29.347985 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2744/5465] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:23:28 2022] DELETE /identity/v3/projects/7dc17b4ab1a149728470cc0d7d1ff38f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:29.355040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1cd7a-1d23-42ec-9424-54132e85fcca None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:29.355948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1cd7a-1d23-42ec-9424-54132e85fcca None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:29.356425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1cd7a-1d23-42ec-9424-54132e85fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:29.404374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1bb1cd7a-1d23-42ec-9424-54132e85fcca None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:29.406066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1bb1cd7a-1d23-42ec-9424-54132e85fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:29.585009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2722/5466] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:29.593930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704a30-ee67-4b1e-8b44-fb70374130a1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:29.594448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704a30-ee67-4b1e-8b44-fb70374130a1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:29.594918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704a30-ee67-4b1e-8b44-fb70374130a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:29.674496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b0704a30-ee67-4b1e-8b44-fb70374130a1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:29.677809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b0704a30-ee67-4b1e-8b44-fb70374130a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:29.704465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2745/5467] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:29.705571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1cd7a-1d23-42ec-9424-54132e85fcca None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:29.719184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1cd7a-1d23-42ec-9424-54132e85fcca None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:29.731922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:29.734476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:29.736382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:29.736850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:29.739483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:23:29.741145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:29.750931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:29.775988 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2723/5468] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:23:29.777881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0704a30-ee67-4b1e-8b44-fb70374130a1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:29.798026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0704a30-ee67-4b1e-8b44-fb70374130a1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:29.809795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:29.810491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:29.811353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:29.811632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:29.812332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:29.814295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:29.881743 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2746/5469] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:23:29 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:29.886160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:29.902198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f778cdd-5128-4f8e-8857-cba3c6b9d4bf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:30.001891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:30.002792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:30.003880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:30.004958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:30.006802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:30.012298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:30.054053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:30.084760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:30.087397 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2724/5470] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:23:29 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:30.102928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9904e8-8980-46be-a612-3d3a5aa211bd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:30.122218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:30.123330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:30.126645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:30.127220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:30.128522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:30.133185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:30.188915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2747/5471] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:30.190444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:30.210913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6282-d46f-43c4-8d91-522739766459 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:30.236797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8d729-465e-47d2-b2e1-0bf9edb863d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:30.237519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d729-465e-47d2-b2e1-0bf9edb863d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:30.237804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d729-465e-47d2-b2e1-0bf9edb863d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:30.238079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d729-465e-47d2-b2e1-0bf9edb863d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:30.238823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8d729-465e-47d2-b2e1-0bf9edb863d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:30.240436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8d729-465e-47d2-b2e1-0bf9edb863d0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:30.277995 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2725/5472] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:30.286191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:30.307801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1be4e-6c67-4c12-8efa-ea18c0258156 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:30.388077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72af80a-5cc3-40db-ae02-e3c3a56b0991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:30.388077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72af80a-5cc3-40db-ae02-e3c3a56b0991 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:30.388077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72af80a-5cc3-40db-ae02-e3c3a56b0991 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:30.388077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72af80a-5cc3-40db-ae02-e3c3a56b0991 admin admin] PATH_INFO: `/v3/projects/878ebb841a1d45beb290d689fe7947f6/users/db591a1386ab46ca84a0473ad1c2e974/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:30.417615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72af80a-5cc3-40db-ae02-e3c3a56b0991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878ebb841a1d45beb290d689fe7947f6, user_id=db591a1386ab46ca84a0473ad1c2e974, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:30.417615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72af80a-5cc3-40db-ae02-e3c3a56b0991 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:30.475929 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2748/5473] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:23:30 2022] PUT /identity/v3/projects/878ebb841a1d45beb290d689fe7947f6/users/db591a1386ab46ca84a0473ad1c2e974/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:30.486001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:30.486487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:30.486573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:30.535372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] MFA Rules not processed for user `db591a1386ab46ca84a0473ad1c2e974`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:30.536943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:30.626792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2726/5474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:30.639076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ad16d-c740-4e1f-a846-62d2d9ba02e0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:30.639763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ad16d-c740-4e1f-a846-62d2d9ba02e0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:30.640188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ad16d-c740-4e1f-a846-62d2d9ba02e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:30.664592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-274ad16d-c740-4e1f-a846-62d2d9ba02e0 None None] MFA Rules not processed for user `db591a1386ab46ca84a0473ad1c2e974`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:30.666495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-274ad16d-c740-4e1f-a846-62d2d9ba02e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:30.680781 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2749/5475] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:31.376787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:31.378667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:31.450823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:31.451888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:31.452602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:31.518433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:31.530229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:31.536861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:31.598723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2147f2c-fc8c-4101-a2a5-e3e395f96ead None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:31.616015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344890-6c46-4e75-aa85-cdfa8909749d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:31.616707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344890-6c46-4e75-aa85-cdfa8909749d service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:31.616986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344890-6c46-4e75-aa85-cdfa8909749d service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:31.617290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344890-6c46-4e75-aa85-cdfa8909749d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:31.637467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344890-6c46-4e75-aa85-cdfa8909749d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:31.639227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344890-6c46-4e75-aa85-cdfa8909749d service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:31.668497 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2750/5476] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:23:31.680858 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2727/5477] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:32.194911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:32.198341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:32.375407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f4292-29b5-4539-a5c6-f79979d2f9da None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:32.391916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:32.392829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:32.393128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:32.393402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] PATH_INFO: `/v3/users/45b3686e3c5b4fc9aedf6820e8da8f64` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:32.395120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b3686e3c5b4fc9aedf6820e8da8f64)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:32.397100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:32.541003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b3686e3c5b4fc9aedf6820e8da8f64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:32.541823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b3686e3c5b4fc9aedf6820e8da8f64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:32.584722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b3686e3c5b4fc9aedf6820e8da8f64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:32.586492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b3686e3c5b4fc9aedf6820e8da8f64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:32.608952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b3686e3c5b4fc9aedf6820e8da8f64'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:32.646884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2751/5478] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:23:32 2022] DELETE /identity/v3/users/45b3686e3c5b4fc9aedf6820e8da8f64 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:32.648906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:32.649508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:32.649647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:32.697050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:32.698743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:32.861705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:32.888747 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2728/5479] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:32.955079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:32.956573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:33.115683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:33.199995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4964b-eb58-4b05-9dda-af1b324ef296 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:33.221158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:33.221855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:33.222144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:33.222425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:33.254872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:33.256425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:33.289230 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2752/5480] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:36.784913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:36.787711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:36.815617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d195945-26d0-46db-8245-4c337c5082d3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:36.823455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:36.837218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:36.837712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:36.838221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] PATH_INFO: `/v3/projects/5918f213b5994b7ab21f98b8fd5c6b2b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:36.841447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5918f213b5994b7ab21f98b8fd5c6b2b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:36.847270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:37.074806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5918f213b5994b7ab21f98b8fd5c6b2b', 'request_id': 'req-33850def-5b94-4010-99b4-87ee3bf326f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.092894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5918f213b5994b7ab21f98b8fd5c6b2b', 'request_id': 'req-33850def-5b94-4010-99b4-87ee3bf326f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.112682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5918f213b5994b7ab21f98b8fd5c6b2b', 'request_id': 'req-33850def-5b94-4010-99b4-87ee3bf326f4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.135776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] The token cache is being invalidate because project 5918f213b5994b7ab21f98b8fd5c6b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:23:37.136122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.136753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33850def-5b94-4010-99b4-87ee3bf326f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.141681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2729/5481] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:23:36 2022] DELETE /identity/v3/projects/5918f213b5994b7ab21f98b8fd5c6b2b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:37.146086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:37.159836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342904a6-55b4-453e-81b6-45b1857e4749 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:37.275075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:37.276309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:37.276756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:37.277245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] PATH_INFO: `/v3/users/311dcc88ee0c409d992fdaf3c3dc092b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:37.278730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=311dcc88ee0c409d992fdaf3c3dc092b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:37.281158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:37.347773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311dcc88ee0c409d992fdaf3c3dc092b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.348415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311dcc88ee0c409d992fdaf3c3dc092b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.362512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311dcc88ee0c409d992fdaf3c3dc092b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.363262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311dcc88ee0c409d992fdaf3c3dc092b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.372054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311dcc88ee0c409d992fdaf3c3dc092b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:37.397391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2753/5482] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:23:37 2022] DELETE /identity/v3/users/311dcc88ee0c409d992fdaf3c3dc092b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:38.163354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3b708-a4a4-49ee-bb46-e9f73a911db2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:38.164049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3b708-a4a4-49ee-bb46-e9f73a911db2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:38.164049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3b708-a4a4-49ee-bb46-e9f73a911db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:38.188449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-04a3b708-a4a4-49ee-bb46-e9f73a911db2 None None] MFA Rules not processed for user `db591a1386ab46ca84a0473ad1c2e974`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:38.190391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-04a3b708-a4a4-49ee-bb46-e9f73a911db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:38.276414 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2730/5483] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:38.454186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:38.455730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:38.616560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:38.630669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8dc31-faf3-4d97-bc94-6099f27757ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:38.648981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:38.650075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:38.652797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:38.652797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] PATH_INFO: `/v3/projects/396aae7db4a8440ebe7670c591f44223` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:38.657722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] RBAC: Authorizing `identity:delete_project(project_id=396aae7db4a8440ebe7670c591f44223)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:38.660435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:38.805491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396aae7db4a8440ebe7670c591f44223', 'request_id': 'req-6dd07dc0-19a9-442a-8295-0be05e71835b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:38.823629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396aae7db4a8440ebe7670c591f44223', 'request_id': 'req-6dd07dc0-19a9-442a-8295-0be05e71835b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:38.842886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396aae7db4a8440ebe7670c591f44223', 'request_id': 'req-6dd07dc0-19a9-442a-8295-0be05e71835b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:38.880291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] The token cache is being invalidate because project 396aae7db4a8440ebe7670c591f44223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:23:38.880595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:38.882783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6dd07dc0-19a9-442a-8295-0be05e71835b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:23:38.891440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2754/5484] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:23:38 2022] DELETE /identity/v3/projects/396aae7db4a8440ebe7670c591f44223 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:38.893362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1695-132e-4013-977a-6edda815bb40 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:38.893667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1695-132e-4013-977a-6edda815bb40 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:38.893950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1695-132e-4013-977a-6edda815bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:38.935181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40fa1695-132e-4013-977a-6edda815bb40 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:38.938214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40fa1695-132e-4013-977a-6edda815bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:39.087615 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2731/5485] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:39.089915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e5f8a-e283-4678-bb1f-d1f7762af02f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:39.090384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e5f8a-e283-4678-bb1f-d1f7762af02f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:39.090823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e5f8a-e283-4678-bb1f-d1f7762af02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:39.147429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-022e5f8a-e283-4678-bb1f-d1f7762af02f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:39.151613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-022e5f8a-e283-4678-bb1f-d1f7762af02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:39.176982 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2755/5486] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:39.178393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1695-132e-4013-977a-6edda815bb40 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:39.190789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1695-132e-4013-977a-6edda815bb40 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:39.204886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:39.205874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:39.206601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:39.207018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:39.207921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:23:39.214919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:39.221055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:39.254769 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2732/5487] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:23:39.258001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e5f8a-e283-4678-bb1f-d1f7762af02f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:39.273682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e5f8a-e283-4678-bb1f-d1f7762af02f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:39.291487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:39.292911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:39.293228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:39.293511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:39.294231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:39.301926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:39.357792 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2756/5488] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:23:39 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:39.358438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:39.373658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eddc14-cb72-40b3-acc8-d6bf65046a44 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:39.400385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:39.581945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:39.582753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:39.583032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:39.583305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:39.584013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:39.588941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:39.658833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:39.671346 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2733/5489] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:23:39 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:23:39.685291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe361afd-372a-46cf-9ef3-ce0cf5841ff0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:39.701256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:39.701963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:39.702252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:39.702518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:39.710067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:39.714551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:39.762189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:39.781477 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2757/5490] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:23:39.781844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff29d9-77b7-4a15-a9aa-e71cf80b66c1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:39.799761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d12e3-5529-42ef-9bfe-52c9a768b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:39.800480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d12e3-5529-42ef-9bfe-52c9a768b759 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:39.800761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d12e3-5529-42ef-9bfe-52c9a768b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:39.801085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d12e3-5529-42ef-9bfe-52c9a768b759 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:39.801812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d12e3-5529-42ef-9bfe-52c9a768b759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:39.822641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d12e3-5529-42ef-9bfe-52c9a768b759 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:39.860741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:39.870096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2734/5491] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:39.879586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf761-686e-46da-8fb0-4963c503f71c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:39.885315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:39.891446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:39.891731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:39.894528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] PATH_INFO: `/v3/projects/3ca176bb6d224b1e9bf3125aaf4fe2a8/users/7d77b624e2044c93824960202be55b77/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:39.947750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca176bb6d224b1e9bf3125aaf4fe2a8, user_id=7d77b624e2044c93824960202be55b77, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:39.962362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:40.035228 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2758/5492] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:23:39 2022] PUT /identity/v3/projects/3ca176bb6d224b1e9bf3125aaf4fe2a8/users/7d77b624e2044c93824960202be55b77/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:40.037796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:40.038410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:40.039020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:40.111290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:40.115411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:40.131425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] MFA Rules not processed for user `7d77b624e2044c93824960202be55b77`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:40.148191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:40.352947 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2735/5493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:40.363738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65281-a4c3-4899-8c2e-b251cd097621 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:40.384728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e14e88-2ab2-47d3-a322-6be753f3fe72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:40.385580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14e88-2ab2-47d3-a322-6be753f3fe72 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:40.385866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14e88-2ab2-47d3-a322-6be753f3fe72 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:40.386142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e14e88-2ab2-47d3-a322-6be753f3fe72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:40.391117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-67e14e88-2ab2-47d3-a322-6be753f3fe72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:40.418205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:40.423798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:40.431366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e14e88-2ab2-47d3-a322-6be753f3fe72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:40.433186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e14e88-2ab2-47d3-a322-6be753f3fe72 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:40.460717 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2759/5494] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:40.508865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae69d-5886-45c0-91d9-ee03828f0a41 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:40.508865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae69d-5886-45c0-91d9-ee03828f0a41 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:40.508865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae69d-5886-45c0-91d9-ee03828f0a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:40.531447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:40.546617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-684ae69d-5886-45c0-91d9-ee03828f0a41 None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:40.549655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-684ae69d-5886-45c0-91d9-ee03828f0a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:40.697760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f9237-5a4c-4e46-bbe7-17895c5490e9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:40.716349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:40.720080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:40.720372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:40.720661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:40.753160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:40.759294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:40.759501 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2760/5495] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:23:40.784713 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2736/5496] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:40.829084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb787-38b1-4cf0-839d-598ebd2cd275 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:40.829423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb787-38b1-4cf0-839d-598ebd2cd275 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:40.829701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cb787-38b1-4cf0-839d-598ebd2cd275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:40.894326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c92cb787-38b1-4cf0-839d-598ebd2cd275 None None] MFA Rules not processed for user `01ecbaf0e5004723bd6a96296ea135d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:40.895585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c92cb787-38b1-4cf0-839d-598ebd2cd275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:41.064639 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2761/5497] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:41.069922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:41.071785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:41.146838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:41.237699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248e9af-6efa-4cac-90ad-eb22f9196dd4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:41.243858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:41.244611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:41.244897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:41.245228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:41.247156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:41.250179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:41.295854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2737/5498] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:23:41 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:41.299457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb787-38b1-4cf0-839d-598ebd2cd275 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:41.315202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cb787-38b1-4cf0-839d-598ebd2cd275 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:41.425704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:41.429370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:41.430064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:41.430352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:41.431228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:41.433345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:41.489170 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2762/5499] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:23:41 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:23:41.493512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:41.511182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868c67-a66c-4562-b021-ec0aa6f1a67c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:41.528412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:41.531650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:41.532022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:41.532303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:41.533177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:41.538308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:41.559085 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2738/5500] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:41.562304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:41.594189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae24e3-a147-4001-a2af-8399dd07ce59 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:41.636130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:41.637877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:41.640174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:41.640669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] PATH_INFO: `/v3/projects/79f53df0af824231bfe6e508ef30b728/users/cd196919118544aa96972f034451acc8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:41.688166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f53df0af824231bfe6e508ef30b728, user_id=cd196919118544aa96972f034451acc8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:41.697990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:41.736372 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2763/5501] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:23:41 2022] PUT /identity/v3/projects/79f53df0af824231bfe6e508ef30b728/users/cd196919118544aa96972f034451acc8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:41.740231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:41.754386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c4b0-96e0-449a-b781-f66a1419b5d9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:41.828457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77821a-59e6-4af1-8716-20e8557e0efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:41.829283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77821a-59e6-4af1-8716-20e8557e0efd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:41.829659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77821a-59e6-4af1-8716-20e8557e0efd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:41.830011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77821a-59e6-4af1-8716-20e8557e0efd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:41.830953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77821a-59e6-4af1-8716-20e8557e0efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:41.832657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77821a-59e6-4af1-8716-20e8557e0efd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:41.846909 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2739/5502] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:23:41.851566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:41.866882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b198a0-65b5-4d7b-8f95-ead35e8e1fbb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:41.873134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf0c5f-feff-41f0-97ae-26c96d250aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:41.874058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0c5f-feff-41f0-97ae-26c96d250aae admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:41.874340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0c5f-feff-41f0-97ae-26c96d250aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:41.874615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0c5f-feff-41f0-97ae-26c96d250aae admin admin] PATH_INFO: `/v3/projects/79f53df0af824231bfe6e508ef30b728/users/cd196919118544aa96972f034451acc8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:41.877954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf0c5f-feff-41f0-97ae-26c96d250aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f53df0af824231bfe6e508ef30b728, user_id=cd196919118544aa96972f034451acc8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:41.881554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf0c5f-feff-41f0-97ae-26c96d250aae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:41.884406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:41.895739 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2764/5503] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:23:41 2022] PUT /identity/v3/projects/79f53df0af824231bfe6e508ef30b728/users/cd196919118544aa96972f034451acc8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:23:44.852714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb1c9-0ef2-467d-a967-27815472c904 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:44.853330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb1c9-0ef2-467d-a967-27815472c904 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:44.853330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb1c9-0ef2-467d-a967-27815472c904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:44.897772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-955cb1c9-0ef2-467d-a967-27815472c904 None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:44.903518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-955cb1c9-0ef2-467d-a967-27815472c904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:45.094042 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2740/5504] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:47.139705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dc04c-f5a2-4c05-8955-6c2773270d9b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:47.140671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dc04c-f5a2-4c05-8955-6c2773270d9b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:47.141633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dc04c-f5a2-4c05-8955-6c2773270d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:47.179294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-582dc04c-f5a2-4c05-8955-6c2773270d9b None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:47.199926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-582dc04c-f5a2-4c05-8955-6c2773270d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:47.228172 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2765/5505] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:49.306363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b038d-74c4-4d23-b336-96e1c01f61f6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:49.308934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b038d-74c4-4d23-b336-96e1c01f61f6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:49.309929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b038d-74c4-4d23-b336-96e1c01f61f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:49.370193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-278b038d-74c4-4d23-b336-96e1c01f61f6 None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:49.371762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-278b038d-74c4-4d23-b336-96e1c01f61f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:49.387131 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2741/5506] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:51.469888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:51.471880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:51.471880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:51.495633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:51.497825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:51.538128 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2766/5507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:23:51.869368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49670cf7-2632-444b-a02d-3b2f2fdef8d6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:51.869852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49670cf7-2632-444b-a02d-3b2f2fdef8d6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:51.870072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49670cf7-2632-444b-a02d-3b2f2fdef8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:51.920439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-49670cf7-2632-444b-a02d-3b2f2fdef8d6 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:51.921718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-49670cf7-2632-444b-a02d-3b2f2fdef8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:52.082508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:52.176730 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2742/5508] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:52.193009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:52.198285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:52.328964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef519bc-eccb-4368-9bde-03b5de2dffbd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:52.334566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb281-e5d9-4e03-b31c-1524202303e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:52.335787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb281-e5d9-4e03-b31c-1524202303e6 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:52.337268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb281-e5d9-4e03-b31c-1524202303e6 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:52.337755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb281-e5d9-4e03-b31c-1524202303e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:52.349283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cb281-e5d9-4e03-b31c-1524202303e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:52.351333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cb281-e5d9-4e03-b31c-1524202303e6 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:52.369372 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2767/5509] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:23:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:23:53.129836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49670cf7-2632-444b-a02d-3b2f2fdef8d6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:53.421406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49670cf7-2632-444b-a02d-3b2f2fdef8d6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:53.451560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14f5a9-1632-488d-ad1e-211d6fd19790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:53.457995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14f5a9-1632-488d-ad1e-211d6fd19790 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:53.458629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14f5a9-1632-488d-ad1e-211d6fd19790 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:53.459017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14f5a9-1632-488d-ad1e-211d6fd19790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:53.469988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7d14f5a9-1632-488d-ad1e-211d6fd19790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:53.597513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14f5a9-1632-488d-ad1e-211d6fd19790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:53.599517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14f5a9-1632-488d-ad1e-211d6fd19790 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:53.638630 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2743/5510] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:54.465899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb5a7a-0d68-4f86-bc30-d19acbf34cbd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:54.466870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb5a7a-0d68-4f86-bc30-d19acbf34cbd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:54.467310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb5a7a-0d68-4f86-bc30-d19acbf34cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:54.534424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-72fb5a7a-0d68-4f86-bc30-d19acbf34cbd None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:54.537278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-72fb5a7a-0d68-4f86-bc30-d19acbf34cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:54.553119 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2768/5511] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:55.754220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b1ec8-1bfe-45a5-9270-1e685aa00f8c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:55.755980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b1ec8-1bfe-45a5-9270-1e685aa00f8c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:55.756514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b1ec8-1bfe-45a5-9270-1e685aa00f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:55.778477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4f1b1ec8-1bfe-45a5-9270-1e685aa00f8c None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:55.780282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f1b1ec8-1bfe-45a5-9270-1e685aa00f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:55.795396 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2744/5512] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:56.427678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48138e1-c7c8-4ce4-8d37-96ca81b03e85 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:56.428613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48138e1-c7c8-4ce4-8d37-96ca81b03e85 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:56.429185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48138e1-c7c8-4ce4-8d37-96ca81b03e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:56.500850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f48138e1-c7c8-4ce4-8d37-96ca81b03e85 None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:56.502127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f48138e1-c7c8-4ce4-8d37-96ca81b03e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:56.543225 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2769/5513] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:59.301529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda766f-9717-42f8-82bd-0a911a1572b8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:59.302683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda766f-9717-42f8-82bd-0a911a1572b8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:59.303177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda766f-9717-42f8-82bd-0a911a1572b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:59.350921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5dda766f-9717-42f8-82bd-0a911a1572b8 None None] MFA Rules not processed for user `cd196919118544aa96972f034451acc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:59.353281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5dda766f-9717-42f8-82bd-0a911a1572b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:59.377730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:59.378374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:59.378374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:59.423830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:23:59.425216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:59.461788 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2770/5514] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:59.490092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:59.566109 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2745/5515] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:23:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:23:59.579412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:23:59.580949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:23:59.797069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe31d33-1c94-475c-819d-f4b3329be83e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:23:59.806396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b915c7c-afb8-41c5-87d6-56de744cd23a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:23:59.807366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b915c7c-afb8-41c5-87d6-56de744cd23a service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:23:59.807815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b915c7c-afb8-41c5-87d6-56de744cd23a service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:23:59.808252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b915c7c-afb8-41c5-87d6-56de744cd23a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:23:59.941173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b915c7c-afb8-41c5-87d6-56de744cd23a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:23:59.942681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b915c7c-afb8-41c5-87d6-56de744cd23a service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:23:59.971012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2771/5516] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:23:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:09.550569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:09.958658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=1,keystone:SELECT=97 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:11.121053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a3d7-926f-4748-9b0b-9be49a42860c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:11.121598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a3d7-926f-4748-9b0b-9be49a42860c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:11.121699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a3d7-926f-4748-9b0b-9be49a42860c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:11.144086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-43e9a3d7-926f-4748-9b0b-9be49a42860c None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:11.147304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-43e9a3d7-926f-4748-9b0b-9be49a42860c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:11.163269 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2746/5517] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:12.436778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0410540-d899-4fae-a25b-a7863aa1434b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:12.437860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0410540-d899-4fae-a25b-a7863aa1434b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:12.438344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0410540-d899-4fae-a25b-a7863aa1434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:12.458877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e0410540-d899-4fae-a25b-a7863aa1434b None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:12.461282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e0410540-d899-4fae-a25b-a7863aa1434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:12.473581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2772/5518] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:15.096659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9a3d7-926f-4748-9b0b-9be49a42860c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:15.118210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9a3d7-926f-4748-9b0b-9be49a42860c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:15.130683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:15.131817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:15.132437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:15.132865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:15.135071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:15.311989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:15.314168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:15.329059 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2747/5519] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:18.118295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:18.118924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:18.118924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:18.182953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:18.186424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:18.218853 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2773/5520] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:24:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:18.246238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:18.265403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951da39d-b4a8-416b-830e-45e91796f4ee service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:18.281008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3954b2-c925-4d69-8f5d-6ac148b34581 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:18.281878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3954b2-c925-4d69-8f5d-6ac148b34581 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:18.282165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3954b2-c925-4d69-8f5d-6ac148b34581 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:18.282489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3954b2-c925-4d69-8f5d-6ac148b34581 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:18.306286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3954b2-c925-4d69-8f5d-6ac148b34581 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:18.307944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3954b2-c925-4d69-8f5d-6ac148b34581 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:18.334647 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2748/5521] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:24:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:18.451254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:18.452525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:18.634979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9b190-3118-417e-ab10-6bd7d91267ce None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:18.641330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:18.643384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:18.643736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:18.644495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:18.646683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:18.680518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:18.688305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:18.724113 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2774/5522] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:19.649722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68350-a13d-4be0-9bcb-456046a12f94 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:19.650305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68350-a13d-4be0-9bcb-456046a12f94 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:19.650521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b68350-a13d-4be0-9bcb-456046a12f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:19.683056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-60b68350-a13d-4be0-9bcb-456046a12f94 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:19.686634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-60b68350-a13d-4be0-9bcb-456046a12f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:19.718243 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2749/5523] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:24:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:24:19.729315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:19.753875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71cfa-37dc-41f1-b9dc-20d320459390 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:19.773291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:19.774979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:19.775503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:19.776037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:19.804371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:19.806594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:19.821124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2775/5524] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:24:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:22.653106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b68350-a13d-4be0-9bcb-456046a12f94 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:22.695219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b68350-a13d-4be0-9bcb-456046a12f94 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:22.713824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c942a0a-9f79-4e89-8a0a-827ab2f5972d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:22.714515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942a0a-9f79-4e89-8a0a-827ab2f5972d service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:22.714795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942a0a-9f79-4e89-8a0a-827ab2f5972d service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:22.715074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942a0a-9f79-4e89-8a0a-827ab2f5972d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:22.724828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9c942a0a-9f79-4e89-8a0a-827ab2f5972d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:22.795153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c942a0a-9f79-4e89-8a0a-827ab2f5972d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:22.797516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c942a0a-9f79-4e89-8a0a-827ab2f5972d service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:22.828810 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2750/5525] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:25.082716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:25.253521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2577d-3427-4059-93d0-4e6651656a33 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:25.259834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:25.260733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:25.261603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:25.262164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] PATH_INFO: `/v3/users/7d77b624e2044c93824960202be55b77` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:25.263903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d77b624e2044c93824960202be55b77)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:25.268296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:25.449609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d77b624e2044c93824960202be55b77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:25.450570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d77b624e2044c93824960202be55b77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:25.484489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d77b624e2044c93824960202be55b77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:25.485742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d77b624e2044c93824960202be55b77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:25.487539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:25.512239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d77b624e2044c93824960202be55b77'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:25.547651 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2776/5526] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:25 2022] DELETE /identity/v3/users/7d77b624e2044c93824960202be55b77 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:25.549451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:25.549992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:25.549992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:25.590012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:25.591853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:25.720501 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2751/5527] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:25.783402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:25.785683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:26.000955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37849feb-166d-431c-b092-58aa5e2dcc9f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:26.015129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0facfc-7c50-4b15-a37d-d680ff530e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:26.015892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0facfc-7c50-4b15-a37d-d680ff530e0e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:26.016184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0facfc-7c50-4b15-a37d-d680ff530e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:26.016465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0facfc-7c50-4b15-a37d-d680ff530e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:26.055298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0facfc-7c50-4b15-a37d-d680ff530e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:26.057141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0facfc-7c50-4b15-a37d-d680ff530e0e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:26.087656 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2777/5528] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:26.912544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:26.914185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:26.935105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31589f80-eed2-4c19-909c-1515616e5e31 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:26.972111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:26.973449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:26.973925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:26.974474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] PATH_INFO: `/v3/projects/3ca176bb6d224b1e9bf3125aaf4fe2a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:26.975860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca176bb6d224b1e9bf3125aaf4fe2a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:26.978430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:27.169869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:27.190336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca176bb6d224b1e9bf3125aaf4fe2a8', 'request_id': 'req-6b73b996-0b54-4487-8137-9cb6af4e315d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:27.204442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca176bb6d224b1e9bf3125aaf4fe2a8', 'request_id': 'req-6b73b996-0b54-4487-8137-9cb6af4e315d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:27.255254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca176bb6d224b1e9bf3125aaf4fe2a8', 'request_id': 'req-6b73b996-0b54-4487-8137-9cb6af4e315d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:27.296890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] The token cache is being invalidate because project 3ca176bb6d224b1e9bf3125aaf4fe2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:27.297470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:27.300720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:27.303560 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2752/5529] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:26 2022] DELETE /identity/v3/projects/3ca176bb6d224b1e9bf3125aaf4fe2a8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:27.312588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf03bc-f064-416d-bab0-a2acecc5c3c5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:27.313583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf03bc-f064-416d-bab0-a2acecc5c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:27.314103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf03bc-f064-416d-bab0-a2acecc5c3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:27.394022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9daf03bc-f064-416d-bab0-a2acecc5c3c5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:27.396803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9daf03bc-f064-416d-bab0-a2acecc5c3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:27.559134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:27.562416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:27.628642 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2778/5530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:27.637189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193fa1-de55-4351-b6bc-ab9f6752994a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:27.637743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193fa1-de55-4351-b6bc-ab9f6752994a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:27.638179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2193fa1-de55-4351-b6bc-ab9f6752994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:27.682081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f2193fa1-de55-4351-b6bc-ab9f6752994a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:27.683640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f2193fa1-de55-4351-b6bc-ab9f6752994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:27.713555 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2779/5531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:27.717726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193fa1-de55-4351-b6bc-ab9f6752994a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:27.739181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2193fa1-de55-4351-b6bc-ab9f6752994a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:27.755926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:27.756635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:27.756934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:27.757254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:27.762186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:27.762896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:27.765482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:27.798070 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2780/5532] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:27.803173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:27.811007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73b996-0b54-4487-8137-9cb6af4e315d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:27.826132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:27.827081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:27.827463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:27.829184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:27.833568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2c3c-abb2-43db-b18a-798fcdf8639b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:27.834530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:27.848857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:27.849756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:27.850385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:27.850730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:27.851776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:27.855321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:27.859546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:27.863995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:27.886746 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2753/5533] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:24:27.921568 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2781/5534] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:27 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:27.925483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:27.946965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4589-cd30-4c75-97df-ca43861cd81b service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:28.090960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:28.092066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:28.092522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:28.092968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:28.093869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:28.106381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:28.146942 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2754/5535] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:27 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:28.150824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:28.165321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e59bd-2818-4532-a1da-b9cab1248048 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:28.180435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:28.181281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:28.181562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:28.181836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:28.182634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:28.184497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:28.209256 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2782/5536] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:28.210105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:28.228943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ec636-0e17-454b-b603-18fff3885764 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:28.241833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d74b8-8aee-40cc-8abf-e6e4a5535f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:28.242688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d74b8-8aee-40cc-8abf-e6e4a5535f73 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:28.243051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d74b8-8aee-40cc-8abf-e6e4a5535f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:28.243422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d74b8-8aee-40cc-8abf-e6e4a5535f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:28.244423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d74b8-8aee-40cc-8abf-e6e4a5535f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:28.252307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d74b8-8aee-40cc-8abf-e6e4a5535f73 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:28.274651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:28.277938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2755/5537] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:24:28.290273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8da0c-d3e0-465c-b939-d7935959837b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:28.296259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:28.297400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:28.297897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:28.298331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] PATH_INFO: `/v3/projects/d3d96ed6a57a4eadb11beda477e22e60/users/810680d329084406ad9fdccf96ef5c65/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:28.331806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d96ed6a57a4eadb11beda477e22e60, user_id=810680d329084406ad9fdccf96ef5c65, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:28.334651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:28.368076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2783/5538] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:28 2022] PUT /identity/v3/projects/d3d96ed6a57a4eadb11beda477e22e60/users/810680d329084406ad9fdccf96ef5c65/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:24:28.384120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:28.384421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:28.384708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:28.436110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] MFA Rules not processed for user `810680d329084406ad9fdccf96ef5c65`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:28.437884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:28.489695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:28.574744 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2756/5539] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:28.585318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:28.587691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:28.617452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:28.738023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e5bb1-4dc6-4156-9f55-cb0bb28096fa admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:28.742907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:28.743842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:28.744185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:28.744531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:28.755494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:28.756990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:28.769361 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2784/5540] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:29.396916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:29.398885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:29.435472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:29.539245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85328bf8-522a-4ddf-8fe3-87e82ba22ac7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:29.546236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86689b59-7163-4dfd-b18e-eeca663d13a8 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:29.550249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:29.550568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:29.551017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:29.551629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] PATH_INFO: `/v3/users/db591a1386ab46ca84a0473ad1c2e974` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:29.554631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db591a1386ab46ca84a0473ad1c2e974)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:29.556778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:29.560880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:29.564496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:29.564849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:29.566945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] PATH_INFO: `/v3/users/810680d329084406ad9fdccf96ef5c65` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:29.568723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=810680d329084406ad9fdccf96ef5c65)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:29.571212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:29.650488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db591a1386ab46ca84a0473ad1c2e974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.651766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db591a1386ab46ca84a0473ad1c2e974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.655259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810680d329084406ad9fdccf96ef5c65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.657265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810680d329084406ad9fdccf96ef5c65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.673797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db591a1386ab46ca84a0473ad1c2e974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.674822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db591a1386ab46ca84a0473ad1c2e974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.683260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-19226ee1-6317-493a-a4cf-1dc977bb9ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db591a1386ab46ca84a0473ad1c2e974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.683929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810680d329084406ad9fdccf96ef5c65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.684737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810680d329084406ad9fdccf96ef5c65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.697666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a1f227b4-1753-4a73-89dd-8329109d0a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810680d329084406ad9fdccf96ef5c65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:29.722310 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2757/5541] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:29 2022] DELETE /identity/v3/users/db591a1386ab46ca84a0473ad1c2e974 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:29.724599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:29.725246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:29.725730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:29.753188 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2785/5542] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:29 2022] DELETE /identity/v3/users/810680d329084406ad9fdccf96ef5c65 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:29.758490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:29.759118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:29.759578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:29.760031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:29.762055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:29.824896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:29.827710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:29.833716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:29.876756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:29.897221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2758/5543] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:29.910442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:29.913690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:29.929433 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2786/5544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:29.940130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:29.942605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:30.005788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47250344-3e87-4eeb-ae85-7af894cf836d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:30.010536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:30.011411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:30.011723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:30.011994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:30.045974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:30.047893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:30.058188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fc3b1-c02a-4669-904d-c3c31974d1a6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:30.062240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:30.062900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:30.063178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:30.063445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:30.064436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2759/5545] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:24:30.076535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:30.078562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:30.091179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2787/5546] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:24:30.783211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:30.784925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:30.828574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:30.830676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:30.837238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473332ed-57b7-4337-ad1b-91196db17d35 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:30.850818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:30.854714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:30.855408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:30.856329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] PATH_INFO: `/v3/projects/878ebb841a1d45beb290d689fe7947f6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:30.858364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=878ebb841a1d45beb290d689fe7947f6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:30.859351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b378-f225-4d42-82d2-9620657fdb46 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:30.863806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:30.870268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:30.873610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:30.874128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:30.874651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] PATH_INFO: `/v3/projects/d3d96ed6a57a4eadb11beda477e22e60` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:30.878731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d96ed6a57a4eadb11beda477e22e60)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:30.882309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.039634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878ebb841a1d45beb290d689fe7947f6', 'request_id': 'req-38fc6694-37fb-4ef0-955d-5b23c05cf15e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.047725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d96ed6a57a4eadb11beda477e22e60', 'request_id': 'req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.051591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878ebb841a1d45beb290d689fe7947f6', 'request_id': 'req-38fc6694-37fb-4ef0-955d-5b23c05cf15e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.063496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d96ed6a57a4eadb11beda477e22e60', 'request_id': 'req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.074402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878ebb841a1d45beb290d689fe7947f6', 'request_id': 'req-38fc6694-37fb-4ef0-955d-5b23c05cf15e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.079706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d96ed6a57a4eadb11beda477e22e60', 'request_id': 'req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.089765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] The token cache is being invalidate because project 878ebb841a1d45beb290d689fe7947f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:31.090067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.090983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38fc6694-37fb-4ef0-955d-5b23c05cf15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.092901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] The token cache is being invalidate because project d3d96ed6a57a4eadb11beda477e22e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:31.093350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.094046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b854a437-001c-48bb-a15c-7e4e5ed0f5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:31.095795 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2788/5548] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:30 2022] DELETE /identity/v3/projects/d3d96ed6a57a4eadb11beda477e22e60 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:24:31.099051 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2760/5548] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:30 2022] DELETE /identity/v3/projects/878ebb841a1d45beb290d689fe7947f6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:31.100257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f45fc2-069a-4bd6-8555-49755d37acab None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.100555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f45fc2-069a-4bd6-8555-49755d37acab None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.100837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f45fc2-069a-4bd6-8555-49755d37acab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.101611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162e42-ca8a-42dc-a0ce-506d6293bf7f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.102222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162e42-ca8a-42dc-a0ce-506d6293bf7f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.102857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162e42-ca8a-42dc-a0ce-506d6293bf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.126227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d0f45fc2-069a-4bd6-8555-49755d37acab None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:31.127551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d0f45fc2-069a-4bd6-8555-49755d37acab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.142156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-76162e42-ca8a-42dc-a0ce-506d6293bf7f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:31.143868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-76162e42-ca8a-42dc-a0ce-506d6293bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.214179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:31.225973 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2761/5549] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:31.226214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2789/5550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:31.228578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6144e0e-2613-4afc-a56d-2f8e547288df None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.228946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6144e0e-2613-4afc-a56d-2f8e547288df None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.229399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6144e0e-2613-4afc-a56d-2f8e547288df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.232184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf16b1-b8e1-4187-9e4a-39f3bec81637 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.232487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf16b1-b8e1-4187-9e4a-39f3bec81637 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.232814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf16b1-b8e1-4187-9e4a-39f3bec81637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.248428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:31.259112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d6144e0e-2613-4afc-a56d-2f8e547288df None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:31.260567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d6144e0e-2613-4afc-a56d-2f8e547288df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.273151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-daaf16b1-b8e1-4187-9e4a-39f3bec81637 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:31.274497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-daaf16b1-b8e1-4187-9e4a-39f3bec81637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.275015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2762/5551] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:31.294477 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2790/5552] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:24:31.294922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6144e0e-2613-4afc-a56d-2f8e547288df None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.295585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf16b1-b8e1-4187-9e4a-39f3bec81637 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.310887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf16b1-b8e1-4187-9e4a-39f3bec81637 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.315509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6144e0e-2613-4afc-a56d-2f8e547288df None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.317106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.318947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.319531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.319945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.320809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:31.321156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.322795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.329668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.330441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.330791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.331130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.331937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:31.332430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.345518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.345631 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2791/5553] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:31.345631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.371406 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2763/5554] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:31.372350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.388080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bce052-10c0-447b-aea9-254d619be39a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.388206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24107ee-8383-4535-bd0e-7e25e5b157e2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.393516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0fb0-aa07-4f7e-8607-06f4fe495311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.393822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0fb0-aa07-4f7e-8607-06f4fe495311 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.394231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0fb0-aa07-4f7e-8607-06f4fe495311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.394573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0fb0-aa07-4f7e-8607-06f4fe495311 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.395351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0fb0-aa07-4f7e-8607-06f4fe495311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.397807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0fb0-aa07-4f7e-8607-06f4fe495311 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.403600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.404064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.404352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.404626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.405356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.407942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.437815 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2764/5555] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:31.440424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a884a-2419-45d8-ba6a-35104454ce1d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.441117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a884a-2419-45d8-ba6a-35104454ce1d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.441692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a884a-2419-45d8-ba6a-35104454ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.454214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2792/5556] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/projects => generated 357 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:31.458134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.461305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.464487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1f7a884a-2419-45d8-ba6a-35104454ce1d None None] MFA Rules not processed for user `719d3fb4f7f44c239e03b5f7076edcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:31.465705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f7a884a-2419-45d8-ba6a-35104454ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.536454 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2765/5557] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:31.537434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a884a-2419-45d8-ba6a-35104454ce1d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.561778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8470ee-3759-4e85-a5bf-71909dfcf64f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.566448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.567120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.567451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.568018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.570947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.647162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a884a-2419-45d8-ba6a-35104454ce1d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.650547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.652616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.652761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.653361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.653645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.654065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.654776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.657177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.664962 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2793/5558] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:31.666724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.681454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b26a7-150c-4516-95dd-98fbaf9ea0d8 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.687892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.688708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.689055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.689659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.690014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.692019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.705103 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2766/5559] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:31.706602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.726410 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2794/5560] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/users => generated 279 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:31.726627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cb3f4-9565-403b-83d1-9ce7ef9d268d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.727700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.740336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc01652-0eb2-4063-af84-04b7b84f8a8f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.744663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.745639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.745934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.746219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.746708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.747610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.748245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.748716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.748964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.749993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.751791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.754737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.769107 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2795/5561] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:31.771987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.780840 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2767/5562] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:24:31.784176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.790797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe95a9f-2039-4cfb-a4e1-8a4bf728b6e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.796993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.798021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.798805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.799304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.800403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.803499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.817207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338bb3d-a296-4f6c-912c-d6ccf1ac4767 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.824249 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2796/5563] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:31.825168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.832617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2703446-9630-4032-9b73-334407983432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.833973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2703446-9630-4032-9b73-334407983432 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.834492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2703446-9630-4032-9b73-334407983432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.835011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2703446-9630-4032-9b73-334407983432 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.835964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2703446-9630-4032-9b73-334407983432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.840322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc116-ec3b-48ec-be0b-1cd7de9a738a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.841291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2703446-9630-4032-9b73-334407983432 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.845408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88a104-c4a0-431d-b698-7bd3e3cf9151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:31.846305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a104-c4a0-431d-b698-7bd3e3cf9151 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.846611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a104-c4a0-431d-b698-7bd3e3cf9151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.847002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88a104-c4a0-431d-b698-7bd3e3cf9151 admin admin] PATH_INFO: `/v3/projects/30c543f4b0ec42618830315b24c4984d/users/876b3b3ba17a45ccadd3ee1e9bce5b89/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.864313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88a104-c4a0-431d-b698-7bd3e3cf9151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c543f4b0ec42618830315b24c4984d, user_id=876b3b3ba17a45ccadd3ee1e9bce5b89, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:31.867628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88a104-c4a0-431d-b698-7bd3e3cf9151 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:31.872590 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2768/5564] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:31.877622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2703446-9630-4032-9b73-334407983432 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:31.892246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2703446-9630-4032-9b73-334407983432 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:31.903217 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2797/5565] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:31 2022] PUT /identity/v3/projects/30c543f4b0ec42618830315b24c4984d/users/876b3b3ba17a45ccadd3ee1e9bce5b89/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:31.904850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:31.905156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:31.905435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:31.912281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:31.948721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] MFA Rules not processed for user `876b3b3ba17a45ccadd3ee1e9bce5b89`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:31.950614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:31.970258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:32.000873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3302-9ca9-4910-b86e-fd7f2184c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:32.001922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3302-9ca9-4910-b86e-fd7f2184c9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:32.002907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3302-9ca9-4910-b86e-fd7f2184c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:32.003262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3302-9ca9-4910-b86e-fd7f2184c9e7 admin admin] PATH_INFO: `/v3/projects/98994a513d8148718997fb1c02dd6833/users/5e97368d9959490bac08b91bc86d8687/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:32.023673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3302-9ca9-4910-b86e-fd7f2184c9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98994a513d8148718997fb1c02dd6833, user_id=5e97368d9959490bac08b91bc86d8687, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:32.028427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3302-9ca9-4910-b86e-fd7f2184c9e7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:32.064263 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2769/5566] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:31 2022] PUT /identity/v3/projects/98994a513d8148718997fb1c02dd6833/users/5e97368d9959490bac08b91bc86d8687/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:24:32.075285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84505271-5e8e-46e7-8b1d-58d17fe8284e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:32.075659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84505271-5e8e-46e7-8b1d-58d17fe8284e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:32.076005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84505271-5e8e-46e7-8b1d-58d17fe8284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:32.135376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-84505271-5e8e-46e7-8b1d-58d17fe8284e None None] MFA Rules not processed for user `5e97368d9959490bac08b91bc86d8687`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:32.136627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-84505271-5e8e-46e7-8b1d-58d17fe8284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:32.150987 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2798/5567] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:32.211079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:32.212571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:32.256275 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2770/5568] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:24:32.258087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:32.258552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:32.258991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:32.279239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] MFA Rules not processed for user `5e97368d9959490bac08b91bc86d8687`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:32.280855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:32.293815 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2771/5569] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:32.355396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f026a8-4e5b-47c7-aeb4-4d96633c11e1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:32.434841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:32.435515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:32.435796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:32.436075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:32.441531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:32.443029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:32.550124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:32.551754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:32.573664 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2799/5570] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:32 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:24:32.621259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b9df-6906-4e04-a151-d85dc02901f3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:32.630729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:32.631581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:32.631991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:32.632360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:32.649175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:32.651950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:32.681477 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2772/5571] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:24:42.206059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:42.207744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:42.214531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:42.310290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872fedf-392e-4436-99d8-79112e2f7f88 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:42.318950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:42.320452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:42.321165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:42.321683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] PATH_INFO: `/v3/users/7a41eb42094f418685b83cc0a57852d5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:42.323276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a41eb42094f418685b83cc0a57852d5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:42.328550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:42.414757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a41eb42094f418685b83cc0a57852d5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:42.417231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a41eb42094f418685b83cc0a57852d5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:42.432041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a41eb42094f418685b83cc0a57852d5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:42.433234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a41eb42094f418685b83cc0a57852d5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:42.442296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-727b766e-c32c-42eb-8bf6-11c1258d7873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a41eb42094f418685b83cc0a57852d5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:42.464991 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2800/5572] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:42 2022] DELETE /identity/v3/users/7a41eb42094f418685b83cc0a57852d5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:42.665144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:43.099522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:43.118715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446c071-e3f1-4d07-8df7-c312636ce5a3 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:43.235599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:43.236682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.237160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.237661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] PATH_INFO: `/v3/projects/e7126d757bd748f291963f779f8eaad3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.239286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7126d757bd748f291963f779f8eaad3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:43.242376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:43.328201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7126d757bd748f291963f779f8eaad3', 'request_id': 'req-41afd6b7-327d-41a6-946a-309ae5675287'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:43.338716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7126d757bd748f291963f779f8eaad3', 'request_id': 'req-41afd6b7-327d-41a6-946a-309ae5675287'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:43.352347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7126d757bd748f291963f779f8eaad3', 'request_id': 'req-41afd6b7-327d-41a6-946a-309ae5675287'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:43.366209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] The token cache is being invalidate because project e7126d757bd748f291963f779f8eaad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:43.366769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:43.367816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41afd6b7-327d-41a6-946a-309ae5675287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:43.370563 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2773/5573] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:43 2022] DELETE /identity/v3/projects/e7126d757bd748f291963f779f8eaad3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:43.376652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d041728-b56d-4c9e-9ce7-f886842a923e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.377150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d041728-b56d-4c9e-9ce7-f886842a923e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.377350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d041728-b56d-4c9e-9ce7-f886842a923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.399185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3d041728-b56d-4c9e-9ce7-f886842a923e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:43.400623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d041728-b56d-4c9e-9ce7-f886842a923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:43.481990 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2801/5574] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:43.484975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4626a-f1f1-436c-9929-724adf726973 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.485647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4626a-f1f1-436c-9929-724adf726973 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.486207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4626a-f1f1-436c-9929-724adf726973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.513983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-14f4626a-f1f1-436c-9929-724adf726973 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:43.515210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-14f4626a-f1f1-436c-9929-724adf726973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:43.525004 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2774/5575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:43.529321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d041728-b56d-4c9e-9ce7-f886842a923e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:43.543974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d041728-b56d-4c9e-9ce7-f886842a923e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:43.547316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:43.548628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.548982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.549290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.550169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:43.551107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:43.553083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:43.571015 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2802/5576] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:24:43.572329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4626a-f1f1-436c-9929-724adf726973 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:43.582693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4626a-f1f1-436c-9929-724adf726973 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:43.587525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:43.588233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.588650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.588986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.589745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:43.591825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:43.629063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2775/5577] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:43 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:43.631180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:43.650834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb5a5-f3ff-44b0-b032-0b75df381703 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:43.658901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:43.769780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:43.771673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.772112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.772499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.773648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:43.778015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:43.814792 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2803/5578] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:43 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:43.815218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:43.830175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcb293-4d85-4d55-87df-35423c57132c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:43.844728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:43.845681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.846077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.846425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.849921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:43.851942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:43.879951 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2776/5579] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:43.884104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:43.913739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c3843-f96f-460b-b0d9-21f40122f2cf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:43.924598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc34a21-ba07-4866-9150-9afd2253798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:43.930984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34a21-ba07-4866-9150-9afd2253798a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:43.931805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34a21-ba07-4866-9150-9afd2253798a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:43.934954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc34a21-ba07-4866-9150-9afd2253798a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:43.937554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc34a21-ba07-4866-9150-9afd2253798a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:43.941277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc34a21-ba07-4866-9150-9afd2253798a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:43.976380 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2804/5580] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:43.979894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:43.994046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338931c-58ba-417d-9833-ffb94f4951be admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:43.999277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:44.000964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:44.001424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:44.001914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] PATH_INFO: `/v3/projects/8d7165cfb5ed42f59bc1e6f23a40d087/users/eacf11dd04294520bb690d0f99d78a09/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:44.106804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7165cfb5ed42f59bc1e6f23a40d087, user_id=eacf11dd04294520bb690d0f99d78a09, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:44.112906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:44.150632 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2777/5581] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:43 2022] PUT /identity/v3/projects/8d7165cfb5ed42f59bc1e6f23a40d087/users/eacf11dd04294520bb690d0f99d78a09/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:44.161456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8dc66-8efb-4083-ade4-f58e3ac86f8f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:44.161456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8dc66-8efb-4083-ade4-f58e3ac86f8f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:44.161758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8dc66-8efb-4083-ade4-f58e3ac86f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:44.200281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ae8dc66-8efb-4083-ade4-f58e3ac86f8f None None] MFA Rules not processed for user `eacf11dd04294520bb690d0f99d78a09`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:44.201566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ae8dc66-8efb-4083-ade4-f58e3ac86f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:44.299217 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2805/5582] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:44.303812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:44.349365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:44.426284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332580eb-5c8e-4de1-92f3-a4d02892ea8b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:44.434249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:44.435178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:44.435644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:44.436122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:44.436994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:44.439264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:44.480538 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2778/5583] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:44 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:44.484384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8dc66-8efb-4083-ade4-f58e3ac86f8f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:44.511745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8dc66-8efb-4083-ade4-f58e3ac86f8f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:44.597497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:44.599072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:44.599450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:44.600003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:44.600810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:44.603647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:44.647135 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2806/5584] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:44 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:24:44.652327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:44.674049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d2b69-5e38-40ab-aa2a-e980ddcee6d5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:44.705932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:44.707872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:44.708448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:44.709201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:44.710481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:44.717255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:44.733401 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2779/5585] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:44.737644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:44.749565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670f2ce-1531-4b6d-ac9a-fe316e1839e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:44.754802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:44.755842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:44.756136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:44.756393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] PATH_INFO: `/v3/projects/23c2a76770b2488ca57b649a9f9e2efb/users/b887e49676774bcca9300b99ada57bc8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:44.760957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:44.785150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c2a76770b2488ca57b649a9f9e2efb, user_id=b887e49676774bcca9300b99ada57bc8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:44.809573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:44.845392 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2807/5586] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:44 2022] PUT /identity/v3/projects/23c2a76770b2488ca57b649a9f9e2efb/users/b887e49676774bcca9300b99ada57bc8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:44.849950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:44.863663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227096-2005-4529-b94c-7465b6f18272 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:45.032454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a126879-5775-42c3-88b9-cb244b83d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:45.033953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126879-5775-42c3-88b9-cb244b83d741 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:45.035104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126879-5775-42c3-88b9-cb244b83d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:45.035570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126879-5775-42c3-88b9-cb244b83d741 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:45.036645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a126879-5775-42c3-88b9-cb244b83d741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:45.042656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a126879-5775-42c3-88b9-cb244b83d741 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:45.059035 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2780/5587] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:45.063147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:45.075882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c53a-0ced-4756-b21d-864e5b7bef88 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:45.082071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:45.088678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:45.097722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:45.099122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] PATH_INFO: `/v3/projects/23c2a76770b2488ca57b649a9f9e2efb/users/b887e49676774bcca9300b99ada57bc8/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:45.102041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c2a76770b2488ca57b649a9f9e2efb, user_id=b887e49676774bcca9300b99ada57bc8, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:45.105765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:45.124638 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2808/5588] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:45 2022] PUT /identity/v3/projects/23c2a76770b2488ca57b649a9f9e2efb/users/b887e49676774bcca9300b99ada57bc8/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:45.218275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac971-8de8-4987-bd82-232ce3657300 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:45.218929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac971-8de8-4987-bd82-232ce3657300 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:45.219402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ac971-8de8-4987-bd82-232ce3657300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:45.263727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-493ac971-8de8-4987-bd82-232ce3657300 None None] MFA Rules not processed for user `b887e49676774bcca9300b99ada57bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:45.265226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-493ac971-8de8-4987-bd82-232ce3657300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:45.384552 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2781/5589] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:45.385788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:45.414520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf03e47-8801-499d-bb4f-7d5cb8f36948 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:45.429781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:45.432132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:45.432703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:45.433225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:45.434240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:45.436140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:45.463283 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2809/5590] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Jun 18 22:24:45 2022] POST /identity/v3/domains => generated 276 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:45.467513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ac971-8de8-4987-bd82-232ce3657300 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:45.479372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ac971-8de8-4987-bd82-232ce3657300 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:45.527293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:45.587830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:45.588529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:45.588816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:45.589252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:45.590016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:45.592390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:45.615146 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2782/5591] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Jun 18 22:24:45 2022] POST /identity/v3/domains => generated 275 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:45.616621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:45.630586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbc1fd-3088-4cd8-a72a-23939cde1f8b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:45.804424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5531-d5de-4fd1-8bb7-ed2dd5f5a774 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:45.807256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5531-d5de-4fd1-8bb7-ed2dd5f5a774 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:45.807552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5531-d5de-4fd1-8bb7-ed2dd5f5a774 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:45.807841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5531-d5de-4fd1-8bb7-ed2dd5f5a774 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:45.808606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5531-d5de-4fd1-8bb7-ed2dd5f5a774 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:45.825607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5531-d5de-4fd1-8bb7-ed2dd5f5a774 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:45.869403 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2810/5592] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Jun 18 22:24:45 2022] POST /identity/v3/domains => generated 277 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:45.876546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:45.890272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6184-ae5a-4016-b4a9-731624a126e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:45.890781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7413-1a3e-48e3-9873-3d0c1adeca78 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:45.891164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6184-ae5a-4016-b4a9-731624a126e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:45.891811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc6184-ae5a-4016-b4a9-731624a126e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:45.918297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3afc6184-ae5a-4016-b4a9-731624a126e1 None None] MFA Rules not processed for user `01ecbaf0e5004723bd6a96296ea135d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:45.920280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3afc6184-ae5a-4016-b4a9-731624a126e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:46.058720 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2811/5593] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:24:46.100682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:46.101431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:46.101722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:46.102091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:46.103337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:46.107681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:46.130777 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2783/5594] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Jun 18 22:24:45 2022] POST /identity/v3/domains => generated 279 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:46.134267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6184-ae5a-4016-b4a9-731624a126e1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:46.153269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc6184-ae5a-4016-b4a9-731624a126e1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:46.241699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:46.254873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:46.256861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:46.257199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:46.257485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/154c01463b0349d8b254630fa10c6c36` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:46.279623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=154c01463b0349d8b254630fa10c6c36)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:46.283261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:46.330099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '154c01463b0349d8b254630fa10c6c36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.335278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '154c01463b0349d8b254630fa10c6c36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.431967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154c01463b0349d8b254630fa10c6c36', 'request_id': 'req-790eee81-f484-4d4c-a41c-f0cd408a780d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.448580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154c01463b0349d8b254630fa10c6c36', 'request_id': 'req-790eee81-f484-4d4c-a41c-f0cd408a780d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.469263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154c01463b0349d8b254630fa10c6c36', 'request_id': 'req-790eee81-f484-4d4c-a41c-f0cd408a780d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.486427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] The token cache is being invalidate because project 154c01463b0349d8b254630fa10c6c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:46.486717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.489837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.509921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '154c01463b0349d8b254630fa10c6c36', 'request_id': 'req-790eee81-f484-4d4c-a41c-f0cd408a780d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.514580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '154c01463b0349d8b254630fa10c6c36', 'request_id': 'req-790eee81-f484-4d4c-a41c-f0cd408a780d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.516311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '154c01463b0349d8b254630fa10c6c36', 'request_id': 'req-790eee81-f484-4d4c-a41c-f0cd408a780d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.527910 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2812/5595] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:46 2022] DELETE /identity/v3/domains/154c01463b0349d8b254630fa10c6c36 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:46.534321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:46.538559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:46.555272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1c7e6-bb4e-4f71-b732-7e50344163e7 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:46.656927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:46.657668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:46.657960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:46.658244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:46.667925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:46.669742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:46.700962 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2784/5596] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:46 2022] POST /identity/v3/domains => generated 249 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:24:46.705332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:46.719313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eee81-f484-4d4c-a41c-f0cd408a780d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:46.802940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:46.804126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:46.804366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:46.804615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/80f12f9f99b24905b244c01b091807b5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:46.819205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=80f12f9f99b24905b244c01b091807b5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:46.820932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:46.847800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '80f12f9f99b24905b244c01b091807b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.849158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '80f12f9f99b24905b244c01b091807b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.860316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:46.885508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '80f12f9f99b24905b244c01b091807b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.887113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '80f12f9f99b24905b244c01b091807b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:46.890916 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2813/5597] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:46 2022] PATCH /identity/v3/domains/80f12f9f99b24905b244c01b091807b5 => generated 250 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:46.894607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:46.896434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:46.921790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878a0c-1950-4da7-a0d1-d66ad49c8979 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:46.980612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:46.999728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:47.000627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:47.000915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:47.001243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/80f12f9f99b24905b244c01b091807b5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:47.014604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=80f12f9f99b24905b244c01b091807b5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:47.022363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:47.074071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '80f12f9f99b24905b244c01b091807b5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.084151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '80f12f9f99b24905b244c01b091807b5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.180617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f12f9f99b24905b244c01b091807b5', 'request_id': 'req-13ace146-0d67-494b-896a-1b85a2d612a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.201837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f12f9f99b24905b244c01b091807b5', 'request_id': 'req-13ace146-0d67-494b-896a-1b85a2d612a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.225862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f12f9f99b24905b244c01b091807b5', 'request_id': 'req-13ace146-0d67-494b-896a-1b85a2d612a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.245214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] The token cache is being invalidate because project 80f12f9f99b24905b244c01b091807b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:47.245585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.246196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.262696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '80f12f9f99b24905b244c01b091807b5', 'request_id': 'req-13ace146-0d67-494b-896a-1b85a2d612a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.267994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '80f12f9f99b24905b244c01b091807b5', 'request_id': 'req-13ace146-0d67-494b-896a-1b85a2d612a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.268730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '80f12f9f99b24905b244c01b091807b5', 'request_id': 'req-13ace146-0d67-494b-896a-1b85a2d612a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.291493 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2785/5598] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:46 2022] DELETE /identity/v3/domains/80f12f9f99b24905b244c01b091807b5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:47.293344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:47.310239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aca2c5-9b14-48f3-970a-e0f9472283c3 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:47.432476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:47.434160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:47.434620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:47.436156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:47.439576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:47.449294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:47.478202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2814/5599] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:47 2022] POST /identity/v3/domains => generated 277 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:47.482419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:47.484429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:47.507850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ace146-0d67-494b-896a-1b85a2d612a8 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:47.616451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:47.617377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:47.617662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:47.617935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/ab66349c563542f2827cd0a4658bf6f8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:47.643021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ab66349c563542f2827cd0a4658bf6f8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:47.644829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:47.664839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:47.670266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.671479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.715528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.716537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:47.721987 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2786/5600] 10.222.0.30 () {60 vars in 1249 bytes} [Sat Jun 18 22:24:47 2022] PATCH /identity/v3/domains/ab66349c563542f2827cd0a4658bf6f8 => generated 279 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:47.726353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:47.728364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:47.752778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce454d74-9c4b-4483-914b-563311abe8d5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:47.890311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:47.891213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:47.891499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:47.891777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/ab66349c563542f2827cd0a4658bf6f8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:47.946391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=ab66349c563542f2827cd0a4658bf6f8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:47.949079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:47.951230 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2815/5601] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:24:47 2022] GET /identity/v3/domains/ab66349c563542f2827cd0a4658bf6f8 => generated 279 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:47.955743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:47.969794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220c5b-4b92-4975-b1c7-798ac5ef3816 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:47.978915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:47.979867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:47.980288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:47.981391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/ab66349c563542f2827cd0a4658bf6f8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:47.983054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ab66349c563542f2827cd0a4658bf6f8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:47.985419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:48.045415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.053738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.130801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8', 'request_id': 'req-4ca06717-a6a4-4cf6-a536-972e25d12151'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.140380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8', 'request_id': 'req-4ca06717-a6a4-4cf6-a536-972e25d12151'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.153797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8', 'request_id': 'req-4ca06717-a6a4-4cf6-a536-972e25d12151'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.172090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] The token cache is being invalidate because project ab66349c563542f2827cd0a4658bf6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:48.172454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.173494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.186402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8', 'request_id': 'req-4ca06717-a6a4-4cf6-a536-972e25d12151'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.187819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8', 'request_id': 'req-4ca06717-a6a4-4cf6-a536-972e25d12151'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.188734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ab66349c563542f2827cd0a4658bf6f8', 'request_id': 'req-4ca06717-a6a4-4cf6-a536-972e25d12151'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.208048 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2787/5602] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:47 2022] DELETE /identity/v3/domains/ab66349c563542f2827cd0a4658bf6f8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:48.209158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:48.211086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:48.224584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29171474-29f3-4c36-9992-d30fa1ae741d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:48.316727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:48.317827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:48.318507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:48.318899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:48.319718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:48.322142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:48.359342 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2816/5603] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:24:48 2022] GET /identity/v3/domains => generated 1346 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:48.364356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:48.379321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca06717-a6a4-4cf6-a536-972e25d12151 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:48.385938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:48.386834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:48.387121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:48.387395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/ab66349c563542f2827cd0a4658bf6f8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:48.395555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find domain: ab66349c563542f2827cd0a4658bf6f8.: keystone.exception.DomainNotFound: Could not find domain: ab66349c563542f2827cd0a4658bf6f8. Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ab66349c563542f2827cd0a4658bf6f8. Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:48.407216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:48.408538 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ab66349c563542f2827cd0a4658bf6f8. Jun 18 22:24:48.409690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:48.412623 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2788/5604] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:48 2022] PATCH /identity/v3/domains/ab66349c563542f2827cd0a4658bf6f8 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:48.416053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:48.428095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ddc9f-4690-402e-a7d3-9f6a5d0a7014 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:48.434705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:48.435775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:48.435775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:48.436006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:48.436729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:48.439106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:48.455479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:UPDATE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:48.472044 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2817/5605] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:48 2022] POST /identity/v3/domains => generated 275 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:48.476667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:48.487895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae75a3-fd14-46f0-94ca-63fc3a5df700 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:48.559008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:48.559716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:48.560005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:48.560310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:48.561061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:48.563191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:48.587805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:48.610517 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2789/5606] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:48 2022] POST /identity/v3/users => generated 348 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:48.611392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:48.623766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd65ac-66e4-481c-92e7-20cd8f5bf91b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:48.628630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:48.629493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:48.629893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:48.630257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/groups` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:48.631043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:48.633081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:48.650902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2818/5607] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:24:48 2022] POST /identity/v3/groups => generated 324 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:24:48.654883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:48.666937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb452-dafe-42d3-8010-5b3703d13b6f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:48.672152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:48.673258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:48.673688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:48.673974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/2879f6d606904fd1b535d9483fa7efdc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:48.675371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2879f6d606904fd1b535d9483fa7efdc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:48.677308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:48.707658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.709136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.745358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.746143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.752924 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2790/5608] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:48 2022] PATCH /identity/v3/domains/2879f6d606904fd1b535d9483fa7efdc => generated 276 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:48.754792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:48.759448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:48.815024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af67c5-b5e4-49a2-8ecb-2fbdf4a6afeb tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:48.918887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:48.919684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:48.919977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:48.921095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/2879f6d606904fd1b535d9483fa7efdc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:48.951330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2879f6d606904fd1b535d9483fa7efdc)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:48.953005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:48.985552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:48.989320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.069127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:49.070804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:49.177157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641125db-fa00-4b5b-a42c-c99ac2382177 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:49.259947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2868f22325394e47a97178fdcc87575d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.260670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2868f22325394e47a97178fdcc87575d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.262196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=1,keystone:DELETE=11 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:49.292152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:49.292837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:49.293167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:49.293450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:49.295557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:49.300035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2868f22325394e47a97178fdcc87575d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.300765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2868f22325394e47a97178fdcc87575d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.319280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2868f22325394e47a97178fdcc87575d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.397694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:49.399367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:49.405430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc', 'request_id': 'req-d87dab93-2a42-40a4-9fb5-ffe67086e67c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.416623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc', 'request_id': 'req-d87dab93-2a42-40a4-9fb5-ffe67086e67c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.421889 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2791/5609] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:24:49.433057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc', 'request_id': 'req-d87dab93-2a42-40a4-9fb5-ffe67086e67c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.452327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] The token cache is being invalidate because project 2879f6d606904fd1b535d9483fa7efdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:49.452939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.454513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.488623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc', 'request_id': 'req-d87dab93-2a42-40a4-9fb5-ffe67086e67c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.489526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc', 'request_id': 'req-d87dab93-2a42-40a4-9fb5-ffe67086e67c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.490179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2879f6d606904fd1b535d9483fa7efdc', 'request_id': 'req-d87dab93-2a42-40a4-9fb5-ffe67086e67c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:49.512706 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2819/5610] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:48 2022] DELETE /identity/v3/domains/2879f6d606904fd1b535d9483fa7efdc => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:49.517493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:49.519975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:49.540780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:UPDATE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:49.606344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6816-e0d2-47c4-abf9-1f4d445019d4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:49.675643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:49.676620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:49.676941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:49.678068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/2879f6d606904fd1b535d9483fa7efdc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:49.687028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=2879f6d606904fd1b535d9483fa7efdc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:49.699764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find domain: 2879f6d606904fd1b535d9483fa7efdc.: keystone.exception.DomainNotFound: Could not find domain: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:49.725362 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:49.726600 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:49.729963 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2792/5611] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:24:49 2022] GET /identity/v3/domains/2879f6d606904fd1b535d9483fa7efdc => generated 112 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:49.731705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:49.733224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:49.754197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dab93-2a42-40a4-9fb5-ffe67086e67c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:49.761187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:49.762405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:49.762744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:49.763107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/users/2868f22325394e47a97178fdcc87575d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:49.772800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:get_user(user_id=2868f22325394e47a97178fdcc87575d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:49.774965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find user: 2868f22325394e47a97178fdcc87575d.: keystone.exception.UserNotFound: Could not find user: 2868f22325394e47a97178fdcc87575d. Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 18 22:24:49.806031 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:49.807321 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2868f22325394e47a97178fdcc87575d. Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:49.808553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2820/5612] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:24:49 2022] GET /identity/v3/users/2868f22325394e47a97178fdcc87575d => generated 110 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 18 22:24:49.813411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:49.826797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739cb10-d64c-46be-bf56-08537f8be59f tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:49.832126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:49.833287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:49.833672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:49.834065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/groups/b4ba33d867c84f768954bab6bd01b104` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:49.839303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:get_group(group_id=b4ba33d867c84f768954bab6bd01b104)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:49.840456 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:24:49.840456 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:24:49.840456 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:24:49.841906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find group: b4ba33d867c84f768954bab6bd01b104.: keystone.exception.GroupNotFound: Could not find group: b4ba33d867c84f768954bab6bd01b104. Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jun 18 22:24:49.863332 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_group(group_id) Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:49.864669 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: b4ba33d867c84f768954bab6bd01b104. Jun 18 22:24:49.866000 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:49.868333 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2793/5613] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:49 2022] GET /identity/v3/groups/b4ba33d867c84f768954bab6bd01b104 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 18 22:24:49.872444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:49.886749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e148af-6903-4338-8965-93bff3123b89 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:49.893130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:49.894242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:49.894716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:49.895467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/groups/b4ba33d867c84f768954bab6bd01b104` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:49.901373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find group: b4ba33d867c84f768954bab6bd01b104.: keystone.exception.GroupNotFound: Could not find group: b4ba33d867c84f768954bab6bd01b104. Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jun 18 22:24:49.916917 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:49.918229 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: b4ba33d867c84f768954bab6bd01b104. Jun 18 22:24:49.919550 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:49.925184 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2821/5614] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:24:49 2022] DELETE /identity/v3/groups/b4ba33d867c84f768954bab6bd01b104 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:49.929248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:49.942151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207ddbd-1a8a-40f7-b71c-acc03afc1e1c tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:49.950807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:49.972953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:49.973564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:49.974010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/users/2868f22325394e47a97178fdcc87575d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:49.996510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2868f22325394e47a97178fdcc87575d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:50.000289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find user: 2868f22325394e47a97178fdcc87575d.: keystone.exception.UserNotFound: Could not find user: 2868f22325394e47a97178fdcc87575d. Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jun 18 22:24:50.069424 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:50.070854 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2868f22325394e47a97178fdcc87575d. Jun 18 22:24:50.072045 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:50.078060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.090440 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2794/5615] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:49 2022] DELETE /identity/v3/users/2868f22325394e47a97178fdcc87575d => generated 110 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:50.095303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799a611-095c-415d-b39b-264388f3e9e2 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.108417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:50.110224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:50.110853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:50.111298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/2879f6d606904fd1b535d9483fa7efdc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:50.124883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find domain: 2879f6d606904fd1b535d9483fa7efdc.: keystone.exception.DomainNotFound: Could not find domain: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:50.140360 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:50.141778 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:50.143146 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:50.146623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2822/5616] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:50 2022] PATCH /identity/v3/domains/2879f6d606904fd1b535d9483fa7efdc => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:50.155440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.168500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbaafb-49cb-458a-941d-34575b243fa4 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.173907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:50.175209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:50.175662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:50.179357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:50.180355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:50.182912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:50.210490 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2795/5617] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:24:50 2022] GET /identity/v3/domains => generated 1346 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:50.219258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.248204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1990854-4420-4578-a055-7e4cdf5cb3c5 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.254693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:50.255367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:50.255654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:50.255931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:50.256736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:50.257068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:50.258967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:50.293589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.301841 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2823/5618] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:24:50 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:50.308044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87181a-2959-4571-9e4e-ade5c3c64bc6 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.314970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:50.315720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:50.316010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:50.316320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:50.317718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-462725089) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:50.318387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:50.320057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:50.340649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.356050 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2796/5619] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Jun 18 22:24:50 2022] GET /identity/v3/domains?name=tempest-test_domain-462725089 => generated 407 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:50.357191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f544379-0789-4396-86e3-9d94de97c32d tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.362961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:50.364547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:50.364847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:50.365163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/2879f6d606904fd1b535d9483fa7efdc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:50.375502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Could not find domain: 2879f6d606904fd1b535d9483fa7efdc.: keystone.exception.DomainNotFound: Could not find domain: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:50.388991 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:50.390367 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2879f6d606904fd1b535d9483fa7efdc. Jun 18 22:24:50.391384 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:50.395958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.412584 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2824/5620] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:50 2022] PATCH /identity/v3/domains/2879f6d606904fd1b535d9483fa7efdc => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:50.412828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2eade9-4967-4627-84ef-73b9b6fb89a9 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.419099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:50.420805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:50.421998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:50.422346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/eaa659c1ca014e0a928e544373349b57` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:50.447294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=eaa659c1ca014e0a928e544373349b57)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:50.449486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:50.508630 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2797/5621] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:50 2022] PATCH /identity/v3/domains/eaa659c1ca014e0a928e544373349b57 => generated 277 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:50.510953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.529533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100930-e7e8-4251-aaa8-97857181f078 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.536576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:50.538057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:50.538854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:50.539298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/eaa659c1ca014e0a928e544373349b57` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:50.579518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=eaa659c1ca014e0a928e544373349b57)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:50.582890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:50.630848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'eaa659c1ca014e0a928e544373349b57'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.641404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'eaa659c1ca014e0a928e544373349b57'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.671186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:50.763053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa659c1ca014e0a928e544373349b57', 'request_id': 'req-41c1bccf-1d7e-4460-a779-650d8e4086ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.786958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa659c1ca014e0a928e544373349b57', 'request_id': 'req-41c1bccf-1d7e-4460-a779-650d8e4086ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.816217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa659c1ca014e0a928e544373349b57', 'request_id': 'req-41c1bccf-1d7e-4460-a779-650d8e4086ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.832428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] The token cache is being invalidate because project eaa659c1ca014e0a928e544373349b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:50.832795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.833489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.842253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'eaa659c1ca014e0a928e544373349b57', 'request_id': 'req-41c1bccf-1d7e-4460-a779-650d8e4086ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.843007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'eaa659c1ca014e0a928e544373349b57', 'request_id': 'req-41c1bccf-1d7e-4460-a779-650d8e4086ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.843963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'eaa659c1ca014e0a928e544373349b57', 'request_id': 'req-41c1bccf-1d7e-4460-a779-650d8e4086ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:50.857103 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2825/5622] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:50 2022] DELETE /identity/v3/domains/eaa659c1ca014e0a928e544373349b57 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:50.858074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:50.859972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:50.877756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee621e8-f41a-4dc4-b1e9-3b27cb91620b tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:50.905506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:51.009182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:51.010280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:51.010669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:51.011060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/b495fb09907848c0a51fdd610cba3863` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:51.040699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b495fb09907848c0a51fdd610cba3863)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:51.046591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:51.081114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b495fb09907848c0a51fdd610cba3863'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.081934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b495fb09907848c0a51fdd610cba3863'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.137513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b495fb09907848c0a51fdd610cba3863'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.139773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b495fb09907848c0a51fdd610cba3863'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.152082 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2798/5623] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:50 2022] PATCH /identity/v3/domains/b495fb09907848c0a51fdd610cba3863 => generated 276 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:24:51.158475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:51.185668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1bccf-1d7e-4460-a779-650d8e4086ec tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:51.349788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:51.351111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:51.351781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:51.352292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/b495fb09907848c0a51fdd610cba3863` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:51.375957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b495fb09907848c0a51fdd610cba3863)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:51.378100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:51.415676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b495fb09907848c0a51fdd610cba3863'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.420892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b495fb09907848c0a51fdd610cba3863'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.492005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:51.495987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b495fb09907848c0a51fdd610cba3863', 'request_id': 'req-0195d5e4-4b55-4aa7-b8d3-384dd3598613'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.506568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b495fb09907848c0a51fdd610cba3863', 'request_id': 'req-0195d5e4-4b55-4aa7-b8d3-384dd3598613'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.527624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b495fb09907848c0a51fdd610cba3863', 'request_id': 'req-0195d5e4-4b55-4aa7-b8d3-384dd3598613'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.546275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] The token cache is being invalidate because project b495fb09907848c0a51fdd610cba3863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:51.546968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.547999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.561664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b495fb09907848c0a51fdd610cba3863', 'request_id': 'req-0195d5e4-4b55-4aa7-b8d3-384dd3598613'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.562900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b495fb09907848c0a51fdd610cba3863', 'request_id': 'req-0195d5e4-4b55-4aa7-b8d3-384dd3598613'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.563767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b495fb09907848c0a51fdd610cba3863', 'request_id': 'req-0195d5e4-4b55-4aa7-b8d3-384dd3598613'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.577197 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2826/5624] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:51 2022] DELETE /identity/v3/domains/b495fb09907848c0a51fdd610cba3863 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:51.581384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:51.584764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:51.607951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b048e4f-ddc1-4bb2-8b80-4c856cc74705 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:51.686682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:51.687632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:51.687918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:51.688423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/b11282a419274b6ea507c2ec11ceec21` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:51.703835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b11282a419274b6ea507c2ec11ceec21)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:51.705626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:51.728668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.729587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.773322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.774253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:51.778148 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2799/5625] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:51 2022] PATCH /identity/v3/domains/b11282a419274b6ea507c2ec11ceec21 => generated 277 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:51.782216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:51.784864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:51.812892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d5e4-4b55-4aa7-b8d3-384dd3598613 tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:51.925604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b887e49676774bcca9300b99ada57bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23c2a76770b2488ca57b649a9f9e2efb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:51.926576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:51.926864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:51.927141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] PATH_INFO: `/v3/domains/b11282a419274b6ea507c2ec11ceec21` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:51.957089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b11282a419274b6ea507c2ec11ceec21)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:51.958847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:52.012383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.017125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.140139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21', 'request_id': 'req-215833b0-1b8a-4d94-8d13-213cf2498fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.172757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21', 'request_id': 'req-215833b0-1b8a-4d94-8d13-213cf2498fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.186695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21', 'request_id': 'req-215833b0-1b8a-4d94-8d13-213cf2498fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.215828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] The token cache is being invalidate because project b11282a419274b6ea507c2ec11ceec21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:52.216134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.218022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.229444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21', 'request_id': 'req-215833b0-1b8a-4d94-8d13-213cf2498fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.230457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21', 'request_id': 'req-215833b0-1b8a-4d94-8d13-213cf2498fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.232809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b11282a419274b6ea507c2ec11ceec21', 'request_id': 'req-215833b0-1b8a-4d94-8d13-213cf2498fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.235758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:52.255076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2827/5626] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:51 2022] DELETE /identity/v3/domains/b11282a419274b6ea507c2ec11ceec21 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:52.256980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:52.264479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:52.310376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:52.352799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a4258-1b61-465f-b648-fed8edb7982e tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:52.475006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:52.477360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:52.477759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:52.478231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] PATH_INFO: `/v3/users/eacf11dd04294520bb690d0f99d78a09` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:52.479746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eacf11dd04294520bb690d0f99d78a09)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:52.481903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:52.525305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:52.527218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:52.554436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215833b0-1b8a-4d94-8d13-213cf2498fdf tempest-DomainsTestJSON-279762134 tempest-DomainsTestJSON-279762134-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:52.562837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eacf11dd04294520bb690d0f99d78a09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.564250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eacf11dd04294520bb690d0f99d78a09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.567197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:52.568494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:52.568773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:52.569058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] PATH_INFO: `/v3/users/876b3b3ba17a45ccadd3ee1e9bce5b89` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:52.574509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876b3b3ba17a45ccadd3ee1e9bce5b89)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:52.576799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:52.586577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eacf11dd04294520bb690d0f99d78a09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.588130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eacf11dd04294520bb690d0f99d78a09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.600095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-924e0fa7-975a-4ede-9dd1-c562403c99f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eacf11dd04294520bb690d0f99d78a09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.640733 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2800/5627] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:52 2022] DELETE /identity/v3/users/eacf11dd04294520bb690d0f99d78a09 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:52.650815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:52.651963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:52.652343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:52.669260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876b3b3ba17a45ccadd3ee1e9bce5b89'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.670466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876b3b3ba17a45ccadd3ee1e9bce5b89'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.687245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876b3b3ba17a45ccadd3ee1e9bce5b89'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.694596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876b3b3ba17a45ccadd3ee1e9bce5b89'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.701464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:52.703012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:52.720834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b883733b-bde5-46b0-a1a4-2be5c0790419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876b3b3ba17a45ccadd3ee1e9bce5b89'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:52.779981 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2828/5628] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:52 2022] DELETE /identity/v3/users/876b3b3ba17a45ccadd3ee1e9bce5b89 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:52.786083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:52.786708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:52.786708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:52.857643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:52.871957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:52.909882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:52.946524 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2801/5629] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:53.018193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:53.021107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:53.076700 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2829/5630] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:53.098874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:53.100763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:53.175721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c481aec-f965-4944-b64c-0e220628c087 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:53.248813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20ded3-d520-4824-bfca-263d5a98440f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:53.262391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:53.263085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:53.263366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:53.263639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:53.286405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:53.287757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:53.288235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:53.288651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:53.289127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:53.289907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:53.301687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:53.305231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:53.314841 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2830/5631] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:53.325445 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2802/5632] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:54.260159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:54.263145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:54.283510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4062114-b34d-4179-bf85-13c56f163e7d service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:54.303187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:54.304378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:54.304930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:54.305592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] PATH_INFO: `/v3/projects/30c543f4b0ec42618830315b24c4984d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:54.307559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c543f4b0ec42618830315b24c4984d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:54.310158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:54.313673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:54.376740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:54.378742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:54.405065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3d897-2f0a-4505-b7fe-acb9a230a5da service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:54.418870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c543f4b0ec42618830315b24c4984d', 'request_id': 'req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.434641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c543f4b0ec42618830315b24c4984d', 'request_id': 'req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.449623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c543f4b0ec42618830315b24c4984d', 'request_id': 'req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.473668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] The token cache is being invalidate because project 30c543f4b0ec42618830315b24c4984d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:54.474235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.475134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d9e4f7a-25f5-4055-97d6-ec7d56dec047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.478068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2831/5633] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:54 2022] DELETE /identity/v3/projects/30c543f4b0ec42618830315b24c4984d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:54.482881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94f35-605f-4fb8-b471-e1ada2b02613 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:54.483161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94f35-605f-4fb8-b471-e1ada2b02613 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:54.483431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94f35-605f-4fb8-b471-e1ada2b02613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:54.503398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:54.504296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:54.505422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:54.505726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] PATH_INFO: `/v3/projects/8d7165cfb5ed42f59bc1e6f23a40d087` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:54.507226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7165cfb5ed42f59bc1e6f23a40d087)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:54.510053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:54.516638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-05b94f35-605f-4fb8-b471-e1ada2b02613 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:54.519177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05b94f35-605f-4fb8-b471-e1ada2b02613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:54.540777 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2832/5634] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:54.542547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc807367-029e-4fb4-b313-08ad49d86aab None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:54.542888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc807367-029e-4fb4-b313-08ad49d86aab None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:54.543259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc807367-029e-4fb4-b313-08ad49d86aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:54.590457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cc807367-029e-4fb4-b313-08ad49d86aab None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:54.591809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7165cfb5ed42f59bc1e6f23a40d087', 'request_id': 'req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.592168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cc807367-029e-4fb4-b313-08ad49d86aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:54.600200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7165cfb5ed42f59bc1e6f23a40d087', 'request_id': 'req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.602014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:54.616885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7165cfb5ed42f59bc1e6f23a40d087', 'request_id': 'req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.645664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] The token cache is being invalidate because project 8d7165cfb5ed42f59bc1e6f23a40d087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:54.645951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.647787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.652287 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2803/5635] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:54 2022] DELETE /identity/v3/projects/8d7165cfb5ed42f59bc1e6f23a40d087 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:54.653332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:54.654787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:54.694575 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2833/5636] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:54.696343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc807367-029e-4fb4-b313-08ad49d86aab None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:54.712388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc807367-029e-4fb4-b313-08ad49d86aab None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:54.720878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:54.721883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:54.722174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:54.723079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:54.723917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:54.724288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:54.726791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:54.740283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee86f9e-d03f-4e5e-a8b7-b4520e072dcb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:54.742883 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2834/5637] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:54.747370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:54.752007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:54.753266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:54.753779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:54.754506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] PATH_INFO: `/v3/users/b887e49676774bcca9300b99ada57bc8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:54.756235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b887e49676774bcca9300b99ada57bc8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:54.758580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:54.758866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9067338-67a9-4744-8522-1374fb9ee162 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:54.764595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:54.765483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:54.765920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:54.766202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:54.767954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:54.769935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:54.813708 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2835/5638] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:54 2022] POST /identity/v3/projects => generated 351 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:54.818697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:54.833278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b887e49676774bcca9300b99ada57bc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.834101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b887e49676774bcca9300b99ada57bc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.852096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b887e49676774bcca9300b99ada57bc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.852978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b887e49676774bcca9300b99ada57bc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.869003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b887e49676774bcca9300b99ada57bc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:54.895338 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2804/5639] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:54 2022] DELETE /identity/v3/users/b887e49676774bcca9300b99ada57bc8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:24:54.948051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:54.974539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05dbe-ffb5-4e67-94c4-ff12a7fb54c7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.121100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.121937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.122315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.122712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.123547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.125835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.167825 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2836/5640] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:54 2022] POST /identity/v3/users => generated 276 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:55.169448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.171168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:55.200347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495117e-d29e-4732-b57e-267685ca9cf7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.214562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.215563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.216012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.216888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.219544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.229565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.259130 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2805/5641] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:55.260403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.277489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762adbd2-9e88-4138-a326-e380bb776a77 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.291950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.292249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.292540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.292818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.293626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.295299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.346080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.358272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2837/5642] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:55.375067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992479c-31cc-4ff3-b3bb-6c72cff924ac admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.378406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.390769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:55.394702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937879f-bad0-42d3-bb6a-2359098e215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.395837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937879f-bad0-42d3-bb6a-2359098e215b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.396232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937879f-bad0-42d3-bb6a-2359098e215b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.396631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937879f-bad0-42d3-bb6a-2359098e215b admin admin] PATH_INFO: `/v3/projects/15c9b780f0f24a839c714621a83c71b4/users/ccd5ec984a3341eda3a5e65c8eeb65f5/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.434812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed654653-4ea5-4a36-ba69-d9fb49f4ca1a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.439681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937879f-bad0-42d3-bb6a-2359098e215b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c9b780f0f24a839c714621a83c71b4, user_id=ccd5ec984a3341eda3a5e65c8eeb65f5, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.442564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937879f-bad0-42d3-bb6a-2359098e215b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.446569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.447483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.447773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.448067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] PATH_INFO: `/v3/projects/23c2a76770b2488ca57b649a9f9e2efb` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.451846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c2a76770b2488ca57b649a9f9e2efb)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.456415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.485911 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2806/5643] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:55 2022] PUT /identity/v3/projects/15c9b780f0f24a839c714621a83c71b4/users/ccd5ec984a3341eda3a5e65c8eeb65f5/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:55.497873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.498180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.498445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.533968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] MFA Rules not processed for user `ccd5ec984a3341eda3a5e65c8eeb65f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:55.535766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:55.545785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c2a76770b2488ca57b649a9f9e2efb', 'request_id': 'req-17299ff3-9e80-41e7-9cb3-48108582e7ff'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:55.550877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=3,keystone:DELETE=13,keystone:SELECT=84 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:55.557719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c2a76770b2488ca57b649a9f9e2efb', 'request_id': 'req-17299ff3-9e80-41e7-9cb3-48108582e7ff'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:55.572923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c2a76770b2488ca57b649a9f9e2efb', 'request_id': 'req-17299ff3-9e80-41e7-9cb3-48108582e7ff'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:55.590698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] The token cache is being invalidate because project 23c2a76770b2488ca57b649a9f9e2efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:55.590971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:55.591669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-17299ff3-9e80-41e7-9cb3-48108582e7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:55.594209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2838/5644] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:55 2022] DELETE /identity/v3/projects/23c2a76770b2488ca57b649a9f9e2efb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:55.599520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d806c-2370-4221-9553-92c113627a3d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.599904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d806c-2370-4221-9553-92c113627a3d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.600248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d806c-2370-4221-9553-92c113627a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.623207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-382d806c-2370-4221-9553-92c113627a3d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:55.624533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-382d806c-2370-4221-9553-92c113627a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:55.634138 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2807/5645] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:55 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:24:55.650066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.651637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:55.708914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:55.726582 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2839/5646] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:24:55.735268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc9894-543d-4928-ab68-e71c1e30c014 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.735554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc9894-543d-4928-ab68-e71c1e30c014 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.735840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc9894-543d-4928-ab68-e71c1e30c014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.755799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-58fc9894-543d-4928-ab68-e71c1e30c014 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:55.758467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-58fc9894-543d-4928-ab68-e71c1e30c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:55.767770 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2840/5647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:55.768314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b78ca3-ec37-401d-9147-318482e9b0bf None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.771897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc9894-543d-4928-ab68-e71c1e30c014 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.776625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.777692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.778068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.778434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.787667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc9894-543d-4928-ab68-e71c1e30c014 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.791084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.793534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.795219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.796256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.796697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.797731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.798862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:24:55.799728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.803744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.807658 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2808/5648] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:55 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:55.822450 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2841/5649] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:55.827027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.841752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d04ba-cb4c-42bf-a6f1-05407f505990 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:55.848790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:55.849591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:55.849974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:55.850725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:55.851551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:55.854353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:55.903412 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2809/5650] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:55 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:55.908775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:55.925880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3b8d0-5cef-47c1-8b0a-a9b86517c538 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.011561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.015523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:56.054836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.055625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.055980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.056379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.057306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.060161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.103876 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2842/5651] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:55 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:56.105142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.134239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a9b69-cb15-4e61-81f6-63fde45c5cca admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.134909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a0af8-f8c9-4e0b-aa5d-de8d3dacbd03 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.145830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.146915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.147075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.147370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.148904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.149691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.150044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.150191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:56.150626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.152228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.155964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.171756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.173652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.181142 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2843/5652] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:56.184704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.189201 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2810/5653] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:24:56.215332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef397ee1-c909-4bf2-a2c7-3a2f7926fc9c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.223445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc8889-6e2c-4e46-b025-8814b3c261e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.224171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc8889-6e2c-4e46-b025-8814b3c261e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.224528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc8889-6e2c-4e46-b025-8814b3c261e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.224737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc8889-6e2c-4e46-b025-8814b3c261e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.225635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc8889-6e2c-4e46-b025-8814b3c261e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.227701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc8889-6e2c-4e46-b025-8814b3c261e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.245733 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2844/5654] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:56.253143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.281812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18186-73a2-4d89-8a48-6877026dbb6a service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.288042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.289174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.289533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.289851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] PATH_INFO: `/v3/projects/fd3e714b75f54b1d889669add8def8c4/users/50ff2afa30794316b0dc9903cef75068/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.320185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3e714b75f54b1d889669add8def8c4, user_id=50ff2afa30794316b0dc9903cef75068, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.324972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.341494 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2811/5655] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:56 2022] PUT /identity/v3/projects/fd3e714b75f54b1d889669add8def8c4/users/50ff2afa30794316b0dc9903cef75068/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:56.357614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64782ee9-79aa-4647-83fd-c3334db61a19 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.358213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64782ee9-79aa-4647-83fd-c3334db61a19 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.358213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64782ee9-79aa-4647-83fd-c3334db61a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.400345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-64782ee9-79aa-4647-83fd-c3334db61a19 None None] MFA Rules not processed for user `50ff2afa30794316b0dc9903cef75068`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:56.403848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-64782ee9-79aa-4647-83fd-c3334db61a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:56.499028 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2845/5656] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:56.504079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.511181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:56.581423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268914f-5890-4c1d-bd85-4b0435712577 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.587886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.588756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.589742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.590115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.590917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.593808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.636601 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2812/5657] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:24:56 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:56.638984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64782ee9-79aa-4647-83fd-c3334db61a19 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.659248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64782ee9-79aa-4647-83fd-c3334db61a19 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.718285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:56.753783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.755103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.755103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.755359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.756056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.758501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.789714 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2846/5658] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:24:56 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:56.790253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.802792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f2bb-170b-4d2d-aa6f-6cc6d8808b10 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.808309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.809138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.809894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.809894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.810917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.812665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.855988 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2813/5659] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:24:56.857337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.879611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcb666-2735-4463-8221-88f07c7408c6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:56.886915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:56.887868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:56.888155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:56.888454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] PATH_INFO: `/v3/projects/021395f7529049ce9624457d0806a57a/users/3b758a887aa844c5a3ff9f4bfd3ba45c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:56.936230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=021395f7529049ce9624457d0806a57a, user_id=3b758a887aa844c5a3ff9f4bfd3ba45c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:56.942360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:56.985504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:56.985762 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2847/5660] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:56 2022] PUT /identity/v3/projects/021395f7529049ce9624457d0806a57a/users/3b758a887aa844c5a3ff9f4bfd3ba45c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:57.011217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54e2b5-10ce-4391-b46f-65964f69d8ed admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.181765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86263b6-3ae9-4d00-a0a7-c370e3ed1c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.183219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86263b6-3ae9-4d00-a0a7-c370e3ed1c12 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.183501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86263b6-3ae9-4d00-a0a7-c370e3ed1c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.183776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86263b6-3ae9-4d00-a0a7-c370e3ed1c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.184843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86263b6-3ae9-4d00-a0a7-c370e3ed1c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:57.188153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86263b6-3ae9-4d00-a0a7-c370e3ed1c12 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:57.219506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:57.222818 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2814/5661] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:24:57.236414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e0d37-9868-4ca9-9368-f6a759d370cd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.245637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.246558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.247005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.247286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] PATH_INFO: `/v3/projects/021395f7529049ce9624457d0806a57a/users/3b758a887aa844c5a3ff9f4bfd3ba45c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.256475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] RBAC: Authorizing `identity:create_grant(project_id=021395f7529049ce9624457d0806a57a, user_id=3b758a887aa844c5a3ff9f4bfd3ba45c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:57.260231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:57.288169 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2848/5662] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:24:57 2022] PUT /identity/v3/projects/021395f7529049ce9624457d0806a57a/users/3b758a887aa844c5a3ff9f4bfd3ba45c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:57.300673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143b2f-e9cf-48f0-8fb8-e9f513ac7282 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.300962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143b2f-e9cf-48f0-8fb8-e9f513ac7282 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.301486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c143b2f-e9cf-48f0-8fb8-e9f513ac7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.333845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0c143b2f-e9cf-48f0-8fb8-e9f513ac7282 None None] MFA Rules not processed for user `3b758a887aa844c5a3ff9f4bfd3ba45c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:57.335539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0c143b2f-e9cf-48f0-8fb8-e9f513ac7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:57.438111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:57.448690 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2815/5663] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:57.459728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:57.475757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e016f09-c782-4409-a992-46ba2314f8de admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.481436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.483311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.483936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.484586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.485852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:57.488565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invalid input for field 'name': '' is too short Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: On instance['name']: Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: On instance['name']: Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: '' Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise error Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application '' Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:57.496528 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:24:57.498201 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application '' Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:24:57.499376 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2849/5664] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:57 2022] POST /identity/v3/domains => generated 283 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 18 22:24:57.503316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c143b2f-e9cf-48f0-8fb8-e9f513ac7282 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:57.515814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c143b2f-e9cf-48f0-8fb8-e9f513ac7282 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.522018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.523231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.523852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.524642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.525876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:57.528087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: On instance['name']: Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: On instance['name']: Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise error Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.536730 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jun 18 22:24:57.538436 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:24:57.539806 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.546761 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2816/5665] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:57 2022] POST /identity/v3/domains => generated 412 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 18 22:24:57.552994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:57.567004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10dbe3-c67d-40c6-9a55-c1d5494236c2 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.579680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.580840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.581275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.581784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.582626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:57.586398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:57.607773 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2850/5666] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:57 2022] POST /identity/v3/domains => generated 276 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:24:57.611789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:57.630290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a6f89-2342-4785-9d03-cea5fc4776e5 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.717143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.718425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.718717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.718992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains/e90d63015c4b407e922121a51f601dd5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.734683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e90d63015c4b407e922121a51f601dd5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:57.736329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jun 18 22:24:57.764509 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jun 18 22:24:57.765764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:57.766414 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2817/5667] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:57 2022] DELETE /identity/v3/domains/e90d63015c4b407e922121a51f601dd5 => generated 120 bytes in 155 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:57.771849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:57.784288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f58ba-7b52-47ad-8a9a-b12cef65c9c1 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.790115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.791102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.791479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.792174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains/e90d63015c4b407e922121a51f601dd5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:57.793519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e90d63015c4b407e922121a51f601dd5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:57.795443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:57.819543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e90d63015c4b407e922121a51f601dd5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:57.820577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e90d63015c4b407e922121a51f601dd5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:57.865375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e90d63015c4b407e922121a51f601dd5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:57.867292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e4958596-f735-4e30-8ded-50fc17748550 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e90d63015c4b407e922121a51f601dd5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:57.873173 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2851/5668] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:57 2022] PATCH /identity/v3/domains/e90d63015c4b407e922121a51f601dd5 => generated 277 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:57.877236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:57.879985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:57.898682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b694-2de6-46f0-b3fe-7b0dd20c2f06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:57.993623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:57.994603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:57.994826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:57.995101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains/e90d63015c4b407e922121a51f601dd5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:58.008541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e90d63015c4b407e922121a51f601dd5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:58.011449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:58.051712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:58.052313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:58.052598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:58.077481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:58.078833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:58.087158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e90d63015c4b407e922121a51f601dd5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.093017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e90d63015c4b407e922121a51f601dd5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.195644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:58.197145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90d63015c4b407e922121a51f601dd5', 'request_id': 'req-b5afd8a4-ba24-43cd-8b79-97b093b3194e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.201059 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2852/5669] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:24:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:24:58.202315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:58.203706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:58.212745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90d63015c4b407e922121a51f601dd5', 'request_id': 'req-b5afd8a4-ba24-43cd-8b79-97b093b3194e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.226152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90d63015c4b407e922121a51f601dd5', 'request_id': 'req-b5afd8a4-ba24-43cd-8b79-97b093b3194e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.241711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] The token cache is being invalidate because project e90d63015c4b407e922121a51f601dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:58.242156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.242869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.253259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e90d63015c4b407e922121a51f601dd5', 'request_id': 'req-b5afd8a4-ba24-43cd-8b79-97b093b3194e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.253924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e90d63015c4b407e922121a51f601dd5', 'request_id': 'req-b5afd8a4-ba24-43cd-8b79-97b093b3194e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.254595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e90d63015c4b407e922121a51f601dd5', 'request_id': 'req-b5afd8a4-ba24-43cd-8b79-97b093b3194e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.267671 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2818/5670] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:57 2022] DELETE /identity/v3/domains/e90d63015c4b407e922121a51f601dd5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:58.268559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:58.270211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:58.283830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:58.359789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38326-c47b-4d8d-a86c-385eda1d2609 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:58.383358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afd8a4-ba24-43cd-8b79-97b093b3194e tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:58.390372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:58.391120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:58.391346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:58.391599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:58.393675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:58.490731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:58.491576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:58.491923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:58.492260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] PATH_INFO: `/v3/users/ab975e8ffd0448939b2105aed58003fe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:58.495724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:58.497402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab975e8ffd0448939b2105aed58003fe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:58.497606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:58.499483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:58.524209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2819/5671] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:58.525923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:58.528661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:58.626177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab975e8ffd0448939b2105aed58003fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.627013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab975e8ffd0448939b2105aed58003fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.659351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab975e8ffd0448939b2105aed58003fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.660349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab975e8ffd0448939b2105aed58003fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.669251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:58.679407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab975e8ffd0448939b2105aed58003fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:58.681287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0019-dd5d-4ae7-97af-c46f58d5613e service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:58.691855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:58.696590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:58.698433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:58.698770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains/9e271f52df8745449c3b0b37d179533f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:58.708461 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2853/5672] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:58 2022] DELETE /identity/v3/users/ab975e8ffd0448939b2105aed58003fe => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:58.711020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Could not find domain: 9e271f52df8745449c3b0b37d179533f.: keystone.exception.DomainNotFound: Could not find domain: 9e271f52df8745449c3b0b37d179533f. Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9e271f52df8745449c3b0b37d179533f. Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:58.721794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:58.723103 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:24:58.724546 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9e271f52df8745449c3b0b37d179533f. Jun 18 22:24:58.725922 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:58.725922 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2820/5673] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:58 2022] DELETE /identity/v3/domains/9e271f52df8745449c3b0b37d179533f => generated 112 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:24:58.729282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:58.730751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:58.809462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1097b-7b1a-4530-beef-5c1094ca9f32 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:58.815332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:58.816725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:58.816725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:58.816725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:58.817431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:58.821632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:58.826087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:58.854485 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2854/5674] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:58 2022] POST /identity/v3/domains => generated 253 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:24:58.858315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:58.883098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0265c12-fbf7-4724-9f85-10089990bf06 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:58.999882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:59.000592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:59.000873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:59.001188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:59.001944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:59.003588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:59.020154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.sql.core [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1166630072' for key 'project.ixu_project_name_domain_id'") Jun 18 22:24:59.020154 ncdv-master-1 devstack@keystone.service[91204]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 22:24:59.020154 ncdv-master-1 devstack@keystone.service[91204]: [parameters: {'id': 'b349cd9e6f434b508f84b78ad0fe3534', 'name': 'tempest-domain-dup-1166630072', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jun 18 22:24:59.020154 ncdv-master-1 devstack@keystone.service[91204]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91204) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1166630072.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1166630072. Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:24:59.059928 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1166630072' for key 'project.ixu_project_name_domain_id'") Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 18 22:24:59.061376 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application yield resource Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise self.value Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application session.commit() Jun 18 22:24:59.062879 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.flush() Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application compat.raise_( Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 22:24:59.064386 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 22:24:59.065727 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:24:59.067188 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1166630072' for key 'project.ixu_project_name_domain_id'") Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [parameters: {'id': 'b349cd9e6f434b508f84b78ad0fe3534', 'name': 'tempest-domain-dup-1166630072', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:59.068825 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1166630072. Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:24:59.069956 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1166630072. Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:24:59.071242 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2821/5675] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:24:58 2022] POST /identity/v3/domains => generated 212 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:24:59.072294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:59.085872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeecde-e273-4642-a607-5c898fd3dec4 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:59.100065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:59.100964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:59.101656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:59.102249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains/09d271cf62e44937b2b339454788eae4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:59.134192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=09d271cf62e44937b2b339454788eae4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:59.136778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:59.164317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '09d271cf62e44937b2b339454788eae4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.165479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '09d271cf62e44937b2b339454788eae4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.224868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '09d271cf62e44937b2b339454788eae4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.225964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '09d271cf62e44937b2b339454788eae4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.234853 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2855/5676] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:59 2022] PATCH /identity/v3/domains/09d271cf62e44937b2b339454788eae4 => generated 254 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:24:59.235965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:59.242934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:59.279460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:59.281441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:59.282251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063127ea-57f8-4031-ba65-7522495a9b11 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:59.472604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679721-422b-4685-8693-5c1167467451 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:59.488856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:59.490253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:59.490614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:59.490899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] PATH_INFO: `/v3/users/ccd5ec984a3341eda3a5e65c8eeb65f5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:59.494904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd5ec984a3341eda3a5e65c8eeb65f5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:59.501583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:59.508331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:59.511703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:59.512838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:59.515345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains/09d271cf62e44937b2b339454788eae4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:59.543584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=09d271cf62e44937b2b339454788eae4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:59.548536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:24:59.592157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '09d271cf62e44937b2b339454788eae4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.598913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '09d271cf62e44937b2b339454788eae4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.618194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd5ec984a3341eda3a5e65c8eeb65f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.619316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd5ec984a3341eda3a5e65c8eeb65f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.653658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd5ec984a3341eda3a5e65c8eeb65f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.656473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd5ec984a3341eda3a5e65c8eeb65f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.666757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d271cf62e44937b2b339454788eae4', 'request_id': 'req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.674873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd5ec984a3341eda3a5e65c8eeb65f5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.678467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d271cf62e44937b2b339454788eae4', 'request_id': 'req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.695256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d271cf62e44937b2b339454788eae4', 'request_id': 'req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.698294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:59.708418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] The token cache is being invalidate because project 09d271cf62e44937b2b339454788eae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:24:59.708719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.709736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.721546 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2856/5677] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:24:59 2022] DELETE /identity/v3/users/ccd5ec984a3341eda3a5e65c8eeb65f5 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:59.728885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:59.731275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:59.736286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '09d271cf62e44937b2b339454788eae4', 'request_id': 'req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.737732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '09d271cf62e44937b2b339454788eae4', 'request_id': 'req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.738936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8 tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '09d271cf62e44937b2b339454788eae4', 'request_id': 'req-ccb7960a-a1b0-4402-b5f2-17882b5f54a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:24:59.759329 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2822/5678] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:24:59 2022] DELETE /identity/v3/domains/09d271cf62e44937b2b339454788eae4 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:24:59.762251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:59.762608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:59.763042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:59.801903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:59.809122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:24:59.812820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:59.910446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d99d1d-ceac-4f1a-b7df-7a14cab7c724 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:24:59.918240 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2823/5679] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:24:59.920426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:24:59.923616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:24:59.928300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:24:59.929061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:24:59.930535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:24:59.930790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] PATH_INFO: `/v3/projects/6269e5969c6a4957b3bb1816d93cebd0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:24:59.933754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6269e5969c6a4957b3bb1816d93cebd0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:24:59.937261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:00.107016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6269e5969c6a4957b3bb1816d93cebd0', 'request_id': 'req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.109964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239d3a0-7a5b-4012-a4cc-c4c4eb0520e8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:00.125708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6269e5969c6a4957b3bb1816d93cebd0', 'request_id': 'req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.171944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6269e5969c6a4957b3bb1816d93cebd0', 'request_id': 'req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.211291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] The token cache is being invalidate because project 6269e5969c6a4957b3bb1816d93cebd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:00.211291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.211291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.213675 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2857/5680] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:24:59 2022] DELETE /identity/v3/projects/6269e5969c6a4957b3bb1816d93cebd0 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:00.214646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:00.223606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:00.318489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd94b1a-7b79-4f22-90c5-bffffc8aa72d tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b758a887aa844c5a3ff9f4bfd3ba45c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '021395f7529049ce9624457d0806a57a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:00.321476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd94b1a-7b79-4f22-90c5-bffffc8aa72d tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:00.321800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd94b1a-7b79-4f22-90c5-bffffc8aa72d tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:00.322235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd94b1a-7b79-4f22-90c5-bffffc8aa72d tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] PATH_INFO: `/v3/domains/e90d63015c4b407e922121a51f601dd5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:00.346882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd94b1a-7b79-4f22-90c5-bffffc8aa72d tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-ffd94b1a-7b79-4f22-90c5-bffffc8aa72d tempest-DomainsNegativeTestJSON-2083618293 tempest-DomainsNegativeTestJSON-2083618293-project-admin] Could not find domain: e90d63015c4b407e922121a51f601dd5.: keystone.exception.DomainNotFound: Could not find domain: e90d63015c4b407e922121a51f601dd5. Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e90d63015c4b407e922121a51f601dd5. Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:00.368860 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:25:00.370116 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:25:00.371265 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e90d63015c4b407e922121a51f601dd5. Jun 18 22:25:00.372381 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:00.373776 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2824/5681] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:24:59 2022] PATCH /identity/v3/domains/e90d63015c4b407e922121a51f601dd5 => generated 112 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:25:00.375100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf537c-495d-4f5f-bf45-81eb85cc2a03 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:00.382972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d5dab-f43c-45d2-8723-133139622397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:00.383791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5dab-f43c-45d2-8723-133139622397 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:00.383915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:00.384293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5dab-f43c-45d2-8723-133139622397 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:00.384736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5dab-f43c-45d2-8723-133139622397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:00.386333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:00.386638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:00.386984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a38d5dab-f43c-45d2-8723-133139622397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:00.436392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:00.438089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:00.484477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:00.641171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d5dab-f43c-45d2-8723-133139622397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:00.646806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d5dab-f43c-45d2-8723-133139622397 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:00.671699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2825/5682] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:00.673860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:00.676106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:00.704650 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2858/5683] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:00.706076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec362368-cdcd-425a-831d-8f4b3f77ff7b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:00.706452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec362368-cdcd-425a-831d-8f4b3f77ff7b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:00.706646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec362368-cdcd-425a-831d-8f4b3f77ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:00.724322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848d9f5-1d01-4b7d-9e91-0c98f9b148da None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:00.743769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:00.744860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:00.746637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:00.747110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:00.747550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] PATH_INFO: `/v3/users/50ff2afa30794316b0dc9903cef75068` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:00.751447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ff2afa30794316b0dc9903cef75068)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:00.758106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:00.813440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ec362368-cdcd-425a-831d-8f4b3f77ff7b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:00.822202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ec362368-cdcd-425a-831d-8f4b3f77ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:00.866554 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2859/5684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:00.872508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec362368-cdcd-425a-831d-8f4b3f77ff7b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:00.890961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec362368-cdcd-425a-831d-8f4b3f77ff7b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:00.896641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:00.899264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:00.899667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:00.900060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:00.900969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:00.901466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:00.903284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:00.922278 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2860/5685] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:25:00.923360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:00.936742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30550a3-d1e5-496a-a56d-d65011934e76 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:00.942044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:00.943585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:00.943968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:00.944343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:00.945164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:00.947558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:00.960450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ff2afa30794316b0dc9903cef75068'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.962439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ff2afa30794316b0dc9903cef75068'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.996803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ff2afa30794316b0dc9903cef75068'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:00.997944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ff2afa30794316b0dc9903cef75068'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:01.007962 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2861/5686] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:00 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:01.009119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:01.011792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:01.018690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8e534564-836b-4b37-98d9-c64e9eba1aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ff2afa30794316b0dc9903cef75068'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:01.066215 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2826/5687] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:00 2022] DELETE /identity/v3/users/50ff2afa30794316b0dc9903cef75068 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:01.071623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.072882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.073436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.107817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:01.109481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:01.128195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb896b2-626d-4203-92c2-ef799a0f50c9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:01.187274 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2827/5688] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:01.202284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:01.203901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:01.300370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:01.300370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.300370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.300370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.301353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:01.301353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:01.301546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:01.370130 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2862/5689] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:01 2022] POST /identity/v3/users => generated 289 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:01.389685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:01.426148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb4db7-8512-4268-a87b-756a9f262190 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:01.426650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ac578-ab6c-4272-966f-1db9e7ae2272 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:01.435231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:01.436182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.436403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.437440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.438294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:01.440913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:01.442326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:01.445315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.445914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.446973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.465553 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2863/5690] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:01.471805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:01.474076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:01.478063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:01.497088 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2828/5691] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:25:01.498992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:01.501440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:01.518440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241fca2-4323-4187-b7ec-658f8514dae1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:01.519812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4dbeb-3284-4af4-a6f7-d9526e185602 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:01.536547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:01.536971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:01.537659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.537825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.538184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.538366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.538579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.538820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] PATH_INFO: `/v3/projects/15c9b780f0f24a839c714621a83c71b4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.539463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:01.540345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c9b780f0f24a839c714621a83c71b4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:01.542514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:01.544223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:01.574892 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2864/5692] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:01.575969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:01.614011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fddf07-74c2-40ca-95da-4d089b64a83d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:01.644317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c9b780f0f24a839c714621a83c71b4', 'request_id': 'req-708b98f8-c605-464f-8267-1cbf3e1f4d8e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:01.664159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c9b780f0f24a839c714621a83c71b4', 'request_id': 'req-708b98f8-c605-464f-8267-1cbf3e1f4d8e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:01.723061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c9b780f0f24a839c714621a83c71b4', 'request_id': 'req-708b98f8-c605-464f-8267-1cbf3e1f4d8e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:01.727697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:01.781460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] The token cache is being invalidate because project 15c9b780f0f24a839c714621a83c71b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:01.781837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:01.784653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-708b98f8-c605-464f-8267-1cbf3e1f4d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:01.791167 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2829/5693] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:01 2022] DELETE /identity/v3/projects/15c9b780f0f24a839c714621a83c71b4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:01.792151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e098b-ef07-4183-a89f-af928f5aeb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:01.794762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e098b-ef07-4183-a89f-af928f5aeb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.798911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb427d92-ae2b-4b4c-8f12-e6a0dfb231b0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.799287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e098b-ef07-4183-a89f-af928f5aeb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.799519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb427d92-ae2b-4b4c-8f12-e6a0dfb231b0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.799806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb427d92-ae2b-4b4c-8f12-e6a0dfb231b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.800351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e098b-ef07-4183-a89f-af928f5aeb7b admin admin] PATH_INFO: `/v3/projects/8f9a7d50200443418ef0c6a20a608bb9/users/39c2337d42bc426abed2ed2fb5000753/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.854208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cb427d92-ae2b-4b4c-8f12-e6a0dfb231b0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:01.855570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cb427d92-ae2b-4b4c-8f12-e6a0dfb231b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:01.861127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e098b-ef07-4183-a89f-af928f5aeb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9a7d50200443418ef0c6a20a608bb9, user_id=39c2337d42bc426abed2ed2fb5000753, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:01.870800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e098b-ef07-4183-a89f-af928f5aeb7b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:01.878492 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2830/5694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:01.885451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316efed-4971-467b-83f0-19105219ddec None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.885770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316efed-4971-467b-83f0-19105219ddec None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.886061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316efed-4971-467b-83f0-19105219ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.913445 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2865/5695] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:01 2022] PUT /identity/v3/projects/8f9a7d50200443418ef0c6a20a608bb9/users/39c2337d42bc426abed2ed2fb5000753/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:01.915641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:01.916039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:01.916424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:01.943570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c316efed-4971-467b-83f0-19105219ddec None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:01.945262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c316efed-4971-467b-83f0-19105219ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:01.982622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:01.984729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:02.144280 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2831/5696] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:02.148264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316efed-4971-467b-83f0-19105219ddec None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.163186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316efed-4971-467b-83f0-19105219ddec None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:02.171796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:02.172614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:02.173644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:02.174029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:02.175471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:02.178945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:02.178945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:02.189840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2866/5697] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:02.193410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.200214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:02.206095 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2832/5698] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:02.210253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.233475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fccb-1593-45d8-9d9f-3e7ab318638d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:02.253562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:02.255619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:02.256018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:02.256401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:02.257310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:02.259675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:02.310772 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2833/5699] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:02 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:02.317416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.364299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:02.378860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac5e71-3ae2-4784-8ed8-5e6ca51aa942 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:02.471281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:02.471281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:02.471281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:02.472001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:02.491655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7e4a-c777-430f-bd98-509ce00e036b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:02.508656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:02.509562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:02.511827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:02.512332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:02.513097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:02.515283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:02.520414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:02.525918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:02.564496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2834/5700] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:02 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:02.566963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.574125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:02.609352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d285ea-de8a-4943-9b36-be0feeba76d1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:02.627336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:02.628240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:02.628526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:02.628803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] PATH_INFO: `/v3/projects/fd3e714b75f54b1d889669add8def8c4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:02.630898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3e714b75f54b1d889669add8def8c4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:02.634367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:02.645143 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2867/5701] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:02.646334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.663164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e43b8-1b76-4e53-857f-dc5ba7ce7a63 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:02.678302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:02.680169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:02.681611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:02.683355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:02.684316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:02.688070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:02.725952 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2868/5702] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:02.730914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.752298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3e714b75f54b1d889669add8def8c4', 'request_id': 'req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:02.755383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a35c3c-6b98-4a7d-ada7-0368f0d54b09 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:02.764085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3e714b75f54b1d889669add8def8c4', 'request_id': 'req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:02.773405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:02.783304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3e714b75f54b1d889669add8def8c4', 'request_id': 'req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:02.805886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] The token cache is being invalidate because project fd3e714b75f54b1d889669add8def8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:02.807136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:02.808770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:02.811381 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2835/5703] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:02 2022] DELETE /identity/v3/projects/fd3e714b75f54b1d889669add8def8c4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:02.818669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:02.822754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:03.017363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:03.018067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:03.018348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:03.018625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:03.019363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:03.029608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:03.042463 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2869/5704] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:03.047938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:03.049737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:03.058127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f9f7-67ab-432b-9a99-6ea4fec73838 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:03.066001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c7d94-70ca-4879-bdb2-d4f2addbd8aa admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:03.079751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:03.080279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf72d8-3a23-44c0-a89b-29f49ffda6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:03.080979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:03.081290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:03.081444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf72d8-3a23-44c0-a89b-29f49ffda6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:03.081561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] PATH_INFO: `/v3/users/3b758a887aa844c5a3ff9f4bfd3ba45c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:03.081748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf72d8-3a23-44c0-a89b-29f49ffda6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:03.082026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf72d8-3a23-44c0-a89b-29f49ffda6d8 admin admin] PATH_INFO: `/v3/projects/248c433048c745a08058f28b2f24d6d7/users/4fa263df7091456e87794b49f49bc965/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:03.085882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b758a887aa844c5a3ff9f4bfd3ba45c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:03.088255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:03.122391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf72d8-3a23-44c0-a89b-29f49ffda6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248c433048c745a08058f28b2f24d6d7, user_id=4fa263df7091456e87794b49f49bc965, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:03.130450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf72d8-3a23-44c0-a89b-29f49ffda6d8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:03.181159 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2870/5705] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:03 2022] PUT /identity/v3/projects/248c433048c745a08058f28b2f24d6d7/users/4fa263df7091456e87794b49f49bc965/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:03.192642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442b56-6f99-4165-9225-60159cef8a61 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:03.193795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442b56-6f99-4165-9225-60159cef8a61 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:03.196745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4442b56-6f99-4165-9225-60159cef8a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:03.203923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:03.277468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b758a887aa844c5a3ff9f4bfd3ba45c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:03.278237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b758a887aa844c5a3ff9f4bfd3ba45c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:03.296365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b4442b56-6f99-4165-9225-60159cef8a61 None None] MFA Rules not processed for user `4fa263df7091456e87794b49f49bc965`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:03.300588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4442b56-6f99-4165-9225-60159cef8a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:03.324605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b758a887aa844c5a3ff9f4bfd3ba45c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:03.328412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b758a887aa844c5a3ff9f4bfd3ba45c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:03.339892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b758a887aa844c5a3ff9f4bfd3ba45c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:03.378364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2836/5706] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:02 2022] DELETE /identity/v3/users/3b758a887aa844c5a3ff9f4bfd3ba45c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:03.479793 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2871/5707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:03.484589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:03.486692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:03.721542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4357a6-f9ae-436b-98a4-b19356dde120 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:03.754107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:03.754825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:03.754954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:03.755220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:03.756063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:03.758065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:03.850927 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2837/5708] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:03 2022] POST /identity/v3/projects => generated 373 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:03.854820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442b56-6f99-4165-9225-60159cef8a61 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:04.043840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4442b56-6f99-4165-9225-60159cef8a61 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:04.092148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:04.218014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:04.219129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:04.219684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:04.219864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:04.220583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:04.222625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:04.266382 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2872/5709] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:03 2022] POST /identity/v3/users => generated 293 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:04.270970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:04.298517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ba651-9e0a-4b36-b216-3f7235dcef8d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:04.319890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:04.323212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:04.323212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:04.323212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:04.323212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:04.339937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:04.380065 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2838/5710] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:04.381891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:04.423664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec64834-e73c-43f5-8693-9fe7b7ef6cce admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:04.444518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:04.445464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:04.446311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:04.446603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] PATH_INFO: `/v3/projects/bf582736c7ec45bb9b1677fe099861d7/users/7cd922809c654c0c868e7cabfff3b0f4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:04.503485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf582736c7ec45bb9b1677fe099861d7, user_id=7cd922809c654c0c868e7cabfff3b0f4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:04.513315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:04.556674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2873/5711] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:04 2022] PUT /identity/v3/projects/bf582736c7ec45bb9b1677fe099861d7/users/7cd922809c654c0c868e7cabfff3b0f4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:04.561507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:04.585533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e49c1-6b86-4c52-bf39-5b289294fba3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:04.696634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6581f8-0b14-4243-a576-7f475982e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:04.698306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6581f8-0b14-4243-a576-7f475982e44f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:04.699910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6581f8-0b14-4243-a576-7f475982e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:04.700404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6581f8-0b14-4243-a576-7f475982e44f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:04.701708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6581f8-0b14-4243-a576-7f475982e44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:04.703578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6581f8-0b14-4243-a576-7f475982e44f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:04.730995 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2839/5712] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:04.735103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:04.752900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84e197-18a2-4e59-92d6-444c452354e0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:04.768897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:04.770420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:04.770848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:04.771317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] PATH_INFO: `/v3/projects/bf582736c7ec45bb9b1677fe099861d7/users/7cd922809c654c0c868e7cabfff3b0f4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:04.779015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf582736c7ec45bb9b1677fe099861d7, user_id=7cd922809c654c0c868e7cabfff3b0f4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:04.782406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:04.799082 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2874/5713] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:04 2022] PUT /identity/v3/projects/bf582736c7ec45bb9b1677fe099861d7/users/7cd922809c654c0c868e7cabfff3b0f4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:04.814770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:04.815353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:04.815353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:04.921001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:04.923587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:04.946201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] MFA Rules not processed for user `7cd922809c654c0c868e7cabfff3b0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:04.947457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:04.982172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:05.134433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2a0f7-28b8-4457-84e8-d7421abf325e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:05.150156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:05.154014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:05.154309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:05.154593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] PATH_INFO: `/v3/projects/021395f7529049ce9624457d0806a57a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:05.156479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021395f7529049ce9624457d0806a57a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:05.158503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:05.280424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021395f7529049ce9624457d0806a57a', 'request_id': 'req-a675a9e6-345b-4731-a42c-eae824f55360'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:05.309979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021395f7529049ce9624457d0806a57a', 'request_id': 'req-a675a9e6-345b-4731-a42c-eae824f55360'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:05.327119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2840/5714] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:05.334548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021395f7529049ce9624457d0806a57a', 'request_id': 'req-a675a9e6-345b-4731-a42c-eae824f55360'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:05.343716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:05.345654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:05.357371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:05.369672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] The token cache is being invalidate because project 021395f7529049ce9624457d0806a57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:05.371763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:05.374641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a675a9e6-345b-4731-a42c-eae824f55360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:05.382647 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2875/5715] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:04 2022] DELETE /identity/v3/projects/021395f7529049ce9624457d0806a57a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:05.389072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee23e-b94f-4908-b437-046b78a7dce4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:05.389391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee23e-b94f-4908-b437-046b78a7dce4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:05.389642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee23e-b94f-4908-b437-046b78a7dce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:05.498203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fadee23e-b94f-4908-b437-046b78a7dce4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:05.499446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fadee23e-b94f-4908-b437-046b78a7dce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:05.602043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510da8-8e60-4555-a638-4bdaf78d90e8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:05.718082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:05.719346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:05.719346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:05.719701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:05.723890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:05.757296 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2876/5716] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:05.766183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211369b-8b1a-480b-9153-05f8804c1f3a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:05.766518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211369b-8b1a-480b-9153-05f8804c1f3a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:05.766802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211369b-8b1a-480b-9153-05f8804c1f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:05.831446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2211369b-8b1a-480b-9153-05f8804c1f3a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:05.832757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2211369b-8b1a-480b-9153-05f8804c1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:05.855087 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2877/5717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:05.859110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211369b-8b1a-480b-9153-05f8804c1f3a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:05.873759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:05.876774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211369b-8b1a-480b-9153-05f8804c1f3a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:05.876938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:05.888002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:05.888675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:05.888824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:05.888938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:05.890480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:05.892066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:05.893702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:05.895599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:05.901594 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2841/5718] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:05.928752 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2878/5719] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:25:05.931251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:05.954605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644fe8-d7fd-48c0-993b-5d6779ab9d04 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:05.959739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:05.960560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:05.960956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:05.961411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:05.962234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:05.964451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:06.031483 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2842/5720] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:05 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:06.032932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:06.047345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e24d-a8da-4967-8a46-b5afde5ae7e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:06.152371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:06.155217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:06.273262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:06.274158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:06.275658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:06.278948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:06.279902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:06.284839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:06.334852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee165d-003a-4da5-9295-7ac7cb8534d5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:06.348068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a662b-fe66-4853-bdb2-1ced3afc8d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:06.349374 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2879/5721] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:06 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:06.352579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a662b-fe66-4853-bdb2-1ced3afc8d9d service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:06.352991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a662b-fe66-4853-bdb2-1ced3afc8d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:06.354632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a662b-fe66-4853-bdb2-1ced3afc8d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:06.354937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:06.360654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cf7a662b-fe66-4853-bdb2-1ced3afc8d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:06.385385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7fbc0-c2ed-4895-8f5c-9ff46f1ebcf4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:06.417650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:06.418348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:06.418631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:06.418907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:06.419657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:06.433748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:06.466041 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2880/5722] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:06.469946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:06.502129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d03e-f55a-4eff-adc5-20c254dc8b58 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:06.521893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:06.522599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:06.522891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:06.523164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:06.527036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:06.530495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:06.574414 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2881/5723] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:06.589074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:06.606543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a662b-fe66-4853-bdb2-1ced3afc8d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:06.608057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a662b-fe66-4853-bdb2-1ced3afc8d9d service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:06.626585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13168fb-8b6e-4d8b-a9e8-5e3205659ea1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:06.636761 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2843/5724] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:25:06.638481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:06.639402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:06.639677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:06.639954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] PATH_INFO: `/v3/projects/89e4cc43916f4ecf8eb9fb1ef33c6e0b/users/33de9aff5f70486db4938c0407642a63/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:06.661224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e4cc43916f4ecf8eb9fb1ef33c6e0b, user_id=33de9aff5f70486db4938c0407642a63, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:06.664533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:06.687772 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2882/5725] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:06 2022] PUT /identity/v3/projects/89e4cc43916f4ecf8eb9fb1ef33c6e0b/users/33de9aff5f70486db4938c0407642a63/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:06.702376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe789-8443-44b1-94c8-9c0e413add1e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:06.703005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe789-8443-44b1-94c8-9c0e413add1e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:06.703465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe789-8443-44b1-94c8-9c0e413add1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:06.768978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0eafe789-8443-44b1-94c8-9c0e413add1e None None] MFA Rules not processed for user `33de9aff5f70486db4938c0407642a63`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:06.772791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0eafe789-8443-44b1-94c8-9c0e413add1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:06.891879 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2844/5726] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:06.896236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:06.979228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:07.071908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a8422-a059-423b-ad46-cdab260de874 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:07.078613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:07.079774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:07.080554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:07.082377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:07.084314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:07.088382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:07.184700 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2883/5727] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:06 2022] POST /identity/v3/projects => generated 371 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:07.188594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe789-8443-44b1-94c8-9c0e413add1e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:07.219298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe789-8443-44b1-94c8-9c0e413add1e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:07.270375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:07.337549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:07.338370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:07.339190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:07.339569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:07.340392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:07.342793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:07.409500 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2845/5728] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:07 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:07.413626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:07.434844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc4dc6-7b2f-44f7-b7f7-3c6ba1961d41 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:07.442254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:07.443515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:07.445911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:07.445911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:07.445911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:07.447102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:07.468777 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2884/5729] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:07.473288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:07.488772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50fd84-1a72-4886-a8da-b452942c2a83 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:07.496554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:07.497791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:07.498120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:07.498603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] PATH_INFO: `/v3/projects/a8776f5fa33446a9a47a979351171302/users/0b08fc02fe3446e3b02461a4f68bf1cb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:07.521278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8776f5fa33446a9a47a979351171302, user_id=0b08fc02fe3446e3b02461a4f68bf1cb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:07.524991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:07.551410 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2846/5730] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:07 2022] PUT /identity/v3/projects/a8776f5fa33446a9a47a979351171302/users/0b08fc02fe3446e3b02461a4f68bf1cb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:07.556136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:07.572613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3599b-ddc1-4d3a-9814-e9c305b29f4e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:07.669947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1584c-4e87-48fa-9778-da5aed5895e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:07.673608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1584c-4e87-48fa-9778-da5aed5895e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:07.673608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1584c-4e87-48fa-9778-da5aed5895e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:07.673608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1584c-4e87-48fa-9778-da5aed5895e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:07.673608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1584c-4e87-48fa-9778-da5aed5895e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:07.675799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1584c-4e87-48fa-9778-da5aed5895e9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:07.694245 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2885/5731] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:07.701318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:07.720012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9633d2-79cc-4f89-b080-e528497b938d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:07.726591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:07.727661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:07.728958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:07.729399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] PATH_INFO: `/v3/projects/a8776f5fa33446a9a47a979351171302/users/0b08fc02fe3446e3b02461a4f68bf1cb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:07.732610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8776f5fa33446a9a47a979351171302, user_id=0b08fc02fe3446e3b02461a4f68bf1cb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:07.738819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:07.765126 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2847/5732] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:07 2022] PUT /identity/v3/projects/a8776f5fa33446a9a47a979351171302/users/0b08fc02fe3446e3b02461a4f68bf1cb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:07.778189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e6ba-4585-47e2-b98c-b0995bcc7140 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:07.778453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e6ba-4585-47e2-b98c-b0995bcc7140 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:07.778737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e6ba-4585-47e2-b98c-b0995bcc7140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:07.859216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1075e6ba-4585-47e2-b98c-b0995bcc7140 None None] MFA Rules not processed for user `0b08fc02fe3446e3b02461a4f68bf1cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:07.860537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1075e6ba-4585-47e2-b98c-b0995bcc7140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:08.168855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:08.184116 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2886/5733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:08.210619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17606-e880-49c7-85c3-386ff6647600 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:08.263923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:08.264682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:08.265061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:08.265452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:08.266252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:08.281482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:08.323719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e6ba-4585-47e2-b98c-b0995bcc7140 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:08.338108 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2848/5734] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:08 2022] POST /identity/v3/services => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:08.340691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e6ba-4585-47e2-b98c-b0995bcc7140 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:08.386646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:08.388238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:08.388719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:08.390255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:08.391335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:08.393350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:08.403797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:08.419602 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-397052147. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:25:08.419602 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:25:08.419602 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:25:08.520053 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2887/5735] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:25:08 2022] POST /identity/v3/endpoints => generated 359 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:08.521375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:08.546378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f7875-47d3-4d07-bd85-e081e1150652 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:08.635821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:08.636728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:08.637012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:08.645546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-397052147` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:08.646520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-397052147)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:08.647557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:08.662318 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2849/5736] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Jun 18 22:25:08 2022] GET /identity/v3/regions/tempest-region-397052147 => generated 178 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:08.665689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:08.682032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf537338-98bf-45b8-8237-d50af8002b6b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:08.705904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:08.706602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:08.707113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:08.707392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:08.707951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:08.713489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:08.755738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:08.764100 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2888/5737] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:08 2022] POST /identity/v3/services => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:08.774977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b9ff9-3c8b-4874-9cd1-e71a11c47989 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:08.825685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:08.827447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:08.827891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:08.828468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:08.829423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:08.831903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:08.862343 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1097319064. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:25:08.862343 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:25:08.862343 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:25:08.948321 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2850/5738] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:25:08 2022] POST /identity/v3/endpoints => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:08.949991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:08.973450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49003b2c-4444-4233-a22d-c0d20765d24b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.050081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.051361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.051803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.052238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-1097319064` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.053102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1097319064)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.054373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.059356 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2889/5739] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Jun 18 22:25:08 2022] GET /identity/v3/regions/tempest-region-1097319064 => generated 180 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:09.063566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.082283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bc041-8aa4-4e19-ade1-4143902eaa33 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.102601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.103305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.103592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.103858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.105548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.107232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.183594 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2016073991. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:25:09.183594 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:25:09.183594 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:25:09.245976 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2851/5740] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:25:09 2022] POST /identity/v3/endpoints => generated 360 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:09.250127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.290017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f57dae-430e-4126-b682-5e8075ac26c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.360245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.361207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.361490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.361770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-2016073991` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.362481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2016073991)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.363801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.373375 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2890/5741] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Jun 18 22:25:09 2022] GET /identity/v3/regions/tempest-region-2016073991 => generated 180 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:09.377885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.393660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760efb-7d4d-49c6-8a78-f1f74d8ea4c3 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.406198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.408812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.409500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.410958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.412851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.414103 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:25:09.414103 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:25:09.414103 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:25:09.417503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.429763 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2852/5742] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Jun 18 22:25:09 2022] GET /identity/v3/endpoints => generated 4386 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:09.436513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.460456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccabd8-235f-489a-9ede-93d9f49cb4c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.470911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.472613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.472905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.473216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints/d0ec9e45ced74680917cada57f35f7ab` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.503582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=d0ec9e45ced74680917cada57f35f7ab)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.509373 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:25:09.509373 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:25:09.509373 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:25:09.510490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.527828 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2891/5743] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:09 2022] GET /identity/v3/endpoints/d0ec9e45ced74680917cada57f35f7ab => generated 360 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:09.529809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.567440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd249-1f53-4109-925b-c5a9fd8b60cf tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.577869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.581138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:09.589400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.592783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.593527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.595070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints/d0ec9e45ced74680917cada57f35f7ab` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.598128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d0ec9e45ced74680917cada57f35f7ab)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.601826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.624175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd0ec9e45ced74680917cada57f35f7ab', 'request_id': 'req-d34556fc-57aa-4cf9-a39e-0ba238d80299'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:09.633693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=10,keystone:DELETE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:09.672692 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2853/5744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:09 2022] DELETE /identity/v3/endpoints/d0ec9e45ced74680917cada57f35f7ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:09.676910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.710584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34556fc-57aa-4cf9-a39e-0ba238d80299 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.717317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.718775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.719497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.720137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.721113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.723071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.747209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2854/5745] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Jun 18 22:25:09 2022] GET /identity/v3/endpoints => generated 4039 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:09.751023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.770592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3412b9-36e1-4315-84cd-506aad56e9b2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.784047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.785023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.787940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.788409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints/d0ec9e45ced74680917cada57f35f7ab` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.802307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:25:09.827317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687cc89-fec5-4d21-af5d-5cc22ffa0fc5 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Could not find endpoint: d0ec9e45ced74680917cada57f35f7ab.: keystone.exception.EndpointNotFound: Could not find endpoint: d0ec9e45ced74680917cada57f35f7ab. Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._iter().one() Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._only_one_row( Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:09.858055 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: d0ec9e45ced74680917cada57f35f7ab. Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:09.859296 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:25:09.861770 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: d0ec9e45ced74680917cada57f35f7ab. Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:09.863738 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2855/5746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:09 2022] DELETE /identity/v3/endpoints/d0ec9e45ced74680917cada57f35f7ab => generated 114 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:25:09.865471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:09.865568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.865568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.865568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.866241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.873869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:09.883060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7c1d2-5fa5-4547-8f3e-8de4508fdb0e tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:09.895597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:09.896500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:09.896785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:09.897093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-2016073991` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:09.897768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2016073991)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:09.898934 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:25:09.898934 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:25:09.898934 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:25:09.899999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:09.946620 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2856/5747] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:25:09 2022] DELETE /identity/v3/regions/tempest-region-2016073991 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:09.951542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.019488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d6c9-1951-46bc-a32d-4fc4bae35729 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.039239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.039946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.041122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.041416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.045499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.048951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.068172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.073427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.080144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2857/5748] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Jun 18 22:25:09 2022] GET /identity/v3/endpoints => generated 4039 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:10.084750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.114464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d83c0-6af9-4461-92db-9bf9af242ca4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.132515 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2892/5749] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:09 2022] GET /identity/v3/auth/tokens => generated 3951 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:25:10.134166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.135026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.135388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.135870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.136662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Adding query filter params (service_id=1f83571b12dc47218757d3376ec79c9f) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:10.137006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.138735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.162654 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2858/5750] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:25:10 2022] GET /identity/v3/endpoints?service_id=1f83571b12dc47218757d3376ec79c9f => generated 501 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:10.166641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.221334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dee753-68d5-46b0-b77e-895e9d16b467 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.235431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.236055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.236342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.239657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.240523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Adding query filter params (service_id=362574cf7aad434494b38bec5ed5f54d) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:10.240846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.244042 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:25:10.244042 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:25:10.244042 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:25:10.244981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.248375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:10.259264 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2893/5751] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:25:10 2022] GET /identity/v3/endpoints?service_id=362574cf7aad434494b38bec5ed5f54d => generated 505 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:10.265585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.280383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea185280-ab66-4c86-837b-dcc2e70c1bc1 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.293518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.296302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.297157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.298541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.301170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:10.302052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.307742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.341478 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2859/5752] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Jun 18 22:25:10 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:10.346103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.363751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539d367-70af-462a-9b04-2a4f5f51bba2 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.377660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.379244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.380120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.380574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.382805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:10.383308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.386809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.401199 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2894/5753] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Jun 18 22:25:10 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:10.406076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.442434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17e9de-52b6-434d-9787-1800045cdb9f tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.454487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.455192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.455480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.455766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.456506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.458207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.493798 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2860/5754] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:10 2022] POST /identity/v3/services => generated 290 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:10.496017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.512113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355eaf4-e446-431b-b617-df6851c76145 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.574172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.574688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.574977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.575263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.582743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.589400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.657243 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1344656993. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:25:10.657243 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:25:10.657243 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:25:10.724002 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2895/5755] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:25:10 2022] POST /identity/v3/endpoints => generated 361 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:10.728529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.747926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01304533-5dee-4f52-bc18-f10f44ddc3ec tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.789965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.790967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.791475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.791764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-1344656993` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.793485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1344656993)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.800262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:10.806388 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2861/5756] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Jun 18 22:25:10 2022] GET /identity/v3/regions/tempest-region-1344656993 => generated 180 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:10.809914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:10.848512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd81f0-0cdf-483c-94a8-71acfafdef40 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:10.880293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:10.887074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:10.889228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:10.891586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints/d88acf0003f74604a76de77e57619339` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:10.937993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=d88acf0003f74604a76de77e57619339)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:10.939655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:11.036540 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-351427421. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:25:11.036540 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:25:11.036540 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:25:11.154882 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2896/5757] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:25:10 2022] PATCH /identity/v3/endpoints/d88acf0003f74604a76de77e57619339 => generated 362 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:11.158889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:11.180269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ab926-8a3b-4797-9905-d4b046b791ee tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:11.224555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:11.226009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:11.226968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:11.227277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-351427421` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:11.229702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-351427421)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:11.230807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:11.240441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2862/5758] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Jun 18 22:25:11 2022] GET /identity/v3/regions/tempest-region-351427421 => generated 178 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:11.244761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:11.270403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6202a7a-72c2-4c42-b244-8708cf314005 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:11.284679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:11.285739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:11.286024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:11.286301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints/d88acf0003f74604a76de77e57619339` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:11.294331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d88acf0003f74604a76de77e57619339)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:11.295994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:11.320700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd88acf0003f74604a76de77e57619339', 'request_id': 'req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:11.336232 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2897/5759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:11 2022] DELETE /identity/v3/endpoints/d88acf0003f74604a76de77e57619339 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:11.340889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:11.356520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d6c26-d308-4a71-80a1-db6d1f0d5201 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:11.411021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:11.412022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:11.412403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:11.412886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-351427421` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:11.413728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-351427421)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:11.417444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:11.459040 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-351427421. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:25:11.459040 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:25:11.459040 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:25:11.472552 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2863/5760] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Jun 18 22:25:11 2022] DELETE /identity/v3/regions/tempest-region-351427421 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:11.476662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:11.500424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f6e29-9a5c-4aa6-b6b9-a9a0cdcbd574 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:11.540243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:11.541109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:11.541392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:11.541672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-1344656993` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:11.543265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1344656993)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:11.544322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:11.597949 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2898/5761] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:25:11 2022] DELETE /identity/v3/regions/tempest-region-1344656993 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:11.599971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:11.630308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa456ce-5108-4a48-afe7-fb07708ebc5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:11.705000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:11.707361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:11.709360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:11.709805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/services/4afc0b8543b0483aa8f5ad2156c0725b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:11.712330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4afc0b8543b0483aa8f5ad2156c0725b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:11.720609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:11.799964 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2864/5762] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:11 2022] DELETE /identity/v3/services/4afc0b8543b0483aa8f5ad2156c0725b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:11.801652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:11.830071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0ce01-05ec-4a28-a045-dfc9ea15df5a tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:11.868915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:11.870626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:11.870912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:11.871185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints/2fc0c146efc840f0af86550b31141cf2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:11.891752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2fc0c146efc840f0af86550b31141cf2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:11.893463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:11.927761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2fc0c146efc840f0af86550b31141cf2', 'request_id': 'req-70e9abbf-a6cc-497f-8afe-38382e1c68c4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:11.956794 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2899/5763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:11 2022] DELETE /identity/v3/endpoints/2fc0c146efc840f0af86550b31141cf2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:11.960675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:11.975122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4574-2633-4f64-9134-458e2fa8355d tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:12.016078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:12.018554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:12.018554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:12.018554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-1097319064` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:12.020951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1097319064)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:12.024225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:12.081542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:12.098370 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2865/5764] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:25:11 2022] DELETE /identity/v3/regions/tempest-region-1097319064 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:12.102973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:12.124796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9abbf-a6cc-497f-8afe-38382e1c68c4 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:12.201990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:12.208139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:12.208488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:12.208708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/services/362574cf7aad434494b38bec5ed5f54d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:12.214630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_service(service_id=362574cf7aad434494b38bec5ed5f54d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:12.219042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:12.284877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:12.303697 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2900/5765] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:12 2022] DELETE /identity/v3/services/362574cf7aad434494b38bec5ed5f54d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:12.304840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:12.327733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f77c8-e8af-4952-bd18-39ec2696b43c tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:12.388458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:12.390851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:12.391282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:12.391624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/endpoints/d7554a4cb77f4635a1e12f3e84961835` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:12.405568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d7554a4cb77f4635a1e12f3e84961835)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:12.407587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:12.430136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd7554a4cb77f4635a1e12f3e84961835', 'request_id': 'req-18c25d3f-97ea-46d8-b266-d3b449615283'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:12.486480 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2866/5766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:12 2022] DELETE /identity/v3/endpoints/d7554a4cb77f4635a1e12f3e84961835 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:12.492454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:12.517169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da031986-3df2-4134-8525-5b636dc9cf42 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:12.622971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:12.631073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:12.631567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:12.631945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/regions/tempest-region-397052147` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:12.634550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-397052147)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:12.640666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:12.690759 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2901/5767] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Jun 18 22:25:12 2022] DELETE /identity/v3/regions/tempest-region-397052147 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:12.692924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:12.716253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c25d3f-97ea-46d8-b266-d3b449615283 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:12.753872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c0ccb-f023-4b9e-91f9-3b63bfac73a0 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b08fc02fe3446e3b02461a4f68bf1cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a8776f5fa33446a9a47a979351171302', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:12.756852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0ccb-f023-4b9e-91f9-3b63bfac73a0 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:12.757172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0ccb-f023-4b9e-91f9-3b63bfac73a0 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:12.757456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c0ccb-f023-4b9e-91f9-3b63bfac73a0 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] PATH_INFO: `/v3/services/1f83571b12dc47218757d3376ec79c9f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:12.758132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0ccb-f023-4b9e-91f9-3b63bfac73a0 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1f83571b12dc47218757d3376ec79c9f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:12.759769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c0ccb-f023-4b9e-91f9-3b63bfac73a0 tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:12.820387 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2867/5768] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:12 2022] DELETE /identity/v3/services/1f83571b12dc47218757d3376ec79c9f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:12.826153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:13.053972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ab55-1b9b-4186-addf-cb482fdb0d7b tempest-EndPointsTestJSON-1588188279 tempest-EndPointsTestJSON-1588188279-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:13.085422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:13.087406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:13.087755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:13.088995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] PATH_INFO: `/v3/users/33de9aff5f70486db4938c0407642a63` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:13.091067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33de9aff5f70486db4938c0407642a63)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:13.093216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:13.192897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33de9aff5f70486db4938c0407642a63'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:13.195189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33de9aff5f70486db4938c0407642a63'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:13.213112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33de9aff5f70486db4938c0407642a63'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:13.214284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33de9aff5f70486db4938c0407642a63'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:13.224124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33de9aff5f70486db4938c0407642a63'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:13.250805 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2902/5769] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:12 2022] DELETE /identity/v3/users/33de9aff5f70486db4938c0407642a63 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:13.256292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:13.256724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:13.257147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:13.293227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:13.319770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:13.515534 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2868/5770] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:13.685195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:13.686344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:13.825254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:13.911767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de0eb-18c4-4303-96da-6bb28fbd8810 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:13.917862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed662-9470-49f5-b123-0d0582cdb497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:13.921958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed662-9470-49f5-b123-0d0582cdb497 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:13.922249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed662-9470-49f5-b123-0d0582cdb497 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:13.922530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed662-9470-49f5-b123-0d0582cdb497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:13.946409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ed662-9470-49f5-b123-0d0582cdb497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:13.947893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ed662-9470-49f5-b123-0d0582cdb497 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:13.987124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2903/5771] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:15.846209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:15.848317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:15.876342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ab0a3-47a1-40ac-929c-3e4222a79a67 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:15.896802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:15.900547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:15.903070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:15.903601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] PATH_INFO: `/v3/users/5e97368d9959490bac08b91bc86d8687` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:15.907026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e97368d9959490bac08b91bc86d8687)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:15.912926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:16.042980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e97368d9959490bac08b91bc86d8687'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:16.043678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e97368d9959490bac08b91bc86d8687'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:16.087515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e97368d9959490bac08b91bc86d8687'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:16.088375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e97368d9959490bac08b91bc86d8687'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:16.113828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e97368d9959490bac08b91bc86d8687'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:16.159822 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2869/5772] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:15 2022] DELETE /identity/v3/users/5e97368d9959490bac08b91bc86d8687 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:16.165947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:16.166503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:16.166613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:16.206497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:16.210334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:16.610943 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2904/5773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:16.689396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:16.693781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:16.705970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:16.872834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f4a04-56e5-4671-bd3e-1bd9995d5d24 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:16.881557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:16.882753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:16.883595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:16.884086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:16.908427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:16.911192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:16.931752 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2870/5774] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:17.622952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:17.624535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:17.645018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbec52-d8b4-46a0-8557-3c04ce31b743 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:17.658718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:17.660214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:17.660214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:17.660214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] PATH_INFO: `/v3/projects/89e4cc43916f4ecf8eb9fb1ef33c6e0b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:17.661384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e4cc43916f4ecf8eb9fb1ef33c6e0b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:17.663993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:17.800717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e4cc43916f4ecf8eb9fb1ef33c6e0b', 'request_id': 'req-d1d983d4-c45a-461e-ad47-409cf918c89b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:17.815170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e4cc43916f4ecf8eb9fb1ef33c6e0b', 'request_id': 'req-d1d983d4-c45a-461e-ad47-409cf918c89b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:17.834563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e4cc43916f4ecf8eb9fb1ef33c6e0b', 'request_id': 'req-d1d983d4-c45a-461e-ad47-409cf918c89b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:17.867023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] The token cache is being invalidate because project 89e4cc43916f4ecf8eb9fb1ef33c6e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:17.867023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:17.869506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:17.871765 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2905/5775] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:17 2022] DELETE /identity/v3/projects/89e4cc43916f4ecf8eb9fb1ef33c6e0b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:17.876966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:17.888583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ead4bf-875b-4ef8-b1ce-38e0ec9d2746 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:18.199130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:18.202105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:18.202674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:18.203400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] PATH_INFO: `/v3/users/0b08fc02fe3446e3b02461a4f68bf1cb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:18.208434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b08fc02fe3446e3b02461a4f68bf1cb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:18.214968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:18.444886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b08fc02fe3446e3b02461a4f68bf1cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:18.451788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b08fc02fe3446e3b02461a4f68bf1cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:18.513167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b08fc02fe3446e3b02461a4f68bf1cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:18.516248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b08fc02fe3446e3b02461a4f68bf1cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:18.551274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f353a40d-8622-4c5b-815c-4032ed81cb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b08fc02fe3446e3b02461a4f68bf1cb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:18.608915 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2871/5776] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:17 2022] DELETE /identity/v3/users/0b08fc02fe3446e3b02461a4f68bf1cb => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:19.908413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:19.910191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:19.951997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d983d4-c45a-461e-ad47-409cf918c89b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:20.090942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:20.127051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:20.128368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:20.129493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:20.130532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] PATH_INFO: `/v3/projects/98994a513d8148718997fb1c02dd6833` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:20.132887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98994a513d8148718997fb1c02dd6833)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:20.137333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:20.257126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98994a513d8148718997fb1c02dd6833', 'request_id': 'req-35c07f71-149c-49ad-9d12-708c6a4f5520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:20.268320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98994a513d8148718997fb1c02dd6833', 'request_id': 'req-35c07f71-149c-49ad-9d12-708c6a4f5520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:20.292299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98994a513d8148718997fb1c02dd6833', 'request_id': 'req-35c07f71-149c-49ad-9d12-708c6a4f5520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:20.313486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] The token cache is being invalidate because project 98994a513d8148718997fb1c02dd6833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:20.314097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:20.315101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-35c07f71-149c-49ad-9d12-708c6a4f5520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:20.319733 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2906/5777] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:19 2022] DELETE /identity/v3/projects/98994a513d8148718997fb1c02dd6833 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:20.325589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdfb6-b717-40b4-b9ef-24c79d46c8a3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:20.326262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdfb6-b717-40b4-b9ef-24c79d46c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:20.326262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdfb6-b717-40b4-b9ef-24c79d46c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:20.379299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-30efdfb6-b717-40b4-b9ef-24c79d46c8a3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:20.391983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-30efdfb6-b717-40b4-b9ef-24c79d46c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:20.473791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:20.620304 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2872/5778] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:20.621276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72fac-9aa5-4c64-8f2b-c3fa494ce6f8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:20.621957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72fac-9aa5-4c64-8f2b-c3fa494ce6f8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:20.621957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d72fac-9aa5-4c64-8f2b-c3fa494ce6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:20.680839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-88d72fac-9aa5-4c64-8f2b-c3fa494ce6f8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:20.682156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-88d72fac-9aa5-4c64-8f2b-c3fa494ce6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:20.724667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efdfb6-b717-40b4-b9ef-24c79d46c8a3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:20.736844 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2907/5779] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:20.738368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efdfb6-b717-40b4-b9ef-24c79d46c8a3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:20.751241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:20.752040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:20.752326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:20.752617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:20.754792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:20.755117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:20.756768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:20.794809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2873/5780] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:20.798798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72fac-9aa5-4c64-8f2b-c3fa494ce6f8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:20.815113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d72fac-9aa5-4c64-8f2b-c3fa494ce6f8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:20.831098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:20.831855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:20.832293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:20.832570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:20.837979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:20.840106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:20.928824 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2908/5781] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:20 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:20.930821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:20.950624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589a35-3adb-4aca-819c-bc87b102002d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:21.155067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:21.155877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:21.156159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:21.156431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:21.157225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:21.160364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:21.219411 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2874/5782] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:20 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:21.220710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:21.240410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de91e5-71c6-4edb-a784-27b8aa6697b1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:21.262021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:21.271939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:21.272344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:21.275040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:21.282963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:21.284868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:21.348833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:21.349516 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2909/5783] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:21.361799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5271a1-1861-4fa6-8a7b-2e71f1646e43 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:21.373411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492be73-b3ad-4b46-8e9d-77378473cfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:21.374122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492be73-b3ad-4b46-8e9d-77378473cfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:21.374458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492be73-b3ad-4b46-8e9d-77378473cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:21.374937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492be73-b3ad-4b46-8e9d-77378473cfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:21.375696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492be73-b3ad-4b46-8e9d-77378473cfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:21.378926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492be73-b3ad-4b46-8e9d-77378473cfb2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:21.419546 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2875/5784] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:21.422029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:21.440836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3d613-774b-4eaf-b676-7fc0e7de1ccc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:21.454402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:21.455641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:21.456082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:21.456656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] PATH_INFO: `/v3/projects/a0cc5cf5466e45189a8d6c05f9c79298/users/a54ea906c1324d9a97b492a3899187d9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:21.491778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0cc5cf5466e45189a8d6c05f9c79298, user_id=a54ea906c1324d9a97b492a3899187d9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:21.504101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:21.540727 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2910/5785] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:21 2022] PUT /identity/v3/projects/a0cc5cf5466e45189a8d6c05f9c79298/users/a54ea906c1324d9a97b492a3899187d9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:21.546091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:21.546656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:21.547089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:21.580783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:21.588186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:21.817178 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2876/5786] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:21.832341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:21.834345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:21.976138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f014-36b4-4d97-99f7-626d5b9e6344 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:21.982014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d293-aa0e-44e9-a493-adc6aa5b9257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:21.983431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d293-aa0e-44e9-a493-adc6aa5b9257 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:21.983879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d293-aa0e-44e9-a493-adc6aa5b9257 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:21.984908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d293-aa0e-44e9-a493-adc6aa5b9257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:21.999089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d293-aa0e-44e9-a493-adc6aa5b9257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:22.002303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d293-aa0e-44e9-a493-adc6aa5b9257 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:22.018075 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2911/5787] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:22.425571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:22.427050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:22.453294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f45e66-a8f5-4053-b289-890025130fbb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:22.466723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:22.467649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:22.475513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:22.476108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] PATH_INFO: `/v3/projects/a8776f5fa33446a9a47a979351171302` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:22.479690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8776f5fa33446a9a47a979351171302)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:22.481929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:22.519152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2490f-2bed-472c-8e61-7f7df0ddc4f4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:22.519446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2490f-2bed-472c-8e61-7f7df0ddc4f4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:22.519904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2490f-2bed-472c-8e61-7f7df0ddc4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:22.615354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ef2490f-2bed-472c-8e61-7f7df0ddc4f4 None None] MFA Rules not processed for user `39c2337d42bc426abed2ed2fb5000753`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:22.616743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ef2490f-2bed-472c-8e61-7f7df0ddc4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:22.628560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:22.640505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:22.688644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8776f5fa33446a9a47a979351171302', 'request_id': 'req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:22.706055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8776f5fa33446a9a47a979351171302', 'request_id': 'req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:22.753149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8776f5fa33446a9a47a979351171302', 'request_id': 'req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:22.775531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] The token cache is being invalidate because project a8776f5fa33446a9a47a979351171302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:22.775904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:22.776516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6c5f5c67-7c2f-403a-8a82-8978cba3e4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:22.785802 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2877/5788] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:22 2022] DELETE /identity/v3/projects/a8776f5fa33446a9a47a979351171302 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:22.788486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83e5b3-3845-4e84-aec0-d1d24881511e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:22.788796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83e5b3-3845-4e84-aec0-d1d24881511e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:22.789114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83e5b3-3845-4e84-aec0-d1d24881511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:22.857376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2f83e5b3-3845-4e84-aec0-d1d24881511e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:22.858691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f83e5b3-3845-4e84-aec0-d1d24881511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:22.912535 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2912/5789] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:22.926243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:22.926574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:22.927067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:22.973882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] MFA Rules not processed for user `39c2337d42bc426abed2ed2fb5000753`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:22.976468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:23.080372 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2913/5790] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:23.101165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:23.103957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:23.119979 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2878/5791] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:23.128226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cef313-bfe4-4d42-a9ca-9fce2e5bc82c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:23.128551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cef313-bfe4-4d42-a9ca-9fce2e5bc82c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:23.128884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cef313-bfe4-4d42-a9ca-9fce2e5bc82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:23.202615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c5cef313-bfe4-4d42-a9ca-9fce2e5bc82c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:23.203972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c5cef313-bfe4-4d42-a9ca-9fce2e5bc82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:23.242791 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2879/5792] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:23.247856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cef313-bfe4-4d42-a9ca-9fce2e5bc82c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:23.265160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cef313-bfe4-4d42-a9ca-9fce2e5bc82c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:23.285960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:23.286990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:23.287397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:23.287783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:23.288648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:23.289089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:23.290840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:23.343399 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2880/5793] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:23.344530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:23.383778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71d96d-1594-44df-9fad-4498cbf1219a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:23.412254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:23.413273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:23.413797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:23.414318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:23.415258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:23.422268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:23.514404 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2881/5794] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:23 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:23.519210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:23.728876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ff82a-2b4e-4d15-ab08-5e1e79fece24 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:23.746119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d269c-a699-47ef-999f-0cd6da4c4173 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:23.757792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed173d3e-5e42-4367-9e14-627e48b49f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:23.758875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173d3e-5e42-4367-9e14-627e48b49f0b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:23.759496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173d3e-5e42-4367-9e14-627e48b49f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:23.760022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed173d3e-5e42-4367-9e14-627e48b49f0b admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:23.761020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed173d3e-5e42-4367-9e14-627e48b49f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:23.763478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed173d3e-5e42-4367-9e14-627e48b49f0b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:23.805757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:23.814636 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2882/5795] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:23 2022] POST /identity/v3/users => generated 284 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:23.818812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85b3fc-6d81-41e2-bb5c-061847a9a38c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:23.820234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85b3fc-6d81-41e2-bb5c-061847a9a38c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:23.820655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85b3fc-6d81-41e2-bb5c-061847a9a38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:23.836253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:23.865615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:23.866307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:23.866863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:23.866863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:23.877797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bc85b3fc-6d81-41e2-bb5c-061847a9a38c None None] MFA Rules not processed for user `a54ea906c1324d9a97b492a3899187d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:23.879538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bc85b3fc-6d81-41e2-bb5c-061847a9a38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:23.964116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:23.966944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:23.980452 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2914/5796] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:23.982210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:24.000270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9ccc9-b261-4c0d-a85f-9e15e347af21 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:24.009773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:24.014166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:24.015200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:24.017974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:24.018987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:24.026668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:24.072852 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2915/5797] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:24.077175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:24.079974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2883/5798] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:24.092110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:24.092399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:24.092711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:24.127883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] MFA Rules not processed for user `a54ea906c1324d9a97b492a3899187d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:24.132275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:24.147697 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2884/5799] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:24.160400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:24.162002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:24.164740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72952cb2-7ddf-41a8-b17e-fddc1e6e598e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:24.186602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:24.188201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:24.188491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:24.188769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:24.189537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:24.191355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:24.197988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886421e-bc99-46b7-b2b9-02ae3dcac5e5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:24.220269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657784c0-3f4f-4073-9c72-87d0a79a452e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:24.221574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657784c0-3f4f-4073-9c72-87d0a79a452e service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:24.222166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657784c0-3f4f-4073-9c72-87d0a79a452e service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:24.222687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657784c0-3f4f-4073-9c72-87d0a79a452e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:24.238693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657784c0-3f4f-4073-9c72-87d0a79a452e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:24.245824 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2916/5800] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:24.246832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:24.253939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657784c0-3f4f-4073-9c72-87d0a79a452e service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:24.285595 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2885/5801] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:24.293575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340bcb-5f9c-405c-83fa-5dcdaa884343 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:24.313631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:24.314566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:24.314847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:24.315120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] PATH_INFO: `/v3/projects/2db36c88c1574b5592437a542df1b17c/users/6a612e82e1584336a0133f68adc53a15/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:24.406023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db36c88c1574b5592437a542df1b17c, user_id=6a612e82e1584336a0133f68adc53a15, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:24.409263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:24.479977 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2917/5802] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:24 2022] PUT /identity/v3/projects/2db36c88c1574b5592437a542df1b17c/users/6a612e82e1584336a0133f68adc53a15/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:24.493334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:24.494719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:24.495203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:24.558871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] MFA Rules not processed for user `6a612e82e1584336a0133f68adc53a15`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:24.561839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:24.683747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:24.684993 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2886/5803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:24.789112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:24.790987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:24.924128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47652b67-81c5-4456-8332-4b02379892a8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:24.943453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:24.944157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:24.944441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:24.944717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:24.945501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:24.947452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:25.010407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa3ec0-76a0-4c54-ac32-35643ac625b1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:25.035751 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2918/5804] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:24 2022] POST /identity/v3/projects => generated 367 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:25.041413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:25.049468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:25.050274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:25.050701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:25.050994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:25.077992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:25.085457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:25.167584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:25.191293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:25.250730 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2887/5805] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:25:25.327906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419595bf-1518-4ef3-aaef-910b48c055c6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:25.339393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:25.340411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:25.340717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:25.340963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:25.341698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:25.350190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:25.404340 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2919/5806] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:25 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:25.408579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:25.423368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6958a-a1b2-4f71-938b-cbe99366735f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:25.440829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:25.441562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:25.441845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:25.442138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:25.443205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:25.454036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:25.456407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:25.488019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:25.503405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ac36-003c-4d70-a691-81b54d9ab165 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:25.510228 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2888/5807] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:25.526868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:25.527856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:25.528082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:25.528378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] PATH_INFO: `/v3/projects/beef0e5c7d854fdb98b8482520fda6ba/users/1db80183bc2145fcacc599e1fb410a10/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:25.613560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=beef0e5c7d854fdb98b8482520fda6ba, user_id=1db80183bc2145fcacc599e1fb410a10, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:25.634563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:25.678422 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2920/5808] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:25 2022] PUT /identity/v3/projects/beef0e5c7d854fdb98b8482520fda6ba/users/1db80183bc2145fcacc599e1fb410a10/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:25.683090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:25.703307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c007626-c4a4-4778-8cb7-7a1bf5524c27 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:25.828944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec346c-c1b6-4751-b36a-75247472c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:25.830297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec346c-c1b6-4751-b36a-75247472c4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:25.831239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec346c-c1b6-4751-b36a-75247472c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:25.831735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec346c-c1b6-4751-b36a-75247472c4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:25.833847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec346c-c1b6-4751-b36a-75247472c4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:25.836297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec346c-c1b6-4751-b36a-75247472c4f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:25.864491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:25.875627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2889/5809] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:25:25.889743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13204bc0-9b7b-44df-98f2-e4e8c76a31ca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:25.902859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:25.904125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:25.906533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:25.907409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] PATH_INFO: `/v3/projects/beef0e5c7d854fdb98b8482520fda6ba/users/1db80183bc2145fcacc599e1fb410a10/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:25.913734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beef0e5c7d854fdb98b8482520fda6ba, user_id=1db80183bc2145fcacc599e1fb410a10, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:25.924084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:25.973097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2921/5810] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:25 2022] PUT /identity/v3/projects/beef0e5c7d854fdb98b8482520fda6ba/users/1db80183bc2145fcacc599e1fb410a10/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:25.978262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec342e-0318-4d12-a59d-5e0eab2c5c42 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:25.978749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec342e-0318-4d12-a59d-5e0eab2c5c42 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:25.979243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec342e-0318-4d12-a59d-5e0eab2c5c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:26.052775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-94ec342e-0318-4d12-a59d-5e0eab2c5c42 None None] MFA Rules not processed for user `1db80183bc2145fcacc599e1fb410a10`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:26.054654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-94ec342e-0318-4d12-a59d-5e0eab2c5c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:26.244591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2890/5811] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:26.250187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:26.303396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abbf5d-a4b6-4610-81df-bbfb9926d240 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:26.327030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:26.327817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:26.328443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:26.328710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:26.329630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:26.332582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:26.396286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2922/5812] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:26 2022] POST /identity/v3/projects => generated 359 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:26.400260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec342e-0318-4d12-a59d-5e0eab2c5c42 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:26.412045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec342e-0318-4d12-a59d-5e0eab2c5c42 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:26.581063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:26.582157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:26.582593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:26.583234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:26.583884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:26.586722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:26.634160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2891/5813] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:26 2022] POST /identity/v3/users => generated 413 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:26.638611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:26.668975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1740e-2366-4a32-a283-2967e77e7ce1 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:26.684007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:26.685365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:26.685773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:26.686159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/users/7a9be6bfdc8b41af991c6e9d0c3331f0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:26.717905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_user(user_id=7a9be6bfdc8b41af991c6e9d0c3331f0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:26.721001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:26.727018 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2923/5814] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:25:26 2022] GET /identity/v3/users/7a9be6bfdc8b41af991c6e9d0c3331f0 => generated 413 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:26.728105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:26.744924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9857a03-3c62-4ba4-9c3a-d76d7e7b3137 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:26.761862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:26.763087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:26.765231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:26.766678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/users/7a9be6bfdc8b41af991c6e9d0c3331f0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:26.769445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7a9be6bfdc8b41af991c6e9d0c3331f0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:26.775294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:26.777484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:26.915021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9be6bfdc8b41af991c6e9d0c3331f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:26.916062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9be6bfdc8b41af991c6e9d0c3331f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:26.935586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9be6bfdc8b41af991c6e9d0c3331f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:26.936721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9be6bfdc8b41af991c6e9d0c3331f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:26.952095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9be6bfdc8b41af991c6e9d0c3331f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:26.988305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2892/5815] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:26 2022] DELETE /identity/v3/users/7a9be6bfdc8b41af991c6e9d0c3331f0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:26.992312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:26.994686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:27.011863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9ccbc-dee6-4c4a-acdd-588a9e211833 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:27.099158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:27.100131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:27.100634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:27.100954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/1e6d5fa1d6d34a1da3d93f238e24bc63` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:27.102976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e6d5fa1d6d34a1da3d93f238e24bc63)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:27.105342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:27.183270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:27.219688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6d5fa1d6d34a1da3d93f238e24bc63', 'request_id': 'req-202c9930-173f-40c4-a1de-cd18be49f0b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:27.238482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6d5fa1d6d34a1da3d93f238e24bc63', 'request_id': 'req-202c9930-173f-40c4-a1de-cd18be49f0b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:27.285883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6d5fa1d6d34a1da3d93f238e24bc63', 'request_id': 'req-202c9930-173f-40c4-a1de-cd18be49f0b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:27.364998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 1e6d5fa1d6d34a1da3d93f238e24bc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:27.372337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:27.392916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:27.418400 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2924/5816] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:26 2022] DELETE /identity/v3/projects/1e6d5fa1d6d34a1da3d93f238e24bc63 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:27.420479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:27.456236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:27.458681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:27.460331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402118e-b30c-4da8-ad40-480e0b04ceeb tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:27.669002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:27.669796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:27.670060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:27.670265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:27.675036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:27.679099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:27.688038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9930-173f-40c4-a1de-cd18be49f0b9 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:27.716090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:27.717021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:27.720309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:27.720592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] PATH_INFO: `/v3/users/a54ea906c1324d9a97b492a3899187d9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:27.723277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54ea906c1324d9a97b492a3899187d9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:27.730472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:27.730757 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2893/5817] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:27 2022] POST /identity/v3/projects => generated 348 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:27.732520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:27.735735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:27.941589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671aa77-456b-4be5-84c6-91f3d6f2413c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:27.965137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:27.965925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:27.966670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:27.967380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:27.968377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:27.968864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:27.971565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:28.035057 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2894/5818] 10.222.0.30 () {58 vars in 1159 bytes} [Sat Jun 18 22:25:27 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:25:28.039003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:28.065527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2cfe3-203e-4a3b-a265-94347c4326db tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:28.079540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:28.094046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:28.098690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:28.099477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:28.100266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:28.101970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:28.103651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:28.154989 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2895/5819] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:25:28 2022] GET /identity/v3/domains => generated 829 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:28.156132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:28.191304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091f2ae-1cbb-4354-a5d3-8fa6588a5412 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:28.283774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:28.285155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:28.291170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:28.291765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/f8fc15cc1fe74f32b15a6abf59a1233c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:28.293940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:update_project(project_id=f8fc15cc1fe74f32b15a6abf59a1233c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:28.300401 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:25:28.300401 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:25:28.300401 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:25:28.302137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:28.414071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.416983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.554773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.558191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.578593 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2896/5820] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Jun 18 22:25:28 2022] PATCH /identity/v3/projects/f8fc15cc1fe74f32b15a6abf59a1233c => generated 362 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:28.581289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:28.593821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:28.675600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54ea906c1324d9a97b492a3899187d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.676905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54ea906c1324d9a97b492a3899187d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.776933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54ea906c1324d9a97b492a3899187d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.780702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54ea906c1324d9a97b492a3899187d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.818962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54ea906c1324d9a97b492a3899187d9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:28.871510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2925/5821] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:27 2022] DELETE /identity/v3/users/a54ea906c1324d9a97b492a3899187d9 => generated 0 bytes in 1416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:28.918395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f12d8-92a4-4b5b-9dcf-dda2dce303d0 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:29.129399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:29.130746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:29.131258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:29.131765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/f8fc15cc1fe74f32b15a6abf59a1233c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:29.169533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8fc15cc1fe74f32b15a6abf59a1233c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:29.171453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:29.268609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.280046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.421416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:29.438375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c', 'request_id': 'req-332c7008-ae9e-41a8-b5d6-accbac330e2b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.449762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c', 'request_id': 'req-332c7008-ae9e-41a8-b5d6-accbac330e2b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.502794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c', 'request_id': 'req-332c7008-ae9e-41a8-b5d6-accbac330e2b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.531476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project f8fc15cc1fe74f32b15a6abf59a1233c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:29.532841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.533873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.545916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c', 'request_id': 'req-332c7008-ae9e-41a8-b5d6-accbac330e2b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.547020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c', 'request_id': 'req-332c7008-ae9e-41a8-b5d6-accbac330e2b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.548296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f8fc15cc1fe74f32b15a6abf59a1233c', 'request_id': 'req-332c7008-ae9e-41a8-b5d6-accbac330e2b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:29.565517 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2897/5822] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:28 2022] DELETE /identity/v3/projects/f8fc15cc1fe74f32b15a6abf59a1233c => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:29.570930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:29.572867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:29.614685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547f602-7ffc-4c04-8a99-c77a607b1e70 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:29.827000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:29.895597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:29.897470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:29.897780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:29.900224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:29.903845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:29.911079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:30.056681 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2926/5823] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:29 2022] POST /identity/v3/projects => generated 358 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:30.057462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:30.057922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:30.059606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:30.066427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:30.262715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c7008-ae9e-41a8-b5d6-accbac330e2b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:30.388316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5783-bf5c-4802-9574-78117d4ca686 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:30.405832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:30.407608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:30.408117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:30.408851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/503d6c7325d74da2810c12e289e13e95` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:30.419238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=503d6c7325d74da2810c12e289e13e95)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:30.427192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:30.429689 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2927/5824] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:30 2022] GET /identity/v3/projects/503d6c7325d74da2810c12e289e13e95 => generated 358 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:30.433886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:30.463392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783112e0-c4ce-4b8f-b067-9a072c02ad38 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:30.496150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:30.497079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:30.497497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:30.497776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/503d6c7325d74da2810c12e289e13e95` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:30.511098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:30.512122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:30.512793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=503d6c7325d74da2810c12e289e13e95)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:30.513214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:30.513571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] PATH_INFO: `/v3/projects/a0cc5cf5466e45189a8d6c05f9c79298` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:30.518452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0cc5cf5466e45189a8d6c05f9c79298)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:30.525338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:30.530912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:30.638424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0cc5cf5466e45189a8d6c05f9c79298', 'request_id': 'req-fbfb3040-f59a-4a5d-9764-ef395ef901b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.654075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0cc5cf5466e45189a8d6c05f9c79298', 'request_id': 'req-fbfb3040-f59a-4a5d-9764-ef395ef901b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.659500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:30.678100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0cc5cf5466e45189a8d6c05f9c79298', 'request_id': 'req-fbfb3040-f59a-4a5d-9764-ef395ef901b7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.702823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] The token cache is being invalidate because project a0cc5cf5466e45189a8d6c05f9c79298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:30.703276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.704091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbfb3040-f59a-4a5d-9764-ef395ef901b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.707821 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2898/5825] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:30 2022] DELETE /identity/v3/projects/a0cc5cf5466e45189a8d6c05f9c79298 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:30.718388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87076-3b95-408f-8221-0610dcc62c97 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:30.721459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87076-3b95-408f-8221-0610dcc62c97 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:30.722180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87076-3b95-408f-8221-0610dcc62c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:30.771979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e5b87076-3b95-408f-8221-0610dcc62c97 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:30.774732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5b87076-3b95-408f-8221-0610dcc62c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:30.807011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503d6c7325d74da2810c12e289e13e95', 'request_id': 'req-44d0f117-90db-4927-b371-5cf6015024f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.816626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503d6c7325d74da2810c12e289e13e95', 'request_id': 'req-44d0f117-90db-4927-b371-5cf6015024f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.835424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503d6c7325d74da2810c12e289e13e95', 'request_id': 'req-44d0f117-90db-4927-b371-5cf6015024f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.862530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 503d6c7325d74da2810c12e289e13e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:30.863234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.864401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:30.869046 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2928/5826] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:30 2022] DELETE /identity/v3/projects/503d6c7325d74da2810c12e289e13e95 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:30.876083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:30.879265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:31.005763 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2899/5827] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:31.015151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71893b2-212b-4a80-a6ef-c37f47a9962c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.015536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71893b2-212b-4a80-a6ef-c37f47a9962c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.015882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71893b2-212b-4a80-a6ef-c37f47a9962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.052441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:31.083093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0f117-90db-4927-b371-5cf6015024f6 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.094052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.094762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.095035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.095311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.096017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.101169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.111662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b71893b2-212b-4a80-a6ef-c37f47a9962c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:31.115456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b71893b2-212b-4a80-a6ef-c37f47a9962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:31.150697 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2900/5828] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:31.154990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71893b2-212b-4a80-a6ef-c37f47a9962c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.173393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71893b2-212b-4a80-a6ef-c37f47a9962c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.179899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.180599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.180880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.181196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.181949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:31.182325 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2929/5829] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:30 2022] POST /identity/v3/projects => generated 359 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:31.182557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.184529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.190981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.204748 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2901/5830] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:31.205813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.225970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d5950-28b8-479b-8539-808d674d35d6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.397902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4b68-cc09-44ee-b984-0267722cc8ed tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.410567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.411549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.412081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.412081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/7d784bbfb09f421fba544ad6ad716840` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.422035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=7d784bbfb09f421fba544ad6ad716840)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.424540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.426724 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2930/5831] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:31 2022] GET /identity/v3/projects/7d784bbfb09f421fba544ad6ad716840 => generated 359 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:31.430780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.441582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.442632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.442920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.443199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.443901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.455626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a77c80-a955-45f5-85e0-4bc9acd301e7 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.457798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.469117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.470018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.470307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.479547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/7d784bbfb09f421fba544ad6ad716840` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.482729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d784bbfb09f421fba544ad6ad716840)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.484810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.534971 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2902/5832] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:31 2022] POST /identity/v3/projects => generated 359 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:31.540184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.608017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d784bbfb09f421fba544ad6ad716840', 'request_id': 'req-66558e04-b584-4479-ad7c-3cb0a69f9db8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:31.617659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d784bbfb09f421fba544ad6ad716840', 'request_id': 'req-66558e04-b584-4479-ad7c-3cb0a69f9db8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:31.625188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:31.641713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d784bbfb09f421fba544ad6ad716840', 'request_id': 'req-66558e04-b584-4479-ad7c-3cb0a69f9db8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:31.645769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deccf4-7a15-4c35-920f-4c4deabae271 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.671870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 7d784bbfb09f421fba544ad6ad716840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:31.675003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:31.677104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:31.680045 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2931/5833] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:31 2022] DELETE /identity/v3/projects/7d784bbfb09f421fba544ad6ad716840 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:31.685412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.688178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:31.772737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.773624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.774359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.774628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.775343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.789970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.832234 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2903/5834] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:31 2022] POST /identity/v3/users => generated 280 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:31.833253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.843499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:31.864850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a40b21-837d-4ffe-9eca-07ac4aaff3ee admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.877866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.878580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.878933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.879135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.879878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.880106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66558e04-b584-4479-ad7c-3cb0a69f9db8 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.884944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.886354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.887352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.887743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.888239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.888955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.894328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:31.906086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:31.921097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2904/5835] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:31.922072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.951680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced5fbd-8fe5-4249-a0a1-6632a16a68fd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:31.961799 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2932/5836] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:25:31 2022] POST /identity/v3/projects => generated 347 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:31.967474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:31.968280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:31.969176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:31.969602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:31.970213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:31.971145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:31.982620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:32.017253 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2905/5837] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:32.027725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:32.060962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b10ab-2577-4ac9-9811-5fbd1906f996 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:32.109927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd394165-99dd-4691-8d83-73ff4cd01861 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:32.122160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:32.123084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.123360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.123632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/0f828395aefd4d56a8f0638d7b54be3a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:32.128331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f828395aefd4d56a8f0638d7b54be3a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:32.131324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:32.139915 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2933/5838] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:31 2022] GET /identity/v3/projects/0f828395aefd4d56a8f0638d7b54be3a => generated 347 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:32.142067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:32.170394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58929985-b6c2-41a8-9d3e-3f6b91f31a7b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:32.179205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:32.180104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.180424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.180653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/0f828395aefd4d56a8f0638d7b54be3a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:32.188097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f828395aefd4d56a8f0638d7b54be3a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:32.190521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:32.209919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde41392-fc77-4df8-a253-cae381fb971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:32.212268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41392-fc77-4df8-a253-cae381fb971f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.212823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41392-fc77-4df8-a253-cae381fb971f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.213300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde41392-fc77-4df8-a253-cae381fb971f admin admin] PATH_INFO: `/v3/projects/81cabf0ab2b84748bf60da80845e322d/users/452e5473b6c643d88eb13675d8814779/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:32.245244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41392-fc77-4df8-a253-cae381fb971f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cabf0ab2b84748bf60da80845e322d, user_id=452e5473b6c643d88eb13675d8814779, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:32.250891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde41392-fc77-4df8-a253-cae381fb971f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:32.281702 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2906/5839] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:32 2022] PUT /identity/v3/projects/81cabf0ab2b84748bf60da80845e322d/users/452e5473b6c643d88eb13675d8814779/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:32.291608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f828395aefd4d56a8f0638d7b54be3a', 'request_id': 'req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.292505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.292802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.293168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:32.313731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f828395aefd4d56a8f0638d7b54be3a', 'request_id': 'req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.335014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f828395aefd4d56a8f0638d7b54be3a', 'request_id': 'req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.352041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] MFA Rules not processed for user `452e5473b6c643d88eb13675d8814779`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:32.353321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 0f828395aefd4d56a8f0638d7b54be3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:32.353472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:32.353607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.356677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.359976 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2934/5840] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:32 2022] DELETE /identity/v3/projects/0f828395aefd4d56a8f0638d7b54be3a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:32.376548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:32.381404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:32.422420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:32.500760 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2907/5841] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:32.538926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fc732-9e63-4356-84ab-687a7cc6ab3a tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:32.543562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:32.544735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:32.584210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:32.696044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:32.696884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5ecbb-dd94-4141-85e5-b4eb6b4eeba6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:32.697023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.699165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.699666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:32.700662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:32.702479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:32.705007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:32.706056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.706342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.706629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] PATH_INFO: `/v3/users/452e5473b6c643d88eb13675d8814779` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:32.708847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452e5473b6c643d88eb13675d8814779)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:32.711291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:32.738784 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2935/5842] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:25:32 2022] POST /identity/v3/domains => generated 276 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:32.744632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:32.841211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452e5473b6c643d88eb13675d8814779'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.842043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452e5473b6c643d88eb13675d8814779'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.887314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452e5473b6c643d88eb13675d8814779'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.889234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452e5473b6c643d88eb13675d8814779'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.911943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb69c-9cb9-4a35-8ca7-dd322506d840 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:32.917590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e48ce3f4-e06a-4c2f-9813-9b2c2ce44e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452e5473b6c643d88eb13675d8814779'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:32.922095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:32.922964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.923568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.923777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:32.925186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:32.927485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:32.972523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2908/5843] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:32 2022] DELETE /identity/v3/users/452e5473b6c643d88eb13675d8814779 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:32.977838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3642cc-3d9f-408c-b4c7-978d64ea213e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:32.978509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3642cc-3d9f-408c-b4c7-978d64ea213e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:32.979050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3642cc-3d9f-408c-b4c7-978d64ea213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:33.030088 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2936/5844] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:32 2022] POST /identity/v3/projects => generated 405 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:33.031624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:33.039117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:33.056574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ae3642cc-3d9f-408c-b4c7-978d64ea213e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:33.057838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ae3642cc-3d9f-408c-b4c7-978d64ea213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:33.173084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:33.187311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea02ac3-20b3-4bc3-b959-3ea080664cd3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:33.200622 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2909/5845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:33.208121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:33.209473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:33.209983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:33.210532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/4f7104ec14a848acaa9b1cc1ea842ede` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:33.212629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f7104ec14a848acaa9b1cc1ea842ede)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:33.216597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:33.219883 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2937/5846] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:33 2022] GET /identity/v3/projects/4f7104ec14a848acaa9b1cc1ea842ede => generated 405 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:33.224794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3642cc-3d9f-408c-b4c7-978d64ea213e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:33.241103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3642cc-3d9f-408c-b4c7-978d64ea213e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:33.251493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:33.254086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:33.259219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:33.260159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:33.260446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:33.260750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/4f7104ec14a848acaa9b1cc1ea842ede` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:33.265758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f7104ec14a848acaa9b1cc1ea842ede)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:33.269232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:33.330255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:33.370145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7104ec14a848acaa9b1cc1ea842ede', 'request_id': 'req-2bb45476-1f3a-4bae-b87d-4504be01e4ae'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.395356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7104ec14a848acaa9b1cc1ea842ede', 'request_id': 'req-2bb45476-1f3a-4bae-b87d-4504be01e4ae'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.399901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae13226-1bc3-429c-b1aa-71a717f18a44 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:33.420160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7104ec14a848acaa9b1cc1ea842ede', 'request_id': 'req-2bb45476-1f3a-4bae-b87d-4504be01e4ae'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.449461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 4f7104ec14a848acaa9b1cc1ea842ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:33.456757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.460694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.463519 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2910/5847] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:33 2022] DELETE /identity/v3/projects/4f7104ec14a848acaa9b1cc1ea842ede => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:33.468082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:33.470881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:33.566842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:33.568284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:33.568788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:33.569284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:33.574887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:33.682035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:33.686158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:33.688832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45476-1f3a-4bae-b87d-4504be01e4ae tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:33.703543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:33.708243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2938/5848] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:25:33.708902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:33.709317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:33.709832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains/0a8090e2433e44d3ad0b59fb57b97ef0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:33.714551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0a8090e2433e44d3ad0b59fb57b97ef0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:33.716686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:33.761203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.762423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.808902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.809975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:33.814708 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2911/5849] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:25:33 2022] PATCH /identity/v3/domains/0a8090e2433e44d3ad0b59fb57b97ef0 => generated 277 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:33.820150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:33.844701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62794eff-095d-4e78-b480-885303d3abfe service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:33.927226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:33.929181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:33.929631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:33.931049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains/0a8090e2433e44d3ad0b59fb57b97ef0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:33.961988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0a8090e2433e44d3ad0b59fb57b97ef0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:33.964567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:34.061660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.083239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.090112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:34.160585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0', 'request_id': 'req-eb527ef9-4734-49cd-bf2e-15a3865fff76'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.177245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0', 'request_id': 'req-eb527ef9-4734-49cd-bf2e-15a3865fff76'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.200631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0', 'request_id': 'req-eb527ef9-4734-49cd-bf2e-15a3865fff76'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.230640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 0a8090e2433e44d3ad0b59fb57b97ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:34.232772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.234148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.256175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0', 'request_id': 'req-eb527ef9-4734-49cd-bf2e-15a3865fff76'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.258655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0', 'request_id': 'req-eb527ef9-4734-49cd-bf2e-15a3865fff76'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.259404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0a8090e2433e44d3ad0b59fb57b97ef0', 'request_id': 'req-eb527ef9-4734-49cd-bf2e-15a3865fff76'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:34.280632 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2939/5850] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:33 2022] DELETE /identity/v3/domains/0a8090e2433e44d3ad0b59fb57b97ef0 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:34.286209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:34.287703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:34.310292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278c36b-fb47-4e5f-b52e-c57b51884719 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:34.432569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:34.490533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:34.491256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:34.491550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:34.491976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:34.492855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:34.497976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:34.537896 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2912/5851] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:25:34 2022] POST /identity/v3/domains => generated 275 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:34.542338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:34.543949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:34.605668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb527ef9-4734-49cd-bf2e-15a3865fff76 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:34.855818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:34.858750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:34.859094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:34.859452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:34.860505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:34.864038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:34.975027 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2940/5852] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:34 2022] POST /identity/v3/projects => generated 410 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:34.979881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:35.034880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df2b43-c182-4f99-ba1e-dbf67afdee6b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:35.213621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:35.214369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:35.214663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:35.214944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:35.217604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:35.224567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:35.332144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2913/5853] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:34 2022] POST /identity/v3/projects => generated 404 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:35.336056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:35.366778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59929e74-8183-4a0b-a95b-c2e94ebde242 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:35.478769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:35.498992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:35.500969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:35.501292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:35.501656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/c3e79cb5d74244419e61ae62413d4986` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:35.503924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c3e79cb5d74244419e61ae62413d4986)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:35.509991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:35.598507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e79cb5d74244419e61ae62413d4986', 'request_id': 'req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:35.611410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e79cb5d74244419e61ae62413d4986', 'request_id': 'req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:35.626085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e79cb5d74244419e61ae62413d4986', 'request_id': 'req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:35.646195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project c3e79cb5d74244419e61ae62413d4986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:35.646622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:35.647421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:35.654619 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2941/5854] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:35 2022] DELETE /identity/v3/projects/c3e79cb5d74244419e61ae62413d4986 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:35.657194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:35.660048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:35.714480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cc122-2207-4ee6-bab6-fc358d03988f tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:35.895018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:35.907127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:35.908310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:35.908771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/4246941b17fc4d8fabbc0dcccb323fcd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:35.911115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4246941b17fc4d8fabbc0dcccb323fcd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:35.913635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:36.016274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4246941b17fc4d8fabbc0dcccb323fcd', 'request_id': 'req-f0420549-ede5-468f-8ee7-3072aa6d8f54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.028212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4246941b17fc4d8fabbc0dcccb323fcd', 'request_id': 'req-f0420549-ede5-468f-8ee7-3072aa6d8f54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.035503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:36.054644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4246941b17fc4d8fabbc0dcccb323fcd', 'request_id': 'req-f0420549-ede5-468f-8ee7-3072aa6d8f54'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.085597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 4246941b17fc4d8fabbc0dcccb323fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:36.086194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.093967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.100583 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2914/5855] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:35 2022] DELETE /identity/v3/projects/4246941b17fc4d8fabbc0dcccb323fcd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:36.103994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:36.153865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a11f5e-29a3-418d-a8ed-b63b404d9d96 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:36.345390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:36.347108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:36.347458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:36.347742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains/9a1eacfa1d5841c0ac891e480d9d65ec` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:36.349427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9a1eacfa1d5841c0ac891e480d9d65ec)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:36.359239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:36.361422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:36.375942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:36.464107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.477615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.586906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.588165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.594074 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2942/5856] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:25:36 2022] PATCH /identity/v3/domains/9a1eacfa1d5841c0ac891e480d9d65ec => generated 276 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:36.607201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:36.618425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0420549-ede5-468f-8ee7-3072aa6d8f54 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:36.625491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:36.728233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:36.729540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:36.730024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:36.730403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] PATH_INFO: `/v3/projects/81cabf0ab2b84748bf60da80845e322d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:36.731810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cabf0ab2b84748bf60da80845e322d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:36.734022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:36.761747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:36.805958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79200b08-a3e9-4c4a-8b98-871d97ae5a05 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:36.812406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cabf0ab2b84748bf60da80845e322d', 'request_id': 'req-b036710a-7ab9-4d8c-95c9-ee449463f005'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.821688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cabf0ab2b84748bf60da80845e322d', 'request_id': 'req-b036710a-7ab9-4d8c-95c9-ee449463f005'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.837406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cabf0ab2b84748bf60da80845e322d', 'request_id': 'req-b036710a-7ab9-4d8c-95c9-ee449463f005'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.856668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] The token cache is being invalidate because project 81cabf0ab2b84748bf60da80845e322d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:36.856973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.857787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b036710a-7ab9-4d8c-95c9-ee449463f005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:36.862900 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2915/5857] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:36 2022] DELETE /identity/v3/projects/81cabf0ab2b84748bf60da80845e322d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:36.866134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c234-59f0-44ea-bd08-569b6d0b90e4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:36.866433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c234-59f0-44ea-bd08-569b6d0b90e4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:36.866715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8c234-59f0-44ea-bd08-569b6d0b90e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:36.898842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c5a8c234-59f0-44ea-bd08-569b6d0b90e4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:36.900989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c5a8c234-59f0-44ea-bd08-569b6d0b90e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:36.959569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:36.969481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:36.970101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:36.971109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:36.971577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains/9a1eacfa1d5841c0ac891e480d9d65ec` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:36.995492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9a1eacfa1d5841c0ac891e480d9d65ec)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:36.997777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.033951 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2916/5858] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:37.035364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.043125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.044583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac41f6d-e9ca-4a5e-9533-944214fb8b6f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.045145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac41f6d-e9ca-4a5e-9533-944214fb8b6f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.045501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac41f6d-e9ca-4a5e-9533-944214fb8b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.069147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fac41f6d-e9ca-4a5e-9533-944214fb8b6f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:37.070277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fac41f6d-e9ca-4a5e-9533-944214fb8b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:37.080563 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2917/5859] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:37.085687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac41f6d-e9ca-4a5e-9533-944214fb8b6f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.096870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac41f6d-e9ca-4a5e-9533-944214fb8b6f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.110834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec', 'request_id': 'req-842486aa-ba36-4f50-ad81-ca21ab9cacb5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.122082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec', 'request_id': 'req-842486aa-ba36-4f50-ad81-ca21ab9cacb5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.136542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec', 'request_id': 'req-842486aa-ba36-4f50-ad81-ca21ab9cacb5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.180228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 9a1eacfa1d5841c0ac891e480d9d65ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:37.180406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.182951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.195741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.197688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.199458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.199738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.200759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:37.202555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.204831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.206126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec', 'request_id': 'req-842486aa-ba36-4f50-ad81-ca21ab9cacb5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.207732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec', 'request_id': 'req-842486aa-ba36-4f50-ad81-ca21ab9cacb5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.208661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9a1eacfa1d5841c0ac891e480d9d65ec', 'request_id': 'req-842486aa-ba36-4f50-ad81-ca21ab9cacb5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.231911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2943/5860] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:36 2022] DELETE /identity/v3/domains/9a1eacfa1d5841c0ac891e480d9d65ec => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:37.237938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.244868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:37.245079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2918/5861] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:37.245562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.248786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:37.278238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d823-c460-4b62-9d2f-3ade8090d044 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.284359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.285269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.285688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.286916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.287362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.289901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.316273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:37.358422 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2919/5862] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:37 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:37.363706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.382576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842486aa-ba36-4f50-ad81-ca21ab9cacb5 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.475262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.476675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.477274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.477836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.478754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.481185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.484487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a543-8a00-4a06-b802-c89c0c24e93f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.505570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.507496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.508592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.509438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.510377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.516511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.549109 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2920/5863] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:37 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:37.550443 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2944/5864] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:37 2022] POST /identity/v3/projects => generated 378 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:37.553399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.554776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.575137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970d2e0-0366-4089-a5bd-34154aa38300 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.613797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:37.683971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.684745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.685319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7ed6f-89aa-4167-8216-876fd87db21b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.685491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.685785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.687640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.689762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.694183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.697196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.697852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.698078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/a5e9f32ae5f94728971ca1bbd03f0dfe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.703354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=a5e9f32ae5f94728971ca1bbd03f0dfe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.709154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.713195 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2945/5865] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:37 2022] GET /identity/v3/projects/a5e9f32ae5f94728971ca1bbd03f0dfe => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:37.716264 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2921/5866] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:37.718874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.719047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.734681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dde69-1a43-41c3-8838-be8e14dc5116 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.740158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85902fef-1a7a-43c6-a31a-d9511119ba37 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.741716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.742559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.742937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.743346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.745097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.747405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.752345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.753200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.753572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.753862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.754723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.756463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.774844 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2922/5867] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:37.778035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.780416 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2946/5868] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:25:37 2022] GET /identity/v3/projects => generated 6914 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:37.784994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:37.800121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f1b65-6bcd-4551-8c02-ce46ffdb710a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.806165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9c3a1-9bf5-40b9-8306-96bfe20ae058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.807178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c3a1-9bf5-40b9-8306-96bfe20ae058 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.807448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c3a1-9bf5-40b9-8306-96bfe20ae058 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.808014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9c3a1-9bf5-40b9-8306-96bfe20ae058 admin admin] PATH_INFO: `/v3/projects/76301551c4574f299511a993dc871890/users/3f6133e6ab7745118bc629dd126189e8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.823091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2962-d996-4b18-b0b7-ece414b0da16 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:37.829784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:37.831042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.831218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9c3a1-9bf5-40b9-8306-96bfe20ae058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76301551c4574f299511a993dc871890, user_id=3f6133e6ab7745118bc629dd126189e8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.831639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.832330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/a5e9f32ae5f94728971ca1bbd03f0dfe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.834161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a5e9f32ae5f94728971ca1bbd03f0dfe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:37.835035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9c3a1-9bf5-40b9-8306-96bfe20ae058 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.837069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:37.879364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2923/5869] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:37 2022] PUT /identity/v3/projects/76301551c4574f299511a993dc871890/users/3f6133e6ab7745118bc629dd126189e8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:37.882278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:37.882679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:37.883160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:37.924303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:37.929093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:37.939023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:37.945769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e9f32ae5f94728971ca1bbd03f0dfe', 'request_id': 'req-78337a54-132f-4600-b148-11e2f750e215'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:37.980825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e9f32ae5f94728971ca1bbd03f0dfe', 'request_id': 'req-78337a54-132f-4600-b148-11e2f750e215'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:38.015985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e9f32ae5f94728971ca1bbd03f0dfe', 'request_id': 'req-78337a54-132f-4600-b148-11e2f750e215'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:38.065780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project a5e9f32ae5f94728971ca1bbd03f0dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:38.066100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:38.067985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:38.072004 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2947/5870] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:37 2022] DELETE /identity/v3/projects/a5e9f32ae5f94728971ca1bbd03f0dfe => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:38.078267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:38.081476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:38.137564 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2924/5871] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:38.190842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:38.192515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:38.267918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78337a54-132f-4600-b148-11e2f750e215 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:38.278732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:38.279507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:38.280048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:38.280412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:38.281268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:38.283577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:38.360661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4cbef-1d0f-49d2-a49d-a9f9d6db6940 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:38.369601 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2948/5872] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:25:38 2022] POST /identity/v3/projects => generated 347 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:38.373954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:38.436341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:38.472223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:38.476463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:38.476947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:38.477879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:38.607407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a9cc1-d038-4592-bcd0-25624a20e18d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:38.637804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:38.640727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:38.645839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:38.646477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/df19826b9558495cb6a8596a76fdbbba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:38.652342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:update_project(project_id=df19826b9558495cb6a8596a76fdbbba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:38.656001 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:25:38.656001 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:25:38.656001 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:25:38.664295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:38.763995 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2949/5873] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Jun 18 22:25:38 2022] PATCH /identity/v3/projects/df19826b9558495cb6a8596a76fdbbba => generated 360 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:25:38.776970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:38.796500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:38.797902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac90aeb-0fa3-4d17-95cc-4f539cf874ff tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:38.799641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:38.807030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:38.808073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:38.808363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:38.808735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/df19826b9558495cb6a8596a76fdbbba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:38.828846 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2925/5874] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:38.830843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=df19826b9558495cb6a8596a76fdbbba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:38.835299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:38.838145 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2950/5875] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:38 2022] GET /identity/v3/projects/df19826b9558495cb6a8596a76fdbbba => generated 347 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:38.842486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:38.857912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507e713-b4c3-4e8d-a06b-74234bcdd22f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:38.865365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:38.866648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:38.866927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:38.867239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/df19826b9558495cb6a8596a76fdbbba` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:38.868649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df19826b9558495cb6a8596a76fdbbba)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:38.871412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:39.072223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df19826b9558495cb6a8596a76fdbbba', 'request_id': 'req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:39.091574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df19826b9558495cb6a8596a76fdbbba', 'request_id': 'req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:39.111328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df19826b9558495cb6a8596a76fdbbba', 'request_id': 'req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:39.125357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project df19826b9558495cb6a8596a76fdbbba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:39.125910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:39.127239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:39.136018 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2926/5876] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:38 2022] DELETE /identity/v3/projects/df19826b9558495cb6a8596a76fdbbba => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:39.136495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:39.138856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:39.165899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b633-ab13-455f-9729-93e5d747a170 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:39.213811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:39.278980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:39.280223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:39.280517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:39.280844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:39.282322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:39.285608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:39.359452 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2951/5877] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:39 2022] POST /identity/v3/projects => generated 360 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:25:39.364126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:39.383473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4a6d2-f640-47c6-a0ea-5ad618fb335c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:39.601678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:39.603115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:39.603297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:39.604043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/947d94233f9d4430a504250c14007452` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:39.605699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:update_project(project_id=947d94233f9d4430a504250c14007452)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:39.609903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:39.635983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:39.773596 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2927/5878] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Jun 18 22:25:39 2022] PATCH /identity/v3/projects/947d94233f9d4430a504250c14007452 => generated 372 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:39.775215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:39.791550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08eede-537c-42c2-8f2d-9eaa9131f4b3 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:39.807019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:39.808212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:39.812571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:39.813133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/947d94233f9d4430a504250c14007452` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:39.843540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=947d94233f9d4430a504250c14007452)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:39.857825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:39.864462 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2952/5879] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:39 2022] GET /identity/v3/projects/947d94233f9d4430a504250c14007452 => generated 359 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:39.869070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:39.885593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b113a0-ed99-4693-b480-a00bd10bbbba tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:39.896425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:39.898393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:39.898835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:39.899479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/947d94233f9d4430a504250c14007452` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:39.900984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=947d94233f9d4430a504250c14007452)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:39.912793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:40.084306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947d94233f9d4430a504250c14007452', 'request_id': 'req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:40.097056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947d94233f9d4430a504250c14007452', 'request_id': 'req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:40.124069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947d94233f9d4430a504250c14007452', 'request_id': 'req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:40.143277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 947d94233f9d4430a504250c14007452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:40.144216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:40.144929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:40.157234 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2928/5880] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:39 2022] DELETE /identity/v3/projects/947d94233f9d4430a504250c14007452 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:40.159943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:40.164368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:40.197003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366300-d5a8-4271-9738-aef699ea677c tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:40.413391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:40.414316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:40.415189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:40.415841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:40.417075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:40.424077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:40.500705 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2953/5881] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:40 2022] POST /identity/v3/projects => generated 353 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:40.507491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:40.522124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfd4ce-57eb-4d44-a854-c6b78ec14a91 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:40.708409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:40.709413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:40.709706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:40.709997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/04c14d44641341ce9220a4c8ba6e8c33` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:40.715665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:update_project(project_id=04c14d44641341ce9220a4c8ba6e8c33)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:40.721203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:40.818143 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2929/5882] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Jun 18 22:25:40 2022] PATCH /identity/v3/projects/04c14d44641341ce9220a4c8ba6e8c33 => generated 367 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:40.820342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:40.861590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f279-ebb7-4891-8ede-aab8ed6e2e21 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:40.883769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:40.885245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:40.885720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:40.886190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/04c14d44641341ce9220a4c8ba6e8c33` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:40.946439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:get_project(project_id=04c14d44641341ce9220a4c8ba6e8c33)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:40.951292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:40.955394 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2954/5883] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:25:40 2022] GET /identity/v3/projects/04c14d44641341ce9220a4c8ba6e8c33 => generated 354 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:40.961939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:41.007983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9392-3e93-4414-9785-9169af3a3a8b tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:41.050067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:41.056686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:41.057585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:41.059110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/projects/04c14d44641341ce9220a4c8ba6e8c33` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:41.062122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04c14d44641341ce9220a4c8ba6e8c33)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:41.069241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:41.140941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:UPDATE=2,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:41.172063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c14d44641341ce9220a4c8ba6e8c33', 'request_id': 'req-e9cb1239-4174-471e-86ff-525dec462b0e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:41.209472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c14d44641341ce9220a4c8ba6e8c33', 'request_id': 'req-e9cb1239-4174-471e-86ff-525dec462b0e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:41.229670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c14d44641341ce9220a4c8ba6e8c33', 'request_id': 'req-e9cb1239-4174-471e-86ff-525dec462b0e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:41.256634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] The token cache is being invalidate because project 04c14d44641341ce9220a4c8ba6e8c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:41.257266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:41.270864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:41.275252 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2930/5884] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:40 2022] DELETE /identity/v3/projects/04c14d44641341ce9220a4c8ba6e8c33 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:41.282621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:41.285776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:41.340861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54307419-65e5-4855-865c-b4e8c6c05008 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:41.532446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:41.534330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:41.534971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:41.535538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains/9a1eacfa1d5841c0ac891e480d9d65ec` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:41.548151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Could not find domain: 9a1eacfa1d5841c0ac891e480d9d65ec.: keystone.exception.DomainNotFound: Could not find domain: 9a1eacfa1d5841c0ac891e480d9d65ec. Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9a1eacfa1d5841c0ac891e480d9d65ec. Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:41.583580 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:25:41.586698 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9a1eacfa1d5841c0ac891e480d9d65ec. Jun 18 22:25:41.589391 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:41.595534 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2955/5885] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:25:41 2022] PATCH /identity/v3/domains/9a1eacfa1d5841c0ac891e480d9d65ec => generated 112 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:25:41.595741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:41.615727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb1239-4174-471e-86ff-525dec462b0e tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:41.621679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ada621-0237-45dd-8424-c6f0c862cf9d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1db80183bc2145fcacc599e1fb410a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'beef0e5c7d854fdb98b8482520fda6ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:41.623178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ada621-0237-45dd-8424-c6f0c862cf9d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:41.623690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ada621-0237-45dd-8424-c6f0c862cf9d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:41.624480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ada621-0237-45dd-8424-c6f0c862cf9d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] PATH_INFO: `/v3/domains/0a8090e2433e44d3ad0b59fb57b97ef0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:41.647469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ada621-0237-45dd-8424-c6f0c862cf9d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-83ada621-0237-45dd-8424-c6f0c862cf9d tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Could not find domain: 0a8090e2433e44d3ad0b59fb57b97ef0.: keystone.exception.DomainNotFound: Could not find domain: 0a8090e2433e44d3ad0b59fb57b97ef0. Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0a8090e2433e44d3ad0b59fb57b97ef0. Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:41.663683 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:25:41.665020 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0a8090e2433e44d3ad0b59fb57b97ef0. Jun 18 22:25:41.666216 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:41.709536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2931/5886] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:25:41 2022] PATCH /identity/v3/domains/0a8090e2433e44d3ad0b59fb57b97ef0 => generated 112 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:25:41.711561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:41.715083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:41.739390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:41.869999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9691245-f6d2-4ad4-97c2-7d31d964c014 tempest-ProjectsTestJSON-317270898 tempest-ProjectsTestJSON-317270898-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:41.886714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:41.887688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:41.889901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:41.890216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] PATH_INFO: `/v3/users/6a612e82e1584336a0133f68adc53a15` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:41.892947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a612e82e1584336a0133f68adc53a15)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:41.895064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:42.102272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a612e82e1584336a0133f68adc53a15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:42.103471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a612e82e1584336a0133f68adc53a15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:42.142230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a612e82e1584336a0133f68adc53a15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:42.143276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a612e82e1584336a0133f68adc53a15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:42.189724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a612e82e1584336a0133f68adc53a15'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:42.228094 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2956/5887] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:41 2022] DELETE /identity/v3/users/6a612e82e1584336a0133f68adc53a15 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:42.233074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b252-36af-42be-a080-8a90152b4ff4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:42.233709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b252-36af-42be-a080-8a90152b4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:42.234344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b252-36af-42be-a080-8a90152b4ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:42.276243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3e88b252-36af-42be-a080-8a90152b4ff4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:42.297873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e88b252-36af-42be-a080-8a90152b4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:42.519623 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2932/5888] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:42.552288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:42.553727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:42.704209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ba5a2-09f6-4c11-b38b-165cc7fe04fe admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:42.712732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:42.714564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:42.715016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:42.718341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:42.742996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:42.745270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:42.774733 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2957/5889] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:43.845816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88b252-36af-42be-a080-8a90152b4ff4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:43.861306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88b252-36af-42be-a080-8a90152b4ff4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:43.870028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:43.871658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:43.872965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:43.875630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:43.881222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:43.918303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:43.923957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:43.951829 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2933/5890] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:44.395010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:44.397313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:44.417516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33a75-4f09-43a5-b9bb-be0a8cc1b8d8 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:44.428094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:44.429480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:44.431145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:44.440363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] PATH_INFO: `/v3/projects/2db36c88c1574b5592437a542df1b17c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:44.443027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db36c88c1574b5592437a542df1b17c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:44.445537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:44.500458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:44.568070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db36c88c1574b5592437a542df1b17c', 'request_id': 'req-fcf1b471-9819-412d-93c8-b94e0cd3159b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.579747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db36c88c1574b5592437a542df1b17c', 'request_id': 'req-fcf1b471-9819-412d-93c8-b94e0cd3159b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.596000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db36c88c1574b5592437a542df1b17c', 'request_id': 'req-fcf1b471-9819-412d-93c8-b94e0cd3159b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.626785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] The token cache is being invalidate because project 2db36c88c1574b5592437a542df1b17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:44.627354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.628253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fcf1b471-9819-412d-93c8-b94e0cd3159b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.634284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2958/5891] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:44 2022] DELETE /identity/v3/projects/2db36c88c1574b5592437a542df1b17c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:44.635709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:44.649687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e36d64-e1f7-40bd-bbe7-07dd5f960253 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:44.807999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:44.809077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:44.810114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:44.810404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] PATH_INFO: `/v3/users/1db80183bc2145fcacc599e1fb410a10` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:44.815398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db80183bc2145fcacc599e1fb410a10)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:44.819612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:44.918721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:44.933695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db80183bc2145fcacc599e1fb410a10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.935394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db80183bc2145fcacc599e1fb410a10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.969568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db80183bc2145fcacc599e1fb410a10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.973335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db80183bc2145fcacc599e1fb410a10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:44.995901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db80183bc2145fcacc599e1fb410a10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:45.026809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2934/5892] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:44 2022] DELETE /identity/v3/users/1db80183bc2145fcacc599e1fb410a10 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:46.125994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:46.127382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:46.127884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:46.172571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:46.177812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:46.271741 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2959/5893] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:25:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:46.280568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:46.285247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:46.356811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:46.359253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:46.444967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5986851-a282-47ff-a150-27dc9b231633 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:46.451372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9973be-1952-42ea-bc54-6c78ba1096b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:46.452268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9973be-1952-42ea-bc54-6c78ba1096b8 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:46.453089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9973be-1952-42ea-bc54-6c78ba1096b8 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:46.453707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9973be-1952-42ea-bc54-6c78ba1096b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:46.466299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9973be-1952-42ea-bc54-6c78ba1096b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:46.468886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9973be-1952-42ea-bc54-6c78ba1096b8 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:46.505841 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2935/5894] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:25:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:25:46.543112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9355ee7-85cc-4384-9a24-17e49813a2d3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:46.551068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:46.552043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:46.552408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:46.552682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] PATH_INFO: `/v3/projects/beef0e5c7d854fdb98b8482520fda6ba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:46.572343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beef0e5c7d854fdb98b8482520fda6ba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:46.583021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:46.779196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beef0e5c7d854fdb98b8482520fda6ba', 'request_id': 'req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:46.783529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:46.808022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beef0e5c7d854fdb98b8482520fda6ba', 'request_id': 'req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:46.827324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beef0e5c7d854fdb98b8482520fda6ba', 'request_id': 'req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:46.849812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] The token cache is being invalidate because project beef0e5c7d854fdb98b8482520fda6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:46.850265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:46.851114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d8e8c0c0-6e61-4a6d-ba27-4676f8aa0aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:46.854912 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2960/5895] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:46 2022] DELETE /identity/v3/projects/beef0e5c7d854fdb98b8482520fda6ba => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:46.860828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cc64-b2dc-4f68-a1a5-0b98f99baeb8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:46.861678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cc64-b2dc-4f68-a1a5-0b98f99baeb8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:46.862242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cc64-b2dc-4f68-a1a5-0b98f99baeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:46.928267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3c09cc64-b2dc-4f68-a1a5-0b98f99baeb8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:46.934161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3c09cc64-b2dc-4f68-a1a5-0b98f99baeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:47.226610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14632-359b-4a4e-9217-e7eca3cf9338 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:47.227163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14632-359b-4a4e-9217-e7eca3cf9338 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:47.227468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14632-359b-4a4e-9217-e7eca3cf9338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:47.227598 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2936/5896] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:47.292972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8ff14632-359b-4a4e-9217-e7eca3cf9338 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:47.296972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8ff14632-359b-4a4e-9217-e7eca3cf9338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:47.350015 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2961/5897] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:47.356100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cc64-b2dc-4f68-a1a5-0b98f99baeb8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:47.381453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cc64-b2dc-4f68-a1a5-0b98f99baeb8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:47.412735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:47.422742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:47.424698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:47.425757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:47.428635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:47.434241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:47.450010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:47.542486 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2937/5898] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:25:47.543354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14632-359b-4a4e-9217-e7eca3cf9338 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:47.575336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14632-359b-4a4e-9217-e7eca3cf9338 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:47.606832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:47.615879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:47.618146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:47.619997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:47.621804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:47.632649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:47.747504 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2962/5899] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:47 2022] POST /identity/v3/projects => generated 395 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:47.751489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:47.772723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51556da0-0a17-4089-a1be-0ce6e875cbe8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:47.876915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:48.053129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:48.054456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:48.054787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:48.055072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:48.055773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:48.057781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:48.162114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2938/5900] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:47 2022] POST /identity/v3/users => generated 298 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:48.165952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:48.199212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd4bb-9e3a-4816-8c10-c5fee8c6f32b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:48.227266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:48.229081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:48.229560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:48.229951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:48.230965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:48.244470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:48.284104 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2963/5901] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:48.288494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:48.311504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9933c-2cd1-46f1-8c69-a8eb82929bd6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:48.338131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6dbdc-1c1c-4d84-8043-548c87fb4e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:48.339496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6dbdc-1c1c-4d84-8043-548c87fb4e9a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:48.340011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6dbdc-1c1c-4d84-8043-548c87fb4e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:48.340583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6dbdc-1c1c-4d84-8043-548c87fb4e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:48.343892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6dbdc-1c1c-4d84-8043-548c87fb4e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:48.347532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6dbdc-1c1c-4d84-8043-548c87fb4e9a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:48.402270 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2939/5902] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:25:48.403649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:48.422386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ada7-080a-4505-b43b-aac616b1da04 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:48.441055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:48.443135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:48.460958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:48.461324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] PATH_INFO: `/v3/projects/e639323480db419a9555adef48782007/users/1aeb1f8e39b94af9afbd071547be6c35/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:48.545232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e639323480db419a9555adef48782007, user_id=1aeb1f8e39b94af9afbd071547be6c35, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:48.558425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:48.611525 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2964/5903] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:48 2022] PUT /identity/v3/projects/e639323480db419a9555adef48782007/users/1aeb1f8e39b94af9afbd071547be6c35/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:48.628585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476d4e9-f9a2-4b72-9f97-c45a3ca3335b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:48.630033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476d4e9-f9a2-4b72-9f97-c45a3ca3335b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:48.630491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476d4e9-f9a2-4b72-9f97-c45a3ca3335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:48.743938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d476d4e9-f9a2-4b72-9f97-c45a3ca3335b None None] MFA Rules not processed for user `1aeb1f8e39b94af9afbd071547be6c35`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:48.745612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d476d4e9-f9a2-4b72-9f97-c45a3ca3335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:49.067454 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2940/5904] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:49.071928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:49.292398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7bf43-14c2-48d9-ab80-4a20f739ed78 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:49.301628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:49.302784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:49.303299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:49.303833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:49.304813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:49.308428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:49.415804 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2965/5905] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:49 2022] POST /identity/v3/projects => generated 397 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:49.419957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476d4e9-f9a2-4b72-9f97-c45a3ca3335b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:49.443967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476d4e9-f9a2-4b72-9f97-c45a3ca3335b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:49.766487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:49.767196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:49.769779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:49.770108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:49.771086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:49.777407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:49.847029 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2941/5906] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:25:49 2022] POST /identity/v3/users => generated 305 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:49.852859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:49.888426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5f7f-3088-4b4c-b8df-a0bfc752cecd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:49.921931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:49.922715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:49.922993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:49.929119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:49.931805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:49.935616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:49.963177 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2966/5907] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:49.967251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:49.998152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48bd01-fdb0-4fe9-998a-09b1b6f9e7d0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:50.005926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:50.007703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:50.008356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:50.008956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] PATH_INFO: `/v3/projects/a9a268bbb25040bdbd5e054f2089d783/users/e6329636159a4a85a6d1a3c274264542/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:50.073853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a268bbb25040bdbd5e054f2089d783, user_id=e6329636159a4a85a6d1a3c274264542, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:50.078262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:50.094745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:50.103055 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2942/5908] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:49 2022] PUT /identity/v3/projects/a9a268bbb25040bdbd5e054f2089d783/users/e6329636159a4a85a6d1a3c274264542/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:50.107597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:50.143494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f12f7-ed4d-446f-bc1e-6c1bfa9f229f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:50.286331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:50.308024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b6924-c129-4f28-8ad0-dd8d73e49d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:50.309825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6924-c129-4f28-8ad0-dd8d73e49d7f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:50.311134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6924-c129-4f28-8ad0-dd8d73e49d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:50.311895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6924-c129-4f28-8ad0-dd8d73e49d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:50.315537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b6924-c129-4f28-8ad0-dd8d73e49d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:50.322125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b6924-c129-4f28-8ad0-dd8d73e49d7f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:50.351102 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2967/5909] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:25:50.356170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:50.377640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831cb61-25fa-43f9-81ce-f6dbc321d88f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:50.393542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:50.394427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:50.394705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:50.394980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] PATH_INFO: `/v3/projects/a9a268bbb25040bdbd5e054f2089d783/users/e6329636159a4a85a6d1a3c274264542/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:50.404105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a268bbb25040bdbd5e054f2089d783, user_id=e6329636159a4a85a6d1a3c274264542, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:50.405809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:50.435839 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2943/5910] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:25:50 2022] PUT /identity/v3/projects/a9a268bbb25040bdbd5e054f2089d783/users/e6329636159a4a85a6d1a3c274264542/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:50.446925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ebe1-abe7-49b2-b3bf-a0f89b7e993a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:50.447257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ebe1-abe7-49b2-b3bf-a0f89b7e993a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:50.447694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ebe1-abe7-49b2-b3bf-a0f89b7e993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:50.527318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-81f2ebe1-abe7-49b2-b3bf-a0f89b7e993a None None] MFA Rules not processed for user `e6329636159a4a85a6d1a3c274264542`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:50.528907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-81f2ebe1-abe7-49b2-b3bf-a0f89b7e993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:50.801195 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2968/5911] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:50.806821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:51.093363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d1e2e-9fd6-477b-8c97-755d00b4f22d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:51.119054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aeb1f8e39b94af9afbd071547be6c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e639323480db419a9555adef48782007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:51.119986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:51.120537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:51.121075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:51.122649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jun 18 22:25:51.155722 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.158310 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2944/5912] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:25:50 2022] POST /identity/v3/projects => generated 136 bytes in 351 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:25:51.163433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ebe1-abe7-49b2-b3bf-a0f89b7e993a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:51.178287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ebe1-abe7-49b2-b3bf-a0f89b7e993a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:51.202240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6329636159a4a85a6d1a3c274264542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a268bbb25040bdbd5e054f2089d783', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:51.203966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:51.204502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:51.205108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:51.206100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:51.208331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Invalid input for field 'name': '' is too short Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: On instance['name']: Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: On instance['name']: Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: '' Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise error Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application '' Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.219987 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:25:51.222175 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application '' Jun 18 22:25:51.223603 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.247727 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2969/5913] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:25:51 2022] POST /identity/v3/projects => generated 283 bytes in 80 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jun 18 22:25:51.249350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:51.279817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2de35e-c7a0-43f0-8d72-2a158bbe5311 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:51.290971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6329636159a4a85a6d1a3c274264542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a268bbb25040bdbd5e054f2089d783', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:51.292428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:51.293509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:51.294371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:51.296328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:51.302671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: On instance['name']: Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: On instance['name']: Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise error Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:25:51.310709 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:51.312700 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application On instance['name']: Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:25:51.314363 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.324305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2945/5914] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:25:51 2022] POST /identity/v3/projects => generated 412 bytes in 71 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 18 22:25:51.329196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:51.343793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028708e9-5ffd-4a14-af3d-133c0148dddc tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:51.353657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6329636159a4a85a6d1a3c274264542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a268bbb25040bdbd5e054f2089d783', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:51.356261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:51.358774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:51.359605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] PATH_INFO: `/v3/projects/883a636fe35845a1b015a7410e794b1c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:51.391811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorizing `identity:delete_project(project_id=883a636fe35845a1b015a7410e794b1c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:51.396721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Could not find project: 883a636fe35845a1b015a7410e794b1c.: keystone.exception.ProjectNotFound: Could not find project: 883a636fe35845a1b015a7410e794b1c. Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 18 22:25:51.431091 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 883a636fe35845a1b015a7410e794b1c. Jun 18 22:25:51.432348 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:25:51.443825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:51.456345 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2970/5915] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:51 2022] DELETE /identity/v3/projects/883a636fe35845a1b015a7410e794b1c => generated 113 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:25:51.462676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18bcb-926a-4570-b4e0-952ad2c6bac6 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:51.478122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aeb1f8e39b94af9afbd071547be6c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e639323480db419a9555adef48782007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:51.479088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:51.481352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:51.481352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:51.481352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jun 18 22:25:51.519331 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._list_projects() Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jun 18 22:25:51.520515 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:51.532059 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2946/5916] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:25:51 2022] GET /identity/v3/projects => generated 135 bytes in 87 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:25:51.537259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:51.583011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa58396-f6cd-4971-9f3b-5251df263027 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:51.632704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6329636159a4a85a6d1a3c274264542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a268bbb25040bdbd5e054f2089d783', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:51.634070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:51.638877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:51.641389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:51.642407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:51.652842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:51.789664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:51.799936 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2971/5917] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:25:51 2022] POST /identity/v3/projects => generated 359 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:25:51.829649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f9f8-6674-41d7-87c5-d683e8797984 tempest-ProjectsNegativeStaticTestJSON-730265948 tempest-ProjectsNegativeStaticTestJSON-730265948-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:52.006980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6329636159a4a85a6d1a3c274264542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a268bbb25040bdbd5e054f2089d783', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:52.008215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:52.009823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:52.010131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:52.010882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:52.012664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:52.051960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.sql.core [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1361548712' for key 'project.ixu_project_name_domain_id'") Jun 18 22:25:52.051960 ncdv-master-1 devstack@keystone.service[91204]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 22:25:52.051960 ncdv-master-1 devstack@keystone.service[91204]: [parameters: {'id': '5d57b15553504aa8a53051376f1fc2b3', 'name': 'tempest-project-dup-1361548712', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 18 22:25:52.051960 ncdv-master-1 devstack@keystone.service[91204]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91204) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1361548712, project id 5d57b15553504aa8a53051376f1fc2b3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1361548712, project id 5d57b15553504aa8a53051376f1fc2b3. Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:25:52.081151 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1361548712' for key 'project.ixu_project_name_domain_id'") Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 22:25:52.082398 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application yield resource Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application next(self.gen) Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.rollback() Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.force_reraise() Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise self.value Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 18 22:25:52.083681 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application session.commit() Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._prepare_impl() Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.session.flush() Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._flush(objects) Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application compat.raise_( Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application flush_context.execute() Jun 18 22:25:52.085794 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rec.execute(self) Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 18 22:25:52.087297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._query(query) Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application conn.query(q) Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result.read() Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:25:52.088690 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1361548712' for key 'project.ixu_project_name_domain_id'") Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [parameters: {'id': '5d57b15553504aa8a53051376f1fc2b3', 'name': 'tempest-project-dup-1361548712', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:52.090198 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1361548712 at domain ID default. Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:25:52.091391 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1361548712, project id 5d57b15553504aa8a53051376f1fc2b3. Jun 18 22:25:52.095384 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:25:52.098856 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2947/5918] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:25:51 2022] POST /identity/v3/projects => generated 285 bytes in 311 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:25:52.103695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:52.123156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8c36d-d036-4c1d-9fc8-118fd88839b0 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:52.133451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6329636159a4a85a6d1a3c274264542', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a9a268bbb25040bdbd5e054f2089d783', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:52.136608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:52.138101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:52.138594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] PATH_INFO: `/v3/projects/3a1e57f4a81647d38d7065632580cc3a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:52.141870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a1e57f4a81647d38d7065632580cc3a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:52.147359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:52.321969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1e57f4a81647d38d7065632580cc3a', 'request_id': 'req-9ac13c43-3143-4c8e-8808-39efaf10d24f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:52.343067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1e57f4a81647d38d7065632580cc3a', 'request_id': 'req-9ac13c43-3143-4c8e-8808-39efaf10d24f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:52.366719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1e57f4a81647d38d7065632580cc3a', 'request_id': 'req-9ac13c43-3143-4c8e-8808-39efaf10d24f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:52.403431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] The token cache is being invalidate because project 3a1e57f4a81647d38d7065632580cc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:52.415392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:52.418399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9ac13c43-3143-4c8e-8808-39efaf10d24f tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:52.422894 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2972/5919] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:52 2022] DELETE /identity/v3/projects/3a1e57f4a81647d38d7065632580cc3a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:52.428443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:52.430987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:52.633831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68637d7f-01fb-4382-9486-f2b64e582598 tempest-ProjectsNegativeStaticTestJSON-1329709810 tempest-ProjectsNegativeStaticTestJSON-1329709810-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:52.668381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:52.833133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:52.834694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:52.835210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:52.836221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] PATH_INFO: `/v3/users/1aeb1f8e39b94af9afbd071547be6c35` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:52.838049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aeb1f8e39b94af9afbd071547be6c35)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:52.845820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:53.032409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aeb1f8e39b94af9afbd071547be6c35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:53.035297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aeb1f8e39b94af9afbd071547be6c35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:53.081470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aeb1f8e39b94af9afbd071547be6c35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:53.083280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aeb1f8e39b94af9afbd071547be6c35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:53.095627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aeb1f8e39b94af9afbd071547be6c35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:53.139177 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2948/5920] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:52 2022] DELETE /identity/v3/users/1aeb1f8e39b94af9afbd071547be6c35 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:53.144877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:53.145606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:53.146090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:53.227332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:53.235634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:53.295777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:53.442460 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2973/5921] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:25:53.449109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:53.450899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:53.674566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf413cc-165c-4e0f-b014-e3248fe14e9b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:53.692824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:53.695644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:53.696461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:53.699671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:53.747930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:53.755481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:53.799993 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2949/5922] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:25:56.137360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:56.139978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:56.187441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c716dd9-b1e4-443f-a713-01fad5aeb695 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:56.195839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:56.199123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:56.199641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:56.218852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] PATH_INFO: `/v3/projects/e639323480db419a9555adef48782007` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:56.239345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e639323480db419a9555adef48782007)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:56.257968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:56.391639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e639323480db419a9555adef48782007', 'request_id': 'req-aeae451d-527c-4679-8bf0-5cf7c56e169d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:56.404602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e639323480db419a9555adef48782007', 'request_id': 'req-aeae451d-527c-4679-8bf0-5cf7c56e169d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:56.424515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e639323480db419a9555adef48782007', 'request_id': 'req-aeae451d-527c-4679-8bf0-5cf7c56e169d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:56.482209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] The token cache is being invalidate because project e639323480db419a9555adef48782007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:56.483549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:56.484522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:56.488541 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2974/5923] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:56 2022] DELETE /identity/v3/projects/e639323480db419a9555adef48782007 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:56.492708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:56.509955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95613be6-28d2-486a-89a0-5925df0c59e2 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:56.639964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:56.712589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:56.725491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:56.726596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:56.727090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] PATH_INFO: `/v3/users/e6329636159a4a85a6d1a3c274264542` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:56.729448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6329636159a4a85a6d1a3c274264542)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:56.731903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:56.972340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6329636159a4a85a6d1a3c274264542'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:56.975179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6329636159a4a85a6d1a3c274264542'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:57.047230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6329636159a4a85a6d1a3c274264542'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:57.050088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6329636159a4a85a6d1a3c274264542'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:57.097934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6329636159a4a85a6d1a3c274264542'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:57.162359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2950/5924] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:56 2022] DELETE /identity/v3/users/e6329636159a4a85a6d1a3c274264542 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:58.685381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:58.687602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:58.733574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae451d-527c-4679-8bf0-5cf7c56e169d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:59.023641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:59.024610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:59.024892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:59.025198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] PATH_INFO: `/v3/users/8d81ad22e9434bff9b01fb434231428f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:59.039483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d81ad22e9434bff9b01fb434231428f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:59.048869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:59.050647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:59.054214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:59.104848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda27a-7480-4fa8-a293-a6c3296d8845 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:59.137278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:59.138196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:59.141776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:59.142062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] PATH_INFO: `/v3/projects/a9a268bbb25040bdbd5e054f2089d783` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:59.159886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a268bbb25040bdbd5e054f2089d783)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:59.171076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:25:59.324765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:59.344052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d81ad22e9434bff9b01fb434231428f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.347589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d81ad22e9434bff9b01fb434231428f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.360614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a268bbb25040bdbd5e054f2089d783', 'request_id': 'req-546f75ca-683a-40ca-9240-fb3039e0d316'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.390217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a268bbb25040bdbd5e054f2089d783', 'request_id': 'req-546f75ca-683a-40ca-9240-fb3039e0d316'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.409169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d81ad22e9434bff9b01fb434231428f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.413937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d81ad22e9434bff9b01fb434231428f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.423911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a268bbb25040bdbd5e054f2089d783', 'request_id': 'req-546f75ca-683a-40ca-9240-fb3039e0d316'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.440694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fddece08-46b1-4c34-a59a-03e8b4631b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d81ad22e9434bff9b01fb434231428f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.472966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] The token cache is being invalidate because project a9a268bbb25040bdbd5e054f2089d783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:25:59.473342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.477272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-546f75ca-683a-40ca-9240-fb3039e0d316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:25:59.484489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2951/5925] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:25:59 2022] DELETE /identity/v3/projects/a9a268bbb25040bdbd5e054f2089d783 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:25:59.488730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2975/5926] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:25:58 2022] DELETE /identity/v3/users/8d81ad22e9434bff9b01fb434231428f => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:25:59.493624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5679-a9a3-4469-854c-cf8e48d4fec6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:59.493955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5679-a9a3-4469-854c-cf8e48d4fec6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:59.494237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb5679-a9a3-4469-854c-cf8e48d4fec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:59.559285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-11eb5679-a9a3-4469-854c-cf8e48d4fec6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:59.560167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-11eb5679-a9a3-4469-854c-cf8e48d4fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:59.653188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec10a08-79a1-4ac3-9603-46fc3a4e6e98 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:59.653420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec10a08-79a1-4ac3-9603-46fc3a4e6e98 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:59.653541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec10a08-79a1-4ac3-9603-46fc3a4e6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:59.738569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:59.815036 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2952/5927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:59.824337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1306-6773-4c7d-a32e-3a61f16bd8c7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:59.824845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1306-6773-4c7d-a32e-3a61f16bd8c7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:59.826574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1306-6773-4c7d-a32e-3a61f16bd8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:59.840818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7ec10a08-79a1-4ac3-9603-46fc3a4e6e98 None None] MFA Rules not processed for user `3f6133e6ab7745118bc629dd126189e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:59.843285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ec10a08-79a1-4ac3-9603-46fc3a4e6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:59.885809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d15d1306-6773-4c7d-a32e-3a61f16bd8c7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:25:59.890506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d15d1306-6773-4c7d-a32e-3a61f16bd8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:25:59.916490 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2953/5928] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:25:59.922257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1306-6773-4c7d-a32e-3a61f16bd8c7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:25:59.944742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1306-6773-4c7d-a32e-3a61f16bd8c7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:25:59.959356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:25:59.961177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:25:59.961345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:25:59.961852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:25:59.964558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:25:59.964888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:25:59.968657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:00.019271 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2954/5929] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:00.019271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:00.029779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:00.062678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba2a5e-db45-42fe-ae40-6b9066880b02 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:00.078671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:00.079737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:00.080162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:00.080548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] PATH_INFO: `/v3/users/4fa263df7091456e87794b49f49bc965` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:00.083722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa263df7091456e87794b49f49bc965)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:00.085940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:00.167392 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2976/5930] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:25:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:00.169596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec10a08-79a1-4ac3-9603-46fc3a4e6e98 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:00.232853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec10a08-79a1-4ac3-9603-46fc3a4e6e98 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:00.255673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897baeed-c1b7-4ba3-b7ba-a7862a3c6372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:00.257127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897baeed-c1b7-4ba3-b7ba-a7862a3c6372 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:00.258768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897baeed-c1b7-4ba3-b7ba-a7862a3c6372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:00.259068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897baeed-c1b7-4ba3-b7ba-a7862a3c6372 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:00.261274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897baeed-c1b7-4ba3-b7ba-a7862a3c6372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:00.264922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa263df7091456e87794b49f49bc965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:00.266494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa263df7091456e87794b49f49bc965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:00.268205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897baeed-c1b7-4ba3-b7ba-a7862a3c6372 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:00.304606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa263df7091456e87794b49f49bc965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:00.309519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa263df7091456e87794b49f49bc965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:00.327333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa263df7091456e87794b49f49bc965'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:00.357216 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2955/5931] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:00 2022] DELETE /identity/v3/users/4fa263df7091456e87794b49f49bc965 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:00.358619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:00.361905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:00.369730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2977/5932] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:00 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:00.374568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:00.374884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:00.375142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:00.469546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:00.505872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:00.636090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a859b33-b3d1-49e4-b92d-07126e428b3b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:00.655739 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2978/5933] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:00.658188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:00.683625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:00.728790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4ee71-8faf-498d-b7a1-b8deb0dfe4e2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:00.743090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:00.747827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:00.749399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:00.749800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:00.754093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:00.755151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:00.766184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:00.827048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:00.829852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:00.830226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:00.830424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:00.832767 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2979/5934] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:00 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:00.835643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:00.836985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:00.839787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:00.870862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3806d97-8a10-46a1-868b-2a0b94e2cfd8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:00.886851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:00.887919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:00.888225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:00.888506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] PATH_INFO: `/v3/projects/b6c1a383333e4e30ace00bcdba714600` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:00.892316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c1a383333e4e30ace00bcdba714600)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:00.895170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:00.900733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:00.993575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:00.996785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.024550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c1a383333e4e30ace00bcdba714600', 'request_id': 'req-b271ec7f-2a36-45ff-9f02-ea3948792d7e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:01.045273 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2956/5935] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:01.046485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.057286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:01.074326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c1a383333e4e30ace00bcdba714600', 'request_id': 'req-b271ec7f-2a36-45ff-9f02-ea3948792d7e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:01.101275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c1a383333e4e30ace00bcdba714600', 'request_id': 'req-b271ec7f-2a36-45ff-9f02-ea3948792d7e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:01.143236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] The token cache is being invalidate because project b6c1a383333e4e30ace00bcdba714600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:01.143606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:01.144335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:01.153341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2980/5936] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:00 2022] DELETE /identity/v3/projects/b6c1a383333e4e30ace00bcdba714600 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:01.162107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.166583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:01.254206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b687a-458f-4713-8f1c-a36adf5daa85 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.330345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6494510-0d9f-4910-919d-d2f742eca43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.331163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6494510-0d9f-4910-919d-d2f742eca43c service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.331784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6494510-0d9f-4910-919d-d2f742eca43c service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.332222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6494510-0d9f-4910-919d-d2f742eca43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.334665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d6494510-0d9f-4910-919d-d2f742eca43c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:01.354908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271ec7f-2a36-45ff-9f02-ea3948792d7e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.355194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6494510-0d9f-4910-919d-d2f742eca43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.356925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6494510-0d9f-4910-919d-d2f742eca43c service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.365596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.367970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.368270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.368551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.369613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.371990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.372580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2957/5937] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:01.374202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16ca93-a369-4c26-a315-7954629b1d31 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.374494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16ca93-a369-4c26-a315-7954629b1d31 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.375589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16ca93-a369-4c26-a315-7954629b1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.388945 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2981/5938] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:01.394833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.402450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8b16ca93-a369-4c26-a315-7954629b1d31 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:01.403968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b16ca93-a369-4c26-a315-7954629b1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:01.411042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb240c-251f-43e7-94e3-5955861304ab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.417423 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2958/5939] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:01.418190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.419411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.419707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.419985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.420731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.423411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.427466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5095-54ab-4055-a7d4-3f13e6ea8619 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.427765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5095-54ab-4055-a7d4-3f13e6ea8619 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.428094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe5095-54ab-4055-a7d4-3f13e6ea8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.446435 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2982/5940] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:01.447999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.454000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-03fe5095-54ab-4055-a7d4-3f13e6ea8619 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:01.455279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-03fe5095-54ab-4055-a7d4-3f13e6ea8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:01.468369 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2959/5941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:01.473975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5095-54ab-4055-a7d4-3f13e6ea8619 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.486752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfcb3b-5049-4728-a358-c3b5b9c75b3d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.487727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe5095-54ab-4055-a7d4-3f13e6ea8619 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.492994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee05bc3-4b4e-4b91-a4d0-4e7cb871f13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.494042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee05bc3-4b4e-4b91-a4d0-4e7cb871f13f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.494333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee05bc3-4b4e-4b91-a4d0-4e7cb871f13f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.494621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee05bc3-4b4e-4b91-a4d0-4e7cb871f13f admin admin] PATH_INFO: `/v3/projects/ed421b82955a44669947bb82fe390bff/users/6a0b1871b1b84329a53d083c00fa9cb7/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.495879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.499622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.499622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.499622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.500284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:01.500845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.503537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.515964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee05bc3-4b4e-4b91-a4d0-4e7cb871f13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed421b82955a44669947bb82fe390bff, user_id=6a0b1871b1b84329a53d083c00fa9cb7, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.519705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee05bc3-4b4e-4b91-a4d0-4e7cb871f13f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.521070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2960/5942] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:01.525512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.534173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:01.540459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126e968-325e-460f-aac5-9d5f8e3602de admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.548826 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2983/5943] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:01 2022] PUT /identity/v3/projects/ed421b82955a44669947bb82fe390bff/users/6a0b1871b1b84329a53d083c00fa9cb7/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:01.571552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da5e4-afe6-4c5a-a065-fe788e14ca30 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.573124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da5e4-afe6-4c5a-a065-fe788e14ca30 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.574409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da5e4-afe6-4c5a-a065-fe788e14ca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.639414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cd8da5e4-afe6-4c5a-a065-fe788e14ca30 None None] MFA Rules not processed for user `6a0b1871b1b84329a53d083c00fa9cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:01.642075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cd8da5e4-afe6-4c5a-a065-fe788e14ca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:01.705996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.708791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.709120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.709400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.710113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.712650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.746046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:01.768274 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2961/5944] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:01 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:01.772505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.802863 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2984/5945] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:01.805793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da5e4-afe6-4c5a-a065-fe788e14ca30 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:01.834345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da5e4-afe6-4c5a-a065-fe788e14ca30 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.931289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5cd3-d510-4efe-a6aa-67fac229563d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:01.937314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.939723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:01.942255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.943119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.943119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.946176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.948907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.954941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:01.958131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:01.960408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:01.962746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:01.979039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:01.992190 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2962/5946] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:01 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:02.000399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.024295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684a1a2-22c2-445d-8233-23f88a34789f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.033567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.034720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.035282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.035730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.036964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.042076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.052747 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2985/5947] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:01 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:02.057544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.084756 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2963/5948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:02.088280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.107170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645c88d-2b97-48cb-8928-ee30c6aa8241 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.230980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b142965-1c68-40c8-81b4-95120d50c7d3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.257238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.261912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.261912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.262458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.264692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.272595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.304650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.305701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.306093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.306373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.307607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.310348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.316191 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2986/5949] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:02 2022] POST /identity/v3/users => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:02.319575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.338140 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2964/5950] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:02.339797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.348102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fc422-a9fe-4623-b8a3-b108d0509fae admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.350924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:02.357754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc810b7-5f9e-4c29-be8f-1b5fc0597719 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.359426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.360688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.364638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.365180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.368495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.373794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.380508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d1553-8209-407a-b6ce-e3df56f6a8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.382200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d1553-8209-407a-b6ce-e3df56f6a8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.382762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d1553-8209-407a-b6ce-e3df56f6a8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.382882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d1553-8209-407a-b6ce-e3df56f6a8dc admin admin] PATH_INFO: `/v3/projects/7c7fe1f21f51409983c5138795103066/users/f9165a71c5cf45cebce374e33f4beb4b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.395937 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2987/5951] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:02.399956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.416463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9355d-0312-42c0-97ce-dc0a614ea311 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.419469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d1553-8209-407a-b6ce-e3df56f6a8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7fe1f21f51409983c5138795103066, user_id=f9165a71c5cf45cebce374e33f4beb4b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.425284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.426562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.426782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d1553-8209-407a-b6ce-e3df56f6a8dc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.427066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.427449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] PATH_INFO: `/v3/projects/780d0e4636bd4408b4c3fd7a9710e58c/users/10f7773874b741b0bb3a518857e13884/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.452907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780d0e4636bd4408b4c3fd7a9710e58c, user_id=10f7773874b741b0bb3a518857e13884, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.462421 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2965/5952] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:02 2022] PUT /identity/v3/projects/7c7fe1f21f51409983c5138795103066/users/f9165a71c5cf45cebce374e33f4beb4b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:02.467414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.467414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.467414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.469419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.498462 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2988/5953] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:02 2022] PUT /identity/v3/projects/780d0e4636bd4408b4c3fd7a9710e58c/users/10f7773874b741b0bb3a518857e13884/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:02.502351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.552546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:02.568706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] MFA Rules not processed for user `f9165a71c5cf45cebce374e33f4beb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:02.569993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:02.674377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1b118-af4d-4aee-8f4c-044ccd390e40 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.684707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.685759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.690997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.693004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.693978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.696095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.712264 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2989/5954] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:02.716619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.731162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533e83-8a8a-4c91-9a06-2b4c0fe3dd89 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:02.733456 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2966/5955] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:02.738250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf68d0-2153-409f-aaf6-84c9b2b25e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:02.739285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf68d0-2153-409f-aaf6-84c9b2b25e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.739643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf68d0-2153-409f-aaf6-84c9b2b25e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.739999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf68d0-2153-409f-aaf6-84c9b2b25e48 admin admin] PATH_INFO: `/v3/projects/780d0e4636bd4408b4c3fd7a9710e58c/users/10f7773874b741b0bb3a518857e13884/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.742513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf68d0-2153-409f-aaf6-84c9b2b25e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780d0e4636bd4408b4c3fd7a9710e58c, user_id=10f7773874b741b0bb3a518857e13884, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:02.745792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:02.747021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf68d0-2153-409f-aaf6-84c9b2b25e48 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:02.753549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:02.763531 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2990/5956] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:02 2022] PUT /identity/v3/projects/780d0e4636bd4408b4c3fd7a9710e58c/users/10f7773874b741b0bb3a518857e13884/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:02.776711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:02.777099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:02.777357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:02.874462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] MFA Rules not processed for user `10f7773874b741b0bb3a518857e13884`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:02.877909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:02.994979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6e2f0-ec90-471c-8596-6d5346ea10f8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:03.133983 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2991/5957] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:03.137048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:03.147165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:03.206042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:03.246658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:03.247407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:03.247902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:03.285061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:03.302110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0167d2-684c-43be-95b1-a62d52d2ef35 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:03.318090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:03.319795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:03.319795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:03.319795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] PATH_INFO: `/v3/projects/248c433048c745a08058f28b2f24d6d7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:03.327626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248c433048c745a08058f28b2f24d6d7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:03.338686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:03.442182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:03.443826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:03.448186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:03.484180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248c433048c745a08058f28b2f24d6d7', 'request_id': 'req-9234f880-67f7-474b-9adc-4229cdd24ac8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.489614 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2967/5958] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:03.490612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:03.495134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248c433048c745a08058f28b2f24d6d7', 'request_id': 'req-9234f880-67f7-474b-9adc-4229cdd24ac8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.518899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e7b78-c441-4918-893e-a83906d81512 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:03.520874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248c433048c745a08058f28b2f24d6d7', 'request_id': 'req-9234f880-67f7-474b-9adc-4229cdd24ac8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.543741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] The token cache is being invalidate because project 248c433048c745a08058f28b2f24d6d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:03.544063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.545599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.548821 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2992/5959] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:03 2022] DELETE /identity/v3/projects/248c433048c745a08058f28b2f24d6d7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:03.553630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:03.556745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:03.703921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f7773874b741b0bb3a518857e13884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d0e4636bd4408b4c3fd7a9710e58c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:03.706846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:03.708502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:03.708891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:03.709824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:03.715453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:03.742150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234f880-67f7-474b-9adc-4229cdd24ac8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:03.764945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:03.771247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:03.777091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:03.777538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] PATH_INFO: `/v3/users/7cd922809c654c0c868e7cabfff3b0f4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:03.780532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd922809c654c0c868e7cabfff3b0f4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:03.787261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:03.800202 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2968/5960] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:03 2022] POST /identity/v3/projects => generated 359 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:03.812562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:03.820801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:03.902295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd922809c654c0c868e7cabfff3b0f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.903299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd922809c654c0c868e7cabfff3b0f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.972042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd922809c654c0c868e7cabfff3b0f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:03.974948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd922809c654c0c868e7cabfff3b0f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:04.005609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd922809c654c0c868e7cabfff3b0f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:04.046902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2993/5961] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:03 2022] DELETE /identity/v3/users/7cd922809c654c0c868e7cabfff3b0f4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:04.054237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b911-279e-441a-a0a6-59067b326bce tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:04.204144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:04.256439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0b1871b1b84329a53d083c00fa9cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed421b82955a44669947bb82fe390bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:04.260112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:04.260112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:04.261243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] PATH_INFO: `/v3/projects/329b983fa1714997a11c27e400f327bf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:04.265647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] RBAC: Authorizing `identity:delete_project(project_id=329b983fa1714997a11c27e400f327bf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jun 18 22:26:04.301533 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jun 18 22:26:04.303348 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:04.310002 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2969/5962] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:03 2022] DELETE /identity/v3/projects/329b983fa1714997a11c27e400f327bf => generated 136 bytes in 499 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:04.311404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:04.313051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:04.525435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:04.571454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726e46a-3bc1-44c3-8203-8bd0e79a519f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:04.580342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10f7773874b741b0bb3a518857e13884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d0e4636bd4408b4c3fd7a9710e58c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:04.582359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:04.582929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:04.583454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] PATH_INFO: `/v3/projects/329b983fa1714997a11c27e400f327bf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:04.585266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] RBAC: Authorizing `identity:delete_project(project_id=329b983fa1714997a11c27e400f327bf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:04.588785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:04.692492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329b983fa1714997a11c27e400f327bf', 'request_id': 'req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:04.705821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329b983fa1714997a11c27e400f327bf', 'request_id': 'req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:04.725893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329b983fa1714997a11c27e400f327bf', 'request_id': 'req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:04.754070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] The token cache is being invalidate because project 329b983fa1714997a11c27e400f327bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:04.754442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:04.755458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:04.768659 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2994/5963] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:04 2022] DELETE /identity/v3/projects/329b983fa1714997a11c27e400f327bf => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:04.775003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:04.779743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:04.950658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259d568-2be9-411e-8577-f595399cecc6 tempest-ProjectsNegativeTestJSON-876005877 tempest-ProjectsNegativeTestJSON-876005877-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:05.148555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:05.150255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:05.150784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:05.151376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] PATH_INFO: `/v3/users/6a0b1871b1b84329a53d083c00fa9cb7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:05.159958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0b1871b1b84329a53d083c00fa9cb7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:05.174593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:05.287457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0b1871b1b84329a53d083c00fa9cb7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.288469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0b1871b1b84329a53d083c00fa9cb7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.318548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0b1871b1b84329a53d083c00fa9cb7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.319464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0b1871b1b84329a53d083c00fa9cb7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.338519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4017c1cb-5de7-478a-b87a-7cbc49ba98d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0b1871b1b84329a53d083c00fa9cb7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.352694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:05.354269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:05.384588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4fd75-2b30-40dd-844f-2fcdb34e64f8 tempest-ProjectsNegativeTestJSON-725179375 tempest-ProjectsNegativeTestJSON-725179375-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:05.396868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:05.398999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:05.399605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:05.400758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] PATH_INFO: `/v3/projects/bf582736c7ec45bb9b1677fe099861d7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:05.404355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf582736c7ec45bb9b1677fe099861d7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:05.409189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:05.410819 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2970/5964] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:04 2022] DELETE /identity/v3/users/6a0b1871b1b84329a53d083c00fa9cb7 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:05.416711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32560b-1cac-4a39-bf0b-3fe176ef857b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:05.417232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32560b-1cac-4a39-bf0b-3fe176ef857b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:05.417408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32560b-1cac-4a39-bf0b-3fe176ef857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:05.459428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ba32560b-1cac-4a39-bf0b-3fe176ef857b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:05.460815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ba32560b-1cac-4a39-bf0b-3fe176ef857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:05.484932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:05.555740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf582736c7ec45bb9b1677fe099861d7', 'request_id': 'req-084e4f7b-4ee1-425f-8387-850e36dc055a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.575436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf582736c7ec45bb9b1677fe099861d7', 'request_id': 'req-084e4f7b-4ee1-425f-8387-850e36dc055a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.597199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf582736c7ec45bb9b1677fe099861d7', 'request_id': 'req-084e4f7b-4ee1-425f-8387-850e36dc055a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.622988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] The token cache is being invalidate because project bf582736c7ec45bb9b1677fe099861d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:05.623180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.623405 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2971/5965] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:05.623954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-084e4f7b-4ee1-425f-8387-850e36dc055a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:05.625392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:05.625944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:05.626529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:05.641640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2995/5966] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:05 2022] DELETE /identity/v3/projects/bf582736c7ec45bb9b1677fe099861d7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:05.655888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b15a-46a4-44b8-af22-3c9b7427e45b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:05.655888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b15a-46a4-44b8-af22-3c9b7427e45b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:05.655888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170b15a-46a4-44b8-af22-3c9b7427e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:05.674283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] MFA Rules not processed for user `3f6133e6ab7745118bc629dd126189e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:05.675537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:05.721064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7170b15a-46a4-44b8-af22-3c9b7427e45b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:05.723816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7170b15a-46a4-44b8-af22-3c9b7427e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:05.806744 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2972/5967] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:05.808969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:05.811792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:05.861327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:05.910306 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2996/5968] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:05.912164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f56a-6db8-44a4-a9a8-1f9efcdfffcd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:05.912462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f56a-6db8-44a4-a9a8-1f9efcdfffcd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:05.912778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f56a-6db8-44a4-a9a8-1f9efcdfffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:05.971726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b38b2-d350-48e8-8697-055b7199d783 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:05.974436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4727f56a-6db8-44a4-a9a8-1f9efcdfffcd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:05.978031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:05.978681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4727f56a-6db8-44a4-a9a8-1f9efcdfffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:05.978819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:05.979023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:05.979504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:05.983148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:05.998274 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2997/5969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:06.000495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f56a-6db8-44a4-a9a8-1f9efcdfffcd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:06.021151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.023579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.025174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f56a-6db8-44a4-a9a8-1f9efcdfffcd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:06.038242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:06.039309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.040792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2973/5970] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:06.042770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.043579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.044572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:06.045145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.048242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.076485 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2998/5971] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:06.082085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:06.098789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306164a-716e-4108-aea5-cd1a980defbb service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:06.106425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:06.108008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.108339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.108619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.109849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.113311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.157200 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2974/5972] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:06 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:06.161365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:06.183210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9a76-0f34-4a80-8448-cd6d3cd549ff admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:06.288034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:06.288998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.289319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.289619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.291270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.293752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.326809 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 2999/5973] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:06 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:06.331698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:06.349890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc52c7-74ff-46ec-b10f-49ffc857e994 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:06.355828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:06.357668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.358196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.358706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.359865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.362838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.377834 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2975/5974] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:06.386195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:06.419463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc42dbf-a134-4026-84df-9ff78edd7df0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:06.439907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e95597-0494-4885-80f4-b56ae41b3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:06.467720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e95597-0494-4885-80f4-b56ae41b3ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.468723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e95597-0494-4885-80f4-b56ae41b3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.469192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e95597-0494-4885-80f4-b56ae41b3ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.471691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e95597-0494-4885-80f4-b56ae41b3ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.478106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e95597-0494-4885-80f4-b56ae41b3ef1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.499157 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3000/5975] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:06.503543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:06.518733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd415a-08bf-4591-a252-7c881928288f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:06.535258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:06.537951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.538297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.538585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] PATH_INFO: `/v3/projects/314c1f892dd74d31991577424e080703/users/3daa68a1c0174a76b2f7f5003df87c3d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.565088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] RBAC: Authorizing `identity:create_grant(project_id=314c1f892dd74d31991577424e080703, user_id=3daa68a1c0174a76b2f7f5003df87c3d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.570454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.608893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f88d8-0ab0-4941-821a-572504209f7a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.609318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f88d8-0ab0-4941-821a-572504209f7a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.609608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f88d8-0ab0-4941-821a-572504209f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.613235 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2976/5976] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:06 2022] PUT /identity/v3/projects/314c1f892dd74d31991577424e080703/users/3daa68a1c0174a76b2f7f5003df87c3d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:06.652912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0e7f88d8-0ab0-4941-821a-572504209f7a None None] MFA Rules not processed for user `3daa68a1c0174a76b2f7f5003df87c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:06.654527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0e7f88d8-0ab0-4941-821a-572504209f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:06.782839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:06.786575 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3001/5977] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:06.797018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:06.912105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6000-7525-49bd-a78f-394e6b43328e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:06.917517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:06.920072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:06.920313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:06.920584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:06.921315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:06.923831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:06.969808 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2977/5978] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:06 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:06.973718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f88d8-0ab0-4941-821a-572504209f7a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:07.005254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f88d8-0ab0-4941-821a-572504209f7a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:07.070838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:07.105294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:07.106020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:07.106439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:07.106720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:07.109897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:07.109897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:07.112056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:07.115317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:07.142578 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3002/5979] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:06 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:07.143817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:07.147810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0035b-aab7-48c7-ad18-4d9f6446e2d1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:07.161564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:07.163280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:07.164622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:07.165391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] PATH_INFO: `/v3/projects/ed421b82955a44669947bb82fe390bff` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:07.167842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed421b82955a44669947bb82fe390bff)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:07.170272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:07.175324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acfc1a-34db-455f-9cbe-507fd3637098 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:07.186402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:07.188223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:07.188512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:07.188819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:07.190581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:07.193340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:07.213462 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3003/5980] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:07.215882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:07.232026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e39cd1-b42c-4d7d-a4c4-d826b69f1ba2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:07.249171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed421b82955a44669947bb82fe390bff', 'request_id': 'req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.260409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed421b82955a44669947bb82fe390bff', 'request_id': 'req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.275255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed421b82955a44669947bb82fe390bff', 'request_id': 'req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.296038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] The token cache is being invalidate because project ed421b82955a44669947bb82fe390bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:07.296588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.297553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.299946 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2978/5981] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:07 2022] DELETE /identity/v3/projects/ed421b82955a44669947bb82fe390bff => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:07.303952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:07.308498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:07.475337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:07.476436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:07.476721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:07.477002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] PATH_INFO: `/v3/projects/5001d515fc804491bb6033a2395e84ee/users/537f58464515407db021065314fa8aeb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:07.500429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5001d515fc804491bb6033a2395e84ee, user_id=537f58464515407db021065314fa8aeb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:07.504686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:07.506981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab943d64-e52b-49a8-ab53-bfa0e2e269e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:07.524721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:07.525820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:07.526276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:07.526633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] PATH_INFO: `/v3/users/10f7773874b741b0bb3a518857e13884` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:07.538274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f7773874b741b0bb3a518857e13884)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:07.539239 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3004/5982] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:07 2022] PUT /identity/v3/projects/5001d515fc804491bb6033a2395e84ee/users/537f58464515407db021065314fa8aeb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:07.539479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:07.542457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:07.544430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:07.593832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:07.664774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f7773874b741b0bb3a518857e13884'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.666544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f7773874b741b0bb3a518857e13884'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.695726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f7773874b741b0bb3a518857e13884'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.696857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f7773874b741b0bb3a518857e13884'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.710847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f7773874b741b0bb3a518857e13884'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:07.760650 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2979/5983] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:07 2022] DELETE /identity/v3/users/10f7773874b741b0bb3a518857e13884 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:07.761772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:07.780789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:07.791349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2412-6c50-46ff-a175-04003a39da8d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:07.953943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:08.014277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:08.014994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:08.015278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:08.015987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:08.020554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:08.027053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:08.079341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3005/5984] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:08.088565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:08.093294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:08.133577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe6d55-df54-4b8c-8966-f631cf73d11f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:08.140147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143a62d-b13d-4694-a90b-11b8a54141d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:08.141813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a62d-b13d-4694-a90b-11b8a54141d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:08.144185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a62d-b13d-4694-a90b-11b8a54141d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:08.145176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a62d-b13d-4694-a90b-11b8a54141d1 admin admin] PATH_INFO: `/v3/projects/5001d515fc804491bb6033a2395e84ee/users/537f58464515407db021065314fa8aeb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:08.152957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143a62d-b13d-4694-a90b-11b8a54141d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5001d515fc804491bb6033a2395e84ee, user_id=537f58464515407db021065314fa8aeb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:08.165149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143a62d-b13d-4694-a90b-11b8a54141d1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:08.200283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2248f-7925-42ed-812a-42f946059386 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:08.213536 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3006/5985] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:08 2022] PUT /identity/v3/projects/5001d515fc804491bb6033a2395e84ee/users/537f58464515407db021065314fa8aeb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:08.216083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:08.216369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:08.216647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:08.281855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] MFA Rules not processed for user `537f58464515407db021065314fa8aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:08.284685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:08.288219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d25085-130b-4039-94f7-23906319927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:08.293577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25085-130b-4039-94f7-23906319927f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:08.293901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25085-130b-4039-94f7-23906319927f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:08.294126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d25085-130b-4039-94f7-23906319927f admin admin] PATH_INFO: `/v3/users/f9165a71c5cf45cebce374e33f4beb4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:08.299166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d25085-130b-4039-94f7-23906319927f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9165a71c5cf45cebce374e33f4beb4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:08.303027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d25085-130b-4039-94f7-23906319927f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:08.394100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:08.414364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d25085-130b-4039-94f7-23906319927f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9165a71c5cf45cebce374e33f4beb4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:08.419148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d25085-130b-4039-94f7-23906319927f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9165a71c5cf45cebce374e33f4beb4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:08.470873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d25085-130b-4039-94f7-23906319927f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9165a71c5cf45cebce374e33f4beb4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:08.471614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d25085-130b-4039-94f7-23906319927f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9165a71c5cf45cebce374e33f4beb4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:08.505395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04d25085-130b-4039-94f7-23906319927f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9165a71c5cf45cebce374e33f4beb4b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:08.537357 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2980/5986] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:07 2022] DELETE /identity/v3/users/f9165a71c5cf45cebce374e33f4beb4b => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:08.542458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:08.542786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:08.543123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:08.544301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3007/5987] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:08.559441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:08.561301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:08.569293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:08.570576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:08.678319 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2981/5988] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:08.683371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab41ad-78d3-4a89-b49d-8b6fb60ccb9d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:08.694250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:08.695717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:08.758985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f90681-0637-4832-9356-4d66d4b0fd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:08.759958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90681-0637-4832-9356-4d66d4b0fd60 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:08.761752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90681-0637-4832-9356-4d66d4b0fd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:08.762146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f90681-0637-4832-9356-4d66d4b0fd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:08.794035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:08.846861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607c372-b291-4316-add8-0be9e0200d72 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:08.865953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:08.867442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:08.867748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:08.868021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:08.897331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:08.898632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:08.917391 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2982/5989] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:08.940446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f90681-0637-4832-9356-4d66d4b0fd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:08.948430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f90681-0637-4832-9356-4d66d4b0fd60 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:08.963405 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3008/5990] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:26:09.169983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:09.172117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:09.207645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad18e2b-b32e-4938-93b1-d39bb80226ec service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:09.222622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:09.223705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:09.224096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:09.224489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] PATH_INFO: `/v3/projects/780d0e4636bd4408b4c3fd7a9710e58c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:09.227509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780d0e4636bd4408b4c3fd7a9710e58c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:09.229570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:09.356593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780d0e4636bd4408b4c3fd7a9710e58c', 'request_id': 'req-33e53b22-b700-4caa-ad3a-ab6b638b3691'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:09.364913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780d0e4636bd4408b4c3fd7a9710e58c', 'request_id': 'req-33e53b22-b700-4caa-ad3a-ab6b638b3691'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:09.369300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:09.376663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780d0e4636bd4408b4c3fd7a9710e58c', 'request_id': 'req-33e53b22-b700-4caa-ad3a-ab6b638b3691'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:09.394781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] The token cache is being invalidate because project 780d0e4636bd4408b4c3fd7a9710e58c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:09.395916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:09.397263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-33e53b22-b700-4caa-ad3a-ab6b638b3691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:09.400251 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2983/5991] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:09 2022] DELETE /identity/v3/projects/780d0e4636bd4408b4c3fd7a9710e58c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:09.405511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6afc8-1a71-4eee-8bac-23b3f17336f4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:09.406196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6afc8-1a71-4eee-8bac-23b3f17336f4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:09.406576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6afc8-1a71-4eee-8bac-23b3f17336f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:09.450447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-13c6afc8-1a71-4eee-8bac-23b3f17336f4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:09.454691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-13c6afc8-1a71-4eee-8bac-23b3f17336f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:09.624361 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3009/5992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:09.638382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec297b2-4162-4af8-9410-e724cb168bfc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:09.639005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec297b2-4162-4af8-9410-e724cb168bfc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:09.639451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec297b2-4162-4af8-9410-e724cb168bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:09.663973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3ec297b2-4162-4af8-9410-e724cb168bfc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:09.666130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ec297b2-4162-4af8-9410-e724cb168bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:09.676977 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2984/5993] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:09.681541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6afc8-1a71-4eee-8bac-23b3f17336f4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:09.709739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6afc8-1a71-4eee-8bac-23b3f17336f4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:09.716554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:09.717427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:09.717710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:09.717988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:09.718833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:09.719145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:09.720989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:09.738339 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3010/5994] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:09.743767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec297b2-4162-4af8-9410-e724cb168bfc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:09.759648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec297b2-4162-4af8-9410-e724cb168bfc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:09.772843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:09.773791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:09.773906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:09.774241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:09.775541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:09.779610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:09.850034 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2985/5995] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:09 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:09.855911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:09.872451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11c350-f0fb-4e72-a51d-0a20f27b241a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:10.103166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:10.104167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.104903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.105366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.106281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:10.109623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:10.156551 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3011/5996] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:09 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:10.161245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:10.174780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37b0ec-31fe-484b-a1a0-9083081456da admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:10.203866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:10.205370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.206045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.207076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.209443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:10.217489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:10.253725 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2986/5997] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:10.257913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:10.275230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9445-a1e1-4f55-943d-882106e3203d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:10.284149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1e899-3e71-44c8-bef8-d2d8480fa0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:10.286176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e899-3e71-44c8-bef8-d2d8480fa0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.286927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e899-3e71-44c8-bef8-d2d8480fa0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.287467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e899-3e71-44c8-bef8-d2d8480fa0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.288985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1e899-3e71-44c8-bef8-d2d8480fa0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:10.294354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1e899-3e71-44c8-bef8-d2d8480fa0e7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:10.309992 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3012/5998] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:10.312373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:10.323929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160843-9093-435c-9a63-97c0ff00adb2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:10.339377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:10.340638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.341227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.341510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] PATH_INFO: `/v3/projects/d21a346ca7a1471a86f3f96b0dbf2515/users/42778307f22e467487097db3a92667dd/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.378427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21a346ca7a1471a86f3f96b0dbf2515, user_id=42778307f22e467487097db3a92667dd, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:10.381326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:10.415241 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2987/5999] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:10 2022] PUT /identity/v3/projects/d21a346ca7a1471a86f3f96b0dbf2515/users/42778307f22e467487097db3a92667dd/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:10.427968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2db1-270d-4b01-8ce6-b5d712140809 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.428756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2db1-270d-4b01-8ce6-b5d712140809 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.430605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2db1-270d-4b01-8ce6-b5d712140809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.486053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6bbb2db1-270d-4b01-8ce6-b5d712140809 None None] MFA Rules not processed for user `42778307f22e467487097db3a92667dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:10.489634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6bbb2db1-270d-4b01-8ce6-b5d712140809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:10.534983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:10.717518 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3013/6000] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:10.723569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:10.752371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fee7d5-a786-4d37-9911-14624fe23409 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:10.784958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:10.785875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.786172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.786453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.787153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=42778307f22e467487097db3a92667dd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:10.793136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:10.851649 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2988/6001] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Jun 18 22:26:10 2022] POST /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2 => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:10.856129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2db1-270d-4b01-8ce6-b5d712140809 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:10.870345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2db1-270d-4b01-8ce6-b5d712140809 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:10.875800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:10.876971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.878496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.878906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/e8f3486d1ca0433aa9e5147e26f4cc55` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.882231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=42778307f22e467487097db3a92667dd, credential_id=e8f3486d1ca0433aa9e5147e26f4cc55)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:10.884114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:10.911439 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3014/6002] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Jun 18 22:26:10 2022] DELETE /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/e8f3486d1ca0433aa9e5147e26f4cc55 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:10.916493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:10.930202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cfc54-2b75-443f-9213-db59eea54fc7 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:10.947380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:10.948381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:10.948560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:10.948879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:10.949839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=42778307f22e467487097db3a92667dd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:10.951698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:10.983098 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2989/6003] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Jun 18 22:26:10 2022] POST /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2 => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:10.987511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:10.994109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.001993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:11.007333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd4f77-2e4c-42a3-a4e7-ddd751786520 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.018721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.019633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.019918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.020192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/4500bf7bbf574758b157357b95985811` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.041710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=42778307f22e467487097db3a92667dd, credential_id=4500bf7bbf574758b157357b95985811)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.044037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.077841 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3015/6004] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Jun 18 22:26:10 2022] DELETE /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/4500bf7bbf574758b157357b95985811 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:11.082914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.109551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d5ec-85c4-4d1c-9be5-744dcbbe62f5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.116787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.117743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.118029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.118310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] PATH_INFO: `/v3/projects/7c7fe1f21f51409983c5138795103066` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.118647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14b56-0432-4c56-95b0-2f0d10b1a98d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.119595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7fe1f21f51409983c5138795103066)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.121608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.134514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e5d72-7ced-413c-95d4-b2faf42afcda tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.135446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5d72-7ced-413c-95d4-b2faf42afcda tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.135732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5d72-7ced-413c-95d4-b2faf42afcda tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.136011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e5d72-7ced-413c-95d4-b2faf42afcda tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/4500bf7bbf574758b157357b95985811` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-2b7e5d72-7ced-413c-95d4-b2faf42afcda tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Could not find credential: 88da2c19482365db853d8da66f502bd120a286204f7332e80f150abd5e1973dc.: keystone.exception.CredentialNotFound: Could not find credential: 88da2c19482365db853d8da66f502bd120a286204f7332e80f150abd5e1973dc. Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jun 18 22:26:11.189022 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:26:11.190178 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 88da2c19482365db853d8da66f502bd120a286204f7332e80f150abd5e1973dc. Jun 18 22:26:11.191807 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:11.195752 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3016/6005] 10.222.0.30 () {58 vars in 1376 bytes} [Sat Jun 18 22:26:11 2022] GET /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/4500bf7bbf574758b157357b95985811 => generated 148 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:11.196606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e5d72-7ced-413c-95d4-b2faf42afcda tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.215938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e5d72-7ced-413c-95d4-b2faf42afcda tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.226294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.229249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.232354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.232681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.236795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=42778307f22e467487097db3a92667dd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.243056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.281681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7fe1f21f51409983c5138795103066', 'request_id': 'req-119588ed-5fb4-430b-9d18-4cce60388f7f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.287256 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3017/6006] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Jun 18 22:26:11 2022] POST /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2 => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:11.292712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.315410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188138-26f9-4edd-ae35-e28fa03acd69 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.326854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7fe1f21f51409983c5138795103066', 'request_id': 'req-119588ed-5fb4-430b-9d18-4cce60388f7f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.335392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:11.349175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7fe1f21f51409983c5138795103066', 'request_id': 'req-119588ed-5fb4-430b-9d18-4cce60388f7f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.388703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] The token cache is being invalidate because project 7c7fe1f21f51409983c5138795103066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:11.389002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.390542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-119588ed-5fb4-430b-9d18-4cce60388f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.398034 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2990/6007] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:10 2022] DELETE /identity/v3/projects/7c7fe1f21f51409983c5138795103066 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:11.405630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac96a-6c61-4b63-a2d8-4e45e1d3c8ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.405922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac96a-6c61-4b63-a2d8-4e45e1d3c8ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.406195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac96a-6c61-4b63-a2d8-4e45e1d3c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.432014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.432592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c92ac96a-6c61-4b63-a2d8-4e45e1d3c8ff None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:11.432873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.433188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.435177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.435886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=42778307f22e467487097db3a92667dd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.436306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c92ac96a-6c61-4b63-a2d8-4e45e1d3c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:11.440822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.475494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3018/6008] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Jun 18 22:26:11 2022] POST /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2 => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:11.476544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.480923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:11.502855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71357900-c412-4bcc-a442-d8052b2ce26a tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.512076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.512852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.513166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.513618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.514397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=42778307f22e467487097db3a92667dd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.516328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.550734 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3019/6009] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Jun 18 22:26:11 2022] GET /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2 => generated 865 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:11.555358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.574638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950ca6-5bb1-4761-90f5-0b724ab6a223 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.581735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.582803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.583265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.583684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/db07a5ffee0e4ed3b35c09cb5cc4003b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.583802 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2991/6010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:11.586504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=42778307f22e467487097db3a92667dd, credential_id=db07a5ffee0e4ed3b35c09cb5cc4003b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.588905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.592139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40fbb-f386-4a0b-8b10-11e95be8bcac None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.592436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40fbb-f386-4a0b-8b10-11e95be8bcac None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.592719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40fbb-f386-4a0b-8b10-11e95be8bcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.616618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-55f40fbb-f386-4a0b-8b10-11e95be8bcac None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:11.618041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-55f40fbb-f386-4a0b-8b10-11e95be8bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:11.635435 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3020/6011] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Jun 18 22:26:11 2022] DELETE /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/db07a5ffee0e4ed3b35c09cb5cc4003b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:11.641229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.642633 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2992/6012] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:11.648572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40fbb-f386-4a0b-8b10-11e95be8bcac None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.662400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d87c-d747-4ef4-836e-0f626c1e7d81 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.662808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40fbb-f386-4a0b-8b10-11e95be8bcac None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.668999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.669720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.670004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.670673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.671028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:11.671336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.673155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.674116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.674397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.674671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/c727efe7595f431a88b367160f494183` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.674989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.681280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=42778307f22e467487097db3a92667dd, credential_id=c727efe7595f431a88b367160f494183)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.683581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.700259 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2993/6013] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:11.701425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.718279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f9c5e-d074-436d-9faf-5df2a6cbf915 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.725485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.726163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.726483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.726794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.730359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.734768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.736378 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3021/6014] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Jun 18 22:26:11 2022] DELETE /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/c727efe7595f431a88b367160f494183 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:11.737276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.741679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:11.761908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bba1e-b043-49e2-b1fe-9698e1a18b3d tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.768388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.769952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.770331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.770704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] PATH_INFO: `/v3/users/3daa68a1c0174a76b2f7f5003df87c3d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.772312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3daa68a1c0174a76b2f7f5003df87c3d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.773742 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2994/6015] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:11 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:11.774942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.779861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.794878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:11.849729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76b200-c3fd-4231-946c-54e3716a89e7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:11.855851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:11.856948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:11.857648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:11.857994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:11.858757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=42778307f22e467487097db3a92667dd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:11.860810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:11.866741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3daa68a1c0174a76b2f7f5003df87c3d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.868325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3daa68a1c0174a76b2f7f5003df87c3d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.884424 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2995/6016] 10.222.0.30 () {60 vars in 1298 bytes} [Sat Jun 18 22:26:11 2022] POST /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2 => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:11.885691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.888085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3daa68a1c0174a76b2f7f5003df87c3d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.889516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3daa68a1c0174a76b2f7f5003df87c3d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.891072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:11.905759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3daa68a1c0174a76b2f7f5003df87c3d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:11.929416 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3022/6017] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:11 2022] DELETE /identity/v3/users/3daa68a1c0174a76b2f7f5003df87c3d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:11.932542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:11.933713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:11.958401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:11.989537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9d15e-c2ed-483c-89d5-d727d3ad5c4c tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.059302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127693-7fb2-4550-8bf1-228114821c80 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.064478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de6844-76a5-4c7f-9787-8700075e5981 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.065505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6844-76a5-4c7f-9787-8700075e5981 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.065996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6844-76a5-4c7f-9787-8700075e5981 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.066185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de6844-76a5-4c7f-9787-8700075e5981 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/2435a6388ec64c0db87c332563fc8060` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.069177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de6844-76a5-4c7f-9787-8700075e5981 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=42778307f22e467487097db3a92667dd, credential_id=2435a6388ec64c0db87c332563fc8060)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.070934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de6844-76a5-4c7f-9787-8700075e5981 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.074136 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3023/6018] 10.222.0.30 () {58 vars in 1376 bytes} [Sat Jun 18 22:26:11 2022] GET /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/2435a6388ec64c0db87c332563fc8060 => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:12.075581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc75d-4357-4707-b49f-4eefa9d65988 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.075863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc75d-4357-4707-b49f-4eefa9d65988 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.076136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc75d-4357-4707-b49f-4eefa9d65988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.086778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.087615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.087976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.088454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.089675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.091997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.095034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-486cc75d-4357-4707-b49f-4eefa9d65988 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:12.097163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-486cc75d-4357-4707-b49f-4eefa9d65988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.112873 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3024/6019] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:12.112873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cc75d-4357-4707-b49f-4eefa9d65988 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.121569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cc75d-4357-4707-b49f-4eefa9d65988 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.124324 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2996/6020] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:11 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:12.125479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.129690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42778307f22e467487097db3a92667dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd21a346ca7a1471a86f3f96b0dbf2515', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.130258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.131094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.131585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.131863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/2435a6388ec64c0db87c332563fc8060` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.133924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=42778307f22e467487097db3a92667dd, credential_id=2435a6388ec64c0db87c332563fc8060)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.135384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.160412 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3025/6021] 10.222.0.30 () {58 vars in 1379 bytes} [Sat Jun 18 22:26:12 2022] DELETE /identity/v3/users/42778307f22e467487097db3a92667dd/credentials/OS-EC2/2435a6388ec64c0db87c332563fc8060 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:12.161587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.175933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96d699-9952-4790-9b37-ae5ebb9248c5 tempest-EC2CredentialsTest-1119360090 tempest-EC2CredentialsTest-1119360090-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.181849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.182512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.182793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.183065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.183825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.185480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.204708 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3026/6022] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:12.210471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.213654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.216611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74bafa-6dc9-4189-a723-c62499ee3d92 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.222366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.223329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.223969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.224458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.238431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.239952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a530-1b46-4713-9511-2a6cde0e8731 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.240355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.247297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.259835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.260165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.260457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] PATH_INFO: `/v3/users/42778307f22e467487097db3a92667dd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.262015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2997/6023] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:12.262472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42778307f22e467487097db3a92667dd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.263589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.265856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.275587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa02ff-42b7-45f1-a446-cdde5fa88259 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.281595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.283000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.284115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.284623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.285917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.288773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.307231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2998/6024] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:12.311926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.329183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cebd-bb72-49a5-bace-37c8297b379a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.340426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d7767-6db4-4b95-b85b-66eecdd6f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.341913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7767-6db4-4b95-b85b-66eecdd6f323 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.342113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7767-6db4-4b95-b85b-66eecdd6f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.342403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7767-6db4-4b95-b85b-66eecdd6f323 admin admin] PATH_INFO: `/v3/projects/0937d08cb8d5460babb03bb695a73ba9/users/9105409c669149f9949ed8f1f57864ba/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.383088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d7767-6db4-4b95-b85b-66eecdd6f323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0937d08cb8d5460babb03bb695a73ba9, user_id=9105409c669149f9949ed8f1f57864ba, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.385908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d7767-6db4-4b95-b85b-66eecdd6f323 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.396964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42778307f22e467487097db3a92667dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:12.403969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42778307f22e467487097db3a92667dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:12.406239 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 2999/6025] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:12 2022] PUT /identity/v3/projects/0937d08cb8d5460babb03bb695a73ba9/users/9105409c669149f9949ed8f1f57864ba/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:12.418873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60bef4-0f1a-49e6-9df1-352dc121f8b8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.419313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60bef4-0f1a-49e6-9df1-352dc121f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.419790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60bef4-0f1a-49e6-9df1-352dc121f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.422707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=19,keystone:SELECT=80,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:12.450713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42778307f22e467487097db3a92667dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:12.451478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42778307f22e467487097db3a92667dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:12.462450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-df60bef4-0f1a-49e6-9df1-352dc121f8b8 None None] MFA Rules not processed for user `9105409c669149f9949ed8f1f57864ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:12.464224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-df60bef4-0f1a-49e6-9df1-352dc121f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.465086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d4b84cc4-1e80-4ff1-a50d-b30d693186d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42778307f22e467487097db3a92667dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:12.501334 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3027/6026] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:12 2022] DELETE /identity/v3/users/42778307f22e467487097db3a92667dd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:12.506062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891210a-578b-4004-88ea-84c940003da0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.506463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891210a-578b-4004-88ea-84c940003da0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.506921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891210a-578b-4004-88ea-84c940003da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.561315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d891210a-578b-4004-88ea-84c940003da0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:12.561315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d891210a-578b-4004-88ea-84c940003da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.574104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:12.630620 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3000/6027] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:12.632315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.632606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.632881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.667535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:12.670325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.711845 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3028/6028] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:12.712930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891210a-578b-4004-88ea-84c940003da0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.714984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d891210a-578b-4004-88ea-84c940003da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.755938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891210a-578b-4004-88ea-84c940003da0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.767686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.768546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.768825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.772289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.773341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:12.775371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:12.775956 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3001/6029] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:12.777521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.779918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.845944 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3029/6030] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:12 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:12.847953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:12.850788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:12.873288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318b400-2433-4237-99e3-63af009d6c80 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.942953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730a738-2b69-481b-8a09-861fd867df2d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:12.950175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.950785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.951168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.951603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:12.959092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:12.960238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:12.960830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:12.961361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:13.055260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:13.080367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.085416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.101866 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3030/6031] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:13.103019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:13.131481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:13.189144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.190839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.227220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509184-fa55-42c0-8167-9b3d95a3878a service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:13.228008 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3002/6032] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:13.228899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:13.232175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:13.235420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:13.236489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:13.237672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:13.238113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:13.243039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.263926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8418ca-bc84-4af1-be3e-1bd4e92c9cb5 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:13.269605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.279976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:13.281092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:13.282119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:13.282484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] PATH_INFO: `/v3/projects/314c1f892dd74d31991577424e080703` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:13.284748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] RBAC: Authorizing `identity:delete_project(project_id=314c1f892dd74d31991577424e080703)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.313373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.345629 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3031/6033] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:13 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:13.352519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:13.373056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17534d38-107f-4f9c-a332-93c55e90886c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:13.396045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:13.396826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:13.397158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:13.397515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:13.398503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.400319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.427461 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3032/6034] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:13.432250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:13.465564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90e2b3-2f06-4c49-a0e9-0b9192f2906d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:13.507535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314c1f892dd74d31991577424e080703', 'request_id': 'req-e0779f92-8274-40fc-849d-83cca297149c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:13.525558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314c1f892dd74d31991577424e080703', 'request_id': 'req-e0779f92-8274-40fc-849d-83cca297149c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:13.546379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314c1f892dd74d31991577424e080703', 'request_id': 'req-e0779f92-8274-40fc-849d-83cca297149c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:13.573724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] The token cache is being invalidate because project 314c1f892dd74d31991577424e080703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:13.574037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:13.575059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:13.577522 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3003/6035] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:13 2022] DELETE /identity/v3/projects/314c1f892dd74d31991577424e080703 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:13.581975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:13.584399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:13.622816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:13.623921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:13.624303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:13.625753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] PATH_INFO: `/v3/projects/bca2832a3c3348f0b96fe1ab587f718b/users/408dc52b2a694a4eb4b2870b4c4b1e50/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:13.666572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca2832a3c3348f0b96fe1ab587f718b, user_id=408dc52b2a694a4eb4b2870b4c4b1e50, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.670896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.697094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0779f92-8274-40fc-849d-83cca297149c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:13.698693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3033/6036] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:13 2022] PUT /identity/v3/projects/bca2832a3c3348f0b96fe1ab587f718b/users/408dc52b2a694a4eb4b2870b4c4b1e50/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:13.703116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:13.705373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:13.812236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:13.846286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:13.849501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:13.850740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:13.851244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] PATH_INFO: `/v3/users/537f58464515407db021065314fa8aeb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:13.854751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537f58464515407db021065314fa8aeb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.861841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.862707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed78800-405c-4703-9f00-c9345b492e2f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:13.876789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:13.879585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:13.879585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:13.881135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:13.883177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:13.890279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:13.930567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:13.955996 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3034/6037] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:13.957676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:13.978753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065e64-e8b4-443a-8af5-3d6e80a2d07b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:13.983229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537f58464515407db021065314fa8aeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:13.984255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537f58464515407db021065314fa8aeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:13.991148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed54c39-e40d-4aa8-b35a-4af3c20d861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:13.995982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed54c39-e40d-4aa8-b35a-4af3c20d861c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:13.996322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed54c39-e40d-4aa8-b35a-4af3c20d861c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:13.996624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed54c39-e40d-4aa8-b35a-4af3c20d861c admin admin] PATH_INFO: `/v3/projects/bca2832a3c3348f0b96fe1ab587f718b/users/408dc52b2a694a4eb4b2870b4c4b1e50/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.000455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed54c39-e40d-4aa8-b35a-4af3c20d861c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca2832a3c3348f0b96fe1ab587f718b, user_id=408dc52b2a694a4eb4b2870b4c4b1e50, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.006196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed54c39-e40d-4aa8-b35a-4af3c20d861c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.006894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537f58464515407db021065314fa8aeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.007841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537f58464515407db021065314fa8aeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.020304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5843a1a3-6d28-43b0-ab38-6b3ad0af5a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537f58464515407db021065314fa8aeb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.039172 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3035/6038] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:13 2022] PUT /identity/v3/projects/bca2832a3c3348f0b96fe1ab587f718b/users/408dc52b2a694a4eb4b2870b4c4b1e50/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:14.049443 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3004/6039] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:13 2022] DELETE /identity/v3/users/537f58464515407db021065314fa8aeb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:14.051662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a6f33-0b50-46f5-a3a2-7c3988417025 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.063630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a6f33-0b50-46f5-a3a2-7c3988417025 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.064786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a6f33-0b50-46f5-a3a2-7c3988417025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.102091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.102810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.103505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.148894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] MFA Rules not processed for user `39c2337d42bc426abed2ed2fb5000753`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:14.151289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:14.154360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1f7a6f33-0b50-46f5-a3a2-7c3988417025 None None] MFA Rules not processed for user `408dc52b2a694a4eb4b2870b4c4b1e50`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:14.158064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1f7a6f33-0b50-46f5-a3a2-7c3988417025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:14.251841 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3005/6040] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:14.257719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.261392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:14.347713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3036/6041] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:14.352304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a6f33-0b50-46f5-a3a2-7c3988417025 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.374900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a6f33-0b50-46f5-a3a2-7c3988417025 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:14.379016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e743dce-1e81-467b-8e11-e064ccd46996 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:14.384167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:14.385244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.385668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.386772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] PATH_INFO: `/v3/projects/d21a346ca7a1471a86f3f96b0dbf2515` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.387860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:14.388260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21a346ca7a1471a86f3f96b0dbf2515)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.390224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.390480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.391610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.392224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.394039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.397868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.427336 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3037/6042] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:26:14 2022] POST /identity/v3/services => generated 240 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:14.429370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.470523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721a3e0-83a7-4536-a1dd-117d3b2cc5b6 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:14.479077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:14.492174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21a346ca7a1471a86f3f96b0dbf2515', 'request_id': 'req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.509643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21a346ca7a1471a86f3f96b0dbf2515', 'request_id': 'req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.529839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21a346ca7a1471a86f3f96b0dbf2515', 'request_id': 'req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.550220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] The token cache is being invalidate because project d21a346ca7a1471a86f3f96b0dbf2515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:14.550820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.551910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-561852cb-f5d6-4e02-9b4a-2d4597dafcd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:14.554843 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3006/6043] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:14 2022] DELETE /identity/v3/projects/d21a346ca7a1471a86f3f96b0dbf2515 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:14.559906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7621a-5cc2-407b-a92c-5bb9fe606977 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.560294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7621a-5cc2-407b-a92c-5bb9fe606977 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.560688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7621a-5cc2-407b-a92c-5bb9fe606977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.596506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bcc7621a-5cc2-407b-a92c-5bb9fe606977 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:14.598046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bcc7621a-5cc2-407b-a92c-5bb9fe606977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:14.606613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:14.609746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.610541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.611723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/b376c0e747874aaea5e9a0adf114c34d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.615187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b376c0e747874aaea5e9a0adf114c34d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.619297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.662697 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3038/6044] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:14 2022] DELETE /identity/v3/services/b376c0e747874aaea5e9a0adf114c34d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:14.670567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.672749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:14.711541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07363a5a-2684-40fc-8658-cf526e7b24ed tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:14.718979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:14.719989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.720426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.720616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.722897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.724943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.727302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:14.766106 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3039/6045] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:14 2022] POST /identity/v3/services => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:14.770234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.782766 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3007/6046] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:14.784542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7923738-9190-46a2-a3cf-191e6a832d2f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.785014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7923738-9190-46a2-a3cf-191e6a832d2f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.785373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7923738-9190-46a2-a3cf-191e6a832d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.809253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a7923738-9190-46a2-a3cf-191e6a832d2f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:14.811134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a7923738-9190-46a2-a3cf-191e6a832d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:14.819543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8209f-5d04-4d76-aa5d-5be0ababa455 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:14.832925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:14.834192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.834807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.835656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/306c98d4e23a45c6950b63438f58eebe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.837020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:update_service(service_id=306c98d4e23a45c6950b63438f58eebe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.840023 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:26:14.840023 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:26:14.840023 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:26:14.841899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.873134 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3008/6047] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:14.879471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7923738-9190-46a2-a3cf-191e6a832d2f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.880664 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3040/6048] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Jun 18 22:26:14 2022] PATCH /identity/v3/services/306c98d4e23a45c6950b63438f58eebe => generated 282 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:26:14.885648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.906791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7923738-9190-46a2-a3cf-191e6a832d2f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:14.938621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c7007-3bfc-4c86-9bd5-86125f900095 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:14.938939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:14.940094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.941769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.942526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.944925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:14.944925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.947790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.948132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:14.949058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:14.949346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:14.949627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/306c98d4e23a45c6950b63438f58eebe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:14.950306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:get_service(service_id=306c98d4e23a45c6950b63438f58eebe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:14.953083 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:26:14.953083 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:26:14.953083 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:26:14.954108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:14.970713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3041/6049] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:26:14 2022] GET /identity/v3/services/306c98d4e23a45c6950b63438f58eebe => generated 282 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:26:14.975367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.983723 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3009/6050] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:14.987473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:14.999547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69bc9-33d4-4f91-8c0c-08f8a54ec1bb tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.004778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a7b2b-a905-4c03-b90b-218d888e6023 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.005756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.007207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.007492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.007773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/306c98d4e23a45c6950b63438f58eebe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.008457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:delete_service(service_id=306c98d4e23a45c6950b63438f58eebe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.010152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.015966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.021545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.021912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.022552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.023543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.026298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.076510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3042/6051] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:14 2022] DELETE /identity/v3/services/306c98d4e23a45c6950b63438f58eebe => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:15.080911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.086231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3010/6052] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:14 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:15.087852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.122946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa4aa2-1b79-4d39-95af-7bf985109939 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.238909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b229a-8c01-48da-b5cc-cac51d291357 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.249177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.250110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.250394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.250670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/306c98d4e23a45c6950b63438f58eebe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.251389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:get_service(service_id=306c98d4e23a45c6950b63438f58eebe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.253161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.261981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:15.266763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.269835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.272945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.274049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.275543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.283729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Could not find service: 306c98d4e23a45c6950b63438f58eebe.: keystone.exception.ServiceNotFound: Could not find service: 306c98d4e23a45c6950b63438f58eebe. Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 306c98d4e23a45c6950b63438f58eebe. Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:15.294502 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:26:15.295936 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application with Lock( Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 306c98d4e23a45c6950b63438f58eebe. Jun 18 22:26:15.297279 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:15.300400 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3043/6053] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:26:15 2022] GET /identity/v3/services/306c98d4e23a45c6950b63438f58eebe => generated 113 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 18 22:26:15.302412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.324854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4430f-e5f6-44de-8390-ca8d4883ba02 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.339826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.340622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.341023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.341473 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3011/6054] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:15 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:15.341744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.342683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.344363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.349460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.373823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5ce8-f31f-473f-9cd4-7779887d01dc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.378822 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3044/6055] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:15 2022] POST /identity/v3/services => generated 275 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:15.383550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.412339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.414129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.414951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.415529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.416687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.419365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd1366-5c8b-4079-9637-7a0a1eb19571 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.420711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.426848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.427803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.428434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.428651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.429425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.431097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.442741 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3012/6056] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:15.448011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.463980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee819-2018-4b45-964a-e0fd6160c980 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.469216 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3045/6057] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:15 2022] POST /identity/v3/services => generated 274 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:15.477595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.510722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b6573-8673-4cab-a39a-61a61638113a tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.522382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.524166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.524672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.524966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.526213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.527605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.528143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.528910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.529489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.529997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.531670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.533859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.561458 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3046/6058] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:15 2022] POST /identity/v3/services => generated 274 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:15.568364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3013/6059] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:15.568896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.571999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.585926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dc20b-6885-4c7f-9d03-d65b008e3648 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.611348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6053-3030-498b-8398-88c87b079aec tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.611643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e87210-754e-4d46-b736-27498c796c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.612510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87210-754e-4d46-b736-27498c796c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.612887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87210-754e-4d46-b736-27498c796c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.613288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e87210-754e-4d46-b736-27498c796c23 admin admin] PATH_INFO: `/v3/projects/bbdcde6973d54d72be763b74536c9213/users/6565f0b580dd425898c83cc7d7e711c4/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.623750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.625612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.625985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.626273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.627934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.630749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e87210-754e-4d46-b736-27498c796c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdcde6973d54d72be763b74536c9213, user_id=6565f0b580dd425898c83cc7d7e711c4, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.633287 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:26:15.633287 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:26:15.633287 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:26:15.633612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e87210-754e-4d46-b736-27498c796c23 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.634427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.659532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3047/6060] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:26:15 2022] GET /identity/v3/services => generated 2978 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:15.663383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.665709 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3014/6061] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:15 2022] PUT /identity/v3/projects/bbdcde6973d54d72be763b74536c9213/users/6565f0b580dd425898c83cc7d7e711c4/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:15.689370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c83bc6-2723-45a1-98c6-33ba5e768b97 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.689370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c83bc6-2723-45a1-98c6-33ba5e768b97 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.689370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c83bc6-2723-45a1-98c6-33ba5e768b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.690478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=4,keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:15.708253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8378-119f-44b4-9629-ceda8b714086 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:15.760891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-70c83bc6-2723-45a1-98c6-33ba5e768b97 None None] MFA Rules not processed for user `6565f0b580dd425898c83cc7d7e711c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:15.765507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-70c83bc6-2723-45a1-98c6-33ba5e768b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:15.848617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:15.849649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:15.850721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:15.852344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:15.853409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1766805203) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:15.854021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:15.858383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:15.896802 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3048/6062] 10.222.0.30 () {58 vars in 1221 bytes} [Sat Jun 18 22:26:15 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1766805203 => generated 418 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:15.901545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:15.910889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:16.000627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3015/6063] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3750 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:16.006664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c83bc6-2723-45a1-98c6-33ba5e768b97 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.049365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c83bc6-2723-45a1-98c6-33ba5e768b97 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.094059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.102797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.104620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.106158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.107242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1190908444) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:16.113230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.116137 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:26:16.116137 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:26:16.116137 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:26:16.117577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.142787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15a9da-975e-4573-b885-8ec565f3ee90 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.148845 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3016/6064] 10.222.0.30 () {58 vars in 1221 bytes} [Sat Jun 18 22:26:15 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1190908444 => generated 417 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:16.149903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.151042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.154834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.155123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.155504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] PATH_INFO: `/v3/projects/5001d515fc804491bb6033a2395e84ee` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.158246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5001d515fc804491bb6033a2395e84ee)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.163624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.185971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb85f2b-c9f0-46f8-a2c1-8010216889aa tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.206902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.207603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.207888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.208170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.209691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.212966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.294070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3017/6065] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:16 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:16.294070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.312221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5001d515fc804491bb6033a2395e84ee', 'request_id': 'req-300d9347-5384-4fbb-9c78-5bb5015d63c5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:16.337991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5001d515fc804491bb6033a2395e84ee', 'request_id': 'req-300d9347-5384-4fbb-9c78-5bb5015d63c5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:16.351742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5001d515fc804491bb6033a2395e84ee', 'request_id': 'req-300d9347-5384-4fbb-9c78-5bb5015d63c5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:16.390895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] The token cache is being invalidate because project 5001d515fc804491bb6033a2395e84ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:16.391211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:16.395058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:16.399804 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3049/6066] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:15 2022] DELETE /identity/v3/projects/5001d515fc804491bb6033a2395e84ee => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:16.402135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.406610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:16.414301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:16.476480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac98ea-4717-4011-adfc-16854f92ee3e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.486609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105808b-45b6-410c-81c7-530dc23e424b tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.487231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105808b-45b6-410c-81c7-530dc23e424b tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.487668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105808b-45b6-410c-81c7-530dc23e424b tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.487956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105808b-45b6-410c-81c7-530dc23e424b tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.488808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105808b-45b6-410c-81c7-530dc23e424b tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1247549699) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:16.489660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105808b-45b6-410c-81c7-530dc23e424b tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.494181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105808b-45b6-410c-81c7-530dc23e424b tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.501982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:16.522267 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3018/6067] 10.222.0.30 () {58 vars in 1221 bytes} [Sat Jun 18 22:26:16 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1247549699 => generated 417 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:16.525864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.526186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.527752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.565886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:16.568426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:16.594936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d9347-5384-4fbb-9c78-5bb5015d63c5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.710241 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3019/6068] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3731 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:16.711779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.714070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:16.735742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ac65-a13c-423f-9af5-d841f5d3b500 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.743999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e244f-deb7-4b12-b9df-5380fc2b884e tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.745518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e244f-deb7-4b12-b9df-5380fc2b884e tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.747005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e244f-deb7-4b12-b9df-5380fc2b884e tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.747577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e244f-deb7-4b12-b9df-5380fc2b884e tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/16879f9f94b84d4d83144bbeb52fb358` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.750318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e244f-deb7-4b12-b9df-5380fc2b884e tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:delete_service(service_id=16879f9f94b84d4d83144bbeb52fb358)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.753020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e244f-deb7-4b12-b9df-5380fc2b884e tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.755946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.756792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.757112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.757430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.759310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.765648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.805107 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3020/6069] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:16 2022] DELETE /identity/v3/services/16879f9f94b84d4d83144bbeb52fb358 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:16.815714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c3f7-6cba-4646-875b-25eabe81ed86 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.816719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c3f7-6cba-4646-875b-25eabe81ed86 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.821087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6c3f7-6cba-4646-875b-25eabe81ed86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.826576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3050/6070] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:16 2022] POST /identity/v3/users => generated 291 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:16.827597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.842479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e563e-2d11-4003-b3ea-bac62b24864d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.856306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-18e6c3f7-6cba-4646-875b-25eabe81ed86 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:16.857948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-18e6c3f7-6cba-4646-875b-25eabe81ed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:16.868155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.869650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.870213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.871099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/79ebbf270a014e08996bffbe99d83fb1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.872287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:delete_service(service_id=79ebbf270a014e08996bffbe99d83fb1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.875528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.891938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3021/6071] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3564 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:16.893394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6c3f7-6cba-4646-875b-25eabe81ed86 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.909920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6c3f7-6cba-4646-875b-25eabe81ed86 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.916703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.918297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.918695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.918996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.919914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:16.922257 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3051/6072] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:16 2022] DELETE /identity/v3/services/79ebbf270a014e08996bffbe99d83fb1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:16.925789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:16.928918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.965558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3022/6073] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:16.965558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:16.983092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c415da-1090-4ba7-8d87-651ac84984be tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.989783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:16.990070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5051-a7f3-40b3-9b2a-eb5776962035 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:16.990821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:16.991200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:16.991884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:16.993561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:16.993884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.009615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.023896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '408dc52b2a694a4eb4b2870b4c4b1e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca2832a3c3348f0b96fe1ab587f718b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.024783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.026304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.026532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] PATH_INFO: `/v3/services/ac025e88c358481ca1a2fc15183f3df6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.027183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ac025e88c358481ca1a2fc15183f3df6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.034606 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3052/6074] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:17.034835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.034937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:17.047868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f0793-0fdd-46cb-ba3f-0014a57f93dd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:17.054430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.055230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.055409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.055609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.056432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.059581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.088458 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3023/6075] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:16 2022] DELETE /identity/v3/services/ac025e88c358481ca1a2fc15183f3df6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:17.090940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:17.100862 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3053/6076] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:17.103614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:17.108664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:17.131720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624bbf8-9ba6-4aae-94e4-1b764b79ca30 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:17.158151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.158777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a550ac7-5f13-4f70-bd6f-b1a358477067 tempest-ServicesTestJSON-1382979942 tempest-ServicesTestJSON-1382979942-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:17.159329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.159623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.159898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] PATH_INFO: `/v3/users/9105409c669149f9949ed8f1f57864ba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.161960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9105409c669149f9949ed8f1f57864ba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.164961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.187625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.188759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.189929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.190911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.193303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.204592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.279658 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3024/6077] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:17 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:17.281403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:17.303158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9105409c669149f9949ed8f1f57864ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:17.306094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9105409c669149f9949ed8f1f57864ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:17.309781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:17.338522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:17.348931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9105409c669149f9949ed8f1f57864ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:17.351746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9105409c669149f9949ed8f1f57864ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:17.397450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9105409c669149f9949ed8f1f57864ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:17.443066 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3054/6078] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:17 2022] DELETE /identity/v3/users/9105409c669149f9949ed8f1f57864ba => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:17.443066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:17.446631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:17.452904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253050d-a90d-4f0f-9c82-70c00ae9bdf6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:17.626200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e629-1afb-4d21-876d-18ae0e2ddaeb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:17.632548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.633867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.634148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.634370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] PATH_INFO: `/v3/projects/cc339fab679c43508a0424ebadb1b322/users/65edd9bb30f64154845b3cee11059eea/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.641676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb696e9-3b06-4f20-9261-f532ef34c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.643946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb696e9-3b06-4f20-9261-f532ef34c13b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.645441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb696e9-3b06-4f20-9261-f532ef34c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.645978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb696e9-3b06-4f20-9261-f532ef34c13b admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.648119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb696e9-3b06-4f20-9261-f532ef34c13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.651681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb696e9-3b06-4f20-9261-f532ef34c13b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.680787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc339fab679c43508a0424ebadb1b322, user_id=65edd9bb30f64154845b3cee11059eea, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.690081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.693158 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3055/6079] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:17 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:17.698947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc29c2-8bab-4a20-881a-4254c6c8d24d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.699637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc29c2-8bab-4a20-881a-4254c6c8d24d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.700286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc29c2-8bab-4a20-881a-4254c6c8d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.724929 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3025/6080] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:17 2022] PUT /identity/v3/projects/cc339fab679c43508a0424ebadb1b322/users/65edd9bb30f64154845b3cee11059eea/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:17.727748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:17.738959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:17.759743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2bcc29c2-8bab-4a20-881a-4254c6c8d24d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:17.762668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2bcc29c2-8bab-4a20-881a-4254c6c8d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:17.849748 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3056/6081] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:17.854660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc29c2-8bab-4a20-881a-4254c6c8d24d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:17.870053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc29c2-8bab-4a20-881a-4254c6c8d24d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:17.879822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc1145-819f-4b5f-9873-861d4de48d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.881764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc1145-819f-4b5f-9873-861d4de48d1e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.882276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc1145-819f-4b5f-9873-861d4de48d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.882839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc1145-819f-4b5f-9873-861d4de48d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.884091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc1145-819f-4b5f-9873-861d4de48d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:17.886492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc1145-819f-4b5f-9873-861d4de48d1e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:17.904944 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3057/6082] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:17.909673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763f9a4-d5cd-45de-bf23-d0ca01105f99 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.910280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763f9a4-d5cd-45de-bf23-d0ca01105f99 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.910909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763f9a4-d5cd-45de-bf23-d0ca01105f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.940040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd27338-fa07-41fc-a5df-ad656a640698 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:17.951982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:17.952700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:17.952932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:17.953232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:17.955476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8763f9a4-d5cd-45de-bf23-d0ca01105f99 None None] MFA Rules not processed for user `65edd9bb30f64154845b3cee11059eea`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:17.957445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8763f9a4-d5cd-45de-bf23-d0ca01105f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:17.958821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:18.029941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:18.067296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:18.102488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:18.104240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:18.111008 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3058/6083] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:18.111382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763f9a4-d5cd-45de-bf23-d0ca01105f99 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:18.131505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763f9a4-d5cd-45de-bf23-d0ca01105f99 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:18.140994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:18.143068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:18.144346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:18.147267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:18.149688 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3026/6084] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:18.151065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:18.170467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e40373-aab5-4580-b5c2-26fff4f6b819 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:18.174279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:18.177178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:18.183750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85393948-3675-406b-9739-54154195fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:18.184459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393948-3675-406b-9739-54154195fab6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:18.184823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393948-3675-406b-9739-54154195fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:18.185186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393948-3675-406b-9739-54154195fab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:18.186117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85393948-3675-406b-9739-54154195fab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:18.189700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85393948-3675-406b-9739-54154195fab6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:18.196266 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3059/6085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:18.197179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:18.199064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:18.212155 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3027/6086] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:18.213357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85393948-3675-406b-9739-54154195fab6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:18.234601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85393948-3675-406b-9739-54154195fab6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:18.244087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eecc58-6cdb-45e4-a94c-50d0b84ff4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:18.245394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eecc58-6cdb-45e4-a94c-50d0b84ff4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:18.245747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eecc58-6cdb-45e4-a94c-50d0b84ff4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:18.246387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eecc58-6cdb-45e4-a94c-50d0b84ff4f7 admin admin] PATH_INFO: `/v3/projects/a29fe11a501a4392be8d6a602d663a1a/users/04a60f11de2a4456857bfd41622192fa/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:18.310787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eecc58-6cdb-45e4-a94c-50d0b84ff4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29fe11a501a4392be8d6a602d663a1a, user_id=04a60f11de2a4456857bfd41622192fa, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:18.321694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eecc58-6cdb-45e4-a94c-50d0b84ff4f7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:18.373597 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3028/6087] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:18 2022] PUT /identity/v3/projects/a29fe11a501a4392be8d6a602d663a1a/users/04a60f11de2a4456857bfd41622192fa/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:18.379588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd610-6b9a-4a66-bad7-9759c142141f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:18.382182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd610-6b9a-4a66-bad7-9759c142141f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:18.382545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fd610-6b9a-4a66-bad7-9759c142141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:18.442976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d03de-f6b5-476c-80fd-304c7a183a9c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:18.456346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3b2fd610-6b9a-4a66-bad7-9759c142141f None None] MFA Rules not processed for user `04a60f11de2a4456857bfd41622192fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:18.460496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3b2fd610-6b9a-4a66-bad7-9759c142141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:18.610257 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3029/6088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:18.611534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd610-6b9a-4a66-bad7-9759c142141f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:18.617141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2385-4040-4fd5-a4d8-7fe96cd6ce88 tempest-IdentityV3ProjectsTest-1754915894 tempest-IdentityV3ProjectsTest-1754915894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6565f0b580dd425898c83cc7d7e711c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbdcde6973d54d72be763b74536c9213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:18.619209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2385-4040-4fd5-a4d8-7fe96cd6ce88 tempest-IdentityV3ProjectsTest-1754915894 tempest-IdentityV3ProjectsTest-1754915894-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:18.620704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2385-4040-4fd5-a4d8-7fe96cd6ce88 tempest-IdentityV3ProjectsTest-1754915894 tempest-IdentityV3ProjectsTest-1754915894-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:18.621577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2385-4040-4fd5-a4d8-7fe96cd6ce88 tempest-IdentityV3ProjectsTest-1754915894 tempest-IdentityV3ProjectsTest-1754915894-project] PATH_INFO: `/v3/users/6565f0b580dd425898c83cc7d7e711c4/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:18.623668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add2385-4040-4fd5-a4d8-7fe96cd6ce88 tempest-IdentityV3ProjectsTest-1754915894 tempest-IdentityV3ProjectsTest-1754915894-project] RBAC: Authorizing `identity:list_user_projects(user_id=6565f0b580dd425898c83cc7d7e711c4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:18.625645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add2385-4040-4fd5-a4d8-7fe96cd6ce88 tempest-IdentityV3ProjectsTest-1754915894 tempest-IdentityV3ProjectsTest-1754915894-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:18.745146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fd610-6b9a-4a66-bad7-9759c142141f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:18.758015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:18.763293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:18.763953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:18.764869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:18.766048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:18.768883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:18.786768 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3060/6089] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:26:18 2022] GET /identity/v3/users/6565f0b580dd425898c83cc7d7e711c4/projects => generated 517 bytes in 590 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:18.791090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280f3cb-71cf-4d83-ae4e-ce72ee99239a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:18.791512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280f3cb-71cf-4d83-ae4e-ce72ee99239a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:18.791966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280f3cb-71cf-4d83-ae4e-ce72ee99239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:18.830429 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3030/6090] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:18 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:18.833901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:18.861366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d280f3cb-71cf-4d83-ae4e-ce72ee99239a None None] MFA Rules not processed for user `6565f0b580dd425898c83cc7d7e711c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:18.865718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d280f3cb-71cf-4d83-ae4e-ce72ee99239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:18.867217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:18.923038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:18.994358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833fbc6-20dc-42ee-b616-1b3d08547f1b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:19.001582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:19.001847 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3061/6091] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:19.004305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.004986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.005519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.006402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:19.006533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.006828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.009206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:19.009353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.050872 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3031/6092] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:18 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:19.056206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:19.058809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] MFA Rules not processed for user `6565f0b580dd425898c83cc7d7e711c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:19.059960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:19.077757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d8e6-bf8e-4be2-9640-0ad92bc3bb43 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:19.091480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:19.095130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.095707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.096240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.103382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:19.105755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:19.126100 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3032/6093] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:19.127423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:19.142639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ee708-de80-440e-95e6-c2400e40ab8a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:19.148594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:19.149895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.150479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.150920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] PATH_INFO: `/v3/projects/25b6f058f4204d0c9878a7206e02a8cd/users/8a050b20d635487c949a1af258636439/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.167073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.models.token_model [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] User 6565f0b580dd425898c83cc7d7e711c4 has no access to project cc339fab679c43508a0424ebadb1b322 {{(pid=91205) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jun 18 22:26:19.175114 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.server.flask.application [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 18 22:26:19.182708 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3062/6094] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 176 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 18 22:26:19.184066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:19.187491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b6f058f4204d0c9878a7206e02a8cd, user_id=8a050b20d635487c949a1af258636439, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:19.188029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:19.192102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:19.212743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13d760-1e8e-4bf9-ac8b-0f4b66f64519 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:19.219271 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3033/6095] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:19 2022] PUT /identity/v3/projects/25b6f058f4204d0c9878a7206e02a8cd/users/8a050b20d635487c949a1af258636439/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:19.221799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:19.317175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:19.318563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.319027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.319563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] PATH_INFO: `/v3/users/6565f0b580dd425898c83cc7d7e711c4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.321490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6565f0b580dd425898c83cc7d7e711c4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:19.323271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7f1d3-878d-4075-9352-3a0e4dc4685d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:19.324940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:19.331201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:19.332129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.332535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.332871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.334315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:19.336837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:19.356068 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3034/6096] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:19.357282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:19.384048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c1a33-119d-4b78-93f1-a03afc3561fb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:19.392367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b2416-aff0-4604-91fc-fab9ca84e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:19.393488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b2416-aff0-4604-91fc-fab9ca84e64a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.393774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b2416-aff0-4604-91fc-fab9ca84e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.394050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b2416-aff0-4604-91fc-fab9ca84e64a admin admin] PATH_INFO: `/v3/projects/25b6f058f4204d0c9878a7206e02a8cd/users/8a050b20d635487c949a1af258636439/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.397939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b2416-aff0-4604-91fc-fab9ca84e64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b6f058f4204d0c9878a7206e02a8cd, user_id=8a050b20d635487c949a1af258636439, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:19.401755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b2416-aff0-4604-91fc-fab9ca84e64a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:19.420250 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3035/6097] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:19 2022] PUT /identity/v3/projects/25b6f058f4204d0c9878a7206e02a8cd/users/8a050b20d635487c949a1af258636439/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:19.429882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.430602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.430951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.433328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6565f0b580dd425898c83cc7d7e711c4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:19.434079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6565f0b580dd425898c83cc7d7e711c4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:19.451751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6565f0b580dd425898c83cc7d7e711c4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:19.452569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6565f0b580dd425898c83cc7d7e711c4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:19.471157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f213395f-10d7-437d-bf78-9c86c1f5bb01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6565f0b580dd425898c83cc7d7e711c4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:19.549207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] MFA Rules not processed for user `8a050b20d635487c949a1af258636439`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:19.551572 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3063/6098] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:19 2022] DELETE /identity/v3/users/6565f0b580dd425898c83cc7d7e711c4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:19.557373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:19.562869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.565523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.567404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:19.588805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:19.624618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:19.629825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:19.685963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:19.796340 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3036/6099] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:19.805097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:19.807691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:19.864645 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3064/6100] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:19.970862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076087f-b8aa-405a-884c-b8c510945511 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:19.991140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:19.994819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:19.999111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:19.999483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:20.017760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:20.020352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:20.035310 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3037/6101] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:20.048668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:20.051320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:20.196429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:20.207737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f600838-cebe-49dd-925c-b1f24d8751d4 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:20.211885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:20.212740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:20.212913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:20.213112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:20.214522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32651e-967a-4fc4-b808-d2b0a4e5fa24 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:20.215373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:20.226045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:20.226732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:20.227013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:20.227294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:20.258259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:20.260528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:20.289125 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3065/6102] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:20.329243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:20.332365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:20.359476 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3038/6103] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:20.528310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:20.534579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:20.564841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:20.566717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:20.571094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ee1f4-4c25-40d6-a392-87dae14c1e87 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:20.584440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:20.589175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12ebf1-e10b-44d6-b495-8557f3eea171 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:20.604628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:20.604966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:20.605985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] PATH_INFO: `/v3/projects/0937d08cb8d5460babb03bb695a73ba9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:20.614333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0937d08cb8d5460babb03bb695a73ba9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:20.618205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:20.642142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:20.647934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:20.665467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:20.665813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:20.684778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:20.737294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0937d08cb8d5460babb03bb695a73ba9', 'request_id': 'req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:20.757826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0937d08cb8d5460babb03bb695a73ba9', 'request_id': 'req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:20.783048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0937d08cb8d5460babb03bb695a73ba9', 'request_id': 'req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:20.810439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] The token cache is being invalidate because project 0937d08cb8d5460babb03bb695a73ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:20.810830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:20.812924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:20.821082 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3066/6104] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:20 2022] DELETE /identity/v3/projects/0937d08cb8d5460babb03bb695a73ba9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:20.822495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:20.825000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:20.885111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:20.893186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:20.944915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:20.944915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:20.973605 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3039/6105] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:26:20.975295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2f0b-9bb2-48e5-b271-9dd8a4a91529 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:20.993207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:20.994573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:20.996434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:20.997198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] PATH_INFO: `/v3/users/408dc52b2a694a4eb4b2870b4c4b1e50` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:20.999869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408dc52b2a694a4eb4b2870b4c4b1e50)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:21.003211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:21.110759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408dc52b2a694a4eb4b2870b4c4b1e50'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:21.114638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408dc52b2a694a4eb4b2870b4c4b1e50'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:21.157329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408dc52b2a694a4eb4b2870b4c4b1e50'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:21.158454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408dc52b2a694a4eb4b2870b4c4b1e50'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:21.176302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408dc52b2a694a4eb4b2870b4c4b1e50'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:21.220458 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3067/6106] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:20 2022] DELETE /identity/v3/users/408dc52b2a694a4eb4b2870b4c4b1e50 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:21.704952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:21.707206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:21.723640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:21.725373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:21.783660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3a207-1366-4dbc-ae89-46b99205d9e9 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:21.899394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933d12-3c58-4480-81f3-d58920a7e342 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:21.913090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:21.913969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:21.913969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:21.914248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] PATH_INFO: `/v3/projects/bca2832a3c3348f0b96fe1ab587f718b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:21.917246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca2832a3c3348f0b96fe1ab587f718b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:21.919281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:21.923393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:21.924384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:21.924669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:21.924970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] PATH_INFO: `/v3/projects/bbdcde6973d54d72be763b74536c9213` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:21.927690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdcde6973d54d72be763b74536c9213)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:21.929477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:22.038302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca2832a3c3348f0b96fe1ab587f718b', 'request_id': 'req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.043689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:22.056829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca2832a3c3348f0b96fe1ab587f718b', 'request_id': 'req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.074491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca2832a3c3348f0b96fe1ab587f718b', 'request_id': 'req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.088408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdcde6973d54d72be763b74536c9213', 'request_id': 'req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.103585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdcde6973d54d72be763b74536c9213', 'request_id': 'req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.104629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] The token cache is being invalidate because project bca2832a3c3348f0b96fe1ab587f718b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:22.104924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.110703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09f776f4-f8fe-415f-a13b-cf6d0b77eb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.119301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3068/6107] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:21 2022] DELETE /identity/v3/projects/bca2832a3c3348f0b96fe1ab587f718b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:22.119906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdcde6973d54d72be763b74536c9213', 'request_id': 'req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.124559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b36e24-fb84-411a-8935-38733e587a87 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:22.124915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b36e24-fb84-411a-8935-38733e587a87 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:22.125258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b36e24-fb84-411a-8935-38733e587a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:22.142736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] The token cache is being invalidate because project bbdcde6973d54d72be763b74536c9213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:22.143107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.144185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.148070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3040/6108] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:21 2022] DELETE /identity/v3/projects/bbdcde6973d54d72be763b74536c9213 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:22.152076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:22.154268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:22.194263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-96b36e24-fb84-411a-8935-38733e587a87 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:22.195663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-96b36e24-fb84-411a-8935-38733e587a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:22.322017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ee51-0ed7-4ac1-a3bf-53f927d3dc38 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:22.355215 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3069/6109] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:22.356916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bc44e-db17-4219-b3ab-0c4e8209d973 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:22.357246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bc44e-db17-4219-b3ab-0c4e8209d973 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:22.357657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bc44e-db17-4219-b3ab-0c4e8209d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:22.364205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:22.391030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-485bc44e-db17-4219-b3ab-0c4e8209d973 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:22.392339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-485bc44e-db17-4219-b3ab-0c4e8209d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:22.422179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3070/6110] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:22.422358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:22.422358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:22.422358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:22.422358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] PATH_INFO: `/v3/users/65edd9bb30f64154845b3cee11059eea` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:22.423963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=65edd9bb30f64154845b3cee11059eea)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:22.424082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bc44e-db17-4219-b3ab-0c4e8209d973 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:22.428396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:22.437953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bc44e-db17-4219-b3ab-0c4e8209d973 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:22.453377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:22.454165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:22.454446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:22.454720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:22.455919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:22.455919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:22.457591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:22.489144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3071/6111] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:26:22.490224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:22.512443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6677c6-f59f-49ad-aa19-e06096581f38 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:22.532400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:22.533102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:22.533384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:22.533658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:22.534355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:22.536267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:22.551518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65edd9bb30f64154845b3cee11059eea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.552322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65edd9bb30f64154845b3cee11059eea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.578973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65edd9bb30f64154845b3cee11059eea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.579737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65edd9bb30f64154845b3cee11059eea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.592127 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3072/6112] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:22 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:22.596854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65edd9bb30f64154845b3cee11059eea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:22.597069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:22.599265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:22.633461 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3041/6113] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:22 2022] DELETE /identity/v3/users/65edd9bb30f64154845b3cee11059eea => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:22.768280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ad4d9-130a-41ae-b24c-5599fde58c1e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:22.846223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:22.869778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:22.869778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:22.870385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:22.870676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:22.871393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:22.873656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:22.922914 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3073/6114] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:22 2022] POST /identity/v3/users => generated 285 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:22.927391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:22.955197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805f63-3a30-4292-813a-68230262bdbe admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:22.966115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:22.966911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:22.967307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:22.967588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:22.968755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:22.977137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:23.029742 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3042/6115] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:23.033534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:23.049997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372477a-dd42-4611-90ed-d290f20c511a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:23.062520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6c3c0-c882-4c18-b396-09f8c7bf95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:23.064656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6c3c0-c882-4c18-b396-09f8c7bf95b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.065564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6c3c0-c882-4c18-b396-09f8c7bf95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.065915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6c3c0-c882-4c18-b396-09f8c7bf95b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.068610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6c3c0-c882-4c18-b396-09f8c7bf95b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:23.072694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6c3c0-c882-4c18-b396-09f8c7bf95b9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:23.101379 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3074/6116] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:23.105304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:23.119223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c0b27-d71b-45a7-9a6e-b05e3213b363 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:23.131333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:23.132523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.132881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.133246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] PATH_INFO: `/v3/projects/b97bf39116c544219d6675f69283d253/users/98b675ef8e8b4df6beedab344ee9773d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.167370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97bf39116c544219d6675f69283d253, user_id=98b675ef8e8b4df6beedab344ee9773d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:23.176659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:23.218810 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3043/6117] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:23 2022] PUT /identity/v3/projects/b97bf39116c544219d6675f69283d253/users/98b675ef8e8b4df6beedab344ee9773d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:23.229818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8dd78-9249-4c99-b5f1-b18ff1bdf185 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.230741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8dd78-9249-4c99-b5f1-b18ff1bdf185 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.231201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8dd78-9249-4c99-b5f1-b18ff1bdf185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.282896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-31a8dd78-9249-4c99-b5f1-b18ff1bdf185 None None] MFA Rules not processed for user `98b675ef8e8b4df6beedab344ee9773d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:23.284658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-31a8dd78-9249-4c99-b5f1-b18ff1bdf185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:23.436741 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3075/6118] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:23.441673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:23.555361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd2080-0fd9-4cb0-98e2-e5b321cd2b49 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:23.561232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:23.563104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.563220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.563475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.564142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:23.566442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:23.593026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:23.605280 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3044/6119] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:23 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:23.606932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8dd78-9249-4c99-b5f1-b18ff1bdf185 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:23.619731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8dd78-9249-4c99-b5f1-b18ff1bdf185 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:23.651141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:23.655071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:23.759367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e33040-3583-4182-bd3b-bc7d44e6ff97 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:23.766101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:23.767012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.767335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.767624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] PATH_INFO: `/v3/users/04a60f11de2a4456857bfd41622192fa` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.769193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a60f11de2a4456857bfd41622192fa)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:23.772195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:23.790663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:23.791899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.816429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.816695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.819310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:23.835183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:23.869512 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3076/6120] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:23 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:23.877591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:23.880153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a60f11de2a4456857bfd41622192fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:23.882719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a60f11de2a4456857bfd41622192fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:23.895466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35488c98-112c-4d54-8782-d1ab25106b89 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:23.902677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:23.904063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.905412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.906258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.907887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:23.910792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:23.913520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a60f11de2a4456857bfd41622192fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:23.914878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a60f11de2a4456857bfd41622192fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:23.929838 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3077/6121] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:23.930698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde2e30-dfbf-4663-8137-a3deb95234d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a60f11de2a4456857bfd41622192fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:23.933944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:23.936644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:23.961350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00498dd5-e927-4151-824a-5afd0f4bf9ec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:23.971121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:23.972853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.973431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.973959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] PATH_INFO: `/v3/projects/87cba317541d459989cd85d12cd8a79f/users/c71a6a6d2b8f42fe85a734c5180be574/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.974941 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3045/6122] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:23 2022] DELETE /identity/v3/users/04a60f11de2a4456857bfd41622192fa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:23.981110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d9d5-0e83-4325-9871-1cd6aa01de4e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:23.981429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d9d5-0e83-4325-9871-1cd6aa01de4e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:23.981679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27d9d5-0e83-4325-9871-1cd6aa01de4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:23.998773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cba317541d459989cd85d12cd8a79f, user_id=c71a6a6d2b8f42fe85a734c5180be574, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:24.003562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:24.013274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1f27d9d5-0e83-4325-9871-1cd6aa01de4e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:24.014829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f27d9d5-0e83-4325-9871-1cd6aa01de4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:24.032778 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3078/6123] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:23 2022] PUT /identity/v3/projects/87cba317541d459989cd85d12cd8a79f/users/c71a6a6d2b8f42fe85a734c5180be574/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:24.036325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:24.055400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:24.127452 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3046/6124] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:24.159285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcfccd-41c8-4103-9337-6ad4092c76c8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:24.165080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6646b4-7324-4118-950d-d3e193d68b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:24.166322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6646b4-7324-4118-950d-d3e193d68b69 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:24.166794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6646b4-7324-4118-950d-d3e193d68b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:24.167363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6646b4-7324-4118-950d-d3e193d68b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:24.168426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6646b4-7324-4118-950d-d3e193d68b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:24.170625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6646b4-7324-4118-950d-d3e193d68b69 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:24.186631 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3079/6125] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:24.187807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27d9d5-0e83-4325-9871-1cd6aa01de4e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:24.200591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27d9d5-0e83-4325-9871-1cd6aa01de4e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:24.216809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:24.218280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:24.218571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:24.218856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] PATH_INFO: `/v3/projects/87cba317541d459989cd85d12cd8a79f/users/c71a6a6d2b8f42fe85a734c5180be574/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:24.227245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cba317541d459989cd85d12cd8a79f, user_id=c71a6a6d2b8f42fe85a734c5180be574, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:24.230278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:24.253147 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3047/6126] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:24 2022] PUT /identity/v3/projects/87cba317541d459989cd85d12cd8a79f/users/c71a6a6d2b8f42fe85a734c5180be574/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:24.261104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db2188-d015-431c-aeb8-ce2ca882f2d8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:24.261104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db2188-d015-431c-aeb8-ce2ca882f2d8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:24.261104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db2188-d015-431c-aeb8-ce2ca882f2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:24.300300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-37db2188-d015-431c-aeb8-ce2ca882f2d8 None None] MFA Rules not processed for user `c71a6a6d2b8f42fe85a734c5180be574`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:24.301794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37db2188-d015-431c-aeb8-ce2ca882f2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:24.408658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3080/6127] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:24.409018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:24.416666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:24.422916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75274d-172c-4725-a74b-de2e590725af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:24.430489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:24.431780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:24.432617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:24.433004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:24.433931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:24.436348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:24.484433 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3048/6128] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:26:24 2022] POST /identity/v3/projects => generated 329 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:24.488606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db2188-d015-431c-aeb8-ce2ca882f2d8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:24.505815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db2188-d015-431c-aeb8-ce2ca882f2d8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:24.546891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:24.549914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:24.603742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:24.604907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:24.605565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:24.606048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:24.607019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:24.609866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:24.650146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c05f74-ca9d-4b69-8ce9-9792386de4bc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:24.656310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:24.657355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:24.657696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:24.658057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] PATH_INFO: `/v3/projects/cc339fab679c43508a0424ebadb1b322` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:24.659573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc339fab679c43508a0424ebadb1b322)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:24.666110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:24.675386 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3081/6129] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:24 2022] POST /identity/v3/users => generated 416 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:24.677152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:24.679419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:24.755097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:24.778680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc339fab679c43508a0424ebadb1b322', 'request_id': 'req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:24.794317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc339fab679c43508a0424ebadb1b322', 'request_id': 'req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:24.815907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc339fab679c43508a0424ebadb1b322', 'request_id': 'req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:24.829571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7aee6-45ab-41bb-a332-12b6b36be5e4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:24.841656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] The token cache is being invalidate because project cc339fab679c43508a0424ebadb1b322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:24.841953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:24.843801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:24.848523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3049/6130] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:24 2022] DELETE /identity/v3/projects/cc339fab679c43508a0424ebadb1b322 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:24.849517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:24.855174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:24.987378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfa382-a01e-4f0d-94d6-273dd46f6290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:24.988601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfa382-a01e-4f0d-94d6-273dd46f6290 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:24.988601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfa382-a01e-4f0d-94d6-273dd46f6290 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:24.988920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfa382-a01e-4f0d-94d6-273dd46f6290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:24.992158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40bfa382-a01e-4f0d-94d6-273dd46f6290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:25.034946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f14da3-bc63-4c4c-855e-d6b0af505f8a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.046689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e297ca-a758-4718-9d8b-41429fc4eb6e tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.047703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e297ca-a758-4718-9d8b-41429fc4eb6e tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.050095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e297ca-a758-4718-9d8b-41429fc4eb6e tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.050320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e297ca-a758-4718-9d8b-41429fc4eb6e tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.052520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e297ca-a758-4718-9d8b-41429fc4eb6e tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.055383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e297ca-a758-4718-9d8b-41429fc4eb6e tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.091450 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3050/6131] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:24 2022] POST /identity/v3/roles => generated 243 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:25.093858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930030d-e648-4662-be63-417dbf72e218 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.094163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930030d-e648-4662-be63-417dbf72e218 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.095828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930030d-e648-4662-be63-417dbf72e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.129539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:25.147226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c930030d-e648-4662-be63-417dbf72e218 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:25.148200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c930030d-e648-4662-be63-417dbf72e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:25.167449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfa382-a01e-4f0d-94d6-273dd46f6290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.169853 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3051/6132] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:25.170709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930030d-e648-4662-be63-417dbf72e218 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.171240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfa382-a01e-4f0d-94d6-273dd46f6290 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.189764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930030d-e648-4662-be63-417dbf72e218 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.201197 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3082/6133] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:25.202576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef88a6-4258-4b73-8c18-840e28d62706 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.202972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef88a6-4258-4b73-8c18-840e28d62706 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.203272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef88a6-4258-4b73-8c18-840e28d62706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.206092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.207891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.209933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.210394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.211327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.213348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.246742 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3052/6134] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:25 2022] POST /identity/v3/roles => generated 247 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:25.254400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.267548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b0ef88a6-4258-4b73-8c18-840e28d62706 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:25.268765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b0ef88a6-4258-4b73-8c18-840e28d62706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:25.277009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acea1-dd73-4968-b420-f3ab3b1e118d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.287932 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3083/6135] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:25.292252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.293373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef88a6-4258-4b73-8c18-840e28d62706 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.295623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.295811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.296094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/bf0515d8266d4917a804c01ce75580f7/users/8bc17a37c4cb4ccd928cf736d5948195/roles/4df451033b9d4b9d98273b560377915f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.322800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef88a6-4258-4b73-8c18-840e28d62706 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.327596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.328280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.328607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.328938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.329712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:25.330188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.332152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.340577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bf0515d8266d4917a804c01ce75580f7, user_id=8bc17a37c4cb4ccd928cf736d5948195, role_id=4df451033b9d4b9d98273b560377915f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.343771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.347643 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3084/6136] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:25.352190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.366982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef499628-4be8-4e1f-a32c-77e5d11d9dbb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.367825 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3053/6137] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:25 2022] PUT /identity/v3/projects/bf0515d8266d4917a804c01ce75580f7/users/8bc17a37c4cb4ccd928cf736d5948195/roles/4df451033b9d4b9d98273b560377915f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:25.372413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.459545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.460565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.461890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.462446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.463664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.466565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.489499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:25.507447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c4d04-6164-4a14-a98f-25a713f5812a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.523870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.523870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.523870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.524190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/bf0515d8266d4917a804c01ce75580f7/users/8bc17a37c4cb4ccd928cf736d5948195/roles/16cdf3ffe20a4e20a62e48e9045b9583` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.527611 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3085/6138] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:25 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:25.530304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bf0515d8266d4917a804c01ce75580f7, user_id=8bc17a37c4cb4ccd928cf736d5948195, role_id=16cdf3ffe20a4e20a62e48e9045b9583)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.534249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.534407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.583749 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3054/6139] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:25 2022] PUT /identity/v3/projects/bf0515d8266d4917a804c01ce75580f7/users/8bc17a37c4cb4ccd928cf736d5948195/roles/16cdf3ffe20a4e20a62e48e9045b9583 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:25.591561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.751874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663d67-568b-4ab8-94b4-c64c800d349c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.808443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63fca-ca24-4960-a94c-a58ab2c5d10a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:25.815609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d26d78-6b70-4a37-b6b4-4ebf546c4848 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.817413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d26d78-6b70-4a37-b6b4-4ebf546c4848 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.817704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d26d78-6b70-4a37-b6b4-4ebf546c4848 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.817987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d26d78-6b70-4a37-b6b4-4ebf546c4848 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.818779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d26d78-6b70-4a37-b6b4-4ebf546c4848 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.820962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d26d78-6b70-4a37-b6b4-4ebf546c4848 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.872780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:25.875282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.875634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.876299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.878069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:25.880235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:25.893223 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3055/6140] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:25 2022] GET /identity/v3/users => generated 8055 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:25.899156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69440-0410-4c08-92d0-fb2b068a1a28 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:25.899624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69440-0410-4c08-92d0-fb2b068a1a28 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:25.900132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69440-0410-4c08-92d0-fb2b068a1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:25.926141 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3086/6141] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:25 2022] POST /identity/v3/users => generated 287 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:25.933823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:25.988243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0688ddb-3c21-4fdc-951f-418761bbbd09 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.017345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.020011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.020196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-63f69440-0410-4c08-92d0-fb2b068a1a28 None None] MFA Rules not processed for user `8bc17a37c4cb4ccd928cf736d5948195`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:26.020582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.022050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.023472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.023934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-63f69440-0410-4c08-92d0-fb2b068a1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:26.030578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.066605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3087/6142] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:25 2022] GET /identity/v3/roles => generated 1892 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:26.070756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.097773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ecdb3-3d30-4aa8-a505-3e3ee7ca3f39 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.124076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.124837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.125451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.125665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.126415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.129152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.149481 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3088/6143] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:26 2022] GET /identity/v3/roles => generated 1892 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:26.156030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:26.157857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.183447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e757e-4db4-4c57-a4ab-c575f82cfc5c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.189798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab567d9-7782-41c9-a069-451b5fa049f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.191459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab567d9-7782-41c9-a069-451b5fa049f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.191904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab567d9-7782-41c9-a069-451b5fa049f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.192387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab567d9-7782-41c9-a069-451b5fa049f0 admin admin] PATH_INFO: `/v3/projects/cf2944a444eb4571b1e4ff4666fa3e8f/users/5b4144d732fd40db813ef59f8aae4414/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.227520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab567d9-7782-41c9-a069-451b5fa049f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2944a444eb4571b1e4ff4666fa3e8f, user_id=5b4144d732fd40db813ef59f8aae4414, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.228041 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3056/6144] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:26.241173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f4c1-e161-4527-89d9-bfbee09c70fc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.241173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f4c1-e161-4527-89d9-bfbee09c70fc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.241173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397f4c1-e161-4527-89d9-bfbee09c70fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.245995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab567d9-7782-41c9-a069-451b5fa049f0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.268871 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3089/6145] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:26 2022] PUT /identity/v3/projects/cf2944a444eb4571b1e4ff4666fa3e8f/users/5b4144d732fd40db813ef59f8aae4414/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:26.282710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.283292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.283762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.305501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6397f4c1-e161-4527-89d9-bfbee09c70fc None None] MFA Rules not processed for user `8bc17a37c4cb4ccd928cf736d5948195`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:26.313766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6397f4c1-e161-4527-89d9-bfbee09c70fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:26.324743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] MFA Rules not processed for user `5b4144d732fd40db813ef59f8aae4414`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:26.326541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:26.365087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:26.430011 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3090/6146] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:26.439835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.442804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:26.448928 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3057/6147] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:26.450044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397f4c1-e161-4527-89d9-bfbee09c70fc None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.460954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397f4c1-e161-4527-89d9-bfbee09c70fc None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.466757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc17a37c4cb4ccd928cf736d5948195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf0515d8266d4917a804c01ce75580f7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2070092787', 'tempest-DelegatedRole-833566377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.467440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.467882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.468171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.469009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] RBAC: Authorizing `identity:create_trust()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.470833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.572768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b1af-7e44-4a76-8615-08d728ce168e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.578975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.579940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.580227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.580508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.604257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.606650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.622500 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3091/6148] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:26:26.640642 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3058/6149] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:26:26 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:26.642772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.774101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef70c5-1cb2-4994-b9c1-f793a8415323 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.775415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.784884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.788132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.788428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.788708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.789483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.793995 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:26:26.793995 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:26:26.793995 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:26:26.797026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.815755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3092/6150] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:26:26 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:26.821072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.842121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c342fb-deac-444c-a2d8-ffeb08a76afd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.852370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc17a37c4cb4ccd928cf736d5948195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf0515d8266d4917a804c01ce75580f7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2070092787', 'tempest-DelegatedRole-833566377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.855015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.856823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.857462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] PATH_INFO: `/v3/OS-TRUST/trusts/1d7c3c88fd364b359e3455d706b15701` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.876484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] RBAC: Authorizing `identity:delete_trust(trust_id=1d7c3c88fd364b359e3455d706b15701)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.880479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.906568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63e08e-c58c-44b7-b13b-8ca117b83407 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:26.920014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:26.923778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:26.924311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:26.924801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] PATH_INFO: `/v3/users/5b4144d732fd40db813ef59f8aae4414` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:26.929349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4144d732fd40db813ef59f8aae4414)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:26.931913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:26.943278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1d7c3c88fd364b359e3455d706b15701', 'request_id': 'req-d156872c-02b6-41f9-a780-90e1ab1150a2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:26.944704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1d7c3c88fd364b359e3455d706b15701', 'request_id': 'req-d156872c-02b6-41f9-a780-90e1ab1150a2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:26.946029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1d7c3c88fd364b359e3455d706b15701', 'request_id': 'req-d156872c-02b6-41f9-a780-90e1ab1150a2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:26.977216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:26.984210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3093/6151] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:26:26 2022] DELETE /identity/v3/OS-TRUST/trusts/1d7c3c88fd364b359e3455d706b15701 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:26.991628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:26.994774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:27.033143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156872c-02b6-41f9-a780-90e1ab1150a2 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:27.062770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc17a37c4cb4ccd928cf736d5948195', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf0515d8266d4917a804c01ce75580f7', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2070092787', 'tempest-DelegatedRole-833566377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:27.063879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:27.064463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:27.066814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] PATH_INFO: `/v3/OS-TRUST/trusts/1d7c3c88fd364b359e3455d706b15701` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:27.086862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4144d732fd40db813ef59f8aae4414'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.088448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4144d732fd40db813ef59f8aae4414'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.115922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4144d732fd40db813ef59f8aae4414'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.117420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4144d732fd40db813ef59f8aae4414'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Could not find trust: 1d7c3c88fd364b359e3455d706b15701.: keystone.exception.TrustNotFound: Could not find trust: 1d7c3c88fd364b359e3455d706b15701. Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 18 22:26:27.121918 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1d7c3c88fd364b359e3455d706b15701. Jun 18 22:26:27.123090 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:27.136830 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3094/6152] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:26 2022] GET /identity/v3/OS-TRUST/trusts/1d7c3c88fd364b359e3455d706b15701 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:27.137902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2478d92a-42ec-4044-9eb3-9302bddc8c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4144d732fd40db813ef59f8aae4414'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.143797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:27.161512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:27.166180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3059/6153] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:26 2022] DELETE /identity/v3/users/5b4144d732fd40db813ef59f8aae4414 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:27.171353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:27.174819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:27.175232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:27.216149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:27.228686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:27.232983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:27.233483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022a26e-923e-47f6-ad63-9943955812a6 tempest-TrustsV3TestJSON-1342231893 tempest-user-1438708813] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:27.357648 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3060/6154] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:27.373984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:27.375499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:27.375791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:27.377133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/16cdf3ffe20a4e20a62e48e9045b9583` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:27.378895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=16cdf3ffe20a4e20a62e48e9045b9583)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:27.380678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:27.412742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:27.426313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:27.455661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role 16cdf3ffe20a4e20a62e48e9045b9583 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:27.455971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.458818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.466998 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3095/6155] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:27 2022] DELETE /identity/v3/roles/16cdf3ffe20a4e20a62e48e9045b9583 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:27.471908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:27.480194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:27.535986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5de4be-ffaf-4305-8568-00e41b860f35 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:27.623462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f560e43-eee0-4b4d-a274-ba13fd2f714f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:27.630882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:27.634049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:27.634943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:27.635229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:27.635504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/4df451033b9d4b9d98273b560377915f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:27.646434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4df451033b9d4b9d98273b560377915f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:27.648363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:27.650261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:27.651998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:27.652396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:27.652790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:27.659721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:27.725820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role 4df451033b9d4b9d98273b560377915f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:27.726121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.735396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:27.735396 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3096/6156] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:27 2022] DELETE /identity/v3/roles/4df451033b9d4b9d98273b560377915f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:27.735965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:27.737324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:27.836742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:27.891815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:27.897387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:27.950354 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3061/6157] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:27.953793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:27.960767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad03aa-284d-47c8-908d-550581cae6b2 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:27.973833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:27.975202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:27.977195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:27.978577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] PATH_INFO: `/v3/users/98cf2ccdb6eb46e1924eff0bfdcb1483` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:27.981781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98cf2ccdb6eb46e1924eff0bfdcb1483)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:27.983124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a9315-1b3e-4a49-af95-bb465bfc55cb service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:27.985726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:28.108567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98cf2ccdb6eb46e1924eff0bfdcb1483'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.110162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98cf2ccdb6eb46e1924eff0bfdcb1483'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.134459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98cf2ccdb6eb46e1924eff0bfdcb1483'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.135922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98cf2ccdb6eb46e1924eff0bfdcb1483'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.138379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:28.139397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:28.139671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:28.139953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users/8bc17a37c4cb4ccd928cf736d5948195` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:28.141596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8bc17a37c4cb4ccd928cf736d5948195)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:28.144030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:28.145090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98cf2ccdb6eb46e1924eff0bfdcb1483'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.167985 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3097/6158] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:27 2022] DELETE /identity/v3/users/98cf2ccdb6eb46e1924eff0bfdcb1483 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:28.169367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:28.171080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:28.215498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc17a37c4cb4ccd928cf736d5948195'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.217213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc17a37c4cb4ccd928cf736d5948195'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.239759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc17a37c4cb4ccd928cf736d5948195'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.240928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc17a37c4cb4ccd928cf736d5948195'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.264123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0ba5986a-235e-4f5a-a85b-7ecd3db82d59 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc17a37c4cb4ccd928cf736d5948195'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.266441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780820ff-83fd-41f4-ad6a-e4ca46fec44f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:28.272964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:28.274119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:28.274507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:28.275222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] PATH_INFO: `/v3/projects/a29fe11a501a4392be8d6a602d663a1a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:28.277175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29fe11a501a4392be8d6a602d663a1a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:28.279121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:28.286973 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3062/6159] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:27 2022] DELETE /identity/v3/users/8bc17a37c4cb4ccd928cf736d5948195 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:28.289123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:28.289575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:28.290053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:28.318277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:28.320121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:28.334855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:28.376928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29fe11a501a4392be8d6a602d663a1a', 'request_id': 'req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.387358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29fe11a501a4392be8d6a602d663a1a', 'request_id': 'req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.395359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:28.405713 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3063/6160] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:28.409095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29fe11a501a4392be8d6a602d663a1a', 'request_id': 'req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.409798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:28.412786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:28.437974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] The token cache is being invalidate because project a29fe11a501a4392be8d6a602d663a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:28.438301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.439010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.444097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3098/6161] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:28 2022] DELETE /identity/v3/projects/a29fe11a501a4392be8d6a602d663a1a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:28.444097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:28.444097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:28.535911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c7a2e-b412-4e40-8668-065dee8b7100 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:28.537930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3ab0e-f47a-4f01-8041-9ff42efba19c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:28.544131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:28.544894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:28.545297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:28.545652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:28.547946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:28.685902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:28.689199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:28.690140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:28.692229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/bf0515d8266d4917a804c01ce75580f7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:28.695264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf0515d8266d4917a804c01ce75580f7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:28.697766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:28.723151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:28.724662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:28.748034 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3099/6162] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:28.749065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:28.751001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:28.768560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56c487-3a8c-4ba3-8d78-b9d3adf754e2 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:28.776565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:28.777989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:28.778281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:28.778612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] PATH_INFO: `/v3/users/8a050b20d635487c949a1af258636439` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:28.780047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a050b20d635487c949a1af258636439)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:28.782783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:28.824341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0515d8266d4917a804c01ce75580f7', 'request_id': 'req-0d3a6e98-a3f2-4171-8731-af37eceab952'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.854276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0515d8266d4917a804c01ce75580f7', 'request_id': 'req-0d3a6e98-a3f2-4171-8731-af37eceab952'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.878958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0515d8266d4917a804c01ce75580f7', 'request_id': 'req-0d3a6e98-a3f2-4171-8731-af37eceab952'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.883763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:28.890558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a050b20d635487c949a1af258636439'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.897783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a050b20d635487c949a1af258636439'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.908028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] The token cache is being invalidate because project bf0515d8266d4917a804c01ce75580f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:28.908877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.911939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.914926 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3064/6163] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:28 2022] DELETE /identity/v3/projects/bf0515d8266d4917a804c01ce75580f7 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:28.921171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:28.923354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:28.927593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a050b20d635487c949a1af258636439'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.929845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a050b20d635487c949a1af258636439'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.952208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a050b20d635487c949a1af258636439'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:28.993693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3100/6164] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:28 2022] DELETE /identity/v3/users/8a050b20d635487c949a1af258636439 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:29.100047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a6e98-a3f2-4171-8731-af37eceab952 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:29.209762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:29.212110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:29.212409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:29.213811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:29.214888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:29.219555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:29.272124 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3065/6165] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:26:28 2022] POST /identity/v3/projects => generated 329 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:29.273070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:29.275436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:29.289854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:29.296207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:29.297348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb496-60aa-4823-bd7e-070f9184104c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:29.307361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:29.497868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:29.498617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:29.498860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:29.499140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:29.500024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:29.502253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:29.537468 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3101/6166] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:29 2022] POST /identity/v3/users => generated 416 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:29.538405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:29.540996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fc782-8f05-488b-ae84-99bca6c2c262 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:29.547812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:29.549010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:29.549242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:29.549928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] PATH_INFO: `/v3/projects/cf2944a444eb4571b1e4ff4666fa3e8f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:29.550178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:29.551192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2944a444eb4571b1e4ff4666fa3e8f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:29.553732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:29.575544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df165-3bfd-4ada-b528-5509bde0f4b5 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:29.582661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:29.583775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:29.584128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:29.584472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] PATH_INFO: `/v3/projects/6d185d9006174eae89b8abdede1c5d7a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:29.587912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d185d9006174eae89b8abdede1c5d7a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:29.589639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:29.619530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:29.668432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2944a444eb4571b1e4ff4666fa3e8f', 'request_id': 'req-a32e33c1-263c-465e-aa44-e94b7c23a211'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.680854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2944a444eb4571b1e4ff4666fa3e8f', 'request_id': 'req-a32e33c1-263c-465e-aa44-e94b7c23a211'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.694553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2944a444eb4571b1e4ff4666fa3e8f', 'request_id': 'req-a32e33c1-263c-465e-aa44-e94b7c23a211'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.715865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] The token cache is being invalidate because project cf2944a444eb4571b1e4ff4666fa3e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:29.719007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.720591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d185d9006174eae89b8abdede1c5d7a', 'request_id': 'req-4001ac8d-4024-472d-b06a-4015a3c47156'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.723166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.732845 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3066/6167] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:29 2022] DELETE /identity/v3/projects/cf2944a444eb4571b1e4ff4666fa3e8f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:29.734274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:29.737710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:29.742613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d185d9006174eae89b8abdede1c5d7a', 'request_id': 'req-4001ac8d-4024-472d-b06a-4015a3c47156'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.771123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d185d9006174eae89b8abdede1c5d7a', 'request_id': 'req-4001ac8d-4024-472d-b06a-4015a3c47156'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.814803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] The token cache is being invalidate because project 6d185d9006174eae89b8abdede1c5d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:29.816989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.817489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4001ac8d-4024-472d-b06a-4015a3c47156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:29.825712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3102/6168] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:29 2022] DELETE /identity/v3/projects/6d185d9006174eae89b8abdede1c5d7a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:29.830503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabaa3-0a86-44b2-b74c-f9bc6cdf676b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:29.830795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabaa3-0a86-44b2-b74c-f9bc6cdf676b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:29.831076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabaa3-0a86-44b2-b74c-f9bc6cdf676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:29.884348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c6dabaa3-0a86-44b2-b74c-f9bc6cdf676b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:29.885810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c6dabaa3-0a86-44b2-b74c-f9bc6cdf676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.007290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e33c1-263c-465e-aa44-e94b7c23a211 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:30.032434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3103/6169] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:30.035017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.039573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.039875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.068412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:30.069898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.082954 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3104/6170] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:30.084877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:30.090764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.127778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb42d-ddfa-4b92-8c7a-78a568dcd7c1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:30.141886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:30.142967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.143276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.143926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] PATH_INFO: `/v3/projects/25b6f058f4204d0c9878a7206e02a8cd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.145301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b6f058f4204d0c9878a7206e02a8cd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:30.147372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:30.157242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:30.177821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb7c78-5b91-4c72-8cd5-f7d69149fc30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:30.178524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7c78-5b91-4c72-8cd5-f7d69149fc30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.181553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7c78-5b91-4c72-8cd5-f7d69149fc30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.182102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb7c78-5b91-4c72-8cd5-f7d69149fc30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.184245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7c78-5b91-4c72-8cd5-f7d69149fc30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:30.186195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb7c78-5b91-4c72-8cd5-f7d69149fc30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:30.216634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b6f058f4204d0c9878a7206e02a8cd', 'request_id': 'req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:30.224061 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3067/6171] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:29 2022] POST /identity/v3/roles => generated 243 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:30.225405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b6f058f4204d0c9878a7206e02a8cd', 'request_id': 'req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:30.225581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a42d-2c7a-403c-8d5e-8ef96c652b06 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.225809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a42d-2c7a-403c-8d5e-8ef96c652b06 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.226086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a42d-2c7a-403c-8d5e-8ef96c652b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.239059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b6f058f4204d0c9878a7206e02a8cd', 'request_id': 'req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:30.261006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] The token cache is being invalidate because project 25b6f058f4204d0c9878a7206e02a8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:30.262279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:30.263200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f274bb42-444b-4a7f-bc1d-f3d5408e5d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:30.266062 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3105/6172] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:30 2022] DELETE /identity/v3/projects/25b6f058f4204d0c9878a7206e02a8cd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:30.267903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.268307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.268684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.290815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0668a42d-2c7a-403c-8d5e-8ef96c652b06 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:30.292345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0668a42d-2c7a-403c-8d5e-8ef96c652b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.304424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:30.307274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.407194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:30.423446 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3106/6173] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:30.424861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:30.427238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.443719 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3068/6174] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:30.445414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715a20-7abb-4271-a7f0-c7c14e55b3d0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.445703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715a20-7abb-4271-a7f0-c7c14e55b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.446023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715a20-7abb-4271-a7f0-c7c14e55b3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.501296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1d715a20-7abb-4271-a7f0-c7c14e55b3d0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:30.502571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1d715a20-7abb-4271-a7f0-c7c14e55b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.527081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3069/6175] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:30.530022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715a20-7abb-4271-a7f0-c7c14e55b3d0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:30.557811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715a20-7abb-4271-a7f0-c7c14e55b3d0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:30.574758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:30.575720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.580190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.580619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.582713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:30.583749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:30.587184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:30.601945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3e746-4585-42c9-93eb-68b931b0326c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:30.612076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41f63c-dded-4c4e-938d-d0e19667e93c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:30.613768 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3070/6176] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:30.616555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:30.618143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f63c-dded-4c4e-938d-d0e19667e93c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.618449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f63c-dded-4c4e-938d-d0e19667e93c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.618737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f63c-dded-4c4e-938d-d0e19667e93c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.619929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41f63c-dded-4c4e-938d-d0e19667e93c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:30.625730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41f63c-dded-4c4e-938d-d0e19667e93c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:30.647039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3964c-d9e8-44c3-b3e8-78b7dbb4e3a3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:30.658718 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3107/6177] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/roles => generated 247 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:30.661956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6b35-675e-43d2-9021-080a99eade82 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.662648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6b35-675e-43d2-9021-080a99eade82 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.663136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6b35-675e-43d2-9021-080a99eade82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.666328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:30.669683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.671074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.671828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.674787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:30.675366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:30.679549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:30.714702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6cac6b35-675e-43d2-9021-080a99eade82 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:30.716405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6cac6b35-675e-43d2-9021-080a99eade82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:30.723328 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3071/6178] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:30.726131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:30.738834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8fc8e-8107-479a-9504-352f49ee003f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:30.742426 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3108/6179] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:30.743766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6b35-675e-43d2-9021-080a99eade82 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:30.755601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:30.756249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.756533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.756955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.757696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:30.760945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6b35-675e-43d2-9021-080a99eade82 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:30.762584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:30.771026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:30.772115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:30.772403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:30.772715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/ba115b037ce640b18c5984fb127fed3a/users/416e0af632684b30b8f64a01500fe479/roles/e6e617220bd44a4bb0ef42545a3ef86d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:30.806414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ba115b037ce640b18c5984fb127fed3a, user_id=416e0af632684b30b8f64a01500fe479, role_id=e6e617220bd44a4bb0ef42545a3ef86d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:30.816143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:30.825408 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3072/6180] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:30.826412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:30.842253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:30.861851 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3109/6181] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:30 2022] PUT /identity/v3/projects/ba115b037ce640b18c5984fb127fed3a/users/416e0af632684b30b8f64a01500fe479/roles/e6e617220bd44a4bb0ef42545a3ef86d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:30.861851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.036365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf5da-f7a0-4874-9006-047749759234 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.048743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb25ac4-9f11-4d23-bcc8-21fb44e5c223 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.049644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.050795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.050795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.051087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.051776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:31.052061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.058408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.071528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.072957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.075476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.076931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.077904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.089723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.093145 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3110/6182] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:31.096256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.123975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad8b12-b397-45e2-b1a3-7d9cf81e13b7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.136317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.137601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.138121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.138527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.139948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.143199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.191890 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3073/6183] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:30 2022] POST /identity/v3/projects => generated 361 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:31.192904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.198266 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3111/6184] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:31 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:31.199399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.223636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d71aa4-d4a7-4aac-8ef4-9ba1df13d7b6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.318618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb038-9fbd-423a-b08b-86425aa9eb70 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.329492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.333414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.333978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.334500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/ba115b037ce640b18c5984fb127fed3a/users/416e0af632684b30b8f64a01500fe479/roles/ead6f76dde30496da586291cfca0268c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.338363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ba115b037ce640b18c5984fb127fed3a, user_id=416e0af632684b30b8f64a01500fe479, role_id=ead6f76dde30496da586291cfca0268c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.341878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.362321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.363628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.364281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.364558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.365774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.368896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.386890 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3074/6185] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:31 2022] PUT /identity/v3/projects/ba115b037ce640b18c5984fb127fed3a/users/416e0af632684b30b8f64a01500fe479/roles/ead6f76dde30496da586291cfca0268c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:31.388083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.429111 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3112/6186] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:31 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:31.430791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.455163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:31.522637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384443b6-4b04-4da0-bbbe-46799ebc9264 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.529053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.530469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.531228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.532331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.532867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.534711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.537624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431639a-21b5-42a7-a7ff-ef3c306fc90f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.538192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:31.546627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.548034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.549119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.549442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.550468 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3113/6187] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:31 2022] GET /identity/v3/roles => generated 1892 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:31.550614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.553625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.554983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.593305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3075/6188] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:31 2022] POST /identity/v3/users => generated 281 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:31.594476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.614900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6420ad-09ee-4c1f-83cc-ec947ca40210 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.622468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.623158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.623437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.623716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.624474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.628121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.662968 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3076/6189] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:31 2022] POST /identity/v3/users => generated 289 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:31.663672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.685147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a8189-7b5f-4489-a432-bb76358a07e9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.697883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.699041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.699467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.699853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.710480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.710769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a7d24-f6df-426c-a846-41a1fc3902cf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.721753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.721900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.721900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.721900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.722190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.722190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.726556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.757284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3077/6190] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:31 2022] GET /identity/v3/roles => generated 1892 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:31.758709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.788056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0b948-385e-4418-88b0-637e9cb9fa30 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.808395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.809827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.810360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.810603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.811499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.817368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.822822 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3114/6191] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:31 2022] GET /identity/v3/users => generated 8341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:31.824191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.843689 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3078/6192] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:31 2022] GET /identity/v3/roles => generated 1892 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:31.845506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.847975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981199c-96d2-4474-a131-d9dffc0002a3 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.857957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527c0e8-869d-4e1c-86c2-9225094b4d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.858755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527c0e8-869d-4e1c-86c2-9225094b4d73 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.859117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527c0e8-869d-4e1c-86c2-9225094b4d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.859713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527c0e8-869d-4e1c-86c2-9225094b4d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.860836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527c0e8-869d-4e1c-86c2-9225094b4d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.863360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527c0e8-869d-4e1c-86c2-9225094b4d73 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.869630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb1517-80ab-429f-a380-dc7da762b75f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:31.882650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:31.887287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.887569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.887991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] PATH_INFO: `/v3/projects/6e45658c8c6f4db290a602cbc1ff8417/users/68a69078d083449e9a1d0a54ff02e6ba/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.889458 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3115/6193] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:31 2022] GET /identity/v3/roles => generated 1892 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:31.894340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbff9-9c28-422a-8b29-70b3f94e7363 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:31.894340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbff9-9c28-422a-8b29-70b3f94e7363 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:31.894704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcbff9-9c28-422a-8b29-70b3f94e7363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:31.918836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e45658c8c6f4db290a602cbc1ff8417, user_id=68a69078d083449e9a1d0a54ff02e6ba, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:31.922333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:31.943865 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3079/6194] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:31 2022] PUT /identity/v3/projects/6e45658c8c6f4db290a602cbc1ff8417/users/68a69078d083449e9a1d0a54ff02e6ba/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:31.943865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:31.960793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-65dcbff9-9c28-422a-8b29-70b3f94e7363 None None] MFA Rules not processed for user `416e0af632684b30b8f64a01500fe479`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:31.963145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-65dcbff9-9c28-422a-8b29-70b3f94e7363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.054497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a8e6-734f-41e3-89fb-56a2ea05e765 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.057880 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3116/6195] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:32.058771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcbff9-9c28-422a-8b29-70b3f94e7363 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.069059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba07a7-06ba-4b59-afa3-415732db07e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.070144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba07a7-06ba-4b59-afa3-415732db07e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.070410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba07a7-06ba-4b59-afa3-415732db07e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.070744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba07a7-06ba-4b59-afa3-415732db07e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.072138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba07a7-06ba-4b59-afa3-415732db07e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.073637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba07a7-06ba-4b59-afa3-415732db07e8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.080875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcbff9-9c28-422a-8b29-70b3f94e7363 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.087074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c075ef1-4608-416f-8d88-a0a722764c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.088003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c075ef1-4608-416f-8d88-a0a722764c8e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.088308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c075ef1-4608-416f-8d88-a0a722764c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.088613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c075ef1-4608-416f-8d88-a0a722764c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.089552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c075ef1-4608-416f-8d88-a0a722764c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.090913 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3080/6196] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:31 2022] GET /identity/v3/roles => generated 1892 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:32.091642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c075ef1-4608-416f-8d88-a0a722764c8e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.092415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744cb90-8fb7-4b6e-8853-ed6f58b877bd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.092700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744cb90-8fb7-4b6e-8853-ed6f58b877bd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.092980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744cb90-8fb7-4b6e-8853-ed6f58b877bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.109090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3117/6197] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:32 2022] GET /identity/v3/roles => generated 1892 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:32.111490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540d0a-9837-4f25-a94c-cc1efb16b2fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.112333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540d0a-9837-4f25-a94c-cc1efb16b2fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.112705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540d0a-9837-4f25-a94c-cc1efb16b2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.113223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7744cb90-8fb7-4b6e-8853-ed6f58b877bd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:32.114634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7744cb90-8fb7-4b6e-8853-ed6f58b877bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.123393 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3081/6198] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:32.126831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744cb90-8fb7-4b6e-8853-ed6f58b877bd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.133804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e1540d0a-9837-4f25-a94c-cc1efb16b2fd None None] MFA Rules not processed for user `416e0af632684b30b8f64a01500fe479`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:32.135386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e1540d0a-9837-4f25-a94c-cc1efb16b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.136649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744cb90-8fb7-4b6e-8853-ed6f58b877bd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.141473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.142437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.142800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.143158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] PATH_INFO: `/v3/projects/6e3ea6f5f50342e3ba194df27ccf6c6a/users/c540b92ffe2349ae8233afbe0290b854/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.143737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3118/6199] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:32.144553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540d0a-9837-4f25-a94c-cc1efb16b2fd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.163464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540d0a-9837-4f25-a94c-cc1efb16b2fd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.163749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3ea6f5f50342e3ba194df27ccf6c6a, user_id=c540b92ffe2349ae8233afbe0290b854, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.166704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.168424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.169450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.169911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.170191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] PATH_INFO: `/v3/projects/58240accc193488fafd486b2bfc19064/users/2528ddd1080546b89e299d23701a8520/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.184054 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3082/6200] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:32 2022] PUT /identity/v3/projects/6e3ea6f5f50342e3ba194df27ccf6c6a/users/c540b92ffe2349ae8233afbe0290b854/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:32.185449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.195557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.198150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58240accc193488fafd486b2bfc19064, user_id=2528ddd1080546b89e299d23701a8520, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.200927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.218656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:32.221646 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3119/6201] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:32 2022] PUT /identity/v3/projects/58240accc193488fafd486b2bfc19064/users/2528ddd1080546b89e299d23701a8520/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:32.222321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.256694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:32.301019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5f74-808c-45c8-86d7-990ea499989f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.339100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786e77a-2beb-4d31-ba14-8cf9edca03c5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.344725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23500da-9332-4f25-8e64-ce08c9e3e0c8 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e0af632684b30b8f64a01500fe479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba115b037ce640b18c5984fb127fed3a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-761210437', 'tempest-NotDelegatedRole-1446309868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.345901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23500da-9332-4f25-8e64-ce08c9e3e0c8 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.346184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23500da-9332-4f25-8e64-ce08c9e3e0c8 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.346467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23500da-9332-4f25-8e64-ce08c9e3e0c8 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.347519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23500da-9332-4f25-8e64-ce08c9e3e0c8 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: Authorizing `identity:create_trust()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.348696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23500da-9332-4f25-8e64-ce08c9e3e0c8 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.360359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f93337-8b8f-480f-87fc-45491d99e054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.361057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f93337-8b8f-480f-87fc-45491d99e054 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.361351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f93337-8b8f-480f-87fc-45491d99e054 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.361792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f93337-8b8f-480f-87fc-45491d99e054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.458745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f93337-8b8f-480f-87fc-45491d99e054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.462771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f93337-8b8f-480f-87fc-45491d99e054 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.474114 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3120/6202] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:26:32 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:32.475303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791180d-4565-450c-8dda-122db871f3ef None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.475597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791180d-4565-450c-8dda-122db871f3ef None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.475910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791180d-4565-450c-8dda-122db871f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.482297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3083/6203] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:32.483539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97774a-94b7-43a6-a658-fc1d5ce8fefa None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.483827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97774a-94b7-43a6-a658-fc1d5ce8fefa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.484105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97774a-94b7-43a6-a658-fc1d5ce8fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.518387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7f97774a-94b7-43a6-a658-fc1d5ce8fefa None None] MFA Rules not processed for user `2528ddd1080546b89e299d23701a8520`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:32.519848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7f97774a-94b7-43a6-a658-fc1d5ce8fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.520010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d791180d-4565-450c-8dda-122db871f3ef None None] MFA Rules not processed for user `c540b92ffe2349ae8233afbe0290b854`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:32.522071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d791180d-4565-450c-8dda-122db871f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.639190 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3084/6204] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:32.639190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97774a-94b7-43a6-a658-fc1d5ce8fefa None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.652342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97774a-94b7-43a6-a658-fc1d5ce8fefa None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.656820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e0af632684b30b8f64a01500fe479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba115b037ce640b18c5984fb127fed3a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-761210437', 'tempest-NotDelegatedRole-1446309868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.657522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.657805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.658079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.658853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.660221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.669314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:32.671470 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3085/6205] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Jun 18 22:26:32 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=416e0af632684b30b8f64a01500fe479 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:32.672633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.675310 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3121/6206] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:32.676389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791180d-4565-450c-8dda-122db871f3ef None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.689683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791180d-4565-450c-8dda-122db871f3ef None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.693777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7945-f529-4669-8d6e-a6b2b327f964 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.698844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e0af632684b30b8f64a01500fe479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba115b037ce640b18c5984fb127fed3a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-761210437', 'tempest-NotDelegatedRole-1446309868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.699817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.700265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.700727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] PATH_INFO: `/v3/OS-TRUST/trusts/b7f1ceb87406406487f974014f883a25` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.702680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.704016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.704306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.704582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.705372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.708234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.709507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: Authorizing `identity:delete_trust(trust_id=b7f1ceb87406406487f974014f883a25)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.711680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.738286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b7f1ceb87406406487f974014f883a25', 'request_id': 'req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.739200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b7f1ceb87406406487f974014f883a25', 'request_id': 'req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.740237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b7f1ceb87406406487f974014f883a25', 'request_id': 'req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.748925 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3086/6207] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:32 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:32.749932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.753768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.760867 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3122/6208] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:26:32 2022] DELETE /identity/v3/OS-TRUST/trusts/b7f1ceb87406406487f974014f883a25 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:32.762207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.763858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.781391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d4b8-795f-4f0f-88c3-b1a70cdb12af tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.795775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:32.844960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cbcc0-5014-43ef-bf8e-75b82b46981a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:32.851093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.852232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.852815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.853412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] PATH_INFO: `/v3/users/c540b92ffe2349ae8233afbe0290b854` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.855359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c540b92ffe2349ae8233afbe0290b854)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.857384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.859271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:32.860113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:32.860488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:32.860828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:32.861635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:32.863631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:32.914478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3123/6209] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:32 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:32.919376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:32.921308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:32.955483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c540b92ffe2349ae8233afbe0290b854'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.956268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c540b92ffe2349ae8233afbe0290b854'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.973310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c540b92ffe2349ae8233afbe0290b854'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.974153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c540b92ffe2349ae8233afbe0290b854'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.982196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c540b92ffe2349ae8233afbe0290b854'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:32.997692 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3087/6210] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:32 2022] DELETE /identity/v3/users/c540b92ffe2349ae8233afbe0290b854 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:32.998897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.000584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d63c3c-e112-4cee-84e8-8f104cb07d57 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.001272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.069363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d9c60-9fa2-4e52-861a-e46fcb1816f1 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416e0af632684b30b8f64a01500fe479', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba115b037ce640b18c5984fb127fed3a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-761210437', 'tempest-NotDelegatedRole-1446309868'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.070348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d9c60-9fa2-4e52-861a-e46fcb1816f1 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.070717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d9c60-9fa2-4e52-861a-e46fcb1816f1 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.071069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d9c60-9fa2-4e52-861a-e46fcb1816f1 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] PATH_INFO: `/v3/OS-TRUST/trusts/b7f1ceb87406406487f974014f883a25` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-1b2d9c60-9fa2-4e52-861a-e46fcb1816f1 tempest-TrustsV3TestJSON-2008994966 tempest-user-1741889590] Could not find trust: b7f1ceb87406406487f974014f883a25.: keystone.exception.TrustNotFound: Could not find trust: b7f1ceb87406406487f974014f883a25. Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 18 22:26:33.085005 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b7f1ceb87406406487f974014f883a25. Jun 18 22:26:33.086487 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:33.087959 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3124/6211] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:32 2022] GET /identity/v3/OS-TRUST/trusts/b7f1ceb87406406487f974014f883a25 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:33.087959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.088158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.088426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.091577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:33.100559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f9dff-dae5-4029-b955-0e89ed806595 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.109747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:33.110550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.111848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.113562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.114207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.115502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.117631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.120044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.121423 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3125/6212] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:33.126470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.128152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.145721 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3088/6213] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:32 2022] GET /identity/v3/roles => generated 1892 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:33.147531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.164684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72864df2-6bc6-4205-b907-deb61fbd1a4b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.171859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.173316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.173600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.173877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.174881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.177651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.195689 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3089/6214] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:33 2022] GET /identity/v3/roles => generated 1892 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:33.197204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.199189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.211160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:33.236846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cac4f-f662-4bb8-832f-c6e75cf56c4e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.242636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.243535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.243891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.244175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/ead6f76dde30496da586291cfca0268c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.245754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ead6f76dde30496da586291cfca0268c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.247508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.309537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4478-2d2f-413c-9884-2d658a763987 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.314461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.315714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.316535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.316896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.322425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role ead6f76dde30496da586291cfca0268c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:33.322743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.327026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.330680 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3126/6215] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:33 2022] DELETE /identity/v3/roles/ead6f76dde30496da586291cfca0268c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:33.331558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.334055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.349175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.350861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.366750 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3090/6216] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:33.367517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.386830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863b5ba-3a87-40db-a877-6f110cfce603 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.466757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4a2-28d1-4e9e-be90-485c18f371f4 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.476973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05e7b-90e4-4c86-9eda-174e35e1c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.477933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05e7b-90e4-4c86-9eda-174e35e1c4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.478206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05e7b-90e4-4c86-9eda-174e35e1c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.478561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05e7b-90e4-4c86-9eda-174e35e1c4e7 admin admin] PATH_INFO: `/v3/projects/0e1744b85d784448a3d08b176bbf2d60/users/d7772291b6844fa6b99fc2afa9173a65/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.484084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.485911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.486479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.487103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/e6e617220bd44a4bb0ef42545a3ef86d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.490285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e6e617220bd44a4bb0ef42545a3ef86d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.495260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.516739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05e7b-90e4-4c86-9eda-174e35e1c4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1744b85d784448a3d08b176bbf2d60, user_id=d7772291b6844fa6b99fc2afa9173a65, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.521124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05e7b-90e4-4c86-9eda-174e35e1c4e7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.554039 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3127/6217] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:33 2022] PUT /identity/v3/projects/0e1744b85d784448a3d08b176bbf2d60/users/d7772291b6844fa6b99fc2afa9173a65/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:33.558937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.560667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.561674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.583738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role e6e617220bd44a4bb0ef42545a3ef86d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:33.584537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.585782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.595079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3091/6218] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:33 2022] DELETE /identity/v3/roles/e6e617220bd44a4bb0ef42545a3ef86d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:33.597711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.599668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.619399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] MFA Rules not processed for user `d7772291b6844fa6b99fc2afa9173a65`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:33.621013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.695438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:33.758586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c833b39-aa2c-46e3-80ca-d25ea2c58955 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.768669 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3128/6219] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:33.769720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:33.774695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:33.792426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.796467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.797453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.797733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users/416e0af632684b30b8f64a01500fe479` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.802305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_user(user_id=416e0af632684b30b8f64a01500fe479)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.804280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.860936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:33.918766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416e0af632684b30b8f64a01500fe479'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.920821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416e0af632684b30b8f64a01500fe479'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.927722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f6608-7565-4c82-92f6-8861cf4f592c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:33.942581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc65cdc-d9ae-4340-9f82-134d43fad997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:33.943278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65cdc-d9ae-4340-9f82-134d43fad997 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.943561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65cdc-d9ae-4340-9f82-134d43fad997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.943840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65cdc-d9ae-4340-9f82-134d43fad997 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:33.945281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc65cdc-d9ae-4340-9f82-134d43fad997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:33.947299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc65cdc-d9ae-4340-9f82-134d43fad997 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:33.953667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416e0af632684b30b8f64a01500fe479'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.954480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416e0af632684b30b8f64a01500fe479'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.975571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416e0af632684b30b8f64a01500fe479'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:33.995750 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3129/6220] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:33 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:33.997332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:33.999178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:33.999536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.000482 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3092/6221] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:33 2022] DELETE /identity/v3/users/416e0af632684b30b8f64a01500fe479 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:34.015698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.022357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.034322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] MFA Rules not processed for user `68a69078d083449e9a1d0a54ff02e6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:34.035620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.143785 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3130/6222] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:34.143785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.143785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.174191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b9ae-2317-4d7d-83a0-4745cacb2f72 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.181810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.182712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.182987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.183282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.183970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.185972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.215586 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3093/6223] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:34 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:34.218413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.220677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.236611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626e9b4-3186-43c5-a7fa-8e1fa5a9d304 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.238238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c30d97-7af2-482a-92c9-fed4ac079124 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.243558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.245115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.245740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.245740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/ba115b037ce640b18c5984fb127fed3a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.247797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba115b037ce640b18c5984fb127fed3a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.250293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.251479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.251768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.252053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.252773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.254780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.258370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.289514 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3094/6224] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:34 2022] POST /identity/v3/projects => generated 403 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:34.290385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.332100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:34.335839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba115b037ce640b18c5984fb127fed3a', 'request_id': 'req-9d6c367f-5798-45f2-8b52-a941ed587aeb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.344103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:34.344610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba115b037ce640b18c5984fb127fed3a', 'request_id': 'req-9d6c367f-5798-45f2-8b52-a941ed587aeb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.358445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba115b037ce640b18c5984fb127fed3a', 'request_id': 'req-9d6c367f-5798-45f2-8b52-a941ed587aeb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.372633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] The token cache is being invalidate because project ba115b037ce640b18c5984fb127fed3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:34.373396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b9a48-f07f-421d-bd5e-1614432221db admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.373870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.374552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.377152 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3131/6225] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:34 2022] DELETE /identity/v3/projects/ba115b037ce640b18c5984fb127fed3a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:34.377731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.382734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.449716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.450486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.450835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.451172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.451978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.453834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.465850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3095/6226] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:34.467019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.468915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.479692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c367f-5798-45f2-8b52-a941ed587aeb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.485986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d1893-fad6-4c17-80b9-f88292819475 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.486206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.487002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.487283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.487557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] PATH_INFO: `/v3/projects/6e3ea6f5f50342e3ba194df27ccf6c6a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.488845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3ea6f5f50342e3ba194df27ccf6c6a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.492304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.492658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.493484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.494001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.494373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.495575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.498426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.547173 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3096/6227] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:34 2022] POST /identity/v3/users => generated 308 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:34.547173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.551448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.555605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3ea6f5f50342e3ba194df27ccf6c6a', 'request_id': 'req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.564563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3ea6f5f50342e3ba194df27ccf6c6a', 'request_id': 'req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.579154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3ea6f5f50342e3ba194df27ccf6c6a', 'request_id': 'req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.594741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] The token cache is being invalidate because project 6e3ea6f5f50342e3ba194df27ccf6c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:34.595036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.595908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:34.598172 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3132/6228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:34 2022] DELETE /identity/v3/projects/6e3ea6f5f50342e3ba194df27ccf6c6a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:34.599541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.601349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.643573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7b91-ad39-49c6-a75e-32141d67fd74 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.695495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb9db5-9994-4f1a-abc3-01592d78c4e3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.705748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.707027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.707309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.707593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] PATH_INFO: `/v3/projects/a98aecfa57fe43edb1b855cb0c732ffe/users/065938aa10e04d4f922fc12f804cd5d1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.721408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:34.737483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695d9d4-913b-42ed-89ba-797db3b7e7c8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.738595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695d9d4-913b-42ed-89ba-797db3b7e7c8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.738786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98aecfa57fe43edb1b855cb0c732ffe, user_id=065938aa10e04d4f922fc12f804cd5d1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.738946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695d9d4-913b-42ed-89ba-797db3b7e7c8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.739165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695d9d4-913b-42ed-89ba-797db3b7e7c8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.739995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695d9d4-913b-42ed-89ba-797db3b7e7c8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.742492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695d9d4-913b-42ed-89ba-797db3b7e7c8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.742658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.761704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:34.766002 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3133/6229] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:34 2022] PUT /identity/v3/projects/a98aecfa57fe43edb1b855cb0c732ffe/users/065938aa10e04d4f922fc12f804cd5d1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:34.766935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.771844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.790042 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3097/6230] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:26:34 2022] POST /identity/v3/projects => generated 329 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:34.792873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a101b0-474a-40dc-be76-968ada44796c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.795511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a101b0-474a-40dc-be76-968ada44796c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.795864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a101b0-474a-40dc-be76-968ada44796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.822266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f2a101b0-474a-40dc-be76-968ada44796c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:34.823821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f2a101b0-474a-40dc-be76-968ada44796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:34.891661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eddacc-b83d-4277-b515-b83c68d69c67 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.931453 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3098/6231] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:34.932618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a101b0-474a-40dc-be76-968ada44796c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.945159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a101b0-474a-40dc-be76-968ada44796c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:34.951502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:34.952642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:34.952925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:34.954010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:34.955031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:34.957646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:34.975009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3099/6232] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:34.975009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:34.975355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:35.009872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb2aac-050e-49fe-bb3c-13f5a8977fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.010668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb2aac-050e-49fe-bb3c-13f5a8977fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.010990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb2aac-050e-49fe-bb3c-13f5a8977fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.011410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb2aac-050e-49fe-bb3c-13f5a8977fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.012067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb2aac-050e-49fe-bb3c-13f5a8977fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.014407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb2aac-050e-49fe-bb3c-13f5a8977fd4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.027149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3134/6233] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:35.028444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca807b-7820-4a47-937a-89cf9be1bfbc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.028728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca807b-7820-4a47-937a-89cf9be1bfbc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.029006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca807b-7820-4a47-937a-89cf9be1bfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.049658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b7ca807b-7820-4a47-937a-89cf9be1bfbc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:35.050876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b7ca807b-7820-4a47-937a-89cf9be1bfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:35.074884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3135/6234] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:35.075885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca807b-7820-4a47-937a-89cf9be1bfbc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.087963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca807b-7820-4a47-937a-89cf9be1bfbc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.089915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db2b5b-fe91-4101-8e97-249e46b3955a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.094013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.094929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.095204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.095612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] PATH_INFO: `/v3/projects/a98aecfa57fe43edb1b855cb0c732ffe/users/065938aa10e04d4f922fc12f804cd5d1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.097867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98aecfa57fe43edb1b855cb0c732ffe, user_id=065938aa10e04d4f922fc12f804cd5d1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.100571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.105544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.107658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.107947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.108233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.108967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.114665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.115990 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3136/6235] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:35 2022] PUT /identity/v3/projects/a98aecfa57fe43edb1b855cb0c732ffe/users/065938aa10e04d4f922fc12f804cd5d1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:35.116900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.155323 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3100/6236] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:34 2022] POST /identity/v3/users => generated 413 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:35.156317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.191311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca544652-395d-4bd4-890e-5e0dd313c075 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.238917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ae1c-4518-413f-bdb1-0170f7d7b227 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.247240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.248520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.248801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.249097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] PATH_INFO: `/v3/projects/1e866984d98842d7bca45fdd31f45daa/users/c2a3ce0cc01e46dd84bfb938b9ae850c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.265366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e866984d98842d7bca45fdd31f45daa, user_id=c2a3ce0cc01e46dd84bfb938b9ae850c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.265607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e0871-ed77-4134-9608-19c6b372b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.266201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0871-ed77-4134-9608-19c6b372b1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.266484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0871-ed77-4134-9608-19c6b372b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.266866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0871-ed77-4134-9608-19c6b372b1c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.267613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0871-ed77-4134-9608-19c6b372b1c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:35.267923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0871-ed77-4134-9608-19c6b372b1c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.268227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.269539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0871-ed77-4134-9608-19c6b372b1c6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.270706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:35.284231 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3101/6237] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:35.286082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782bea-2ad4-4df6-b2f3-4378e07832f1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.286377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782bea-2ad4-4df6-b2f3-4378e07832f1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.286724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08782bea-2ad4-4df6-b2f3-4378e07832f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.291299 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3137/6238] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:35 2022] PUT /identity/v3/projects/1e866984d98842d7bca45fdd31f45daa/users/c2a3ce0cc01e46dd84bfb938b9ae850c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:35.291919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.305442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:35.323174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-08782bea-2ad4-4df6-b2f3-4378e07832f1 None None] MFA Rules not processed for user `065938aa10e04d4f922fc12f804cd5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:35.324437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-08782bea-2ad4-4df6-b2f3-4378e07832f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:35.369166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14fef9-0e4e-4bc1-afd6-99f7d24fe96f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.375780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.376665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.377022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.377400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.378187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.379820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.399907 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3138/6239] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:35 2022] POST /identity/v3/roles => generated 244 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:35.400811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.426293 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3102/6240] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:35.426293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782bea-2ad4-4df6-b2f3-4378e07832f1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.507233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08782bea-2ad4-4df6-b2f3-4378e07832f1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.511856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.512535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.512822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.513126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.513857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.514127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd634e-c3f7-4d4d-b758-04fc8e87d66c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.515638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.519616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.520396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.520817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.521735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.522559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.525021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.526344 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3103/6241] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:35 2022] GET /identity/v3/roles => generated 1655 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:35.527144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.539337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40e607-c596-48ad-a8e0-1957c8d57dbe admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.544884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.545883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.546166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.546435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.547430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.549157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.557582 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3139/6242] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:35 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:35.558427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.560047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:35.573288 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3104/6243] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:35 2022] POST /identity/v3/roles => generated 247 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:35.573288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.591447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800e675-7755-471e-aff2-7e2f9d75bf2a tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.654911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb0803-e714-4076-afc7-7de858167487 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.660481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.661436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.661814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.662101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.666136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.667799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.668087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.668357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] PATH_INFO: `/v3/projects/1e866984d98842d7bca45fdd31f45daa/users/c2a3ce0cc01e46dd84bfb938b9ae850c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.676104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e866984d98842d7bca45fdd31f45daa, user_id=c2a3ce0cc01e46dd84bfb938b9ae850c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.676104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.702536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3105/6244] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:35 2022] PUT /identity/v3/projects/1e866984d98842d7bca45fdd31f45daa/users/c2a3ce0cc01e46dd84bfb938b9ae850c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:35.703636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.710304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:35.730750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:35.776755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.776755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.801400 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3140/6245] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:35.818270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.878791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f019b3f-952c-4f47-9eae-43b8bf841bef admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:35.885749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:35.886587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:35.886871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:35.887145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:35.887984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:35.890033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:35.922988 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3106/6246] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:35 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:35.924876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:35.936681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:36.001135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7e6e-9777-4ebf-bd7e-51532442c9db service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.064735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a785-214a-479b-9c95-49979eccd1c1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.088423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.090786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.092069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.094170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.101788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:36.152653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.153924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.154522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.154964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/a219c8df2c974015915133c3b9bfc6f2/users/8620bc26ec73481e8797b660857703d1/roles/bf4dcc87d8f249a6ab6ad265db160e4b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.191691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a219c8df2c974015915133c3b9bfc6f2, user_id=8620bc26ec73481e8797b660857703d1, role_id=bf4dcc87d8f249a6ab6ad265db160e4b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.195037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.226804 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3141/6247] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:35 2022] PUT /identity/v3/projects/a219c8df2c974015915133c3b9bfc6f2/users/8620bc26ec73481e8797b660857703d1/roles/bf4dcc87d8f249a6ab6ad265db160e4b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:36.227824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:36.294483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.295943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.314894 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3107/6248] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:36.316271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:36.326007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:36.348248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a7719-1070-4cb2-8b05-c7da2a3c8a0c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.359739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.359739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.359739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.359739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.360339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.363182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.370156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e5e62-d431-4922-97b7-15ea11b3d1ea service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.378162 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3142/6249] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:36 2022] GET /identity/v3/roles => generated 1893 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:36.382563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:36.393944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe334b-6658-4317-8b78-6f7757354c33 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.400369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.401211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.401523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.401799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.402546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.404749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.422499 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3143/6250] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:36 2022] GET /identity/v3/roles => generated 1893 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:36.423443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:36.438018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e6cdb-1cd8-4b68-a749-37ab7eacdb83 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.446682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23993ab-8fae-4c1b-9ac3-1839dced8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.447873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23993ab-8fae-4c1b-9ac3-1839dced8079 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.448345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23993ab-8fae-4c1b-9ac3-1839dced8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.448803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23993ab-8fae-4c1b-9ac3-1839dced8079 admin admin] PATH_INFO: `/v3/projects/b9563b01afb4419f8e1569c0a0a24fd3/users/fa0b898d8a8e48d4a586b89004c36960/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.481257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23993ab-8fae-4c1b-9ac3-1839dced8079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9563b01afb4419f8e1569c0a0a24fd3, user_id=fa0b898d8a8e48d4a586b89004c36960, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.487548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23993ab-8fae-4c1b-9ac3-1839dced8079 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.521187 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3144/6251] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:36 2022] PUT /identity/v3/projects/b9563b01afb4419f8e1569c0a0a24fd3/users/fa0b898d8a8e48d4a586b89004c36960/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:36.526574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07972-1c02-45ac-8909-2e5d25490cd5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.528096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07972-1c02-45ac-8909-2e5d25490cd5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.528600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d07972-1c02-45ac-8909-2e5d25490cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.557907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:36.575978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.576887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.577196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.577481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/a219c8df2c974015915133c3b9bfc6f2/users/8620bc26ec73481e8797b660857703d1/roles/a60dd211c6f34cbb90094f6b448da613` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.580310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a219c8df2c974015915133c3b9bfc6f2, user_id=8620bc26ec73481e8797b660857703d1, role_id=a60dd211c6f34cbb90094f6b448da613)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.583035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.609209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3108/6252] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:36 2022] PUT /identity/v3/projects/a219c8df2c974015915133c3b9bfc6f2/users/8620bc26ec73481e8797b660857703d1/roles/a60dd211c6f34cbb90094f6b448da613 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:36.613446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:36.618764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b9d07972-1c02-45ac-8909-2e5d25490cd5 None None] MFA Rules not processed for user `fa0b898d8a8e48d4a586b89004c36960`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:36.620010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9d07972-1c02-45ac-8909-2e5d25490cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:36.756161 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3145/6253] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:36.758001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07972-1c02-45ac-8909-2e5d25490cd5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:36.771164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be37c9-f0e6-4117-a12d-c428b8e2eea8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.788730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691e2a0-f8b0-4f58-95f5-2b0b72545330 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.789666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691e2a0-f8b0-4f58-95f5-2b0b72545330 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.790145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691e2a0-f8b0-4f58-95f5-2b0b72545330 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.790550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691e2a0-f8b0-4f58-95f5-2b0b72545330 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.791382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691e2a0-f8b0-4f58-95f5-2b0b72545330 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.803664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691e2a0-f8b0-4f58-95f5-2b0b72545330 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.852505 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3109/6254] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:36 2022] GET /identity/v3/users => generated 9207 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:36.857501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0454d2-a00a-4773-8fcb-743ca7f285c2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.857721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0454d2-a00a-4773-8fcb-743ca7f285c2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.858039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0454d2-a00a-4773-8fcb-743ca7f285c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.892051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d07972-1c02-45ac-8909-2e5d25490cd5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:36.902159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:36.902941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:36.903508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:36.904256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:36.905283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:36.909388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:36.974103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bf0454d2-a00a-4773-8fcb-743ca7f285c2 None None] MFA Rules not processed for user `8620bc26ec73481e8797b660857703d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:36.975626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bf0454d2-a00a-4773-8fcb-743ca7f285c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:37.014105 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3146/6255] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:36 2022] POST /identity/v3/projects => generated 367 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:37.018046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.118295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:37.185348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c083-a277-41a7-855d-525fd82ebd41 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.189834 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3110/6256] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:37.192248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2216fd-8a84-4dec-b271-3412d65f5106 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.193180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2216fd-8a84-4dec-b271-3412d65f5106 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.193180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2216fd-8a84-4dec-b271-3412d65f5106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.208468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ad09-d5ee-4217-9e26-ec5e7643d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.209598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ad09-d5ee-4217-9e26-ec5e7643d34e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.209889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ad09-d5ee-4217-9e26-ec5e7643d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.210171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ad09-d5ee-4217-9e26-ec5e7643d34e admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.210984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ad09-d5ee-4217-9e26-ec5e7643d34e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.212877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ad09-d5ee-4217-9e26-ec5e7643d34e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.233994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2b2216fd-8a84-4dec-b271-3412d65f5106 None None] MFA Rules not processed for user `c2a3ce0cc01e46dd84bfb938b9ae850c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:37.235371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2b2216fd-8a84-4dec-b271-3412d65f5106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:37.265128 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3147/6257] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:37 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:37.266918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850163a1-ae5a-4bfc-9eab-69187fc33b7d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.267213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850163a1-ae5a-4bfc-9eab-69187fc33b7d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.267499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850163a1-ae5a-4bfc-9eab-69187fc33b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.309510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-850163a1-ae5a-4bfc-9eab-69187fc33b7d None None] MFA Rules not processed for user `8620bc26ec73481e8797b660857703d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:37.310831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-850163a1-ae5a-4bfc-9eab-69187fc33b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:37.354347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:37.393851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3111/6258] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:37.395112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2216fd-8a84-4dec-b271-3412d65f5106 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.410777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2216fd-8a84-4dec-b271-3412d65f5106 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.416068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3148/6259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:37.421328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850163a1-ae5a-4bfc-9eab-69187fc33b7d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.435252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850163a1-ae5a-4bfc-9eab-69187fc33b7d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.435883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.436598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.437076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.437404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.438271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.439932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.449976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.451538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.452900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.455021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.457160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:create_trust()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.459638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.468639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3112/6260] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:37 2022] GET /identity/v3/roles => generated 1893 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:37.473155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.495643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78cf2d-25c3-4181-8ade-14d1af763c1c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.512195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.513987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.514505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.514935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] PATH_INFO: `/v3/projects/154a2adfa57b4e23bf84cb77d3975a90/users/8d2b524e62d249a7903ace966dfc7dbb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.535573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154a2adfa57b4e23bf84cb77d3975a90, user_id=8d2b524e62d249a7903ace966dfc7dbb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.539614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.570518 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3113/6261] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:37 2022] PUT /identity/v3/projects/154a2adfa57b4e23bf84cb77d3975a90/users/8d2b524e62d249a7903ace966dfc7dbb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:37.571827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.660689 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3149/6262] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:26:37 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:37.666108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.671651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11a35-e014-46fb-80fb-845814a56cf9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.682695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.683990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940bdf7-d5d8-44a1-9564-cc1788783f91 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.684562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.685127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.686416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.688987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.692404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.716392 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3114/6263] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:37 2022] GET /identity/v3/roles => generated 1893 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:37.720181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.736154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998926-c78a-48fb-b0fc-d7eec41b4072 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.748818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa8ab-0920-49b1-a3b9-eb044b903fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.750449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa8ab-0920-49b1-a3b9-eb044b903fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.750776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa8ab-0920-49b1-a3b9-eb044b903fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.751431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa8ab-0920-49b1-a3b9-eb044b903fbb admin admin] PATH_INFO: `/v3/projects/154a2adfa57b4e23bf84cb77d3975a90/users/8d2b524e62d249a7903ace966dfc7dbb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.756805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa8ab-0920-49b1-a3b9-eb044b903fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=154a2adfa57b4e23bf84cb77d3975a90, user_id=8d2b524e62d249a7903ace966dfc7dbb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.765042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa8ab-0920-49b1-a3b9-eb044b903fbb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.785294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:37.785541 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3115/6264] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:37 2022] PUT /identity/v3/projects/154a2adfa57b4e23bf84cb77d3975a90/users/8d2b524e62d249a7903ace966dfc7dbb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:37.792053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.792776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e316d-8544-4b0a-ac7b-6a307b2dac04 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.792939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.793148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e316d-8544-4b0a-ac7b-6a307b2dac04 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.793272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.793377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e316d-8544-4b0a-ac7b-6a307b2dac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.793509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.814932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:get_trust(trust_id=a81984468924401eb72bfff7fc2d100a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.819591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.834264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d64e316d-8544-4b0a-ac7b-6a307b2dac04 None None] MFA Rules not processed for user `8d2b524e62d249a7903ace966dfc7dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:37.835868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d64e316d-8544-4b0a-ac7b-6a307b2dac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:37.853026 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3150/6265] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:37 2022] GET /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a => generated 859 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:26:37.855144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:37.872259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d4ac1-e07b-449f-8567-51648687b5c6 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:37.965139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:37.966095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:37.966972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:37.966972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:37.976972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a81984468924401eb72bfff7fc2d100a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:37.978563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:37.993752 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3116/6266] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:37.995912 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3151/6267] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:26:37 2022] GET /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles => generated 371 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:26:38.000793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e316d-8544-4b0a-ac7b-6a307b2dac04 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.015694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e316d-8544-4b0a-ac7b-6a307b2dac04 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.019788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.020625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.020906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.021226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/bf4dcc87d8f249a6ab6ad265db160e4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.031344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a81984468924401eb72bfff7fc2d100a, role_id=bf4dcc87d8f249a6ab6ad265db160e4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:38.032914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:38.046989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.048983 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3117/6268] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Jun 18 22:26:37 2022] GET /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/bf4dcc87d8f249a6ab6ad265db160e4b => generated 244 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:38.050167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.059998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524349e-3649-405e-862c-2e5b13354850 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.060909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:38.067056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.068038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.068490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.068884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/bf4dcc87d8f249a6ab6ad265db160e4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.070976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:38.076772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a81984468924401eb72bfff7fc2d100a, role_id=bf4dcc87d8f249a6ab6ad265db160e4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:38.079547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:38.094151 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3118/6269] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Jun 18 22:26:38 2022] HEAD /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/bf4dcc87d8f249a6ab6ad265db160e4b => generated 0 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 18 22:26:38.095412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.109789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f6c9a-550c-4592-8009-c56cf98e9555 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.114882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.115829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.139063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.139322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/a60dd211c6f34cbb90094f6b448da613` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.164698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a81984468924401eb72bfff7fc2d100a, role_id=a60dd211c6f34cbb90094f6b448da613)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:38.173587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Could not find role: a60dd211c6f34cbb90094f6b448da613.: keystone.exception.RoleNotFound: Could not find role: a60dd211c6f34cbb90094f6b448da613. Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 18 22:26:38.234900 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 22:26:38.236297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a60dd211c6f34cbb90094f6b448da613. Jun 18 22:26:38.236297 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:38.236488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88326-dd14-4511-b633-a8e03333a8a4 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.248694 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3119/6270] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Jun 18 22:26:38 2022] GET /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/a60dd211c6f34cbb90094f6b448da613 => generated 110 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:38.250442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.253179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.256084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.256372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.256651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.280972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927198d2-5c8a-4bbc-9701-6e057f76d74d tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.288805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:38.293373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:38.294655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.295522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.295966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.296242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/a60dd211c6f34cbb90094f6b448da613` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.304350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a81984468924401eb72bfff7fc2d100a, role_id=a60dd211c6f34cbb90094f6b448da613)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:38.308718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:38.329022 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3152/6271] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Could not find role: a60dd211c6f34cbb90094f6b448da613.: keystone.exception.RoleNotFound: Could not find role: a60dd211c6f34cbb90094f6b448da613. Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 18 22:26:38.332976 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 22:26:38.334090 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a60dd211c6f34cbb90094f6b448da613. Jun 18 22:26:38.334090 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:38.338082 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3120/6272] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Jun 18 22:26:38 2022] HEAD /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a/roles/a60dd211c6f34cbb90094f6b448da613 => generated 0 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 18 22:26:38.338862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.354195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd4da-94e9-451b-bf59-01b797fb620e service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.360785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.361814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.362125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.362395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.371162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorizing `identity:delete_trust(trust_id=a81984468924401eb72bfff7fc2d100a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:38.373944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:38.431723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a81984468924401eb72bfff7fc2d100a', 'request_id': 'req-69e6822b-5258-4232-b46b-957b81dfe226'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:38.438615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a81984468924401eb72bfff7fc2d100a', 'request_id': 'req-69e6822b-5258-4232-b46b-957b81dfe226'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:38.439349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a81984468924401eb72bfff7fc2d100a', 'request_id': 'req-69e6822b-5258-4232-b46b-957b81dfe226'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:38.464992 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3153/6273] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:26:38 2022] DELETE /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:38.467099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.476834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:38.530466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d162-c2f9-4ccb-9c13-ead7eccbab1e tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.551112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8620bc26ec73481e8797b660857703d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a219c8df2c974015915133c3b9bfc6f2', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1804884934', 'tempest-NotDelegatedRole-1522697871'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.552030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.552323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.552991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] PATH_INFO: `/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Could not find trust: a81984468924401eb72bfff7fc2d100a.: keystone.exception.TrustNotFound: Could not find trust: a81984468924401eb72bfff7fc2d100a. Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 18 22:26:38.577223 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a81984468924401eb72bfff7fc2d100a. Jun 18 22:26:38.579099 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:38.589557 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3121/6274] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:38 2022] GET /identity/v3/OS-TRUST/trusts/a81984468924401eb72bfff7fc2d100a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:38.594220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.595729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:38.701397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:38.750840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6822b-5258-4232-b46b-957b81dfe226 tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:38.767414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:38.768631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:38.768924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:38.769229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/a60dd211c6f34cbb90094f6b448da613` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:38.774569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a60dd211c6f34cbb90094f6b448da613)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:38.776504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:38.919750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role a60dd211c6f34cbb90094f6b448da613 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:38.919929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:38.922502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:38.931526 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3154/6275] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:38 2022] DELETE /identity/v3/roles/a60dd211c6f34cbb90094f6b448da613 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:38.932750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:38.935715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:38.962600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcee2f-26ad-4c0a-a620-6c8f10162b3b tempest-TrustsV3TestJSON-1613033601 tempest-user-737665420] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:39.081105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:39.082153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:39.082538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:39.082926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/bf4dcc87d8f249a6ab6ad265db160e4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:39.084569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bf4dcc87d8f249a6ab6ad265db160e4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:39.086396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:39.155944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role bf4dcc87d8f249a6ab6ad265db160e4b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:39.158553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.160619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.167743 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3122/6276] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:38 2022] DELETE /identity/v3/roles/bf4dcc87d8f249a6ab6ad265db160e4b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:39.172230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:39.187588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404321b3-eeb8-427b-9773-9156f68bef26 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:39.263253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:39.264346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:39.264633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:39.265051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users/8620bc26ec73481e8797b660857703d1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:39.267229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8620bc26ec73481e8797b660857703d1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:39.269994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:39.365144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8620bc26ec73481e8797b660857703d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.366170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8620bc26ec73481e8797b660857703d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.415729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8620bc26ec73481e8797b660857703d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.416575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8620bc26ec73481e8797b660857703d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.428285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8620bc26ec73481e8797b660857703d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.462063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:39.462609 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3155/6277] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:39 2022] DELETE /identity/v3/users/8620bc26ec73481e8797b660857703d1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:39.463517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:39.479248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f490e-e735-4edd-819e-c209786d7fdd tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:39.612966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:39.616261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:39.616627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:39.618978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/a219c8df2c974015915133c3b9bfc6f2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:39.621183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a219c8df2c974015915133c3b9bfc6f2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:39.629721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:39.665079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:39.719237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a219c8df2c974015915133c3b9bfc6f2', 'request_id': 'req-c4f818c6-7987-453f-8b5f-c282a1b12a62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.727291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a219c8df2c974015915133c3b9bfc6f2', 'request_id': 'req-c4f818c6-7987-453f-8b5f-c282a1b12a62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.737818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a219c8df2c974015915133c3b9bfc6f2', 'request_id': 'req-c4f818c6-7987-453f-8b5f-c282a1b12a62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.752361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] The token cache is being invalidate because project a219c8df2c974015915133c3b9bfc6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:39.752713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.753677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:39.756341 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3123/6278] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:39 2022] DELETE /identity/v3/projects/a219c8df2c974015915133c3b9bfc6f2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:39.762970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:39.764435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:39.799594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb08c9d-ec7a-4a2d-8a72-85e1a0696789 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:39.854365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:39.901093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:39.901093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:39.901093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:39.901601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:39.901704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:39.903675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:39.947759 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3156/6279] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:26:39 2022] POST /identity/v3/projects => generated 329 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:39.948802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:39.950871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:39.969650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f818c6-7987-453f-8b5f-c282a1b12a62 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.066782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.068916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:40.088030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.089481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.089819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.090387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.091194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.093558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.124902 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3124/6280] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:39 2022] POST /identity/v3/users => generated 416 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:40.126195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.141924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827e0e2-e105-4daa-969e-44df4edf433d tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.148304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.149600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.150176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.150583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.151720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.154474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.166153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4392-31bc-4748-8e68-b2dfcf551891 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.177167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.178224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.178628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.178913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] PATH_INFO: `/v3/users/2528ddd1080546b89e299d23701a8520` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.180167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2528ddd1080546b89e299d23701a8520)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.182302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.184908 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3125/6281] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:40 2022] POST /identity/v3/roles => generated 244 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:40.188870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.208719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845ce4-b83a-45b7-9138-e8e985971ece tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.216599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.217556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.218099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.218559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.220473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.223258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.250496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3126/6282] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:40 2022] POST /identity/v3/roles => generated 246 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:40.251084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2528ddd1080546b89e299d23701a8520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:40.251768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2528ddd1080546b89e299d23701a8520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:40.255952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.259046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:40.271369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2528ddd1080546b89e299d23701a8520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:40.274864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa2a0-fbd1-4c73-9bfa-a216f2c5d3ab tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.276229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2528ddd1080546b89e299d23701a8520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:40.280049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.280993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.281395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.281688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/0f7359b35a2e462a948a9bb2fda599aa/users/3cef04887bff49af98d28e93a3ec4f86/roles/21149036b1a242e88c3e27ee10659664` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.289707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-72f249fa-1782-41b4-b7ec-290659265c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2528ddd1080546b89e299d23701a8520'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:40.302033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0f7359b35a2e462a948a9bb2fda599aa, user_id=3cef04887bff49af98d28e93a3ec4f86, role_id=21149036b1a242e88c3e27ee10659664)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.305423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.311398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3157/6283] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:40 2022] DELETE /identity/v3/users/2528ddd1080546b89e299d23701a8520 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:40.316789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a908-d480-4a58-b780-22987a065c68 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.317123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a908-d480-4a58-b780-22987a065c68 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.317532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597a908-d480-4a58-b780-22987a065c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.324806 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3127/6284] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:40 2022] PUT /identity/v3/projects/0f7359b35a2e462a948a9bb2fda599aa/users/3cef04887bff49af98d28e93a3ec4f86/roles/21149036b1a242e88c3e27ee10659664 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:40.329004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.339208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4597a908-d480-4a58-b780-22987a065c68 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:40.340432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4597a908-d480-4a58-b780-22987a065c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:40.373501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:40.375958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:40.403403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65b336-a910-4ecf-93b0-291bbd5555f8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.408368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.409397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.409798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.410140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/0f7359b35a2e462a948a9bb2fda599aa/users/3cef04887bff49af98d28e93a3ec4f86/roles/23261e89ef1c47a1b3647a11c042f12b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.412498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0f7359b35a2e462a948a9bb2fda599aa, user_id=3cef04887bff49af98d28e93a3ec4f86, role_id=23261e89ef1c47a1b3647a11c042f12b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.415270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.416986 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3158/6285] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:40.427059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597a908-d480-4a58-b780-22987a065c68 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.428911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4597a908-d480-4a58-b780-22987a065c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:40.433097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3128/6286] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:40 2022] PUT /identity/v3/projects/0f7359b35a2e462a948a9bb2fda599aa/users/3cef04887bff49af98d28e93a3ec4f86/roles/23261e89ef1c47a1b3647a11c042f12b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:40.437687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.499067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597a908-d480-4a58-b780-22987a065c68 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.516229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c1a03-94c2-439c-bd7d-c869b8b67e6c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.521066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b8c6f-d155-4460-85f9-c6703832f868 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.521754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8c6f-d155-4460-85f9-c6703832f868 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.522041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8c6f-d155-4460-85f9-c6703832f868 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.522318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b8c6f-d155-4460-85f9-c6703832f868 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.523217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8c6f-d155-4460-85f9-c6703832f868 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.525099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b8c6f-d155-4460-85f9-c6703832f868 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.553838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebd759-86fa-44e8-b25a-eb4eec89c4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.554510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd759-86fa-44e8-b25a-eb4eec89c4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.554795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd759-86fa-44e8-b25a-eb4eec89c4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.555072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd759-86fa-44e8-b25a-eb4eec89c4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.560455 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3129/6287] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:40 2022] GET /identity/v3/users => generated 9211 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:40.565442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64acd-b82d-4011-a55d-245575b67ab5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.566108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64acd-b82d-4011-a55d-245575b67ab5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.566384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b64acd-b82d-4011-a55d-245575b67ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.609642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-99b64acd-b82d-4011-a55d-245575b67ab5 None None] MFA Rules not processed for user `3cef04887bff49af98d28e93a3ec4f86`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:40.610863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-99b64acd-b82d-4011-a55d-245575b67ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:40.647614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebd759-86fa-44e8-b25a-eb4eec89c4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.649526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebd759-86fa-44e8-b25a-eb4eec89c4f2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.663652 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3159/6288] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:26:40.711681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3130/6289] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:40.712187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85765d6-7179-46c9-b678-3e9120fa812f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.712187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85765d6-7179-46c9-b678-3e9120fa812f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.712187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85765d6-7179-46c9-b678-3e9120fa812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.733544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f85765d6-7179-46c9-b678-3e9120fa812f None None] MFA Rules not processed for user `3cef04887bff49af98d28e93a3ec4f86`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:40.734889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f85765d6-7179-46c9-b678-3e9120fa812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:40.744946 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3160/6290] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:40.749491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b64acd-b82d-4011-a55d-245575b67ab5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.759270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b64acd-b82d-4011-a55d-245575b67ab5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.763679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3cef04887bff49af98d28e93a3ec4f86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f7359b35a2e462a948a9bb2fda599aa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1852130589', 'tempest-NotDelegatedRole-413953320'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.764570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.764961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.766130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.766996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] RBAC: Authorizing `identity:create_trust()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.768849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.823460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 67, in parse_isotime Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jun 18 22:26:40.875445 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 69, in parse_isotime Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jun 18 22:26:40.876661 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jun 18 22:26:40.878040 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jun 18 22:26:40.878040 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jun 18 22:26:40.878040 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jun 18 22:26:40.878040 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jun 18 22:26:40.878040 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jun 18 22:26:40.878040 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:40.878040 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3131/6291] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:26:40 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 128 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 18 22:26:40.881217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85765d6-7179-46c9-b678-3e9120fa812f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.895070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85765d6-7179-46c9-b678-3e9120fa812f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:40.901877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:40.902839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:40.903480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:40.903856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/23261e89ef1c47a1b3647a11c042f12b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:40.906299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=23261e89ef1c47a1b3647a11c042f12b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:40.908091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:40.942667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:40.975743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role 23261e89ef1c47a1b3647a11c042f12b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:40.976227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:40.977458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:40.981697 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3161/6292] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:40 2022] DELETE /identity/v3/roles/23261e89ef1c47a1b3647a11c042f12b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:40.986173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:40.990861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.000222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:41.002731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.022480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6957a27-0977-42d0-a4a9-1c4aae6e3f08 tempest-TrustsV3TestJSON-1724942555 tempest-user-1700796492] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:41.107012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eba35-3fa2-48d5-bd03-3898ec3434a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:41.123293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:41.124302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:41.125083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:41.125390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] PATH_INFO: `/v3/users/68a69078d083449e9a1d0a54ff02e6ba` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:41.127057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a69078d083449e9a1d0a54ff02e6ba)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:41.129746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:41.131119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:41.132497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:41.132948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:41.133336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/21149036b1a242e88c3e27ee10659664` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:41.135526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=21149036b1a242e88c3e27ee10659664)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:41.138047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:41.207019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role 21149036b1a242e88c3e27ee10659664 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:41.207459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.208551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.215485 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3132/6293] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:40 2022] DELETE /identity/v3/roles/21149036b1a242e88c3e27ee10659664 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:41.215485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:41.217585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.229779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a69078d083449e9a1d0a54ff02e6ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.230810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a69078d083449e9a1d0a54ff02e6ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.254420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a69078d083449e9a1d0a54ff02e6ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.255254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a69078d083449e9a1d0a54ff02e6ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.276044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a69078d083449e9a1d0a54ff02e6ba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.302798 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3162/6294] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:40 2022] DELETE /identity/v3/users/68a69078d083449e9a1d0a54ff02e6ba => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:41.303742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:41.306931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.370940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35adbb9-ed34-4197-a38d-d3d735ec7cb6 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:41.391311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996d526-86cc-4739-b617-fdbf88931707 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:41.396652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:41.397705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:41.397990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:41.398449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users/3cef04887bff49af98d28e93a3ec4f86` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:41.399691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3cef04887bff49af98d28e93a3ec4f86)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:41.401790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:41.416571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:41.452863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:41.469765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cef04887bff49af98d28e93a3ec4f86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.470938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cef04887bff49af98d28e93a3ec4f86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.485281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:41.485972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:41.486254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:41.486570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:41.489441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.500902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cef04887bff49af98d28e93a3ec4f86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.501681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cef04887bff49af98d28e93a3ec4f86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.510679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cef04887bff49af98d28e93a3ec4f86'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.513481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:41.516963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:41.531167 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3163/6295] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:41 2022] DELETE /identity/v3/users/3cef04887bff49af98d28e93a3ec4f86 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:41.535894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:41.539557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.540930 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3133/6296] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:41.639155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325dcf4-afcc-4f56-a70e-15b3bd7ea6a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:41.645222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:41.646869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:41.647291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:41.647682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/0f7359b35a2e462a948a9bb2fda599aa` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:41.649100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f7359b35a2e462a948a9bb2fda599aa)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:41.651106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:41.718323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7359b35a2e462a948a9bb2fda599aa', 'request_id': 'req-eb92b4c7-839e-4b1b-a495-4b316cdbd324'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.727134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7359b35a2e462a948a9bb2fda599aa', 'request_id': 'req-eb92b4c7-839e-4b1b-a495-4b316cdbd324'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.736624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7359b35a2e462a948a9bb2fda599aa', 'request_id': 'req-eb92b4c7-839e-4b1b-a495-4b316cdbd324'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.760416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] The token cache is being invalidate because project 0f7359b35a2e462a948a9bb2fda599aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:41.760783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.761435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:41.763490 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3164/6297] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:41 2022] DELETE /identity/v3/projects/0f7359b35a2e462a948a9bb2fda599aa => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:41.770285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:41.786320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c21ca-eb2e-4aac-8a9a-dd804193e045 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:41.828962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:41.832390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.871193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:41.881455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:41.882382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:41.882701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:41.883090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:41.883889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:41.886145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:41.949160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3134/6298] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:26:41 2022] POST /identity/v3/projects => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:41.951426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:41.956132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:41.993079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b4c7-839e-4b1b-a495-4b316cdbd324 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.047911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557158b2-6912-430d-bae5-61fd16c6127b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.054354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.055065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.055529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.055822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.056818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.059249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.081091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.082831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.083277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.083578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] PATH_INFO: `/v3/projects/58240accc193488fafd486b2bfc19064` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.085010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58240accc193488fafd486b2bfc19064)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.087337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.090634 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3135/6299] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:41 2022] POST /identity/v3/users => generated 416 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:42.091704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:42.093975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:42.115671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f189be2-8f9a-4118-a395-73a37e81b961 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.121067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.122148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.122511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.122862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] PATH_INFO: `/v3/users/fa0b898d8a8e48d4a586b89004c36960` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.124193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0b898d8a8e48d4a586b89004c36960)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.127104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.170948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58240accc193488fafd486b2bfc19064', 'request_id': 'req-12868b67-1306-407c-81d1-aae4ec9a89c2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.183327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58240accc193488fafd486b2bfc19064', 'request_id': 'req-12868b67-1306-407c-81d1-aae4ec9a89c2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.199043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58240accc193488fafd486b2bfc19064', 'request_id': 'req-12868b67-1306-407c-81d1-aae4ec9a89c2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.212737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0b898d8a8e48d4a586b89004c36960'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.213875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0b898d8a8e48d4a586b89004c36960'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.216427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:42.217301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] The token cache is being invalidate because project 58240accc193488fafd486b2bfc19064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:42.218016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.219334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.222012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3165/6300] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:41 2022] DELETE /identity/v3/projects/58240accc193488fafd486b2bfc19064 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:42.223772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:42.225882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:42.235547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0b898d8a8e48d4a586b89004c36960'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.236560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0b898d8a8e48d4a586b89004c36960'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.247474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0b898d8a8e48d4a586b89004c36960'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.286272 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3136/6301] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:42 2022] DELETE /identity/v3/users/fa0b898d8a8e48d4a586b89004c36960 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:42.287895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:42.290243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:42.337807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:42.346369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868b67-1306-407c-81d1-aae4ec9a89c2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.403705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c77f63-f1b4-4fc4-8d96-525c88c74158 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.411001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.412008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.412367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.412718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] PATH_INFO: `/v3/projects/6e45658c8c6f4db290a602cbc1ff8417` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.414112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e45658c8c6f4db290a602cbc1ff8417)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.416759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.431021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.431857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.432133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.432688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.433819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.436108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.459236 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3166/6302] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:42 2022] POST /identity/v3/roles => generated 243 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:42.459236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:42.460040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:42.486811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bef2-a5d2-48fc-bfb4-055b156af0a7 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.495016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e45658c8c6f4db290a602cbc1ff8417', 'request_id': 'req-05cd9410-be17-455e-aace-a2b14cc5628f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.506583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e45658c8c6f4db290a602cbc1ff8417', 'request_id': 'req-05cd9410-be17-455e-aace-a2b14cc5628f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.520001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e45658c8c6f4db290a602cbc1ff8417', 'request_id': 'req-05cd9410-be17-455e-aace-a2b14cc5628f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.535356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] The token cache is being invalidate because project 6e45658c8c6f4db290a602cbc1ff8417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:42.535702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.536396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-05cd9410-be17-455e-aace-a2b14cc5628f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.538729 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3137/6303] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:42 2022] DELETE /identity/v3/projects/6e45658c8c6f4db290a602cbc1ff8417 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:42.540097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.540381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.540671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.562845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:42.564661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:42.609592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.610499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.610778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.611053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] PATH_INFO: `/v3/users/d7772291b6844fa6b99fc2afa9173a65` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.612341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7772291b6844fa6b99fc2afa9173a65)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.618700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.645819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:42.662232 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3138/6304] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:42.663357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:42.669877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:42.702397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7772291b6844fa6b99fc2afa9173a65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.703494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7772291b6844fa6b99fc2afa9173a65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.728663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7772291b6844fa6b99fc2afa9173a65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.729744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7772291b6844fa6b99fc2afa9173a65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.738781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7772291b6844fa6b99fc2afa9173a65'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:42.767107 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3167/6305] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:42 2022] DELETE /identity/v3/users/d7772291b6844fa6b99fc2afa9173a65 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:42.772109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:42.774053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:42.803932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:42.806641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aacb45-8ed3-4185-a09e-a30162858dd4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.920538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b6091-b923-4176-b073-9c4e77195d33 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:42.927732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.929775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.930700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.931087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] PATH_INFO: `/v3/users/c2a3ce0cc01e46dd84bfb938b9ae850c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.933171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a3ce0cc01e46dd84bfb938b9ae850c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.936713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.942720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:42.944784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:42.945422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:42.945881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:42.946891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:42.949067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:42.993832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3139/6306] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:42 2022] POST /identity/v3/roles => generated 246 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:42.997819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:43.001309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:43.032910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a3ce0cc01e46dd84bfb938b9ae850c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.033469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a3ce0cc01e46dd84bfb938b9ae850c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.074917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a3ce0cc01e46dd84bfb938b9ae850c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.074917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a3ce0cc01e46dd84bfb938b9ae850c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.079679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a3ce0cc01e46dd84bfb938b9ae850c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.116622 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3168/6307] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:42 2022] DELETE /identity/v3/users/c2a3ce0cc01e46dd84bfb938b9ae850c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:43.117636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:43.121402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:43.141510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7d611-4e4a-452e-812b-3c46a3d5dff0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:43.220628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8d20d-8f8c-40c6-8ea7-937dee77f0e9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:43.226142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:43.227163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:43.227452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:43.227791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/743d69a9f668499491ebbf39b3e07a81/users/5cc6af71b423429699715e9f6411849c/roles/051e509f699d4083870f9c7090f3f0e8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:43.249336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=743d69a9f668499491ebbf39b3e07a81, user_id=5cc6af71b423429699715e9f6411849c, role_id=051e509f699d4083870f9c7090f3f0e8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:43.253698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:43.266996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:43.267481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:43.267775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:43.268344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:43.270896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:43.284131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:43.288630 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3169/6308] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:43 2022] PUT /identity/v3/projects/743d69a9f668499491ebbf39b3e07a81/users/5cc6af71b423429699715e9f6411849c/roles/051e509f699d4083870f9c7090f3f0e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:43.294600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:43.337525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:43.391777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:43.394544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:43.411947 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3140/6309] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:43.414763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57598-9895-41ae-9414-9c89d8dfbd30 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:43.420012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:43.421013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:43.421313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:43.421932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/743d69a9f668499491ebbf39b3e07a81/users/5cc6af71b423429699715e9f6411849c/roles/db1aa7339c7a4b6882267605cfb41652` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:43.424027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=743d69a9f668499491ebbf39b3e07a81, user_id=5cc6af71b423429699715e9f6411849c, role_id=db1aa7339c7a4b6882267605cfb41652)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:43.426947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:43.447522 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3170/6310] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:43 2022] PUT /identity/v3/projects/743d69a9f668499491ebbf39b3e07a81/users/5cc6af71b423429699715e9f6411849c/roles/db1aa7339c7a4b6882267605cfb41652 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:43.452763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:43.467185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560bc03-b64a-45b2-8c0f-c767b6f6314f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:43.583171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:43.585345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:43.585747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:43.586130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:43.587489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:43.591021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:43.617398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:43.621206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:43.648078 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3141/6311] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:43 2022] GET /identity/v3/users => generated 8063 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:43.649946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:43.670762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:43.802397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897e51-7fc3-44d9-91e4-e4c504d38ce9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:43.816364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:43.817142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:43.818192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:43.819903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] PATH_INFO: `/v3/projects/1e866984d98842d7bca45fdd31f45daa` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:43.823891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e866984d98842d7bca45fdd31f45daa)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:43.825088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:43.858393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b6504-8dff-49c2-871a-135cf03860a0 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:43.869980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:43.873160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:43.873569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:43.874808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] PATH_INFO: `/v3/projects/0e1744b85d784448a3d08b176bbf2d60` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:43.878234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1744b85d784448a3d08b176bbf2d60)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:43.882545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:43.950986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e866984d98842d7bca45fdd31f45daa', 'request_id': 'req-a55ec96f-1381-4d96-b58e-fd76af543ddc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.968165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e866984d98842d7bca45fdd31f45daa', 'request_id': 'req-a55ec96f-1381-4d96-b58e-fd76af543ddc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.976833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:43.987037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e866984d98842d7bca45fdd31f45daa', 'request_id': 'req-a55ec96f-1381-4d96-b58e-fd76af543ddc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:43.987612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1744b85d784448a3d08b176bbf2d60', 'request_id': 'req-748bc88a-6529-44b1-8f1c-d805a18becd8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.001825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1744b85d784448a3d08b176bbf2d60', 'request_id': 'req-748bc88a-6529-44b1-8f1c-d805a18becd8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.005576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] The token cache is being invalidate because project 1e866984d98842d7bca45fdd31f45daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:44.005875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.006611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a55ec96f-1381-4d96-b58e-fd76af543ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.011612 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3171/6312] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:43 2022] DELETE /identity/v3/projects/1e866984d98842d7bca45fdd31f45daa => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:44.011612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.011612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.011612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.034849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1744b85d784448a3d08b176bbf2d60', 'request_id': 'req-748bc88a-6529-44b1-8f1c-d805a18becd8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.054754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] The token cache is being invalidate because project 0e1744b85d784448a3d08b176bbf2d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:44.055056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.057647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-748bc88a-6529-44b1-8f1c-d805a18becd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.063911 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3142/6313] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:43 2022] DELETE /identity/v3/projects/0e1744b85d784448a3d08b176bbf2d60 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:44.067033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9516-922e-48bc-9a40-3216cf46f4c1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.071418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9516-922e-48bc-9a40-3216cf46f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.071539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9516-922e-48bc-9a40-3216cf46f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.116657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] MFA Rules not processed for user `5cc6af71b423429699715e9f6411849c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:44.117987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.132118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-453e9516-922e-48bc-9a40-3216cf46f4c1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:44.137154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-453e9516-922e-48bc-9a40-3216cf46f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.196355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:44.288134 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3172/6314] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:44 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:44.288500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:44.291010 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3143/6315] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:44.302010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb35452-8439-4591-812b-44a070389add None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.302337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb35452-8439-4591-812b-44a070389add None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.302617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb35452-8439-4591-812b-44a070389add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.305595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.342702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dcafe-7c58-4dfe-beb5-57f614f81602 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:44.353232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9fb35452-8439-4591-812b-44a070389add None None] MFA Rules not processed for user `5cc6af71b423429699715e9f6411849c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:44.354622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:44.355549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.355828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.356103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] PATH_INFO: `/v3/users/065938aa10e04d4f922fc12f804cd5d1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.358501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9fb35452-8439-4591-812b-44a070389add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.361151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065938aa10e04d4f922fc12f804cd5d1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:44.366782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:44.377144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3144/6316] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:44 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:44.378867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.379151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.379426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.414381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:44.415609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.429499 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3145/6317] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:44.430935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:44.432845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.462473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f868b3-e2dd-4e9f-8359-89fd0f65b27b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:44.467943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:44.469110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.469930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.470418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] PATH_INFO: `/v3/projects/b9563b01afb4419f8e1569c0a0a24fd3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.472727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9563b01afb4419f8e1569c0a0a24fd3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:44.475050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:44.483236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065938aa10e04d4f922fc12f804cd5d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.486190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065938aa10e04d4f922fc12f804cd5d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.510147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065938aa10e04d4f922fc12f804cd5d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.511883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065938aa10e04d4f922fc12f804cd5d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.529015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065938aa10e04d4f922fc12f804cd5d1'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.552692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9563b01afb4419f8e1569c0a0a24fd3', 'request_id': 'req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.553911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3173/6318] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:44 2022] DELETE /identity/v3/users/065938aa10e04d4f922fc12f804cd5d1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:44.555094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:44.557554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.563637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9563b01afb4419f8e1569c0a0a24fd3', 'request_id': 'req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.576612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9563b01afb4419f8e1569c0a0a24fd3', 'request_id': 'req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.591904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] The token cache is being invalidate because project b9563b01afb4419f8e1569c0a0a24fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:44.592390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.594314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.597263 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3146/6319] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:44 2022] DELETE /identity/v3/projects/b9563b01afb4419f8e1569c0a0a24fd3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:44.598335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:44.600515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.684693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:44.711679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562368-c89d-4171-910a-e8d018c00891 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:44.726704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf6d9-798b-4b1a-bc3d-ea01d5e5af13 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:44.728058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:44.728817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.729182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.729495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.730391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:create_trust()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:44.732131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:44.844124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:44.859114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:44.860203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.860690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.860953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.862082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:44.862342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:44.871030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:44.881321 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3174/6320] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:26:44 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:44.882513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:44.884736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.894459 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3147/6321] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:44.899577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:44.903839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:44.921667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475d36-d520-4195-9909-eed0574d0062 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:44.927638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:44.928620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.928906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.929332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] PATH_INFO: `/v3/users/8d2b524e62d249a7903ace966dfc7dbb` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.930657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2b524e62d249a7903ace966dfc7dbb)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:44.932632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:44.943516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae6587-491e-49ea-bc99-7ea6cd040790 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:44.949264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:44.950949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:44.951940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:44.952535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:44.967464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:get_trust(trust_id=9f0bdb9bb96f43f4a15cc7af034a7954)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:44.969024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:44.980940 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3148/6322] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:44 2022] GET /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954 => generated 833 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:44.983570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:44.992499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2b524e62d249a7903ace966dfc7dbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.993853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2b524e62d249a7903ace966dfc7dbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:44.999659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d707-755a-4369-a890-61b49f3fc63d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.006281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.007257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.007767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.008147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.009173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.010539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2b524e62d249a7903ace966dfc7dbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.011460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.011782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2b524e62d249a7903ace966dfc7dbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.020623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2b524e62d249a7903ace966dfc7dbb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.049108 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3175/6323] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:44 2022] DELETE /identity/v3/users/8d2b524e62d249a7903ace966dfc7dbb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:45.050878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.053112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:45.059108 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3149/6324] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:44 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:45.063241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.066222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:45.138383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce55a3-f4a7-4aed-894a-be0dc14fd4a8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.145520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7340c27-30c1-426c-ac70-de87be2532a2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.152701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.159937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.160337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.160853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.161747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.164731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.194436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3150/6325] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:45 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:26:45.199013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.210210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c917708-193c-4f46-9993-2d03497748ee admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.219664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.220610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.220958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.221336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.222697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.224080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.226665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.227998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.228275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.228554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.235868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=9f0bdb9bb96f43f4a15cc7af034a7954)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.238514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.241247 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3151/6326] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:45 2022] GET /identity/v3/roles => generated 1891 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:45.241434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:45.242345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.250984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3176/6327] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:26:45 2022] GET /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:45.255169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.266608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187813fc-10b1-4bb7-9bd8-2daeebf8ee3c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.273720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc123e-2c39-4cc5-8b17-0eadc1a1d7b8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.280235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.281379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.281718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.281997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/051e509f699d4083870f9c7090f3f0e8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.289825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.290092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.290296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.290578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.290859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f0bdb9bb96f43f4a15cc7af034a7954, role_id=051e509f699d4083870f9c7090f3f0e8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.291742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.292350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.294081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.305237 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3177/6328] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Jun 18 22:26:45 2022] GET /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/051e509f699d4083870f9c7090f3f0e8 => generated 243 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:45.307126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.319695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f05f4b-0f05-4abe-bb40-65f1d6f319dc tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.320087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3152/6329] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:45 2022] GET /identity/v3/roles => generated 1891 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:45.322234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.324830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.325783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `HEAD` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.326324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.326608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/051e509f699d4083870f9c7090f3f0e8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.336358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ff44-99f3-400c-b990-104ed7bc043b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.336530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f0bdb9bb96f43f4a15cc7af034a7954, role_id=051e509f699d4083870f9c7090f3f0e8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.338371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.343015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.344571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.344880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.345206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] PATH_INFO: `/v3/projects/f40438adf0344122a3f04c3a813ee749/users/5760183761cc47199bbb4a4b1b13ad6d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.352649 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3178/6330] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Jun 18 22:26:45 2022] HEAD /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/051e509f699d4083870f9c7090f3f0e8 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 18 22:26:45.354158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.360373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:45.370145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd374-c2a5-4695-a493-2a2ddce06338 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.371851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40438adf0344122a3f04c3a813ee749, user_id=5760183761cc47199bbb4a4b1b13ad6d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.376864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31658638-0283-48e0-8bb6-da25b7c162c8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.377256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.378721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31658638-0283-48e0-8bb6-da25b7c162c8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.379052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31658638-0283-48e0-8bb6-da25b7c162c8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.379430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31658638-0283-48e0-8bb6-da25b7c162c8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/db1aa7339c7a4b6882267605cfb41652` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.392664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31658638-0283-48e0-8bb6-da25b7c162c8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f0bdb9bb96f43f4a15cc7af034a7954, role_id=db1aa7339c7a4b6882267605cfb41652)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.395471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31658638-0283-48e0-8bb6-da25b7c162c8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-31658638-0283-48e0-8bb6-da25b7c162c8 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Could not find role: db1aa7339c7a4b6882267605cfb41652.: keystone.exception.RoleNotFound: Could not find role: db1aa7339c7a4b6882267605cfb41652. Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 18 22:26:45.421165 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 22:26:45.422372 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: db1aa7339c7a4b6882267605cfb41652. Jun 18 22:26:45.422372 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:45.426208 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3179/6332] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Jun 18 22:26:45 2022] GET /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/db1aa7339c7a4b6882267605cfb41652 => generated 110 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jun 18 22:26:45.428819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.428975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3153/6332] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:45 2022] PUT /identity/v3/projects/f40438adf0344122a3f04c3a813ee749/users/5760183761cc47199bbb4a4b1b13ad6d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:45.429337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.429838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.430073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.478828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] MFA Rules not processed for user `5760183761cc47199bbb4a4b1b13ad6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:45.480370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:45.601518 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3180/6333] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:45.602668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.608030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:45.673330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d645da-275a-48fb-b8a8-f8102acfc492 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.677598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.679936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.680290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.680575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/db1aa7339c7a4b6882267605cfb41652` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.687528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9f0bdb9bb96f43f4a15cc7af034a7954, role_id=db1aa7339c7a4b6882267605cfb41652)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.689004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Could not find role: db1aa7339c7a4b6882267605cfb41652.: keystone.exception.RoleNotFound: Could not find role: db1aa7339c7a4b6882267605cfb41652. Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 18 22:26:45.715809 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 22:26:45.716987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: db1aa7339c7a4b6882267605cfb41652. Jun 18 22:26:45.716987 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:45.718239 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3154/6334] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Jun 18 22:26:45 2022] HEAD /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954/roles/db1aa7339c7a4b6882267605cfb41652 => generated 0 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 18 22:26:45.719150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.743049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b58ef6-2f92-414c-bb3f-d2e0ae89f904 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.747860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021a0ed-d6b1-4cd1-98f9-5297c7d6275d tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:45.751553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.752771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.753305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.753718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:45.753860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] PATH_INFO: `/v3/projects/a98aecfa57fe43edb1b855cb0c732ffe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.754395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:45.754763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:45.755045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:45.755326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98aecfa57fe43edb1b855cb0c732ffe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.755735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:45.757973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.758215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:45.818811 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3155/6335] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:45 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:45.820065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.837308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:45.867559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98aecfa57fe43edb1b855cb0c732ffe', 'request_id': 'req-b6831984-34a5-402a-8021-fcdb2150e466'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.879177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98aecfa57fe43edb1b855cb0c732ffe', 'request_id': 'req-b6831984-34a5-402a-8021-fcdb2150e466'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.895882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98aecfa57fe43edb1b855cb0c732ffe', 'request_id': 'req-b6831984-34a5-402a-8021-fcdb2150e466'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.909437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] The token cache is being invalidate because project a98aecfa57fe43edb1b855cb0c732ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:45.909776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.910570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:45.912810 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3181/6336] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:45 2022] DELETE /identity/v3/projects/a98aecfa57fe43edb1b855cb0c732ffe => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:45.913336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:45.915262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:45.924655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadca0db-6176-4fff-a4a7-9ba773dd48d4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.000898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.002476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.002911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.003328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.026852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorizing `identity:delete_trust(trust_id=9f0bdb9bb96f43f4a15cc7af034a7954)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:46.028469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:46.044906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:46.064003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6831984-34a5-402a-8021-fcdb2150e466 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.071940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0cd56-0fe7-4c68-80d6-5fe2e00cea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.072922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9f0bdb9bb96f43f4a15cc7af034a7954', 'request_id': 'req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.073830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0cd56-0fe7-4c68-80d6-5fe2e00cea58 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.074112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9f0bdb9bb96f43f4a15cc7af034a7954', 'request_id': 'req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.074531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0cd56-0fe7-4c68-80d6-5fe2e00cea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.074940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '9f0bdb9bb96f43f4a15cc7af034a7954', 'request_id': 'req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.075171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0cd56-0fe7-4c68-80d6-5fe2e00cea58 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.076041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0cd56-0fe7-4c68-80d6-5fe2e00cea58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:46.096211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0cd56-0fe7-4c68-80d6-5fe2e00cea58 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:46.102557 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3156/6337] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:26:45 2022] DELETE /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:46.107327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:46.112082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.147592 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3182/6338] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:45 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:46.149184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.150002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.150440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.159244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e262-e43e-4a72-8b1f-f105c3abcaa0 tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.169529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.173889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.174385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.175068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] PATH_INFO: `/v3/projects/154a2adfa57b4e23bf84cb77d3975a90` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.190816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] RBAC: Authorizing `identity:delete_project(project_id=154a2adfa57b4e23bf84cb77d3975a90)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:46.201418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:46.213243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:46.219771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.245744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3183/6339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:46.254100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:46.258826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.289768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33bf33-969c-40d6-90d6-61a8742055ca None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.308922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154a2adfa57b4e23bf84cb77d3975a90', 'request_id': 'req-42915cff-0f72-48a7-a1dd-4e93951233df'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.321789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154a2adfa57b4e23bf84cb77d3975a90', 'request_id': 'req-42915cff-0f72-48a7-a1dd-4e93951233df'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.336497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154a2adfa57b4e23bf84cb77d3975a90', 'request_id': 'req-42915cff-0f72-48a7-a1dd-4e93951233df'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.364955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] The token cache is being invalidate because project 154a2adfa57b4e23bf84cb77d3975a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:46.365572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.368931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.376105 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3157/6340] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:46 2022] DELETE /identity/v3/projects/154a2adfa57b4e23bf84cb77d3975a90 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:46.378220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:46.381615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.461821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285010d9-6d88-474b-bff5-f69f3309514c tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cc6af71b423429699715e9f6411849c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '743d69a9f668499491ebbf39b3e07a81', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-292073218', 'tempest-NotDelegatedRole-840672453'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.462851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285010d9-6d88-474b-bff5-f69f3309514c tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.463136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285010d9-6d88-474b-bff5-f69f3309514c tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.463415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285010d9-6d88-474b-bff5-f69f3309514c tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] PATH_INFO: `/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-285010d9-6d88-474b-bff5-f69f3309514c tempest-TrustsV3TestJSON-34281946 tempest-user-1448229145] Could not find trust: 9f0bdb9bb96f43f4a15cc7af034a7954.: keystone.exception.TrustNotFound: Could not find trust: 9f0bdb9bb96f43f4a15cc7af034a7954. Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 18 22:26:46.481292 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 9f0bdb9bb96f43f4a15cc7af034a7954. Jun 18 22:26:46.482617 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:46.487048 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3184/6341] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:46 2022] GET /identity/v3/OS-TRUST/trusts/9f0bdb9bb96f43f4a15cc7af034a7954 => generated 111 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:46.489452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acae9e-fd1f-410f-aed3-b2a627c0ac3e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.489452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acae9e-fd1f-410f-aed3-b2a627c0ac3e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.489452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acae9e-fd1f-410f-aed3-b2a627c0ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.520542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e3acae9e-fd1f-410f-aed3-b2a627c0ac3e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:46.522542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e3acae9e-fd1f-410f-aed3-b2a627c0ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.531212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42915cff-0f72-48a7-a1dd-4e93951233df admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.550605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.550840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3185/6342] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:46.550980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.550980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.550980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.551287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e931125-d10d-4d54-a779-5f52101f384f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.551287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e931125-d10d-4d54-a779-5f52101f384f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.551472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:46.551578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e931125-d10d-4d54-a779-5f52101f384f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.552481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:46.583907 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3158/6343] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:46 2022] GET /identity/v3/roles => generated 1891 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:46.584700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:46.597460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.609589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6e931125-d10d-4d54-a779-5f52101f384f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:46.611417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e931125-d10d-4d54-a779-5f52101f384f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.626678 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3186/6344] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:46.627850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e931125-d10d-4d54-a779-5f52101f384f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:46.667632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e931125-d10d-4d54-a779-5f52101f384f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.686418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.687349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.687728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.688105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.689425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:46.689830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:46.693527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:46.734998 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3187/6345] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:46.736111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:46.754138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c578037-c8d3-4531-9232-2168aee59dee admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.762709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076bf1-e7d8-4966-ae53-7af324123501 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:46.768337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064051f5-e37c-445e-842c-8022e6343ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.769756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064051f5-e37c-445e-842c-8022e6343ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.770285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064051f5-e37c-445e-842c-8022e6343ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.770879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064051f5-e37c-445e-842c-8022e6343ce7 admin admin] PATH_INFO: `/v3/projects/5b4f98548fb04583841aa09ee120bab0/users/f6db51559b214a6491059797627e9b7c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.786236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:46.787485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.788066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.788775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/db1aa7339c7a4b6882267605cfb41652` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.791654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=db1aa7339c7a4b6882267605cfb41652)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:46.793649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:46.802389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:46.823321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064051f5-e37c-445e-842c-8022e6343ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4f98548fb04583841aa09ee120bab0, user_id=f6db51559b214a6491059797627e9b7c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:46.826974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064051f5-e37c-445e-842c-8022e6343ce7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:46.842716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:46.870339 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3188/6346] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:46 2022] PUT /identity/v3/projects/5b4f98548fb04583841aa09ee120bab0/users/f6db51559b214a6491059797627e9b7c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:46.878970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:46.879305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:46.879654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:46.890419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role db1aa7339c7a4b6882267605cfb41652 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:46.890721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.891428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:46.893594 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3159/6347] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:46 2022] DELETE /identity/v3/roles/db1aa7339c7a4b6882267605cfb41652 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:46.894344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:46.900939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:46.914595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:46.917590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.033200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f998e53-f0bb-49a5-af81-50c09093329f tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.040787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.041735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.042018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.042291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.043011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.045364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.055798 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3189/6348] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:47.056767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.059291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.099473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d37c3b-0614-416e-bb92-7dec291045af None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.113999 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3160/6349] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:46 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:47.113999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.115086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.125017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.126124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.126603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.127058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.128026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.130692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.153908 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3190/6350] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:47 2022] GET /identity/v3/roles => generated 1654 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:47.154976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.157235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.230317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01da1d7-e002-432b-8ff7-26742d477339 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.236956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.238058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.238340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.238619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] PATH_INFO: `/v3/users/719d3fb4f7f44c239e03b5f7076edcc8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.239849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] RBAC: Authorizing `identity:delete_user(user_id=719d3fb4f7f44c239e03b5f7076edcc8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.240873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dbee2-ae72-4767-906b-9d694570ebf4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.241819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.298445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719d3fb4f7f44c239e03b5f7076edcc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.299625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719d3fb4f7f44c239e03b5f7076edcc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.305827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:47.312071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.313010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.313313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.313654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/051e509f699d4083870f9c7090f3f0e8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.314557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719d3fb4f7f44c239e03b5f7076edcc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.315203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=051e509f699d4083870f9c7090f3f0e8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.316103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719d3fb4f7f44c239e03b5f7076edcc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.317445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.325618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719d3fb4f7f44c239e03b5f7076edcc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.343842 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3161/6351] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:47 2022] DELETE /identity/v3/users/719d3fb4f7f44c239e03b5f7076edcc8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:47.344917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.346011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.372811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role 051e509f699d4083870f9c7090f3f0e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:47.373329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.374080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.376050 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3191/6352] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:47 2022] DELETE /identity/v3/roles/051e509f699d4083870f9c7090f3f0e8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:47.376904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.378442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.385306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:47.428440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143569e-1632-4a2d-ae58-e7ce1a7b875d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.459700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900634e-222f-4701-b79d-c1091ff37454 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.465112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.465814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.466169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.466358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.467057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.469059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.493210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3192/6353] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:47 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:47.494619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.496267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.499927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.500621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.500902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.502058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.503159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:47.503653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.506630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.510179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c47ef-20f7-44b8-83e5-268b5b26edb1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.515866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.517310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.517658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.518001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] PATH_INFO: `/v3/projects/5b4f98548fb04583841aa09ee120bab0/users/f6db51559b214a6491059797627e9b7c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.523930 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3162/6354] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:47.524132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4f98548fb04583841aa09ee120bab0, user_id=f6db51559b214a6491059797627e9b7c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.524308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.524308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.524517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.536611 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3193/6355] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:47 2022] PUT /identity/v3/projects/5b4f98548fb04583841aa09ee120bab0/users/f6db51559b214a6491059797627e9b7c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:47.537602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.537786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44909b98-f64e-45ac-8aeb-9d80384ccd1e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.547626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.609605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.610848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.611201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.611553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] PATH_INFO: `/v3/users/01ecbaf0e5004723bd6a96296ea135d8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.612834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ecbaf0e5004723bd6a96296ea135d8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.614798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.619556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627328e5-f28e-44e3-98ba-6666c824b682 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.624276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.625242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.625536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.625817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users/5cc6af71b423429699715e9f6411849c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.627061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5cc6af71b423429699715e9f6411849c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.628718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:47.629003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.665846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ecbaf0e5004723bd6a96296ea135d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.666514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ecbaf0e5004723bd6a96296ea135d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.675651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc6af71b423429699715e9f6411849c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.676306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc6af71b423429699715e9f6411849c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.679329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ecbaf0e5004723bd6a96296ea135d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.680249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ecbaf0e5004723bd6a96296ea135d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.687756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ecbaf0e5004723bd6a96296ea135d8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.688906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc6af71b423429699715e9f6411849c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.689621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc6af71b423429699715e9f6411849c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.697627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc6af71b423429699715e9f6411849c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:47.702392 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3163/6356] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:47 2022] DELETE /identity/v3/users/01ecbaf0e5004723bd6a96296ea135d8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:47.703291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.704619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.710687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:47.718402 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3194/6357] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:47 2022] DELETE /identity/v3/users/5cc6af71b423429699715e9f6411849c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:47.720699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.726403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.784960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f096ec-887e-4213-ae61-8cdfbb6048ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.824293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243972e-bd10-4280-bba5-9d81ac313589 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.829090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fe5a2-efcf-4a3a-8b10-3e7ab23cb984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.829752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe5a2-efcf-4a3a-8b10-3e7ab23cb984 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.830035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe5a2-efcf-4a3a-8b10-3e7ab23cb984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.830304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe5a2-efcf-4a3a-8b10-3e7ab23cb984 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.831005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fe5a2-efcf-4a3a-8b10-3e7ab23cb984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.836192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fe5a2-efcf-4a3a-8b10-3e7ab23cb984 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.859994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.862773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.863080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.863684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.865132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.867179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.870422 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3195/6358] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:47 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:47.871863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.872198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.872479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.886990 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3164/6359] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:47.888974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.891322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.908183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] MFA Rules not processed for user `f6db51559b214a6491059797627e9b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:47.909661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:47.920447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa01a2-8281-4447-bbcf-db91d7f5fc25 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:47.957611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:47.984608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:47.985521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:47.985800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:47.986131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] PATH_INFO: `/v3/projects/a88cba0e44af4875b05d6c3546cf0543` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:47.987378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88cba0e44af4875b05d6c3546cf0543)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:47.989509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:47.991653 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3196/6360] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:47.992567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:47.994177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.041090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88cba0e44af4875b05d6c3546cf0543', 'request_id': 'req-a36d2a22-8efc-4298-9716-5a9918e02ac1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.047541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88cba0e44af4875b05d6c3546cf0543', 'request_id': 'req-a36d2a22-8efc-4298-9716-5a9918e02ac1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.056970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88cba0e44af4875b05d6c3546cf0543', 'request_id': 'req-a36d2a22-8efc-4298-9716-5a9918e02ac1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.066513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd09f16-ac18-44cb-a846-d3f909f440f4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.070239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] The token cache is being invalidate because project a88cba0e44af4875b05d6c3546cf0543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:48.070707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.071850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.073506 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3165/6361] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:47 2022] DELETE /identity/v3/projects/a88cba0e44af4875b05d6c3546cf0543 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:48.074344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.075751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.079245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:48.125649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.126480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.126765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.127045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/743d69a9f668499491ebbf39b3e07a81` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.128273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_project(project_id=743d69a9f668499491ebbf39b3e07a81)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.130269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.139779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2a22-8efc-4298-9716-5a9918e02ac1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.144447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.145161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.145444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.145719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.146599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.148670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.175420 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3166/6362] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:48 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:48.175420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.175420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.191053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2287a40-0360-44b6-b6e4-f9f8518dc435 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.200049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743d69a9f668499491ebbf39b3e07a81', 'request_id': 'req-77e90091-c2fe-44f6-baf6-8bd97365bcdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.212116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743d69a9f668499491ebbf39b3e07a81', 'request_id': 'req-77e90091-c2fe-44f6-baf6-8bd97365bcdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.227055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743d69a9f668499491ebbf39b3e07a81', 'request_id': 'req-77e90091-c2fe-44f6-baf6-8bd97365bcdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.239627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] The token cache is being invalidate because project 743d69a9f668499491ebbf39b3e07a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:48.240026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.240721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.242554 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3197/6363] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:47 2022] DELETE /identity/v3/projects/743d69a9f668499491ebbf39b3e07a81 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:48.247792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.249248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.255738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:48.267430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.270243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.270766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.271238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.272190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.274713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.286826 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3167/6364] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:48.287950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.290520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.331544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e90091-c2fe-44f6-baf6-8bd97365bcdf tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.336437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.337348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.337632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.337907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] PATH_INFO: `/v3/projects/106e2aa0adfd40da9a2d689f3b4653db` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.339106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106e2aa0adfd40da9a2d689f3b4653db)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.341117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.355028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af8f4-79c7-4fe9-bc10-cdbe4fa4f1dd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.358884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.359547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.359941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.360320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.362183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.387441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:48.390533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106e2aa0adfd40da9a2d689f3b4653db', 'request_id': 'req-571561a5-ec9e-472f-81dd-ed6a7f29c713'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.399658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106e2aa0adfd40da9a2d689f3b4653db', 'request_id': 'req-571561a5-ec9e-472f-81dd-ed6a7f29c713'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.408353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106e2aa0adfd40da9a2d689f3b4653db', 'request_id': 'req-571561a5-ec9e-472f-81dd-ed6a7f29c713'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.419338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] The token cache is being invalidate because project 106e2aa0adfd40da9a2d689f3b4653db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:48.419631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.420284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-571561a5-ec9e-472f-81dd-ed6a7f29c713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.422043 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3198/6365] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:48 2022] DELETE /identity/v3/projects/106e2aa0adfd40da9a2d689f3b4653db => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:48.423357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.423648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.423932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.429705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.431142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.441531 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3168/6366] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:48.442605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.443326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:48.443913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.444552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.458077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e880b9-b6b2-44a2-b08c-269a17ec883e service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.512299 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3199/6367] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:48.513273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.514666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.540921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.541635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.542016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.542390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.543255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.545308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.556966 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3169/6368] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:48.557934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.559884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.577661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4d10b-98f5-4298-b506-fe6341bd7e56 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.583007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.583994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.584377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.584700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] PATH_INFO: `/v3/projects/74cadec108de4dd28a1b69ef6e01d26b/users/f3b4ccf9fb6546f9a2e4716b2d85885a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.595459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9373b-0c59-4902-89dd-45eb5d262cf8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.600257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cadec108de4dd28a1b69ef6e01d26b, user_id=f3b4ccf9fb6546f9a2e4716b2d85885a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.601093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afc70c-d360-4c91-9337-2c5843f82387 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.601918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc70c-d360-4c91-9337-2c5843f82387 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.602271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc70c-d360-4c91-9337-2c5843f82387 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.602613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc70c-d360-4c91-9337-2c5843f82387 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.602810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.603588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afc70c-d360-4c91-9337-2c5843f82387 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.606280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afc70c-d360-4c91-9337-2c5843f82387 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.617350 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3170/6369] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:48 2022] PUT /identity/v3/projects/74cadec108de4dd28a1b69ef6e01d26b/users/f3b4ccf9fb6546f9a2e4716b2d85885a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:48.618386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.628665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.645278 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3200/6370] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:26:48 2022] POST /identity/v3/projects => generated 329 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:48.645278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.645278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.645278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.650419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:48.670283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:48.671724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.718833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f007d-6c18-4a78-9f2e-935710d23b4c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.731948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:48.745554 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3201/6371] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:48.746640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.748837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.761944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb2a13-39c2-443c-a746-d1c767a6f1ae None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.767465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c5d58-d350-4315-a215-b5baa7590cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.768345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5d58-d350-4315-a215-b5baa7590cdc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.768795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5d58-d350-4315-a215-b5baa7590cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.769341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5d58-d350-4315-a215-b5baa7590cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.770498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c5d58-d350-4315-a215-b5baa7590cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.772403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c5d58-d350-4315-a215-b5baa7590cdc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.783371 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3202/6372] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:48.784969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.785471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.785916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.791764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.792659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.792940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.793257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] PATH_INFO: `/v3/users/cd196919118544aa96972f034451acc8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.795676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd196919118544aa96972f034451acc8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.796803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:48.826064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] MFA Rules not processed for user `f3b4ccf9fb6546f9a2e4716b2d85885a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:48.827302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.849000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd196919118544aa96972f034451acc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.849716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd196919118544aa96972f034451acc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.869391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd196919118544aa96972f034451acc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.870380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd196919118544aa96972f034451acc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.879441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd196919118544aa96972f034451acc8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:48.899040 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3171/6373] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:48 2022] DELETE /identity/v3/users/cd196919118544aa96972f034451acc8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:48.899040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.900242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.921424 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3203/6374] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:48.922511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:48.924507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:48.943720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23e6a8-1efe-40c9-8ca6-46d6df987092 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.959346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:48.983970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3902c1-76fa-42e8-9def-a16bb590713e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:48.990830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:48.991636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:48.991987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:48.992321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:48.993308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:48.995405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.023585 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3172/6375] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:48 2022] POST /identity/v3/users => generated 416 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.024641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.025635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.026324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.026608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.026722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.026885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.027640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:49.027947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.029604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.045057 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3204/6376] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:49.045816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.048510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6547388-bf8d-4e0a-ab49-aea02680682b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.050400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.054877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.055843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.056121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.056661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] PATH_INFO: `/v3/projects/692c7528a3fc460a8d67e5467ee043ad/users/bba15a826bb84582be6f841b3acb980d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.064491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de745ae-2e1f-42b3-b952-2d0578352dab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.070300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.070979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.071255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.071528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.072251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.073947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=692c7528a3fc460a8d67e5467ee043ad, user_id=bba15a826bb84582be6f841b3acb980d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.074723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.077076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.094359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3173/6377] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:49 2022] PUT /identity/v3/projects/692c7528a3fc460a8d67e5467ee043ad/users/bba15a826bb84582be6f841b3acb980d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:49.095435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.103994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.113075 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3205/6378] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.113075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.176802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bf6e4-cead-4324-b27f-d1d69d2febfb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.183504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:49.198078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cd70-6693-4362-9643-f355f40d3425 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.202879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.203787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.203983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.204240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.204966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.206632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.228009 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3206/6379] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/roles => generated 243 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.228009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.237229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.238179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.238472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.238734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] PATH_INFO: `/v3/users/5760183761cc47199bbb4a4b1b13ad6d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.239948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5760183761cc47199bbb4a4b1b13ad6d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.241942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.289889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a51170-c0d2-4ea1-8150-42f8c9f888d8 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.290614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5760183761cc47199bbb4a4b1b13ad6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.291309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5760183761cc47199bbb4a4b1b13ad6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.294526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fc750-4cc8-41c5-b6c7-8f354dde3be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.295188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fc750-4cc8-41c5-b6c7-8f354dde3be1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.295468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fc750-4cc8-41c5-b6c7-8f354dde3be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.295798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fc750-4cc8-41c5-b6c7-8f354dde3be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.296733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fc750-4cc8-41c5-b6c7-8f354dde3be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.296865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:49.298405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fc750-4cc8-41c5-b6c7-8f354dde3be1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.306007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5760183761cc47199bbb4a4b1b13ad6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.306816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5760183761cc47199bbb4a4b1b13ad6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.314730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5760183761cc47199bbb4a4b1b13ad6d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.325168 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3207/6380] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.327077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.327365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.327681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.331144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3174/6381] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:49 2022] DELETE /identity/v3/users/5760183761cc47199bbb4a4b1b13ad6d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:49.331963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.333349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.356613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] MFA Rules not processed for user `bba15a826bb84582be6f841b3acb980d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:49.357863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.408806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f93689-a756-4257-ada9-feb3604458ba admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.416074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.416755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.417057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.417336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.418091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.420443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.433192 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3208/6382] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:49.434370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.435840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.452329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb9c3b-f3df-4ef1-bf98-edc54a7aa422 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.457276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.458153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.458586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.458721 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3175/6383] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.458842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] PATH_INFO: `/v3/projects/79f53df0af824231bfe6e508ef30b728` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.459444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.459924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f53df0af824231bfe6e508ef30b728)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.462040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.463025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.518904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f53df0af824231bfe6e508ef30b728', 'request_id': 'req-ad789b17-44ae-4127-998d-085e72f26a35'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.525191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f53df0af824231bfe6e508ef30b728', 'request_id': 'req-ad789b17-44ae-4127-998d-085e72f26a35'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.526879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:49.535253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f53df0af824231bfe6e508ef30b728', 'request_id': 'req-ad789b17-44ae-4127-998d-085e72f26a35'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.537185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b76fdf-2320-4350-bcac-98c8349367ca admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.549105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] The token cache is being invalidate because project 79f53df0af824231bfe6e508ef30b728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:49.549392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.550045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:49.551625 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3209/6384] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:49 2022] DELETE /identity/v3/projects/79f53df0af824231bfe6e508ef30b728 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:49.558010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.559498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.616289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402372a8-68ff-4a26-8e74-e6ca649bbbb9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.617132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402372a8-68ff-4a26-8e74-e6ca649bbbb9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.617571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402372a8-68ff-4a26-8e74-e6ca649bbbb9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.617944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402372a8-68ff-4a26-8e74-e6ca649bbbb9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.619381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402372a8-68ff-4a26-8e74-e6ca649bbbb9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.621638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402372a8-68ff-4a26-8e74-e6ca649bbbb9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.638264 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3176/6385] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/roles => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.639768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.640335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.640507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.650284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad789b17-44ae-4127-998d-085e72f26a35 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.654086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:49.656274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.657268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.657571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.657849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.658723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.661206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.661457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:49.663548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.675284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3177/6386] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:49.676453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.682267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.693749 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3210/6387] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.697485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.697940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.702426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ad19-ac35-41d9-9307-abd14e00293e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.708367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.709335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.709906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.710460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.711361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.713148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48996db-118b-4b97-8540-35a5cbbad42a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.713702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.718510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.719246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.719726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.719911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.720600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.722305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.734723 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3211/6388] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:49 2022] GET /identity/v3/roles => generated 1891 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:49.736006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.739373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.755161 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3178/6389] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:49.756382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.759857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:49.761904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a676-967f-4555-b46c-6b83bd6b8588 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.830751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef1da-24b7-4857-a882-664590a38643 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.832882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.833846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.834136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.834415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/123106436dcd4b96aaf7f820b5e94bcf/users/1c51563cf31d4695b05e1e6d5ef69cf4/roles/7a8d26b0c6794c9ebf33ae1340203267` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.835719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.836882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.837384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.837671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.855013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=123106436dcd4b96aaf7f820b5e94bcf, user_id=1c51563cf31d4695b05e1e6d5ef69cf4, role_id=7a8d26b0c6794c9ebf33ae1340203267)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.858004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.879428 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3212/6390] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:49 2022] PUT /identity/v3/projects/123106436dcd4b96aaf7f820b5e94bcf/users/1c51563cf31d4695b05e1e6d5ef69cf4/roles/7a8d26b0c6794c9ebf33ae1340203267 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:49.879428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.925216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.926810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.936617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:49.941681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3179/6391] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:49.942597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:49.955939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5a51-04d8-4fed-9c09-b07021ead32d service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.961495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.962436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.962723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.963182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] PATH_INFO: `/v3/projects/ce7b637b826c4901afc4cacec5757ffc/users/a909bc421bc2443aa87f600ad3cec4fa/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.964343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3705cd-f312-4d86-a80c-45221a84143b tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:49.971595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:49.972647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:49.973215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:49.973599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:49.974541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.976356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.986408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7b637b826c4901afc4cacec5757ffc, user_id=a909bc421bc2443aa87f600ad3cec4fa, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:49.989469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:49.990413 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3213/6392] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:49 2022] GET /identity/v3/roles => generated 1891 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:49.994737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.008512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ecac2-b3ce-4334-a71c-423b80c62097 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.012313 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3180/6393] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:49 2022] PUT /identity/v3/projects/ce7b637b826c4901afc4cacec5757ffc/users/a909bc421bc2443aa87f600ad3cec4fa/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:50.012313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.115334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.116245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.116627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.117568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.117845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.119998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.125074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b4a69-8dc4-4654-8bdc-5a58eee30adb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.132559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.133995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.134330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.134836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/123106436dcd4b96aaf7f820b5e94bcf/users/1c51563cf31d4695b05e1e6d5ef69cf4/roles/9922f3679aff4c469b596a582160f264` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.137456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:create_grant(project_id=123106436dcd4b96aaf7f820b5e94bcf, user_id=1c51563cf31d4695b05e1e6d5ef69cf4, role_id=9922f3679aff4c469b596a582160f264)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.144147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.144490 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3214/6394] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:49 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:50.144691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:50.144782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.156177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f590-a351-42ad-bd05-0be15e0a1e30 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.164250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.165661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.165879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.166136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.166983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.168779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.170591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3181/6395] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:50 2022] PUT /identity/v3/projects/123106436dcd4b96aaf7f820b5e94bcf/users/1c51563cf31d4695b05e1e6d5ef69cf4/roles/9922f3679aff4c469b596a582160f264 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:50.171909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.182617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3215/6396] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:50 2022] GET /identity/v3/roles => generated 1891 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:50.183534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.194566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c79997-961f-473a-97cb-70dcee3c5c55 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.253746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ae7c-be47-41f6-b5a9-d3eec2fb92df tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.260656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.261015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.261561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.261746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.261947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.262080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.262281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.262406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.263082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.263211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.264765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.264940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.279494 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3216/6397] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:50 2022] GET /identity/v3/roles => generated 1891 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:50.283419 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3182/6398] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:50 2022] GET /identity/v3/roles => generated 1891 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:50.283419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.285067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.297090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24237d-8026-400c-9d24-6c77bd584f56 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.302560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.303521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.303803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.304077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] PATH_INFO: `/v3/projects/254bf89989f04c4e8c2fe857b853c3de/users/0139ec1b1a664b9388293d41e892db04/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.321955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254bf89989f04c4e8c2fe857b853c3de, user_id=0139ec1b1a664b9388293d41e892db04, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.324687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.343495 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3217/6399] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:50 2022] PUT /identity/v3/projects/254bf89989f04c4e8c2fe857b853c3de/users/0139ec1b1a664b9388293d41e892db04/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:50.344655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.367742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5240c-2c0b-4459-932b-ecc63478471d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.377717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:50.412032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22eb76-6b43-4e6a-ba5d-7fb9a99b5e67 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.416991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.417914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.418182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.418514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] PATH_INFO: `/v3/projects/e216905a10de4b0a829b979a339e480a/users/fcac65f639634bf185766bf6361072b1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.427198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.427874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.428161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.428443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.429252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.431126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.436625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e216905a10de4b0a829b979a339e480a, user_id=fcac65f639634bf185766bf6361072b1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.439280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.454151 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3218/6400] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:50 2022] PUT /identity/v3/projects/e216905a10de4b0a829b979a339e480a/users/fcac65f639634bf185766bf6361072b1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:50.454953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.460815 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3183/6401] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:50 2022] GET /identity/v3/users => generated 8351 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:50.461549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.463320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:50.477149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b07f6-4528-4af4-8fd9-2d0d5510776c tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.508010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:50.523437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e3014-7a3f-4e1d-a907-1c2a0744da8b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.531648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f768f-62ff-4966-8943-ffc1f1ddd833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.532640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f768f-62ff-4966-8943-ffc1f1ddd833 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.532926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f768f-62ff-4966-8943-ffc1f1ddd833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.533215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f768f-62ff-4966-8943-ffc1f1ddd833 admin admin] PATH_INFO: `/v3/projects/ce7b637b826c4901afc4cacec5757ffc/users/a909bc421bc2443aa87f600ad3cec4fa/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.535302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f768f-62ff-4966-8943-ffc1f1ddd833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7b637b826c4901afc4cacec5757ffc, user_id=a909bc421bc2443aa87f600ad3cec4fa, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.538034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f768f-62ff-4966-8943-ffc1f1ddd833 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.543286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.544425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.544774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.545875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] PATH_INFO: `/v3/projects/f40438adf0344122a3f04c3a813ee749` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.547298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40438adf0344122a3f04c3a813ee749)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.549519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.550748 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3219/6402] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:50 2022] PUT /identity/v3/projects/ce7b637b826c4901afc4cacec5757ffc/users/a909bc421bc2443aa87f600ad3cec4fa/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:50.552117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1587d-653f-4cfa-845f-1da904a4a64b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.552468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1587d-653f-4cfa-845f-1da904a4a64b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.552809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1587d-653f-4cfa-845f-1da904a4a64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.577301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6da1587d-653f-4cfa-845f-1da904a4a64b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:50.578696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6da1587d-653f-4cfa-845f-1da904a4a64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:50.621151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40438adf0344122a3f04c3a813ee749', 'request_id': 'req-131719d7-b655-437b-82f7-9d6785493c4e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.628702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40438adf0344122a3f04c3a813ee749', 'request_id': 'req-131719d7-b655-437b-82f7-9d6785493c4e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.639045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40438adf0344122a3f04c3a813ee749', 'request_id': 'req-131719d7-b655-437b-82f7-9d6785493c4e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.650415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] The token cache is being invalidate because project f40438adf0344122a3f04c3a813ee749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:50.650702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.651364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-131719d7-b655-437b-82f7-9d6785493c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.652127 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3220/6403] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:50.653769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1587d-653f-4cfa-845f-1da904a4a64b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.656434 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3184/6404] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:50 2022] DELETE /identity/v3/projects/f40438adf0344122a3f04c3a813ee749 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:50.657933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.658343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.658536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.672043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1587d-653f-4cfa-845f-1da904a4a64b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.698709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] MFA Rules not processed for user `1c51563cf31d4695b05e1e6d5ef69cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:50.700047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:50.726906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:50.740633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef33a5-388a-4d3e-a752-f6016976656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.741352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef33a5-388a-4d3e-a752-f6016976656a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.741633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef33a5-388a-4d3e-a752-f6016976656a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.741932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef33a5-388a-4d3e-a752-f6016976656a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.742665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef33a5-388a-4d3e-a752-f6016976656a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.744442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef33a5-388a-4d3e-a752-f6016976656a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.755774 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3221/6405] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:50 2022] GET /identity/v3/roles => generated 1891 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:50.757299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.757612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.757878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.767307 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3185/6406] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:50 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:50.768224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.769745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:50.784333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] MFA Rules not processed for user `a909bc421bc2443aa87f600ad3cec4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:50.785742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:50.789416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbfd2f-59af-45f4-8669-03806d927416 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.794086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.795039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.795376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.795662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] PATH_INFO: `/v3/users/f6db51559b214a6491059797627e9b7c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.796946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6db51559b214a6491059797627e9b7c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.798942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.843813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:50.849468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6db51559b214a6491059797627e9b7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.850421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6db51559b214a6491059797627e9b7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.865531 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3222/6407] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:50.865531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.865531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:50.868791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6db51559b214a6491059797627e9b7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.869734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6db51559b214a6491059797627e9b7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.878419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6db51559b214a6491059797627e9b7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:50.894098 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3186/6408] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:50 2022] DELETE /identity/v3/users/f6db51559b214a6491059797627e9b7c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:50.894901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:50.896248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:50.938145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a011104-fecb-472b-bc4f-d8460f856d93 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.974862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9627-9e4b-4bef-8131-3feeae5b178c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:50.980571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf56f6a-0b49-46ee-afe4-80cc70a3caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.981775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56f6a-0b49-46ee-afe4-80cc70a3caa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:50.982060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56f6a-0b49-46ee-afe4-80cc70a3caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:50.982346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56f6a-0b49-46ee-afe4-80cc70a3caa7 admin admin] PATH_INFO: `/v3/projects/e216905a10de4b0a829b979a339e480a/users/fcac65f639634bf185766bf6361072b1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:50.984565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf56f6a-0b49-46ee-afe4-80cc70a3caa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e216905a10de4b0a829b979a339e480a, user_id=fcac65f639634bf185766bf6361072b1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:50.987285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf56f6a-0b49-46ee-afe4-80cc70a3caa7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:50.998562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:50.999450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.000122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.000328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.009603 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3187/6409] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:50 2022] PUT /identity/v3/projects/e216905a10de4b0a829b979a339e480a/users/fcac65f639634bf185766bf6361072b1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:51.009603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d4d80-2e6d-4431-8e4c-5139818a82e4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.009603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d4d80-2e6d-4431-8e4c-5139818a82e4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.009603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d4d80-2e6d-4431-8e4c-5139818a82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.010409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.039922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.042967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:51.045379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8e2d4d80-2e6d-4431-8e4c-5139818a82e4 None None] MFA Rules not processed for user `1c51563cf31d4695b05e1e6d5ef69cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:51.047692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8e2d4d80-2e6d-4431-8e4c-5139818a82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.064409 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3223/6410] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:51.065274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.069022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.137321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:51.167796 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3188/6411] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:51.172884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc804d-3a98-4638-807a-afd10eee33ac None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.173489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc804d-3a98-4638-807a-afd10eee33ac None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.174199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc804d-3a98-4638-807a-afd10eee33ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.174448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b4a5-f54e-4994-83da-ddb5e7091ba1 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:51.211311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-05dc804d-3a98-4638-807a-afd10eee33ac None None] MFA Rules not processed for user `fcac65f639634bf185766bf6361072b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:51.212535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-05dc804d-3a98-4638-807a-afd10eee33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.241988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:51.243052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.244777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.245328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.248861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.279337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:51.329091 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3189/6412] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:51.329091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc804d-3a98-4638-807a-afd10eee33ac None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.347519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc804d-3a98-4638-807a-afd10eee33ac None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:51.350994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.354178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:51.354331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:51.354579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.354785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.355070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.355946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:create_trust()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.357248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:51.368649 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3224/6413] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:51.369804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.372193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.454559 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3190/6414] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:26:51 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:51.455906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.458640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.467834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7221b-b28b-4376-9008-67efe80eea2e service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:51.473012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:51.474337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.474728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.474986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] PATH_INFO: `/v3/projects/5b4f98548fb04583841aa09ee120bab0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.477588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4f98548fb04583841aa09ee120bab0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.479899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:51.548797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:51.571641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4f98548fb04583841aa09ee120bab0', 'request_id': 'req-ee355390-5fd6-47af-a599-9773aa1b11cb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:51.578441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc96c1-c7c4-45a6-86ad-9043774c47bd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:51.594524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4f98548fb04583841aa09ee120bab0', 'request_id': 'req-ee355390-5fd6-47af-a599-9773aa1b11cb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:51.610076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4f98548fb04583841aa09ee120bab0', 'request_id': 'req-ee355390-5fd6-47af-a599-9773aa1b11cb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:51.627668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] The token cache is being invalidate because project 5b4f98548fb04583841aa09ee120bab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:51.628106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:51.629067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:51.633603 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3225/6415] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:51 2022] DELETE /identity/v3/projects/5b4f98548fb04583841aa09ee120bab0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:51.633603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.635910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.648284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:51.649058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.649365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.650113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.652282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.735621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee355390-5fd6-47af-a599-9773aa1b11cb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:51.737981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:51.743581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12007-eba1-41c8-bd84-930e35c2d988 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:51.744935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12007-eba1-41c8-bd84-930e35c2d988 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.746395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12007-eba1-41c8-bd84-930e35c2d988 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.746940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12007-eba1-41c8-bd84-930e35c2d988 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.761835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12007-eba1-41c8-bd84-930e35c2d988 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:get_trust(trust_id=f3dad0ea8b2e4aafbf51ca581083f1de)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.763585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12007-eba1-41c8-bd84-930e35c2d988 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:51.775813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.775813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:51.776520 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3226/6416] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:51 2022] GET /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de => generated 834 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:51.778409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f057ff-99db-4b19-becf-68c1665779ec None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.778879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f057ff-99db-4b19-becf-68c1665779ec None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.779313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f057ff-99db-4b19-becf-68c1665779ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.798974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3191/6417] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:51.802040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.811876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-67f057ff-99db-4b19-becf-68c1665779ec None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:51.813378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-67f057ff-99db-4b19-becf-68c1665779ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.831813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa24fd-0f6e-469a-87a0-9097d2f51282 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:51.845171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:51.846009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.846369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.846657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.866755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=f3dad0ea8b2e4aafbf51ca581083f1de)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.868280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:51.905398 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3192/6418] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:26:51 2022] GET /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles => generated 370 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:51.907256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.927164 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3227/6419] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:51.935281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8906-63b4-4baa-8d9d-bbc3fb678ea4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.935640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8906-63b4-4baa-8d9d-bbc3fb678ea4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.935976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8906-63b4-4baa-8d9d-bbc3fb678ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.944509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c10f0-9595-4e50-b793-eacfe9a7d31d tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:51.969642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d3ce8906-63b4-4baa-8d9d-bbc3fb678ea4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:51.970665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:51.971189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d3ce8906-63b4-4baa-8d9d-bbc3fb678ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:51.971916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:51.972361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:51.972799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/7a8d26b0c6794c9ebf33ae1340203267` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:51.984541 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3228/6420] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:51.990087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8906-63b4-4baa-8d9d-bbc3fb678ea4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:51.991375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f3dad0ea8b2e4aafbf51ca581083f1de, role_id=7a8d26b0c6794c9ebf33ae1340203267)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:51.993070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.004521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8906-63b4-4baa-8d9d-bbc3fb678ea4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.015779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.016692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.017519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.017869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.018696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:52.019965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.021936 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3193/6421] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Jun 18 22:26:51 2022] GET /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/7a8d26b0c6794c9ebf33ae1340203267 => generated 243 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:52.023181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.023321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.049605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59520d67-1fe8-494e-a8bb-5513e4c10478 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.055708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.056938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.057418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.057876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/7a8d26b0c6794c9ebf33ae1340203267` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.066266 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3229/6422] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:52.068769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.079479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f3dad0ea8b2e4aafbf51ca581083f1de, role_id=7a8d26b0c6794c9ebf33ae1340203267)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.080754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.092975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3194/6423] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Jun 18 22:26:52 2022] HEAD /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/7a8d26b0c6794c9ebf33ae1340203267 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jun 18 22:26:52.095993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661d146-c0df-4f11-a00d-22a485214db4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.101553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.109584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.114439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.114760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.115143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.115892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.119542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.122292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7b41-5152-43a3-9ae5-ac1ad242873f tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.136767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.137655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.138081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.138207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/9922f3679aff4c469b596a582160f264` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.153597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f3dad0ea8b2e4aafbf51ca581083f1de, role_id=9922f3679aff4c469b596a582160f264)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.155101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Could not find role: 9922f3679aff4c469b596a582160f264.: keystone.exception.RoleNotFound: Could not find role: 9922f3679aff4c469b596a582160f264. Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 18 22:26:52.179364 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 22:26:52.180869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9922f3679aff4c469b596a582160f264. Jun 18 22:26:52.180869 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:52.188444 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3195/6424] 10.222.0.30 () {58 vars in 1367 bytes} [Sat Jun 18 22:26:52 2022] GET /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/9922f3679aff4c469b596a582160f264 => generated 110 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:52.192980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.209698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3230/6425] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:52 2022] POST /identity/v3/projects => generated 355 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:52.210762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.213628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:52.216054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84a1df-4181-4cc5-9445-1ee6a7ce08f2 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.260696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:52.324265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.325633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `HEAD` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.325917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.326201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/9922f3679aff4c469b596a582160f264` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.334201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f3dad0ea8b2e4aafbf51ca581083f1de, role_id=9922f3679aff4c469b596a582160f264)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.335805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Could not find role: 9922f3679aff4c469b596a582160f264.: keystone.exception.RoleNotFound: Could not find role: 9922f3679aff4c469b596a582160f264. Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jun 18 22:26:52.355395 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 18 22:26:52.356777 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 9922f3679aff4c469b596a582160f264. Jun 18 22:26:52.356777 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:26:52.356777 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3196/6426] 10.222.0.30 () {58 vars in 1368 bytes} [Sat Jun 18 22:26:52 2022] HEAD /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de/roles/9922f3679aff4c469b596a582160f264 => generated 0 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jun 18 22:26:52.361258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.374770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e83c-e59d-4c3c-b804-9c3fe09460dd tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.378081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa5cf-e06c-4bcf-906a-13a546a7e960 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.380072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.380584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.380869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.381390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.382106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.384603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.395240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.396540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.396899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.397348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] PATH_INFO: `/v3/users/f3b4ccf9fb6546f9a2e4716b2d85885a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.399246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b4ccf9fb6546f9a2e4716b2d85885a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.402772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.426615 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3197/6427] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:52 2022] POST /identity/v3/users => generated 278 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:52.432495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.455571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa0522-b3bb-44eb-ad80-a15d26ce4037 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.460212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.461476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.462126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.462586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.470440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorizing `identity:delete_trust(trust_id=f3dad0ea8b2e4aafbf51ca581083f1de)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.473387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.502550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f3dad0ea8b2e4aafbf51ca581083f1de', 'request_id': 'req-922ced63-34ca-43c8-a8f7-7435d3287543'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.503503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f3dad0ea8b2e4aafbf51ca581083f1de', 'request_id': 'req-922ced63-34ca-43c8-a8f7-7435d3287543'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.505320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f3dad0ea8b2e4aafbf51ca581083f1de', 'request_id': 'req-922ced63-34ca-43c8-a8f7-7435d3287543'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.507483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b4ccf9fb6546f9a2e4716b2d85885a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.508723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b4ccf9fb6546f9a2e4716b2d85885a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.533722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3198/6428] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:26:52 2022] DELETE /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:52.534594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.534737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b4ccf9fb6546f9a2e4716b2d85885a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.535951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b4ccf9fb6546f9a2e4716b2d85885a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.538420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:52.547279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b4ccf9fb6546f9a2e4716b2d85885a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:52.562049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:52.576562 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3231/6429] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:52 2022] DELETE /identity/v3/users/f3b4ccf9fb6546f9a2e4716b2d85885a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:52.577847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ced63-34ca-43c8-a8f7-7435d3287543 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.578590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.580410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:52.734640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa50550-7e7b-46e7-a432-4a4e2f6882a9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.736316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd7445-1f74-4419-9c45-4a87cee26878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.737164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7445-1f74-4419-9c45-4a87cee26878 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.737568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7445-1f74-4419-9c45-4a87cee26878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.737944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd7445-1f74-4419-9c45-4a87cee26878 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.738804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd7445-1f74-4419-9c45-4a87cee26878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.740561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd7445-1f74-4419-9c45-4a87cee26878 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.753011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c51563cf31d4695b05e1e6d5ef69cf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '123106436dcd4b96aaf7f820b5e94bcf', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-225822363', 'tempest-NotDelegatedRole-739946797'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.754233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.754648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.755023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] PATH_INFO: `/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.769308 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3199/6430] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:52 2022] GET /identity/v3/roles => generated 1891 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Could not find trust: f3dad0ea8b2e4aafbf51ca581083f1de.: keystone.exception.TrustNotFound: Could not find trust: f3dad0ea8b2e4aafbf51ca581083f1de. Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jun 18 22:26:52.770509 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: f3dad0ea8b2e4aafbf51ca581083f1de. Jun 18 22:26:52.771832 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:26:52.777524 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3232/6431] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:26:52 2022] GET /identity/v3/OS-TRUST/trusts/f3dad0ea8b2e4aafbf51ca581083f1de => generated 111 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:26:52.778370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.778691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.779013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.779450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.780842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:52.800358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d27c0-59c3-476f-a79b-ea335a6e2c51 tempest-TrustsV3TestJSON-2007666003 tempest-user-2107755294] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.813672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.814063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:52.814369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.814655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.816056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:52.820059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.820955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.823213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.832212 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3200/6432] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:52.832212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.832212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:52.847069 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3233/6433] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:52 2022] GET /identity/v3/roles => generated 1891 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:52.851523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.868641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad6026-3d05-4bf3-9552-b7f93f387f31 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:52.885219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:52.886277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:52.887131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:52.887486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] PATH_INFO: `/v3/projects/06e58c7426ac47dda531c1ee4838f3f8/users/070972ca7aa746e8af3aaa82579cca33/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:52.912232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e58c7426ac47dda531c1ee4838f3f8, user_id=070972ca7aa746e8af3aaa82579cca33, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:52.917713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:52.947138 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3234/6434] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:52 2022] PUT /identity/v3/projects/06e58c7426ac47dda531c1ee4838f3f8/users/070972ca7aa746e8af3aaa82579cca33/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:52.947138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:52.949483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:52.960160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:52.986671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfacd9-3248-4f71-8dbd-ff676a644b10 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:53.052639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157953c-60f8-4757-903f-6764571d1cc7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:53.057407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:53.058313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:53.058653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:53.058996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:53.106742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:53.109507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:53.110588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:53.112347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/9922f3679aff4c469b596a582160f264` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:53.116335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9922f3679aff4c469b596a582160f264)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:53.125733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:53.227722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role 9922f3679aff4c469b596a582160f264 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:53.228402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.230187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0c6f4300-a478-4752-8c93-8c1daa632acb tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.234746 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3201/6435] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:52 2022] DELETE /identity/v3/roles/9922f3679aff4c469b596a582160f264 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:53.236136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:53.236428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:53.237077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:53.246154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:53.252351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:53.267326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:53.279596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3235/6436] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:53.281193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:53.303053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] MFA Rules not processed for user `070972ca7aa746e8af3aaa82579cca33`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:53.305549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21f502-3122-492e-a661-a867f6aabdcf service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:53.306674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:53.396880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:53.404196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:53.404196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:53.404196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/roles/7a8d26b0c6794c9ebf33ae1340203267` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:53.406582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7a8d26b0c6794c9ebf33ae1340203267)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:53.410758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:53.458896 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3202/6437] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:53.464289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:53.465973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:53.488017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invalidating the token cache because role 7a8d26b0c6794c9ebf33ae1340203267 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:53.489847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.491509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.495486 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3236/6438] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:53 2022] DELETE /identity/v3/roles/7a8d26b0c6794c9ebf33ae1340203267 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:53.500505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:53.502032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:53.553985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:53.592668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a110d5-65d4-4f27-abba-ac235a02c4b9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:53.650574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad084e-c128-4516-af5a-36514635a3b9 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:53.657472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:53.658809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:53.659384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:53.659882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/users/1c51563cf31d4695b05e1e6d5ef69cf4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:53.667086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1c51563cf31d4695b05e1e6d5ef69cf4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:53.669901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:53.751504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c51563cf31d4695b05e1e6d5ef69cf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.752932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c51563cf31d4695b05e1e6d5ef69cf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.772648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:53.773399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:53.773685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:53.773961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:53.774672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:53.776881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:53.796798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c51563cf31d4695b05e1e6d5ef69cf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.799030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c51563cf31d4695b05e1e6d5ef69cf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.819181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c51563cf31d4695b05e1e6d5ef69cf4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:53.830291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3203/6439] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:53 2022] POST /identity/v3/projects => generated 357 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:53.834472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:53.836546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:53.855086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3237/6440] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:53 2022] DELETE /identity/v3/users/1c51563cf31d4695b05e1e6d5ef69cf4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:53.856277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:53.858912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:53.917085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:53.977961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883de2c-031c-42a3-a740-246426aab2eb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:53.991790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbb2c2-5183-4eba-bdd9-38e1a292cfdc tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:53.997407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71a6a6d2b8f42fe85a734c5180be574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cba317541d459989cd85d12cd8a79f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:53.998471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:53.999418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:53.999857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] PATH_INFO: `/v3/projects/123106436dcd4b96aaf7f820b5e94bcf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.001676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorizing `identity:delete_project(project_id=123106436dcd4b96aaf7f820b5e94bcf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:54.004429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:54.092363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:54.099465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:54.100872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.101372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.101653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.103227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:54.105820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:54.123096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123106436dcd4b96aaf7f820b5e94bcf', 'request_id': 'req-5c0f090e-12cc-47d6-a218-0e5d86155c67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.137243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123106436dcd4b96aaf7f820b5e94bcf', 'request_id': 'req-5c0f090e-12cc-47d6-a218-0e5d86155c67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.156892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123106436dcd4b96aaf7f820b5e94bcf', 'request_id': 'req-5c0f090e-12cc-47d6-a218-0e5d86155c67'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.162766 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3204/6441] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:53 2022] POST /identity/v3/users => generated 285 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:54.171573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:54.188367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] The token cache is being invalidate because project 123106436dcd4b96aaf7f820b5e94bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:54.188661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.189794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.194171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35123e-71e6-4a25-bfd9-67786067fd7a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:54.195555 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3238/6442] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:53 2022] DELETE /identity/v3/projects/123106436dcd4b96aaf7f820b5e94bcf => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:54.202689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:54.207508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:54.350987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f090e-12cc-47d6-a218-0e5d86155c67 tempest-TrustsV3TestJSON-1224071318 tempest-TrustsV3TestJSON-1224071318-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:54.354606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:54.356946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.357454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.357651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:54.358291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.358694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.359100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.359273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] PATH_INFO: `/v3/users/98b675ef8e8b4df6beedab344ee9773d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.360567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:54.360804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b675ef8e8b4df6beedab344ee9773d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:54.362652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:54.363065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:54.394535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3205/6443] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:54.399510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:54.403152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:54.424470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830965-3b9d-44cb-a7eb-61245af545a0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:54.431572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:54.432819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.433312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.433747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] PATH_INFO: `/v3/projects/87756774924f48969706c05751dc7e32/users/23f02a2994bf43c6bdf13e22a305c4bc/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.455572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87756774924f48969706c05751dc7e32, user_id=23f02a2994bf43c6bdf13e22a305c4bc, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:54.458624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:54.475076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b675ef8e8b4df6beedab344ee9773d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.476256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b675ef8e8b4df6beedab344ee9773d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.481135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3206/6444] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:54 2022] PUT /identity/v3/projects/87756774924f48969706c05751dc7e32/users/23f02a2994bf43c6bdf13e22a305c4bc/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:54.484556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:54.487317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:54.512382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b675ef8e8b4df6beedab344ee9773d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.513405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b675ef8e8b4df6beedab344ee9773d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.529012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-39710fff-723e-4f84-a99a-2cd32c115ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b675ef8e8b4df6beedab344ee9773d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:54.543161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:54.554399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3239/6445] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:54 2022] DELETE /identity/v3/users/98b675ef8e8b4df6beedab344ee9773d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:54.560173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.560469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.560755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.572986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5adc5-fe7e-4146-bd78-070d6216d3b6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:54.600349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:54.603490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:54.644563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:54.645444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.645939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.646371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.647124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:54.649628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:54.672275 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3207/6446] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:54.673331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:54.692847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9428b-529e-427a-9867-3a2d2df7de5f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:54.704835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc5909-1c96-4288-93c1-82453fde9002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:54.707539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc5909-1c96-4288-93c1-82453fde9002 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.708163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc5909-1c96-4288-93c1-82453fde9002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.708607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc5909-1c96-4288-93c1-82453fde9002 admin admin] PATH_INFO: `/v3/projects/87756774924f48969706c05751dc7e32/users/23f02a2994bf43c6bdf13e22a305c4bc/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.713576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc5909-1c96-4288-93c1-82453fde9002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87756774924f48969706c05751dc7e32, user_id=23f02a2994bf43c6bdf13e22a305c4bc, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:54.716834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc5909-1c96-4288-93c1-82453fde9002 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:54.743269 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3208/6447] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:54 2022] PUT /identity/v3/projects/87756774924f48969706c05751dc7e32/users/23f02a2994bf43c6bdf13e22a305c4bc/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:54.745097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:54.745398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:54.745675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:54.749402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:UPDATE=1,keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:54.786629 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3240/6448] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:54.802375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] MFA Rules not processed for user `23f02a2994bf43c6bdf13e22a305c4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:54.803726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:54.811433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:54.813591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:54.962006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608381cb-4417-4fc4-b10e-67e18e8722d8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:54.981648 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3209/6449] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:54 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:54.982931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:54.984987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:55.050745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:55.076732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243983b-a565-49ac-8557-97e771a4bfd5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:55.084507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:55.085334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:55.085774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:55.086238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:55.087504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:55.088391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:55.088666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:55.088935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] PATH_INFO: `/v3/projects/74cadec108de4dd28a1b69ef6e01d26b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:55.090722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cadec108de4dd28a1b69ef6e01d26b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:55.092658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:55.098750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:55.100651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:55.121301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3241/6450] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:55.123132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:55.126364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:55.195992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cadec108de4dd28a1b69ef6e01d26b', 'request_id': 'req-878f450a-a95f-4cdc-ab03-f176009344bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.202665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cadec108de4dd28a1b69ef6e01d26b', 'request_id': 'req-878f450a-a95f-4cdc-ab03-f176009344bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.214879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cadec108de4dd28a1b69ef6e01d26b', 'request_id': 'req-878f450a-a95f-4cdc-ab03-f176009344bc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.229014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] The token cache is being invalidate because project 74cadec108de4dd28a1b69ef6e01d26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:55.229336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.230529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.233128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3210/6451] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:54 2022] DELETE /identity/v3/projects/74cadec108de4dd28a1b69ef6e01d26b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:55.237819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:55.239270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:55.263555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46092868-6b37-403a-badc-ff1434db42a2 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:55.394266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f450a-a95f-4cdc-ab03-f176009344bc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:55.402961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:55.414734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:55.415339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:55.415861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:55.418353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:55.421782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:55.424191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:55.424475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:55.427760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] PATH_INFO: `/v3/users/a909bc421bc2443aa87f600ad3cec4fa` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:55.435885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a909bc421bc2443aa87f600ad3cec4fa)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:55.441074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:55.458973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:55.567634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:55.571901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:55.573017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a909bc421bc2443aa87f600ad3cec4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.573754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a909bc421bc2443aa87f600ad3cec4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.593204 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3242/6452] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:55 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:55.595817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a909bc421bc2443aa87f600ad3cec4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.597902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a909bc421bc2443aa87f600ad3cec4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.608451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a909bc421bc2443aa87f600ad3cec4fa'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:55.646418 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3211/6453] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:55 2022] DELETE /identity/v3/users/a909bc421bc2443aa87f600ad3cec4fa => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:55.731426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:55.732895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:55.755495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44bc6-fac9-4dd2-87e1-7d5e3125b5ca service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:55.874566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:55.875281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:55.875578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:55.875797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:55.881586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.023654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:56.026235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:56.045421 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3243/6454] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:55 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:56.074154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:56.076008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.083193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:56.276585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:56.278119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.301365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a34a6-1ed5-4123-afcd-8d048d875ed8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:56.305677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bede58-c56d-4a08-bdeb-ccadff84d699 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:56.316606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:56.318330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:56.319329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:56.319817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:56.320111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] PATH_INFO: `/v3/projects/b97bf39116c544219d6675f69283d253` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:56.321957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:56.322971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97bf39116c544219d6675f69283d253)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:56.324612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:56.324770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] PATH_INFO: `/v3/users/bba15a826bb84582be6f841b3acb980d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:56.327639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba15a826bb84582be6f841b3acb980d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:56.329020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:56.333066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:56.411634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba15a826bb84582be6f841b3acb980d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.412344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba15a826bb84582be6f841b3acb980d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.420596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97bf39116c544219d6675f69283d253', 'request_id': 'req-6801c589-abaf-4b63-9055-6a731f828bc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.437027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97bf39116c544219d6675f69283d253', 'request_id': 'req-6801c589-abaf-4b63-9055-6a731f828bc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.438287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:56.444739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba15a826bb84582be6f841b3acb980d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.446445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba15a826bb84582be6f841b3acb980d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.456248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97bf39116c544219d6675f69283d253', 'request_id': 'req-6801c589-abaf-4b63-9055-6a731f828bc4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.459386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba15a826bb84582be6f841b3acb980d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.470794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] The token cache is being invalidate because project b97bf39116c544219d6675f69283d253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:56.471105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.472254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.474734 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3212/6455] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:56 2022] DELETE /identity/v3/projects/b97bf39116c544219d6675f69283d253 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:56.475950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:56.477651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.483501 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3244/6456] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:56 2022] DELETE /identity/v3/users/bba15a826bb84582be6f841b3acb980d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:56.485505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:56.488033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.571114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801c589-abaf-4b63-9055-6a731f828bc4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:56.575997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:56.576879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:56.577413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:56.577700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] PATH_INFO: `/v3/projects/ce7b637b826c4901afc4cacec5757ffc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:56.579467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7b637b826c4901afc4cacec5757ffc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:56.581500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:56.582547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bcc02-7bba-4bc3-913b-b8dd699bfd6a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:56.590015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:56.591021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:56.591300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:56.591685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] PATH_INFO: `/v3/users/c71a6a6d2b8f42fe85a734c5180be574` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:56.593732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71a6a6d2b8f42fe85a734c5180be574)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:56.596927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:56.632839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:56.646923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7b637b826c4901afc4cacec5757ffc', 'request_id': 'req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.654657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7b637b826c4901afc4cacec5757ffc', 'request_id': 'req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.669728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7b637b826c4901afc4cacec5757ffc', 'request_id': 'req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.687573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] The token cache is being invalidate because project ce7b637b826c4901afc4cacec5757ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:56.687875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.688742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a6e6d2c1-d060-4424-b5e5-156b4fa5a610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.694995 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3213/6457] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:56 2022] DELETE /identity/v3/projects/ce7b637b826c4901afc4cacec5757ffc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:56.698112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:56.699086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:56.699626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:56.725821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71a6a6d2b8f42fe85a734c5180be574'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.730810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71a6a6d2b8f42fe85a734c5180be574'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.736276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:56.739558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.753774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71a6a6d2b8f42fe85a734c5180be574'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.754020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71a6a6d2b8f42fe85a734c5180be574'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.767896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3d0a4b37-ba1d-4a67-b807-0facd1707df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71a6a6d2b8f42fe85a734c5180be574'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:56.794576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3245/6458] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:56 2022] DELETE /identity/v3/users/c71a6a6d2b8f42fe85a734c5180be574 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:56.798091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452728ff-4ec0-4d97-8cb7-a5a75119bb08 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:56.799748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452728ff-4ec0-4d97-8cb7-a5a75119bb08 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:56.801231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452728ff-4ec0-4d97-8cb7-a5a75119bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:56.824098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-452728ff-4ec0-4d97-8cb7-a5a75119bb08 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:56.825428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-452728ff-4ec0-4d97-8cb7-a5a75119bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.843445 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3214/6459] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:56.854674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:56.857258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:56.928150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:56.957860 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3246/6460] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:56.959783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea245d7-290b-439f-815c-52305ac33708 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:56.960216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea245d7-290b-439f-815c-52305ac33708 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:56.960570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea245d7-290b-439f-815c-52305ac33708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.006147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cea245d7-290b-439f-815c-52305ac33708 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:57.007435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cea245d7-290b-439f-815c-52305ac33708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:57.012760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e4fd4-4bc8-44d5-91b0-8ba3269b0f30 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.048206 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3247/6461] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:57.049676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea245d7-290b-439f-815c-52305ac33708 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.067924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea245d7-290b-439f-815c-52305ac33708 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.088295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.089248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.089541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.089824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.090405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.092153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.093257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.093786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.094720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:57.096179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.098186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.107058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.109120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.116079 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3248/6462] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:26:57.120165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.125580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3215/6463] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:26:57.137706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24e743-242f-447a-a8c9-936d51a7be6b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.142982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.143676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.144098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.144386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.145115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.147616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.187845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.189846 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3249/6464] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:57 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:57.207942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55b2f-9c89-4e6a-b8cc-db39a8048542 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.268330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:57.320533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.321298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.321587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.321870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.322587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.324604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.359442 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3216/6465] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:57 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:57.364113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.391500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b7e7b-45d7-499e-a529-6dd8d5b1d2aa admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.399165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.400318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.400318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.400575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.401261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.403124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.429297 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3250/6466] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:57.432865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.449766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.450902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36789-26f8-4cfb-9f78-7108df5c7002 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.451579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:57.466201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.466590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.466876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.467154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.468589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.470395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.474245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a89dc-87c2-48d4-9b85-20ef892e314d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.483547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.485637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.485930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.486211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] PATH_INFO: `/v3/projects/87cba317541d459989cd85d12cd8a79f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.487670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cba317541d459989cd85d12cd8a79f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.491026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.491220 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3217/6467] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:57.492237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.514125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d8dff-b356-4896-9b6e-967aab532744 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.519438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaa1e8-d9d0-41ab-b4b5-679dc260037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.520479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa1e8-d9d0-41ab-b4b5-679dc260037d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.522177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa1e8-d9d0-41ab-b4b5-679dc260037d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.522360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaa1e8-d9d0-41ab-b4b5-679dc260037d admin admin] PATH_INFO: `/v3/projects/17e29d31b0974eeebe8ef48f0de23582/users/dcd1462ff001498e8776b711e121817f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.541109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaa1e8-d9d0-41ab-b4b5-679dc260037d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e29d31b0974eeebe8ef48f0de23582, user_id=dcd1462ff001498e8776b711e121817f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.545688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaa1e8-d9d0-41ab-b4b5-679dc260037d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.569633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cba317541d459989cd85d12cd8a79f', 'request_id': 'req-aad97c91-db62-46d8-883b-06b714ef9e5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:57.577325 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3218/6468] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:57 2022] PUT /identity/v3/projects/17e29d31b0974eeebe8ef48f0de23582/users/dcd1462ff001498e8776b711e121817f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:57.579282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.579282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.579578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.591507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cba317541d459989cd85d12cd8a79f', 'request_id': 'req-aad97c91-db62-46d8-883b-06b714ef9e5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:57.600129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:57.602935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:57.619170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cba317541d459989cd85d12cd8a79f', 'request_id': 'req-aad97c91-db62-46d8-883b-06b714ef9e5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:57.651362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] The token cache is being invalidate because project 87cba317541d459989cd85d12cd8a79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:57.651671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:57.654453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-aad97c91-db62-46d8-883b-06b714ef9e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:57.664093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3251/6469] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:57 2022] DELETE /identity/v3/projects/87cba317541d459989cd85d12cd8a79f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:57.665903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38593-06b3-493e-aa4c-b8cb5893ffe5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.666198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38593-06b3-493e-aa4c-b8cb5893ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.666474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd38593-06b3-493e-aa4c-b8cb5893ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.725169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-afd38593-06b3-493e-aa4c-b8cb5893ffe5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:57.726417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-afd38593-06b3-493e-aa4c-b8cb5893ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:57.798762 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3219/6470] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:57.810800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:57.812344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:57.896802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220ecdf-201f-41b3-a375-9465b6c2bcbb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:57.901173 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3252/6471] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:57.910069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1360854-94aa-48ab-a682-2d35d4794a29 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.910447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1360854-94aa-48ab-a682-2d35d4794a29 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.910796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1360854-94aa-48ab-a682-2d35d4794a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.919126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:57.919927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:57.922216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:57.922577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:57.949335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:57.954595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:57.959552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d1360854-94aa-48ab-a682-2d35d4794a29 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:57.963738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1360854-94aa-48ab-a682-2d35d4794a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:57.993367 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3220/6472] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:26:57.996377 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3253/6473] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:58.000186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.000740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1360854-94aa-48ab-a682-2d35d4794a29 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.001688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:58.015121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1360854-94aa-48ab-a682-2d35d4794a29 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.051861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.053114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.053114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.053363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.054847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:26:58.055209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.056391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b828d6-68e6-4ba7-9ed3-12277281609d service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.058600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.063002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.064204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.064736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.065560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] PATH_INFO: `/v3/projects/692c7528a3fc460a8d67e5467ee043ad` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.067920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=692c7528a3fc460a8d67e5467ee043ad)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.070545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.083960 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3254/6474] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:26:58.085069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.087715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:58.093321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:58.116998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9a9e-fb2f-49ae-b585-74c1713c4340 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.121520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.122329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.122613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.122886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.127010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:58.138405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:58.168959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.175010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.189139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692c7528a3fc460a8d67e5467ee043ad', 'request_id': 'req-9c6706c2-07bf-4314-b925-030d3ffbcfbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.197205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692c7528a3fc460a8d67e5467ee043ad', 'request_id': 'req-9c6706c2-07bf-4314-b925-030d3ffbcfbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.213384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692c7528a3fc460a8d67e5467ee043ad', 'request_id': 'req-9c6706c2-07bf-4314-b925-030d3ffbcfbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.224341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3255/6475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:26:58.225916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.231933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] The token cache is being invalidate because project 692c7528a3fc460a8d67e5467ee043ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:26:58.232279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.234192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.238229 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3221/6476] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:57 2022] DELETE /identity/v3/projects/692c7528a3fc460a8d67e5467ee043ad => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:58.242117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.246997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:58.297566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480360ce-481d-4738-a04b-b8eb6e626499 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.447983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6706c2-07bf-4314-b925-030d3ffbcfbf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.456714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.459094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.459967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.460549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] PATH_INFO: `/v3/users/fcac65f639634bf185766bf6361072b1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.462736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcac65f639634bf185766bf6361072b1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.465734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.491995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14fa95-2bac-43f6-aa97-5126520dd358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.492651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14fa95-2bac-43f6-aa97-5126520dd358 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.493345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14fa95-2bac-43f6-aa97-5126520dd358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.493698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14fa95-2bac-43f6-aa97-5126520dd358 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.494458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14fa95-2bac-43f6-aa97-5126520dd358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.497021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14fa95-2bac-43f6-aa97-5126520dd358 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.563767 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3256/6477] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:58 2022] POST /identity/v3/projects => generated 377 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:58.565932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819994-5cfe-4bdd-9f15-b361ea992d21 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.566553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819994-5cfe-4bdd-9f15-b361ea992d21 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.566965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819994-5cfe-4bdd-9f15-b361ea992d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.572802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcac65f639634bf185766bf6361072b1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.573874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcac65f639634bf185766bf6361072b1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.589699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcac65f639634bf185766bf6361072b1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.590880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcac65f639634bf185766bf6361072b1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.600428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcac65f639634bf185766bf6361072b1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:58.620345 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3222/6478] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:26:58 2022] DELETE /identity/v3/users/fcac65f639634bf185766bf6361072b1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:58.621714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.624839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-88819994-5cfe-4bdd-9f15-b361ea992d21 None None] MFA Rules not processed for user `0139ec1b1a664b9388293d41e892db04`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:58.626282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-88819994-5cfe-4bdd-9f15-b361ea992d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:58.636331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:58.679076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:58.745230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ad68-09f6-404c-82e7-c3d249e6940d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.757777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.758807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.761444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.761833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.762669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.766349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.805614 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3257/6479] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:58.834212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88819994-5cfe-4bdd-9f15-b361ea992d21 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.835160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3223/6480] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:58 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:58.852628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88819994-5cfe-4bdd-9f15-b361ea992d21 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.864698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.865849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.866553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.867061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.868249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.870299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.889336 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3258/6481] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:58.893539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.917182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258dd3-4864-4da9-a634-d8fc07ea4165 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.922017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e5aae-7b42-4dfb-805f-4bf79b096c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.922768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5aae-7b42-4dfb-805f-4bf79b096c84 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.923182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5aae-7b42-4dfb-805f-4bf79b096c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.923340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5aae-7b42-4dfb-805f-4bf79b096c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.924059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e5aae-7b42-4dfb-805f-4bf79b096c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.925754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e5aae-7b42-4dfb-805f-4bf79b096c84 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:58.945782 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3224/6482] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:58.946681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:58.959124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9bd58-ebf6-4cf1-8cb1-4f90c2c61e37 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:58.970194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:58.970961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:58.971231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:58.971513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] PATH_INFO: `/v3/projects/bd7c556f1b6b49c1b6bcfc5346ac6358/users/d6300dbe2fb947799c999b9c42aa7cd3/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:58.992182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7c556f1b6b49c1b6bcfc5346ac6358, user_id=d6300dbe2fb947799c999b9c42aa7cd3, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:58.995103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:59.026407 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3259/6483] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:58 2022] PUT /identity/v3/projects/bd7c556f1b6b49c1b6bcfc5346ac6358/users/d6300dbe2fb947799c999b9c42aa7cd3/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:26:59.037757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c1dd-cff6-4b03-b553-739c0946cc0d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.038302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c1dd-cff6-4b03-b553-739c0946cc0d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.038413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581c1dd-cff6-4b03-b553-739c0946cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.081089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e581c1dd-cff6-4b03-b553-739c0946cc0d None None] MFA Rules not processed for user `d6300dbe2fb947799c999b9c42aa7cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:59.082401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e581c1dd-cff6-4b03-b553-739c0946cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:59.199087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3225/6484] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:26:59.203332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:59.259196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:59.294557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6189-622a-4c59-bfb7-6537b95bcd50 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:59.300245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:59.301112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.301410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.301736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.302483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:59.304516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:59.377890 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3260/6485] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:26:59 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:59.380368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581c1dd-cff6-4b03-b553-739c0946cc0d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:59.393564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581c1dd-cff6-4b03-b553-739c0946cc0d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:59.479780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:59.480542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.480800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.481626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.483438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:59.485809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:59.512672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3226/6486] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:26:59 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:26:59.516724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:59.528157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480a841-bc79-4b24-ab9b-e2cbcd8dee7e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:59.533718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:59.534441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.534756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.535067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.535882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:59.537708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:59.550037 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3261/6487] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:26:59.554336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:59.567118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b488-1ac0-455a-b37e-e56bdd121ea0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:59.574662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:59.574909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.575169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.575511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.576563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:59.578851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:59.594163 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3227/6488] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:26:59.598321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:59.612711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18684f-6ece-43cd-b2c4-2f49ad0c251b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:59.618924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc1d95-4c3b-437a-ae02-7cfef396f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:59.619967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1d95-4c3b-437a-ae02-7cfef396f5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.620342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1d95-4c3b-437a-ae02-7cfef396f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.621149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc1d95-4c3b-437a-ae02-7cfef396f5e8 admin admin] PATH_INFO: `/v3/projects/0cde2f217fb34ac892d83ea547fd245c/users/bc0d65b032fd4ae8a393742c52e9895d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.641441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1d95-4c3b-437a-ae02-7cfef396f5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cde2f217fb34ac892d83ea547fd245c, user_id=bc0d65b032fd4ae8a393742c52e9895d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:59.645796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc1d95-4c3b-437a-ae02-7cfef396f5e8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:59.649917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:59.652194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:59.664408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3262/6489] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:26:59 2022] PUT /identity/v3/projects/0cde2f217fb34ac892d83ea547fd245c/users/bc0d65b032fd4ae8a393742c52e9895d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:26:59.678435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.678636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.679045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.680977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f523-6ca6-4c56-a5cd-ce768438675d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:26:59.695043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:59.734009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] MFA Rules not processed for user `bc0d65b032fd4ae8a393742c52e9895d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:26:59.735556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:59.839122 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3263/6490] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:26:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:26:59.850643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:26:59.851797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:26:59.852082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:26:59.852362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] PATH_INFO: `/v3/projects/e216905a10de4b0a829b979a339e480a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:26:59.855109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e216905a10de4b0a829b979a339e480a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:26:59.862374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:26:59.864772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:26:59.866346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:26:59.977744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e216905a10de4b0a829b979a339e480a', 'request_id': 'req-e339419f-7707-46b2-8f6a-40385c65b701'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:59.987206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e216905a10de4b0a829b979a339e480a', 'request_id': 'req-e339419f-7707-46b2-8f6a-40385c65b701'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:26:59.998412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e216905a10de4b0a829b979a339e480a', 'request_id': 'req-e339419f-7707-46b2-8f6a-40385c65b701'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:00.013483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] The token cache is being invalidate because project e216905a10de4b0a829b979a339e480a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:00.014082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:00.015573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e339419f-7707-46b2-8f6a-40385c65b701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:00.019157 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3228/6491] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:26:59 2022] DELETE /identity/v3/projects/e216905a10de4b0a829b979a339e480a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:00.023624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df2cac-4fcd-488b-ba8c-d2ea72d9ae76 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.024153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df2cac-4fcd-488b-ba8c-d2ea72d9ae76 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.026443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df2cac-4fcd-488b-ba8c-d2ea72d9ae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.030811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55d064-c48b-4ad7-889c-5426a5a5cd4a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:00.055693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-88df2cac-4fcd-488b-ba8c-d2ea72d9ae76 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:00.057561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-88df2cac-4fcd-488b-ba8c-d2ea72d9ae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:00.099810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:00.127602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:00.128269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.128551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.130061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.131061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:00.168610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3229/6492] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:00.176631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa0459-344d-4145-bd19-03fa1305fe37 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.177067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa0459-344d-4145-bd19-03fa1305fe37 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.177451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa0459-344d-4145-bd19-03fa1305fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.246733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-07aa0459-344d-4145-bd19-03fa1305fe37 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:00.249893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-07aa0459-344d-4145-bd19-03fa1305fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:00.264915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:00.266431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:00.271979 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3230/6493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:00.277808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa0459-344d-4145-bd19-03fa1305fe37 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:00.282971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3264/6494] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:26:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:00.325467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa0459-344d-4145-bd19-03fa1305fe37 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:00.351625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfae48-0736-4f15-b8a6-22b5bf25c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:00.352370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfae48-0736-4f15-b8a6-22b5bf25c0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.352684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfae48-0736-4f15-b8a6-22b5bf25c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.353646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfae48-0736-4f15-b8a6-22b5bf25c0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.354458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfae48-0736-4f15-b8a6-22b5bf25c0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:00.354812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfae48-0736-4f15-b8a6-22b5bf25c0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:00.356955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfae48-0736-4f15-b8a6-22b5bf25c0a6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:00.403224 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3231/6495] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:00.407487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:00.429896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacc57-329e-40f6-8a4b-8c3f66091802 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:00.441917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:00.443269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.443734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.446819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.447757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:00.450059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:00.495794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317f6b-9757-4bb5-870b-3d6c6b13301e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.496373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317f6b-9757-4bb5-870b-3d6c6b13301e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.496373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31317f6b-9757-4bb5-870b-3d6c6b13301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.535602 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3265/6496] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:00 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:00.536729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:00.591363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-31317f6b-9757-4bb5-870b-3d6c6b13301e None None] MFA Rules not processed for user `dcd1462ff001498e8776b711e121817f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:00.594405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-31317f6b-9757-4bb5-870b-3d6c6b13301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:00.619241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:00.691308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a5e8c-ddc6-4043-a27e-f47d3f0532da admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:00.700358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508fac2-2f73-49fb-82e7-47e486cc15f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:00.701081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508fac2-2f73-49fb-82e7-47e486cc15f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.702458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508fac2-2f73-49fb-82e7-47e486cc15f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.703371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508fac2-2f73-49fb-82e7-47e486cc15f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.703512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508fac2-2f73-49fb-82e7-47e486cc15f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:00.705972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508fac2-2f73-49fb-82e7-47e486cc15f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:00.738795 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3266/6497] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:00 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:00.738795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55242-49da-4f42-91c1-ba850dec9242 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.739816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55242-49da-4f42-91c1-ba850dec9242 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.740124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc55242-49da-4f42-91c1-ba850dec9242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.783850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bfc55242-49da-4f42-91c1-ba850dec9242 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:00.785197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bfc55242-49da-4f42-91c1-ba850dec9242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:00.796741 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3232/6498] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:00.817629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317f6b-9757-4bb5-870b-3d6c6b13301e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:00.839249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31317f6b-9757-4bb5-870b-3d6c6b13301e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:00.845593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:00.847002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.847302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.847582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.848348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:00.850007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:00.866708 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3233/6499] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:00.867260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:00.867824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:00.870829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:00.885056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd665a-9c00-464c-b93c-85ab03ed7d04 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:00.891438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:00.892041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.892328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.892661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.893541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:00.895726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:00.896664 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3267/6500] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:00.897983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc55242-49da-4f42-91c1-ba850dec9242 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:00.911983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc55242-49da-4f42-91c1-ba850dec9242 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:00.917622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:00.918516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:00.918794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:00.919070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:00.919806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:00.922524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:00.938130 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3268/6501] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:00.939054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:00.941225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:00.955530 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3234/6502] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:00 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:00.955530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.054722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428a2e9-718b-4140-834b-de7922c6c838 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.066310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.067352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.067923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.068208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] PATH_INFO: `/v3/projects/ec7319b9bddb4284a4c84f76c1f86452/users/0d6fa9e59bb649fea86593d00f379562/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.105562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7319b9bddb4284a4c84f76c1f86452, user_id=0d6fa9e59bb649fea86593d00f379562, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.108388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.110879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd170-ebf1-481e-9c21-dfc44bbef24b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.148944 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3235/6503] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:00 2022] PUT /identity/v3/projects/ec7319b9bddb4284a4c84f76c1f86452/users/0d6fa9e59bb649fea86593d00f379562/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:01.148944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.261060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.262535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.263068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.263570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.298274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638fa5e-b809-4eb0-9673-2c283f085004 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.327746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9064664-0a35-426b-9829-b321d11f2c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.328932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064664-0a35-426b-9829-b321d11f2c53 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.329337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064664-0a35-426b-9829-b321d11f2c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.329705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064664-0a35-426b-9829-b321d11f2c53 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.330505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9064664-0a35-426b-9829-b321d11f2c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.333095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9064664-0a35-426b-9829-b321d11f2c53 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.342153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:01.378530 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3236/6504] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:01 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:01.381223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afcde6-d27a-4b11-9f9a-e779c93c4d33 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.381621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afcde6-d27a-4b11-9f9a-e779c93c4d33 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.383673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afcde6-d27a-4b11-9f9a-e779c93c4d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.407168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.409329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.423588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3269/6505] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:01.425942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.426091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-92afcde6-d27a-4b11-9f9a-e779c93c4d33 None None] MFA Rules not processed for user `0d6fa9e59bb649fea86593d00f379562`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:01.428082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-92afcde6-d27a-4b11-9f9a-e779c93c4d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:01.444849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6e0c0-a677-4cef-969c-75ca4272bb2d service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.455643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.456971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.457623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.458538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.459472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.461688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.478490 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3270/6506] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:01.479984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.488727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:01.497555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456f8d-0c20-4491-a3e1-1397fc15354d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.506613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.507827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.508165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.508558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] PATH_INFO: `/v3/projects/348d4ac5e1604df6ba679613824208bb/users/7cef12225f8e46b68753e71512b6d43f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.550266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348d4ac5e1604df6ba679613824208bb, user_id=7cef12225f8e46b68753e71512b6d43f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.556077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.569326 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3237/6507] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:01.585065 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3271/6508] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:01 2022] PUT /identity/v3/projects/348d4ac5e1604df6ba679613824208bb/users/7cef12225f8e46b68753e71512b6d43f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:01.588864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afcde6-d27a-4b11-9f9a-e779c93c4d33 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.597727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.602987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:01.604799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afcde6-d27a-4b11-9f9a-e779c93c4d33 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.709794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88610a-95b2-474c-af7e-ac607e386367 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.730746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.731316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.732007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.732266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.732595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.732862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.733088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.733571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.734139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.736288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.772223 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3238/6509] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:01.773172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.779906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:01.881972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc2526-de34-4b1c-8fde-9415bf270aba admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.886809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.887678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.887974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.888412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.890430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.892224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.892692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:01.907037 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3272/6510] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:01.907878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:01.946022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a1afe-01a7-48e0-a510-bde79c2123ab service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:01.960313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d09f-8f8f-46f8-b810-a8010b79eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:01.963908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d09f-8f8f-46f8-b810-a8010b79eb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:01.965355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d09f-8f8f-46f8-b810-a8010b79eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:01.965680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d09f-8f8f-46f8-b810-a8010b79eb60 admin admin] PATH_INFO: `/v3/projects/348d4ac5e1604df6ba679613824208bb/users/7cef12225f8e46b68753e71512b6d43f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:01.970042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d09f-8f8f-46f8-b810-a8010b79eb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348d4ac5e1604df6ba679613824208bb, user_id=7cef12225f8e46b68753e71512b6d43f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:01.976267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d09f-8f8f-46f8-b810-a8010b79eb60 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:01.977666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:02.004950 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3273/6511] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:01 2022] PUT /identity/v3/projects/348d4ac5e1604df6ba679613824208bb/users/7cef12225f8e46b68753e71512b6d43f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:02.061792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:02.063833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:02.079551 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3239/6512] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:02.184092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:02.184687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:02.184687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:02.229625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:02.231582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:02.328126 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3274/6513] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:27:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:02.342107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:02.474847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fa85f-c024-4a15-ac31-2c066171bf50 service glance] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:02.587874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f308b-b097-42fa-a001-70f76e456e2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:02.589837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f308b-b097-42fa-a001-70f76e456e2b service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:02.597438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f308b-b097-42fa-a001-70f76e456e2b service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:02.598590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f308b-b097-42fa-a001-70f76e456e2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:02.615654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f308b-b097-42fa-a001-70f76e456e2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:02.618488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f308b-b097-42fa-a001-70f76e456e2b service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:02.633013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3240/6514] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:02.826773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:02.828641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:02.885424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:03.004803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89658964-2257-4297-b9e8-ea341dd6d229 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:03.011907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:03.015638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:03.016740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:03.017294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] PATH_INFO: `/v3/users/d6300dbe2fb947799c999b9c42aa7cd3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:03.021732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6300dbe2fb947799c999b9c42aa7cd3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:03.025071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:03.119628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6300dbe2fb947799c999b9c42aa7cd3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:03.120603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6300dbe2fb947799c999b9c42aa7cd3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:03.141423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6300dbe2fb947799c999b9c42aa7cd3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:03.142254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6300dbe2fb947799c999b9c42aa7cd3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:03.155149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6300dbe2fb947799c999b9c42aa7cd3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:03.180828 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3275/6515] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:02 2022] DELETE /identity/v3/users/d6300dbe2fb947799c999b9c42aa7cd3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:03.184803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc4bd-5ae6-40c7-8287-1ab6f219520a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:03.185125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc4bd-5ae6-40c7-8287-1ab6f219520a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:03.185404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc4bd-5ae6-40c7-8287-1ab6f219520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:03.213763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8b3cc4bd-5ae6-40c7-8287-1ab6f219520a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:03.215179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b3cc4bd-5ae6-40c7-8287-1ab6f219520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:03.313408 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3241/6516] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:03.340475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:03.342121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:03.437864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4f26c-fdbe-43ce-9b74-1369cd6c925e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:03.443420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42173-8d87-4cd5-ad05-c769ba6f3b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:03.444228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42173-8d87-4cd5-ad05-c769ba6f3b74 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:03.444608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42173-8d87-4cd5-ad05-c769ba6f3b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:03.444978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42173-8d87-4cd5-ad05-c769ba6f3b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:03.460573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42173-8d87-4cd5-ad05-c769ba6f3b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:03.463906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42173-8d87-4cd5-ad05-c769ba6f3b74 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:03.480869 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3276/6517] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:04.221424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:04.221918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:04.221918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:04.232526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:04.305792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] MFA Rules not processed for user `7cef12225f8e46b68753e71512b6d43f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:04.307211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:04.473422 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3242/6518] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:04.477603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:04.478615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:04.478909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:04.517423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] MFA Rules not processed for user `dcd1462ff001498e8776b711e121817f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:04.518780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:04.631410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:04.702345 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3277/6519] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:04.714417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:04.715870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:04.789124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:04.792120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:04.814702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f89e-fee6-423c-91a8-7af34b9f7f25 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:04.838178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:04.839641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:04.840200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:04.841608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] PATH_INFO: `/v3/projects/bd7c556f1b6b49c1b6bcfc5346ac6358` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:04.845561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7c556f1b6b49c1b6bcfc5346ac6358)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:04.848586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:04.913409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441ec47-46e9-4323-b51e-d81871a9c65b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:04.944445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7c556f1b6b49c1b6bcfc5346ac6358', 'request_id': 'req-0c8d9035-f81a-4f45-bb65-589842052d02'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:04.961868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7c556f1b6b49c1b6bcfc5346ac6358', 'request_id': 'req-0c8d9035-f81a-4f45-bb65-589842052d02'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:04.982340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7c556f1b6b49c1b6bcfc5346ac6358', 'request_id': 'req-0c8d9035-f81a-4f45-bb65-589842052d02'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.018773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] The token cache is being invalidate because project bd7c556f1b6b49c1b6bcfc5346ac6358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:05.019174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.027866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.034019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:05.034717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:05.035001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:05.036542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:05.038017 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3278/6520] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:04 2022] DELETE /identity/v3/projects/bd7c556f1b6b49c1b6bcfc5346ac6358 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:05.038787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:05.040252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:05.041895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:05.070466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:05.116660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:05.116935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9035-f81a-4f45-bb65-589842052d02 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:05.118647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:05.122082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:05.123102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:05.123507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:05.123930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] PATH_INFO: `/v3/users/0139ec1b1a664b9388293d41e892db04` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:05.125305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0139ec1b1a664b9388293d41e892db04)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:05.127344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:05.129371 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3243/6521] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:05.130164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:05.131451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:05.156584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f6e45-69f8-4e30-8c26-8b600bca26ee service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:05.170691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:05.172404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:05.173220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:05.174318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] PATH_INFO: `/v3/users/bc0d65b032fd4ae8a393742c52e9895d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:05.175843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0d65b032fd4ae8a393742c52e9895d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:05.178289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:05.215714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0139ec1b1a664b9388293d41e892db04'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.216780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0139ec1b1a664b9388293d41e892db04'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.247576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0139ec1b1a664b9388293d41e892db04'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.248293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0139ec1b1a664b9388293d41e892db04'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.253322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0d65b032fd4ae8a393742c52e9895d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.254317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0d65b032fd4ae8a393742c52e9895d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.258551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0139ec1b1a664b9388293d41e892db04'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.261245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:05.274362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0d65b032fd4ae8a393742c52e9895d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.275866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0d65b032fd4ae8a393742c52e9895d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.277911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3279/6522] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:05 2022] DELETE /identity/v3/users/0139ec1b1a664b9388293d41e892db04 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:05.292003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0d65b032fd4ae8a393742c52e9895d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.310672 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3244/6523] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:05 2022] DELETE /identity/v3/users/bc0d65b032fd4ae8a393742c52e9895d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:05.629169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:05.631532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:05.763298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfdf12-6fe2-4988-938c-9c761d7f3806 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:05.778523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:05.780395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:05.866673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:05.867881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:05.869019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:05.869272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] PATH_INFO: `/v3/projects/254bf89989f04c4e8c2fe857b853c3de` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:05.871432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254bf89989f04c4e8c2fe857b853c3de)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:05.873970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:05.973311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b2c21-080e-4743-a9f3-9c4312b1c5ab admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:05.977260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254bf89989f04c4e8c2fe857b853c3de', 'request_id': 'req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:05.988997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254bf89989f04c4e8c2fe857b853c3de', 'request_id': 'req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.002937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254bf89989f04c4e8c2fe857b853c3de', 'request_id': 'req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.019346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] The token cache is being invalidate because project 254bf89989f04c4e8c2fe857b853c3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:06.020168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.022046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a42b61a8-8122-4a2f-9833-5c9fd0ca8ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.025828 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3280/6524] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:05 2022] DELETE /identity/v3/projects/254bf89989f04c4e8c2fe857b853c3de => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:06.037634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412ee1-2080-41b1-982a-0349fa3a4353 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.037858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412ee1-2080-41b1-982a-0349fa3a4353 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.038106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412ee1-2080-41b1-982a-0349fa3a4353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.091549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c3412ee1-2080-41b1-982a-0349fa3a4353 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:06.092428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c3412ee1-2080-41b1-982a-0349fa3a4353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:06.138202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:06.163585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:06.178089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.191852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.192449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.193086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] PATH_INFO: `/v3/projects/0cde2f217fb34ac892d83ea547fd245c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.198159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cde2f217fb34ac892d83ea547fd245c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.200149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.237118 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3281/6525] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:06.241890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d631-92d8-48e6-a4fc-9f26a5cfd7cc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.242471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d631-92d8-48e6-a4fc-9f26a5cfd7cc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.242746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d631-92d8-48e6-a4fc-9f26a5cfd7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.263593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ac95d631-92d8-48e6-a4fc-9f26a5cfd7cc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:06.264912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ac95d631-92d8-48e6-a4fc-9f26a5cfd7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:06.274666 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3282/6526] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:06.279409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d631-92d8-48e6-a4fc-9f26a5cfd7cc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.291721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d631-92d8-48e6-a4fc-9f26a5cfd7cc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.303716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cde2f217fb34ac892d83ea547fd245c', 'request_id': 'req-ba57d769-5f82-4421-a018-7f95205bfd78'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.312395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cde2f217fb34ac892d83ea547fd245c', 'request_id': 'req-ba57d769-5f82-4421-a018-7f95205bfd78'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.325131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cde2f217fb34ac892d83ea547fd245c', 'request_id': 'req-ba57d769-5f82-4421-a018-7f95205bfd78'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.344231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] The token cache is being invalidate because project 0cde2f217fb34ac892d83ea547fd245c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:06.344523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.345235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ba57d769-5f82-4421-a018-7f95205bfd78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:06.347604 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3245/6527] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:05 2022] DELETE /identity/v3/projects/0cde2f217fb34ac892d83ea547fd245c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:06.354081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c319-53fe-4c88-b67d-a0ffb6ffa8fe None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.356398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c319-53fe-4c88-b67d-a0ffb6ffa8fe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.356751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c319-53fe-4c88-b67d-a0ffb6ffa8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.367932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.368572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.368870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.369212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.370000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:06.370335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.372696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.397331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3283/6528] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:06.400297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.403073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:06.418545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e0d6c319-53fe-4c88-b67d-a0ffb6ffa8fe None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:06.419228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf3177-2f43-44bb-9ff3-71c38bc2ad34 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.421199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e0d6c319-53fe-4c88-b67d-a0ffb6ffa8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:06.425641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.426479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.426871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.427215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.427928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.432098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.437080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3246/6529] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:06.447092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7f81-7216-4b11-aa99-14c25cfb0d27 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.447680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7f81-7216-4b11-aa99-14c25cfb0d27 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.448140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7f81-7216-4b11-aa99-14c25cfb0d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.475545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-462f7f81-7216-4b11-aa99-14c25cfb0d27 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:06.477197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-462f7f81-7216-4b11-aa99-14c25cfb0d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:06.492192 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3247/6530] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:06.493756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f7f81-7216-4b11-aa99-14c25cfb0d27 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.494655 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3284/6531] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:06.499950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.505107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f7f81-7216-4b11-aa99-14c25cfb0d27 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.589434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.591049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.591756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.592256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.593509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:06.595344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.597487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.619407 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3248/6532] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:06.620358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.622363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:06.640063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9aca4-25a3-4afa-977e-f7a8fbd6bea9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.644877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.645615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.645891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.646162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.646862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.648827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.672443 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3285/6533] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:06.673329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.684440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2739d4-04ec-4604-a018-0b4ca0b2c0b5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.690663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.691375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.691801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.692057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.692949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.694927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.703212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:06.727488 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3286/6534] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:06.732330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.732549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06d32e-8977-46b0-819e-c8f0b7b0b7f2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.739920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:06.821137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e1b63-ba14-44fd-b9d6-0113ed3f3d9f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.828633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.830219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.830985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.831488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.834078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.836234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.847788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.848481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.848926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.849796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.853074 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3287/6535] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:06.853074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.856910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:06.863383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84dfef-9c16-43e5-a5d0-af5e20f2a8e6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.870441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.871492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.871873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.873760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.874939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.877960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.878447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.881198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.900748 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3249/6536] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:06.906173 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3288/6537] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:06 2022] POST /identity/v3/users => generated 286 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:06.914039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.914366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.926312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540db12-e2d4-43c0-9c17-903066ad4441 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.926876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84837fcb-eeb4-4d22-86e2-0bdf68e17eaf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.934146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.934146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.934678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.935076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.935946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.937930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.951862 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3250/6538] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:06.955486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.955851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:06.956193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.963131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.963468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.964261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.967758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a89f4-3144-487f-abc7-c007821f5adf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:06.969376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:06.973264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5be1b-cf1c-4ef9-8973-07269760d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:06.974657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5be1b-cf1c-4ef9-8973-07269760d4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:06.975262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5be1b-cf1c-4ef9-8973-07269760d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:06.975635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5be1b-cf1c-4ef9-8973-07269760d4c7 admin admin] PATH_INFO: `/v3/projects/358c229e13204a20bfc38ba44f24c2e3/users/876c4a2451de4278ad112620a06cbcee/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:06.994637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5be1b-cf1c-4ef9-8973-07269760d4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358c229e13204a20bfc38ba44f24c2e3, user_id=876c4a2451de4278ad112620a06cbcee, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:06.997888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5be1b-cf1c-4ef9-8973-07269760d4c7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:07.014433 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3289/6539] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:07.018589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:07.021204 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3251/6540] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:06 2022] PUT /identity/v3/projects/358c229e13204a20bfc38ba44f24c2e3/users/876c4a2451de4278ad112620a06cbcee/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:07.031809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:07.032417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:07.032797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:07.051468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64960-9f34-405d-abaf-18e2ad998f6a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:07.075723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] MFA Rules not processed for user `876c4a2451de4278ad112620a06cbcee`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:07.077621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:07.161460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:07.162193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:07.162479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:07.162755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:07.164436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:07.167095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:07.188460 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3290/6541] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:07.197395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:07.207633 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3252/6542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:07.213083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a4c83-cd1f-42aa-b4f0-66f5615344b4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:07.218127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c804772-8696-4c52-9b29-e5f3e666146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:07.219139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c804772-8696-4c52-9b29-e5f3e666146e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:07.220743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:07.221096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c804772-8696-4c52-9b29-e5f3e666146e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:07.223575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:07.229369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c804772-8696-4c52-9b29-e5f3e666146e admin admin] PATH_INFO: `/v3/projects/56cdf5c69af1438d8fd4ea21a05b1f4e/users/ea3ff37902e4486bb8f9cf77dd01a8dc/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:07.266581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c804772-8696-4c52-9b29-e5f3e666146e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cdf5c69af1438d8fd4ea21a05b1f4e, user_id=ea3ff37902e4486bb8f9cf77dd01a8dc, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:07.271766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c804772-8696-4c52-9b29-e5f3e666146e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:07.302878 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3291/6543] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:07 2022] PUT /identity/v3/projects/56cdf5c69af1438d8fd4ea21a05b1f4e/users/ea3ff37902e4486bb8f9cf77dd01a8dc/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:07.314220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:07.317010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:07.319457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:07.328449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:07.375895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] MFA Rules not processed for user `ea3ff37902e4486bb8f9cf77dd01a8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:07.377180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:07.390540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ee14e-f0a4-4141-9d7d-69508ad97568 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:07.450379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:07.511253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3292/6544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:07.530618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:07.533476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:07.584716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:07.585731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:07.587885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:07.588314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:07.664531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d6b9b-75da-41f1-bea8-21e3937f08fd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:07.679867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:07.681211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:07.681678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:07.682111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:07.709183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:07.711693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:07.727491 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3293/6545] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:07.739768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:07.742321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:07.765184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3253/6546] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:07.891088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:07.946877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:07.979901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c202d9b-977e-46c1-818a-2a51f6495134 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:08.008120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdabbb-649e-4d25-af19-58dc44888cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:08.009466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdabbb-649e-4d25-af19-58dc44888cde service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:08.010062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdabbb-649e-4d25-af19-58dc44888cde service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:08.010991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdabbb-649e-4d25-af19-58dc44888cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:08.017338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7abdabbb-649e-4d25-af19-58dc44888cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:08.073203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdabbb-649e-4d25-af19-58dc44888cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:08.074979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdabbb-649e-4d25-af19-58dc44888cde service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:08.117499 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3254/6547] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:08.119078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:08.119364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:08.119640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:08.124204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705e8cb-9e3d-4c3e-b977-49ef5ed30b28 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:08.141433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:08.142476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:08.142653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:08.142786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:08.144037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:08.147267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] PATH_INFO: `/v3/users/876c4a2451de4278ad112620a06cbcee` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:08.150576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876c4a2451de4278ad112620a06cbcee)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:08.152847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:08.261871 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3255/6548] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:08.283032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876c4a2451de4278ad112620a06cbcee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:08.284612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876c4a2451de4278ad112620a06cbcee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:08.286174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:08.288970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:08.306783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:08.318801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876c4a2451de4278ad112620a06cbcee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:08.319742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876c4a2451de4278ad112620a06cbcee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:08.339560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5b9ff0aa-9409-4dfb-b52e-33b72fd7a8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876c4a2451de4278ad112620a06cbcee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:08.345420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:08.364016 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3294/6549] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:07 2022] DELETE /identity/v3/users/876c4a2451de4278ad112620a06cbcee => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:08.366187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:08.366355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:08.366794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:08.390921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:08.392299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:08.407868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c518-83c4-411e-9eb6-c1ceb04aa01a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:08.485000 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3295/6550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:08.497376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:08.498730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:08.532824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:08.533917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:08.534328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:08.534613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:08.538071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:08.586768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca618d8-c6e0-4def-a524-f822b7e48be0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:08.592323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622290d0-f85c-4897-98b6-7499d509948d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:08.593307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622290d0-f85c-4897-98b6-7499d509948d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:08.593642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622290d0-f85c-4897-98b6-7499d509948d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:08.593994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622290d0-f85c-4897-98b6-7499d509948d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:08.605430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622290d0-f85c-4897-98b6-7499d509948d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:08.607157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622290d0-f85c-4897-98b6-7499d509948d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:08.621921 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3296/6551] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:08.685311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:08.687433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:08.701222 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3256/6552] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:09.009430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.009928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.010116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.038247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:09.039972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:09.051071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3297/6553] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:09.064070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:09.066854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:09.095398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a598c81-09f3-4948-9ad7-f4760e8ad675 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:09.102406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26772-cb6c-41de-bc61-47c6b14a24a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:09.103213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26772-cb6c-41de-bc61-47c6b14a24a1 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.103415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26772-cb6c-41de-bc61-47c6b14a24a1 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.103730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26772-cb6c-41de-bc61-47c6b14a24a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.115365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26772-cb6c-41de-bc61-47c6b14a24a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:09.117072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26772-cb6c-41de-bc61-47c6b14a24a1 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:09.128047 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3257/6554] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:09.389828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:09.391590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:09.419053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d7bdb-1992-4d79-8f09-81fd36b81512 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:09.425958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:09.426834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.427187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.427550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] PATH_INFO: `/v3/projects/358c229e13204a20bfc38ba44f24c2e3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.428894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=358c229e13204a20bfc38ba44f24c2e3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:09.437667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:09.516212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.516823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.516823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.545006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:09.545006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:09.553504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358c229e13204a20bfc38ba44f24c2e3', 'request_id': 'req-6fe2f047-51ed-435e-81d9-cdc237def17c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:09.561582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358c229e13204a20bfc38ba44f24c2e3', 'request_id': 'req-6fe2f047-51ed-435e-81d9-cdc237def17c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:09.580039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358c229e13204a20bfc38ba44f24c2e3', 'request_id': 'req-6fe2f047-51ed-435e-81d9-cdc237def17c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:09.584765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:09.594928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] The token cache is being invalidate because project 358c229e13204a20bfc38ba44f24c2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:09.595610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:09.596489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6fe2f047-51ed-435e-81d9-cdc237def17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:09.599234 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3298/6555] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:09 2022] DELETE /identity/v3/projects/358c229e13204a20bfc38ba44f24c2e3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:09.603964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d910-6611-48ba-85b7-f30e162ff50a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.604262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d910-6611-48ba-85b7-f30e162ff50a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.604543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d910-6611-48ba-85b7-f30e162ff50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.613860 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3258/6556] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:09.628351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:09.630564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4640d910-6611-48ba-85b7-f30e162ff50a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:09.630888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:09.631837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4640d910-6611-48ba-85b7-f30e162ff50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:09.643359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:09.744135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe375b-68af-442d-b630-c5fd81de35ba None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:09.753321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:09.754318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.754612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.755058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.772755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3299/6557] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:09.780905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b695bd9-3bf3-41b9-9048-d4fee553d749 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.781734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b695bd9-3bf3-41b9-9048-d4fee553d749 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.783164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b695bd9-3bf3-41b9-9048-d4fee553d749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.797399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:09.799105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:09.809148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7b695bd9-3bf3-41b9-9048-d4fee553d749 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:09.810535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7b695bd9-3bf3-41b9-9048-d4fee553d749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:09.823008 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3300/6558] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:09.826733 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3259/6559] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:27:09.834459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b695bd9-3bf3-41b9-9048-d4fee553d749 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:09.844788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b695bd9-3bf3-41b9-9048-d4fee553d749 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:09.850062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:09.850996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.851283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.851562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.852310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:09.852909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:09.854677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:09.869083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3301/6560] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:09.874032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:09.886868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dc68c-5d37-4ef4-9516-14dd4c3e826b service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:09.892298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:09.893219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:09.893509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:09.893791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:09.894514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:09.896450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:09.936084 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3260/6561] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:09 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:09.940833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:09.956320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f44a0-e472-41c9-90b9-278be856db1b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.031857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.032968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.033389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.033736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.034510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.036759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.073083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3302/6562] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:09 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:10.074609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:10.087516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96899897-a4e1-46d0-88c1-84b7fc7f779f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.093770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77b38c-f135-4567-bfe8-93329fcd65f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.094561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77b38c-f135-4567-bfe8-93329fcd65f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.094849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77b38c-f135-4567-bfe8-93329fcd65f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.095130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77b38c-f135-4567-bfe8-93329fcd65f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.096942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77b38c-f135-4567-bfe8-93329fcd65f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.098735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77b38c-f135-4567-bfe8-93329fcd65f9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.147003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:10.160325 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3261/6563] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:10.163129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ff3fd-1877-4548-957a-1aee6e6e101b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.168737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.169704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.170775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.170775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.171297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.173739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.179196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75406a2-095c-4e15-999b-1de0a26b551b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.179196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75406a2-095c-4e15-999b-1de0a26b551b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.179492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75406a2-095c-4e15-999b-1de0a26b551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.200083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3303/6564] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:10.200999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:10.205137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a75406a2-095c-4e15-999b-1de0a26b551b None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:10.206777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a75406a2-095c-4e15-999b-1de0a26b551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:10.214829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154814d-6bab-4e1d-b60a-ac7a1edf800a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.221059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e72c8-0957-4536-90cf-499baff4367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.221724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e72c8-0957-4536-90cf-499baff4367b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.222235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e72c8-0957-4536-90cf-499baff4367b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.222522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e72c8-0957-4536-90cf-499baff4367b admin admin] PATH_INFO: `/v3/projects/50dad433928c4ccabf3b120c9f9bdff7/users/74d5884f52f24625a843da2bade3de07/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.242897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e72c8-0957-4536-90cf-499baff4367b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50dad433928c4ccabf3b120c9f9bdff7, user_id=74d5884f52f24625a843da2bade3de07, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.246982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e72c8-0957-4536-90cf-499baff4367b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.270698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3304/6565] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:10 2022] PUT /identity/v3/projects/50dad433928c4ccabf3b120c9f9bdff7/users/74d5884f52f24625a843da2bade3de07/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:10.282743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.283121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.283462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.314388 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3262/6566] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:10.320218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] MFA Rules not processed for user `74d5884f52f24625a843da2bade3de07`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:10.321706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:10.330603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75406a2-095c-4e15-999b-1de0a26b551b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:10.375318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:10.429345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:10.437089 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3305/6567] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:10.450450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:10.452102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:10.475597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75406a2-095c-4e15-999b-1de0a26b551b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.555468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8969d0-ba39-495a-888e-c98653842ca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.556137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8969d0-ba39-495a-888e-c98653842ca1 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.556422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8969d0-ba39-495a-888e-c98653842ca1 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.556806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8969d0-ba39-495a-888e-c98653842ca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.613987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791ee8a-e630-4d38-91dc-28de7b224c09 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.622526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e725ed-9953-4c66-81e8-3f0e748a7c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.623328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e725ed-9953-4c66-81e8-3f0e748a7c24 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.623771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e725ed-9953-4c66-81e8-3f0e748a7c24 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.624151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e725ed-9953-4c66-81e8-3f0e748a7c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.635604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e725ed-9953-4c66-81e8-3f0e748a7c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.638253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e725ed-9953-4c66-81e8-3f0e748a7c24 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.651897 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3306/6568] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:10.669510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56fe3-dce8-44a6-982d-473ca51fb116 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.670121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56fe3-dce8-44a6-982d-473ca51fb116 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.670640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56fe3-dce8-44a6-982d-473ca51fb116 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.672934 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3307/6569] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:27:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:27:10.679402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56fe3-dce8-44a6-982d-473ca51fb116 None None] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:27:10.681990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8969d0-ba39-495a-888e-c98653842ca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.684640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8969d0-ba39-495a-888e-c98653842ca1 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.699807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3263/6570] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:10.721318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56fe3-dce8-44a6-982d-473ca51fb116 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:10.740493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56fe3-dce8-44a6-982d-473ca51fb116 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.746416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d5884f52f24625a843da2bade3de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dad433928c4ccabf3b120c9f9bdff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.747327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.748619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.748911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] PATH_INFO: `/v3/projects/50dad433928c4ccabf3b120c9f9bdff7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.750603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorizing `identity:get_project(project_id=50dad433928c4ccabf3b120c9f9bdff7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.752754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.756301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3308/6571] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:27:10 2022] GET /identity/v3/projects/50dad433928c4ccabf3b120c9f9bdff7 => generated 365 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:10.791238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24b3a-f168-4840-adc1-2075b91b7a9e None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.791619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24b3a-f168-4840-adc1-2075b91b7a9e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.792110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24b3a-f168-4840-adc1-2075b91b7a9e None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.793482 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3264/6572] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:27:10.806807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:27:10.809117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:10.865762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:10.895057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96282ed7-ee5c-4743-a3af-21ef53a1245c tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:10.900892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d5884f52f24625a843da2bade3de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dad433928c4ccabf3b120c9f9bdff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:10.902103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.902771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.902971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] PATH_INFO: `/v3/projects/50dad433928c4ccabf3b120c9f9bdff7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.904643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorizing `identity:get_project(project_id=50dad433928c4ccabf3b120c9f9bdff7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:10.930757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:10.939218 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3309/6573] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:27:10 2022] GET /identity/v3/projects/50dad433928c4ccabf3b120c9f9bdff7 => generated 365 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:10.989337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fc27e-faca-4b6b-b433-74d0477c14aa None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:10.989728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fc27e-faca-4b6b-b433-74d0477c14aa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:10.990579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fc27e-faca-4b6b-b433-74d0477c14aa None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:10.992116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3265/6574] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:27:10.998058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:27:11.020393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:11.037154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f977-dc31-4ad7-b894-c7636e6718c1 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:11.045004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d5884f52f24625a843da2bade3de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dad433928c4ccabf3b120c9f9bdff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:11.046465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.046899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.047389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] PATH_INFO: `/v3/projects/50dad433928c4ccabf3b120c9f9bdff7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.048981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorizing `identity:get_project(project_id=50dad433928c4ccabf3b120c9f9bdff7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:11.051390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:11.058787 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3310/6575] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:27:10 2022] GET /identity/v3/projects/50dad433928c4ccabf3b120c9f9bdff7 => generated 365 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:11.088590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068987c6-8747-4db5-955c-bb5af15477b5 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.088977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068987c6-8747-4db5-955c-bb5af15477b5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.089888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068987c6-8747-4db5-955c-bb5af15477b5 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.092806 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3266/6576] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:27:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:27:11.099632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:27:11.112826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349714ab-7b66-4913-9e86-e4032d492e9e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.113160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349714ab-7b66-4913-9e86-e4032d492e9e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.113456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349714ab-7b66-4913-9e86-e4032d492e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.121706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:11.133541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0a0c0-2059-42b6-810e-ef09163e8002 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:11.133802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-349714ab-7b66-4913-9e86-e4032d492e9e None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:11.135015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-349714ab-7b66-4913-9e86-e4032d492e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:11.142336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6feb-ca25-4ab4-bc59-18143369f849 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d5884f52f24625a843da2bade3de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dad433928c4ccabf3b120c9f9bdff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:11.143405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6feb-ca25-4ab4-bc59-18143369f849 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.143521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6feb-ca25-4ab4-bc59-18143369f849 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.143852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6feb-ca25-4ab4-bc59-18143369f849 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] PATH_INFO: `/v3/projects/50dad433928c4ccabf3b120c9f9bdff7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.145384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6feb-ca25-4ab4-bc59-18143369f849 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorizing `identity:get_project(project_id=50dad433928c4ccabf3b120c9f9bdff7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:11.145860 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3267/6577] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:11.147641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc6feb-ca25-4ab4-bc59-18143369f849 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:11.149835 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3311/6578] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:27:11 2022] GET /identity/v3/projects/50dad433928c4ccabf3b120c9f9bdff7 => generated 365 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:27:11.161733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349714ab-7b66-4913-9e86-e4032d492e9e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:11.177936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349714ab-7b66-4913-9e86-e4032d492e9e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:11.191762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:11.193062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.195477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.195873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.214927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146eeea-4fb8-4ac2-88f8-3ad057680466 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.215227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146eeea-4fb8-4ac2-88f8-3ad057680466 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.215496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146eeea-4fb8-4ac2-88f8-3ad057680466 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.215944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:11.218247 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3312/6579] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:27:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:27:11.222549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:11.228776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146eeea-4fb8-4ac2-88f8-3ad057680466 None None] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:27:11.234414 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3268/6580] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:11.253022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146eeea-4fb8-4ac2-88f8-3ad057680466 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:11.267615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146eeea-4fb8-4ac2-88f8-3ad057680466 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:11.279619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562f614-4bb5-4899-8d5a-2539a4c3f898 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d5884f52f24625a843da2bade3de07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50dad433928c4ccabf3b120c9f9bdff7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:11.280879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f614-4bb5-4899-8d5a-2539a4c3f898 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.281483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f614-4bb5-4899-8d5a-2539a4c3f898 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.281865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f614-4bb5-4899-8d5a-2539a4c3f898 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] PATH_INFO: `/v3/projects/50dad433928c4ccabf3b120c9f9bdff7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.283944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562f614-4bb5-4899-8d5a-2539a4c3f898 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorizing `identity:get_project(project_id=50dad433928c4ccabf3b120c9f9bdff7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:11.286566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562f614-4bb5-4899-8d5a-2539a4c3f898 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:11.294189 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3313/6581] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:27:11 2022] GET /identity/v3/projects/50dad433928c4ccabf3b120c9f9bdff7 => generated 365 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:27:11.327962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:11.445971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba32fee-14b4-413c-89f1-ada68ebe5adb service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:11.451755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:11.453734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.454113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.454565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] PATH_INFO: `/v3/users/74d5884f52f24625a843da2bade3de07` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.456146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d5884f52f24625a843da2bade3de07)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:11.458556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:11.475333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:11.554504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d5884f52f24625a843da2bade3de07'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:11.555407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d5884f52f24625a843da2bade3de07'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:11.573802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d5884f52f24625a843da2bade3de07'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:11.574949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d5884f52f24625a843da2bade3de07'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:11.585191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e5924774-ea7f-4588-ab4f-2eab3f2ed5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d5884f52f24625a843da2bade3de07'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:11.598247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.598612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.598964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.603060 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3269/6582] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:11 2022] DELETE /identity/v3/users/74d5884f52f24625a843da2bade3de07 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:11.607819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.608362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.608655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.625380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:11.626788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:11.638716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:11.642278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:11.693243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3314/6583] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:11.707113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:11.708939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:11.715875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3270/6584] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:11.728198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:11.730381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:11.742949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:11.816828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11c74-d926-4a3b-9041-ad771ca9bb6c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:11.822650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:11.823438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.823819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.824190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.830673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d015-6fd9-443a-8743-f366a6f3b2fe None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:11.839141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:11.840388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579331f1-9bf1-4b02-8a70-f7e69d70de5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:11.841026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:11.841176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579331f1-9bf1-4b02-8a70-f7e69d70de5f service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:11.841506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579331f1-9bf1-4b02-8a70-f7e69d70de5f service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:11.841789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579331f1-9bf1-4b02-8a70-f7e69d70de5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:11.857805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3271/6585] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:11.862151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579331f1-9bf1-4b02-8a70-f7e69d70de5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:11.864053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579331f1-9bf1-4b02-8a70-f7e69d70de5f service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:11.873985 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3315/6586] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:27:12.703346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:12.705220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:12.736314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f7bdc-d167-409d-8a1c-79f032c77835 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:12.741933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:12.743835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:12.744402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:12.744881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] PATH_INFO: `/v3/projects/50dad433928c4ccabf3b120c9f9bdff7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:12.746529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50dad433928c4ccabf3b120c9f9bdff7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:12.748990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:12.821059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:12.851535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50dad433928c4ccabf3b120c9f9bdff7', 'request_id': 'req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:12.862213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50dad433928c4ccabf3b120c9f9bdff7', 'request_id': 'req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:12.875409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50dad433928c4ccabf3b120c9f9bdff7', 'request_id': 'req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:12.896172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] The token cache is being invalidate because project 50dad433928c4ccabf3b120c9f9bdff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:12.896880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:12.897832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f26f0a-9f2b-4c38-b3dd-e992afbe126d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:12.899705 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3272/6587] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:12 2022] DELETE /identity/v3/projects/50dad433928c4ccabf3b120c9f9bdff7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:12.906665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70849-acb4-4415-8057-2039cfb66d37 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:12.907275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70849-acb4-4415-8057-2039cfb66d37 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:12.907275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70849-acb4-4415-8057-2039cfb66d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:12.963789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-09c70849-acb4-4415-8057-2039cfb66d37 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:12.966699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-09c70849-acb4-4415-8057-2039cfb66d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:13.115939 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3316/6588] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:13.124796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e2bb6-bfb4-4cfd-ba9c-37a748347c4e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.125170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e2bb6-bfb4-4cfd-ba9c-37a748347c4e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.125567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e2bb6-bfb4-4cfd-ba9c-37a748347c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.167272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-654e2bb6-bfb4-4cfd-ba9c-37a748347c4e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:13.171240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-654e2bb6-bfb4-4cfd-ba9c-37a748347c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:13.187167 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3273/6589] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:13.192303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c70849-acb4-4415-8057-2039cfb66d37 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.212146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c70849-acb4-4415-8057-2039cfb66d37 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:13.219136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:13.220254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.220633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.221006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.221878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:13.222314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:13.224036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:13.240858 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3317/6590] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:13.248391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e2bb6-bfb4-4cfd-ba9c-37a748347c4e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.266006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e2bb6-bfb4-4cfd-ba9c-37a748347c4e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:13.274376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1abbd4-6ea8-4814-825e-421c957a4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:13.275802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1abbd4-6ea8-4814-825e-421c957a4c52 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.276631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1abbd4-6ea8-4814-825e-421c957a4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.277383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1abbd4-6ea8-4814-825e-421c957a4c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.279146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1abbd4-6ea8-4814-825e-421c957a4c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:13.284189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1abbd4-6ea8-4814-825e-421c957a4c52 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:13.341384 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3274/6591] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:13 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:13.343885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.362100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd811e93-a7f9-4399-a51f-7863be5427f8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:13.387992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.388295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.388590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.414290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:13.416136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:13.439606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:13.441106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.441392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.441667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.442390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:13.444601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:13.470380 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3318/6592] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:13 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:13.475292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.490876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c50f4-258a-46ae-89c1-f6214f831764 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:13.493417 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3275/6593] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:27:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:13.497068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:13.497894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.498407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.498776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.500271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:13.503176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:13.508860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.513290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:13.518764 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3319/6594] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:27:13.523062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.559132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4a965-183d-42de-8cba-ff9f918cce1f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:13.565919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:13.566508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.567539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.567539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.568438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:13.571292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:13.591210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3320/6595] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:13.592383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.604065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f31bcd-b615-4db3-963d-cece942299d3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:13.616755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a1fdd-ae8b-4f9b-8094-9ce77129854d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:13.616993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:13.618214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.618605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.619058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] PATH_INFO: `/v3/projects/1d289d1b4db94b2080a1a260c0a613e5/users/220438320dbb418493cabef550b87066/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.623428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab15bb-f4a9-4b28-abcf-8ab7ae44e435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:13.624160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab15bb-f4a9-4b28-abcf-8ab7ae44e435 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.625210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab15bb-f4a9-4b28-abcf-8ab7ae44e435 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.625561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab15bb-f4a9-4b28-abcf-8ab7ae44e435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.632526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:13.640208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab15bb-f4a9-4b28-abcf-8ab7ae44e435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:13.642834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d289d1b4db94b2080a1a260c0a613e5, user_id=220438320dbb418493cabef550b87066, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:13.643549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab15bb-f4a9-4b28-abcf-8ab7ae44e435 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:13.646214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:13.654317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3276/6596] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:13.671003 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3321/6597] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:13 2022] PUT /identity/v3/projects/1d289d1b4db94b2080a1a260c0a613e5/users/220438320dbb418493cabef550b87066/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:13.686117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4251-022c-4fc5-a60a-7ad92077b4b7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.686551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4251-022c-4fc5-a60a-7ad92077b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.687120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab4251-022c-4fc5-a60a-7ad92077b4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.724471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e3ab4251-022c-4fc5-a60a-7ad92077b4b7 None None] MFA Rules not processed for user `220438320dbb418493cabef550b87066`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:13.725879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3ab4251-022c-4fc5-a60a-7ad92077b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:13.744281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:13.850375 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3277/6598] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:13.855994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:13.913504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4d331-2717-4269-8406-c09b8a819602 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:13.914124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4d331-2717-4269-8406-c09b8a819602 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:13.914707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4d331-2717-4269-8406-c09b8a819602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:13.937118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f7c4d331-2717-4269-8406-c09b8a819602 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:13.938480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f7c4d331-2717-4269-8406-c09b8a819602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:14.025467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35069-d210-4fda-9a0e-cd1b24fdb92e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.041974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.042691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.043006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.047798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.048574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.055939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.061405 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3278/6599] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:27:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:14.101716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4d331-2717-4269-8406-c09b8a819602 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.185592 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3322/6600] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:13 2022] POST /identity/v3/projects => generated 367 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:14.185592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.249687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a0988-2cc8-4add-ada1-602b81dd546e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.261129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.262087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.262377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.262666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.263510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.265570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.277091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4d331-2717-4269-8406-c09b8a819602 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.294139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3323/6601] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:14 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:14.295538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.297693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:14.311567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34086f9-b9b7-4c18-bc25-334eac9ecf17 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.317329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.319424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.319845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.320238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] PATH_INFO: `/v3/users/070972ca7aa746e8af3aaa82579cca33` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.322231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=070972ca7aa746e8af3aaa82579cca33)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.325172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.341586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:14.355586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.356418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.356970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.361438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.428966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070972ca7aa746e8af3aaa82579cca33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:14.431392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070972ca7aa746e8af3aaa82579cca33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:14.450666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:14.454151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.456093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.467892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070972ca7aa746e8af3aaa82579cca33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:14.469668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070972ca7aa746e8af3aaa82579cca33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:14.477823 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3279/6602] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:14.479411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.488000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1c1da5c-5510-4c34-a330-2ee758e325cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070972ca7aa746e8af3aaa82579cca33'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:14.505079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7db8ed-ab18-4e5e-ab3e-5a84344b72cc service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.513736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.514269 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3324/6603] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:14 2022] DELETE /identity/v3/users/070972ca7aa746e8af3aaa82579cca33 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:14.514665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.519276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.519276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.519930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.522107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.526195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f380-4374-41ac-a488-840f090cd0b5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.527333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f380-4374-41ac-a488-840f090cd0b5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.528310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f380-4374-41ac-a488-840f090cd0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.541787 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3280/6604] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:14.546702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.549513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:14.570594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4302-62b0-416d-959a-7fc2a51a1025 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.585988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e1c5f380-4374-41ac-a488-840f090cd0b5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:14.587738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e1c5f380-4374-41ac-a488-840f090cd0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:14.697447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.699035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.699321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.699602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] PATH_INFO: `/v3/projects/a7e9b2bb051846498f76f355357e246a/users/58253df94c67452e864c28d55b614c94/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.707674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3325/6605] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:14.707674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4871f4-3531-4aaa-a1c5-c3d97d96f442 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.707674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4871f4-3531-4aaa-a1c5-c3d97d96f442 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.707674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4871f4-3531-4aaa-a1c5-c3d97d96f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.727294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e9b2bb051846498f76f355357e246a, user_id=58253df94c67452e864c28d55b614c94, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.727799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4b4871f4-3531-4aaa-a1c5-c3d97d96f442 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:14.729019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4b4871f4-3531-4aaa-a1c5-c3d97d96f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:14.732987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.778628 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3281/6606] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:14 2022] PUT /identity/v3/projects/a7e9b2bb051846498f76f355357e246a/users/58253df94c67452e864c28d55b614c94/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:14.778628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.781320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:14.811053 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3326/6607] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:27:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:14.812295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4871f4-3531-4aaa-a1c5-c3d97d96f442 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.826092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4871f4-3531-4aaa-a1c5-c3d97d96f442 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.884872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4b9b-1855-46a6-b974-b1673acbcce2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:14.890508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.891885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.892303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.892966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.913596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:14.914721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:14.915199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:14.915704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:14.916627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.918630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.933097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3327/6608] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:14.933097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:14.933649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:14.934205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:14.956947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:14.982986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:14.984590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:14.997126 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3282/6609] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:14.998637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.019449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc64dae-550b-47dc-b777-68ef285b5a55 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.020430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a747c-ba3e-4546-9d62-1ba1f6eb26fd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.025665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.026339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.026621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.027422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.034660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c98ca-8a8f-42f5-8bbf-a69ca196f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.035809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c98ca-8a8f-42f5-8bbf-a69ca196f694 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.036433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c98ca-8a8f-42f5-8bbf-a69ca196f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.036433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c98ca-8a8f-42f5-8bbf-a69ca196f694 admin admin] PATH_INFO: `/v3/projects/a7e9b2bb051846498f76f355357e246a/users/58253df94c67452e864c28d55b614c94/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.039049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c98ca-8a8f-42f5-8bbf-a69ca196f694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e9b2bb051846498f76f355357e246a, user_id=58253df94c67452e864c28d55b614c94, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.044443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c98ca-8a8f-42f5-8bbf-a69ca196f694 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.058848 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3283/6610] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:14 2022] PUT /identity/v3/projects/a7e9b2bb051846498f76f355357e246a/users/58253df94c67452e864c28d55b614c94/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:15.072219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907006-0922-4490-a630-b32ebf34e6ad None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.072696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907006-0922-4490-a630-b32ebf34e6ad None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.073062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907006-0922-4490-a630-b32ebf34e6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.108068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e3907006-0922-4490-a630-b32ebf34e6ad None None] MFA Rules not processed for user `58253df94c67452e864c28d55b614c94`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:15.110128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3907006-0922-4490-a630-b32ebf34e6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:15.125055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.128450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.144263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3328/6611] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:15.217085 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3284/6612] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:15.221229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.326048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175f7c1-5196-4685-b535-abafa280e2d5 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.335043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.335454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.335831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.336207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.337848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.339457 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:27:15.339457 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:27:15.339457 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:27:15.340634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.342323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebeaae-c892-4b35-9934-6dc4e0eab710 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.342782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebeaae-c892-4b35-9934-6dc4e0eab710 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.343192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebeaae-c892-4b35-9934-6dc4e0eab710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.366443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8aebeaae-c892-4b35-9934-6dc4e0eab710 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:15.366923 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3329/6613] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:27:15 2022] POST /identity/v3/regions => generated 224 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:15.368090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.368245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8aebeaae-c892-4b35-9934-6dc4e0eab710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:15.398870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cd4b9-68b5-4a3c-b674-798837927730 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.405775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.406605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.407077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.407448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.408267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.410914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.436537 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3330/6614] 10.222.0.30 () {60 vars in 1148 bytes} [Sat Jun 18 22:27:15 2022] POST /identity/v3/regions => generated 222 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:15.441627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.463438 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3285/6615] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:27:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:15.471716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1bcbd-9ce7-4d0b-841d-09368976f61d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.476759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.477707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.477995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.478273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/ddc530a3-703b-4b9f-9730-b031a7e1da24` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.479226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:create_region(region_id=ddc530a3-703b-4b9f-9730-b031a7e1da24)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.479694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebeaae-c892-4b35-9934-6dc4e0eab710 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.481451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.489370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:15.523384 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3331/6616] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Jun 18 22:27:15 2022] PUT /identity/v3/regions/ddc530a3-703b-4b9f-9730-b031a7e1da24 => generated 231 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:15.526124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.535193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:15.572174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15093a2-00fa-4ad4-8fea-8af7e3f0463e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.578829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.580182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.580658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.581159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/ddc530a3-703b-4b9f-9730-b031a7e1da24` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.582016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ddc530a3-703b-4b9f-9730-b031a7e1da24)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.583982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.618684 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3332/6617] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:27:15 2022] DELETE /identity/v3/regions/ddc530a3-703b-4b9f-9730-b031a7e1da24 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:15.624125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.631046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebeaae-c892-4b35-9934-6dc4e0eab710 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.653080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.653766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.653936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.654219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.655109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7437392-4b0f-4c6f-9a40-9870f9fe6f91 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.662827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.663865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.664370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.664830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.665458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.665989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.667081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.668540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.679107 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3286/6618] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:15.680786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.682930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:15.736894 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3333/6619] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Jun 18 22:27:15 2022] POST /identity/v3/regions => generated 253 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:15.738406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:15.818876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dc01f-6a7b-4800-8b94-9f01c9182c8e tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.848745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.851223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.851506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.851786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/dab13d3d3b264bb49644b985312e255a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.866532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:update_region(region_id=dab13d3d3b264bb49644b985312e255a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.868747 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:27:15.868747 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:27:15.868747 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:27:15.872759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.878449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f362737-8d56-4ac1-b5d5-cf18c9dfb5e4 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:15.932835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:15.933777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:15.934063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:15.934345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] PATH_INFO: `/v3/projects/06e58c7426ac47dda531c1ee4838f3f8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:15.937496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e58c7426ac47dda531c1ee4838f3f8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:15.942782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:15.950319 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3334/6620] 10.222.0.30 () {60 vars in 1249 bytes} [Sat Jun 18 22:27:15 2022] PATCH /identity/v3/regions/dab13d3d3b264bb49644b985312e255a => generated 254 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:15.954886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.009324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1d6b-1805-4223-a19b-9e70fa8e3252 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.020005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975da3ec-d244-4476-abe9-b80312404a3d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.021377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975da3ec-d244-4476-abe9-b80312404a3d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.021916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975da3ec-d244-4476-abe9-b80312404a3d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.022906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975da3ec-d244-4476-abe9-b80312404a3d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/dab13d3d3b264bb49644b985312e255a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.023775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975da3ec-d244-4476-abe9-b80312404a3d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:get_region(region_id=dab13d3d3b264bb49644b985312e255a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.025127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975da3ec-d244-4476-abe9-b80312404a3d tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.036362 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3335/6621] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:27:15 2022] GET /identity/v3/regions/dab13d3d3b264bb49644b985312e255a => generated 254 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:16.039073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.039559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.040023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.073208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:16.074656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.087757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e58c7426ac47dda531c1ee4838f3f8', 'request_id': 'req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.097431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e58c7426ac47dda531c1ee4838f3f8', 'request_id': 'req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.110241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e58c7426ac47dda531c1ee4838f3f8', 'request_id': 'req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.126488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] The token cache is being invalidate because project 06e58c7426ac47dda531c1ee4838f3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:16.126844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.127925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.131315 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3287/6622] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:15 2022] DELETE /identity/v3/projects/06e58c7426ac47dda531c1ee4838f3f8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:16.132016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.133644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.155799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:16.180077 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3336/6623] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:27:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:16.186554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.189120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.246216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48246f13-ff36-4f11-bb7a-19f7ad4f0aa2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.249444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:16.252662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.253785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.254070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.254350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/dab13d3d3b264bb49644b985312e255a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.256038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dab13d3d3b264bb49644b985312e255a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.257721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.290211 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3288/6624] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:27:16 2022] DELETE /identity/v3/regions/dab13d3d3b264bb49644b985312e255a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:16.290211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.290549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.291911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba16c71-19e2-4ae4-8a8f-8c5eb77f6f87 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.315565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.317675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.318130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.319044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] PATH_INFO: `/v3/users/23f02a2994bf43c6bdf13e22a305c4bc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.320581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f02a2994bf43c6bdf13e22a305c4bc)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.323718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.422537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f02a2994bf43c6bdf13e22a305c4bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.423391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f02a2994bf43c6bdf13e22a305c4bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.427322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058afd1c-5cc1-44df-bdaa-7fcdd8681eac tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.434544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.435571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.436727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.437010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.438943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.442815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f02a2994bf43c6bdf13e22a305c4bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.443810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f02a2994bf43c6bdf13e22a305c4bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.454141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.454996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f02a2994bf43c6bdf13e22a305c4bc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:16.455760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.467303 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3289/6625] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:16.468359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.470197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.475974 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3337/6626] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:16 2022] DELETE /identity/v3/users/23f02a2994bf43c6bdf13e22a305c4bc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:16.512235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c561cb9-bd44-4bd2-8a6c-27e3667f4687 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.613383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.616218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.616801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.617346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.618895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.620991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.630477 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3290/6627] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:27:16 2022] GET /identity/v3/regions => generated 668 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:16.634769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.651967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960f6a0-c8b9-4a46-b926-5198cf995211 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.658550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50ba7a-b8ef-4b56-b909-5b26b40736dd tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.659465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ba7a-b8ef-4b56-b909-5b26b40736dd tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.659728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ba7a-b8ef-4b56-b909-5b26b40736dd tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.660039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ba7a-b8ef-4b56-b909-5b26b40736dd tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/dab13d3d3b264bb49644b985312e255a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.660896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50ba7a-b8ef-4b56-b909-5b26b40736dd tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:delete_region(region_id=dab13d3d3b264bb49644b985312e255a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.663211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50ba7a-b8ef-4b56-b909-5b26b40736dd tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-fb50ba7a-b8ef-4b56-b909-5b26b40736dd tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Could not find region: dab13d3d3b264bb49644b985312e255a.: keystone.exception.RegionNotFound: Could not find region: dab13d3d3b264bb49644b985312e255a. Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: dab13d3d3b264bb49644b985312e255a. Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:27:16.709110 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: dab13d3d3b264bb49644b985312e255a. Jun 18 22:27:16.709972 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:27:16.715630 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3338/6628] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:27:16 2022] DELETE /identity/v3/regions/dab13d3d3b264bb49644b985312e255a => generated 112 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:27:16.716094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.719320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.719615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.720015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.736419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84914d58-e161-47d4-b324-ea1f6f8d6759 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.741681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.742371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.742653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.742933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.743614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.744906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.751918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:16.759809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:16.760843 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3291/6629] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:27:16 2022] GET /identity/v3/regions => generated 668 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:27:16.761751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.765654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.786380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76803ec-f6ee-4dd7-81f9-d40d658ab34b tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.803731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.805069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.805069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.805069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.805758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.806805 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:27:16.806805 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:27:16.806805 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:27:16.807764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.836740 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3292/6630] 10.222.0.30 () {60 vars in 1149 bytes} [Sat Jun 18 22:27:16 2022] POST /identity/v3/regions => generated 253 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:16.842276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.868377 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3339/6631] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:27:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:16.868984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27f4dd-2898-4f54-b2a1-00f7a8af0fb3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.874882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.875724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.876084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.876930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.877579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Adding query filter params (parent_region_id=235b12db376445ba9a070d3022336ffb) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:16.878126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.879677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.886183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.889847 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3293/6632] 10.222.0.30 () {58 vars in 1226 bytes} [Sat Jun 18 22:27:16 2022] GET /identity/v3/regions?parent_region_id=235b12db376445ba9a070d3022336ffb => generated 399 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:16.891319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.893002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:16.904609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a397f4-30aa-4067-bc23-ae512eeb72d9 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:16.913581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:16.914585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:16.914948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:16.915307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/be5c2987bcc545bcb43c83ac6b6f3086` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:16.916846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:delete_region(region_id=be5c2987bcc545bcb43c83ac6b6f3086)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:16.919138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:16.939238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:16.955400 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3294/6633] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:27:16 2022] DELETE /identity/v3/regions/be5c2987bcc545bcb43c83ac6b6f3086 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:16.957509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:16.995853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ff894-988b-460b-a719-de2d0b4b16c3 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:17.006916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:17.008995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.009342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.010996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/b51ce1997e4f4a65be472fd58fc6bf4e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.011696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:delete_region(region_id=b51ce1997e4f4a65be472fd58fc6bf4e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:17.015786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:17.059488 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3295/6634] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:27:16 2022] DELETE /identity/v3/regions/b51ce1997e4f4a65be472fd58fc6bf4e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:17.064546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:17.072019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdba1d-09a4-4f81-81a1-bb142cc669b1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:17.107539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89969-9598-4ee6-8af6-2c47007b8691 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:17.107726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:17.108427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.108713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.109135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.114197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58253df94c67452e864c28d55b614c94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e9b2bb051846498f76f355357e246a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:17.115881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.115881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.115881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] PATH_INFO: `/v3/regions/235b12db376445ba9a070d3022336ffb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.116460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorizing `identity:delete_region(region_id=235b12db376445ba9a070d3022336ffb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:17.118355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:17.130025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:17.131879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:17.149399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3340/6635] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:17.158041 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3296/6636] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:27:17 2022] DELETE /identity/v3/regions/235b12db376445ba9a070d3022336ffb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:17.159689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:17.161282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:17.304084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337f84a-a25e-4ed6-8b73-3e494337efd2 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:17.335944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:17.337433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.337717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.337989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] PATH_INFO: `/v3/users/220438320dbb418493cabef550b87066` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.342423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220438320dbb418493cabef550b87066)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:17.346192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:17.355256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:17.357470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:17.379774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23798a9e-2825-4724-81af-2a72cc2d6200 tempest-RegionsTestJSON-1006277627 tempest-RegionsTestJSON-1006277627-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:17.393504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:17.394475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.394785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.395074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] PATH_INFO: `/v3/users/ea3ff37902e4486bb8f9cf77dd01a8dc` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.397810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3ff37902e4486bb8f9cf77dd01a8dc)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:17.402090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:17.467505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220438320dbb418493cabef550b87066'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.468636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220438320dbb418493cabef550b87066'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.499586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3ff37902e4486bb8f9cf77dd01a8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.500423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3ff37902e4486bb8f9cf77dd01a8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.502132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220438320dbb418493cabef550b87066'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.503400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220438320dbb418493cabef550b87066'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.518343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220438320dbb418493cabef550b87066'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.525754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3ff37902e4486bb8f9cf77dd01a8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.526576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3ff37902e4486bb8f9cf77dd01a8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.541698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3341/6637] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:17 2022] DELETE /identity/v3/users/220438320dbb418493cabef550b87066 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:17.543106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:17.543843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acad7e2a-fa95-4cee-95b0-c23f5d120d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3ff37902e4486bb8f9cf77dd01a8dc'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.547783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:17.566336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:17.567832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3297/6638] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:17 2022] DELETE /identity/v3/users/ea3ff37902e4486bb8f9cf77dd01a8dc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:17.571143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ef3b-77a7-4720-a7be-d63457c08ab5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.571352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ef3b-77a7-4720-a7be-d63457c08ab5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.571903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ef3b-77a7-4720-a7be-d63457c08ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.611974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-daf1ef3b-77a7-4720-a7be-d63457c08ab5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:17.613405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-daf1ef3b-77a7-4720-a7be-d63457c08ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:17.621541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:17.675660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d450f4-1ef7-4e59-bf14-89764b383938 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:17.752266 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3298/6639] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:17.753663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.753804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:17.753988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.754220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.754988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:17.755329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:17.755755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] PATH_INFO: `/v3/projects/87756774924f48969706c05751dc7e32` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:17.758418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87756774924f48969706c05751dc7e32)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:17.760731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:17.798266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:17.801003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:17.824916 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3299/6640] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:17.826129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:17.831551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:17.854742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87756774924f48969706c05751dc7e32', 'request_id': 'req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.867319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87756774924f48969706c05751dc7e32', 'request_id': 'req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.885416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87756774924f48969706c05751dc7e32', 'request_id': 'req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.913652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] The token cache is being invalidate because project 87756774924f48969706c05751dc7e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:17.914026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.915032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:17.917349 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3342/6641] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:17 2022] DELETE /identity/v3/projects/87756774924f48969706c05751dc7e32 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:17.918232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:17.920776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:17.980722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:18.009107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103281bf-9dcc-48ac-9508-5cf16a0e5a05 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.014179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e7d3c-5a8a-41b6-bc3b-84bf4a7cda68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.015054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e7d3c-5a8a-41b6-bc3b-84bf4a7cda68 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.015442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e7d3c-5a8a-41b6-bc3b-84bf4a7cda68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.015725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e7d3c-5a8a-41b6-bc3b-84bf4a7cda68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.017504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b973e71-e1ee-44a9-bf20-a2d9d7ac5c8e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.018325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7d8e7d3c-5a8a-41b6-bc3b-84bf4a7cda68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.028894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b5e61-646a-4316-af9e-c7410e38113a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.029984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5e61-646a-4316-af9e-c7410e38113a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.030939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5e61-646a-4316-af9e-c7410e38113a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.030939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b5e61-646a-4316-af9e-c7410e38113a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.034086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-907b5e61-646a-4316-af9e-c7410e38113a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.130667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e7d3c-5a8a-41b6-bc3b-84bf4a7cda68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.132370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e7d3c-5a8a-41b6-bc3b-84bf4a7cda68 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.146751 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3300/6642] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:18.151521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.151826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.152107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.159095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b5e61-646a-4316-af9e-c7410e38113a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.162498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b5e61-646a-4316-af9e-c7410e38113a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.176004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:18.177608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.191149 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3301/6643] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:18.192707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.194354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.198763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3343/6644] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:18.204888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249eec6-338b-4b1f-b8c8-e76b0f9f675f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.205381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249eec6-338b-4b1f-b8c8-e76b0f9f675f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.205755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249eec6-338b-4b1f-b8c8-e76b0f9f675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.228629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6249eec6-338b-4b1f-b8c8-e76b0f9f675f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:18.230290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6249eec6-338b-4b1f-b8c8-e76b0f9f675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.239685 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3344/6645] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:18.245307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249eec6-338b-4b1f-b8c8-e76b0f9f675f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.256639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249eec6-338b-4b1f-b8c8-e76b0f9f675f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.268531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.273863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.274169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.274586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.275449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:18.275821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.277728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.279619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:18.302232 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3345/6646] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:18.303621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.317095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ef208-e54c-41cd-85bc-9e31972e5a1c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.324703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.325704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.326054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.326479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.327358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.329790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.371273 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3346/6647] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:18 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:18.373543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.392467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38415787-bafb-4ace-9725-d30b72e66a78 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.468832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.469561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.469846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.470210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.472055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.480889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98191e8-c0cd-4769-bd0c-e569ae274734 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.492517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.494430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.494874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.495333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.496412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.498938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.500694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.500812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.518552 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3302/6648] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:18.548947 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3347/6649] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:18 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:18.550240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.561834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e68d8-9fb3-4e33-9957-668b108c59a1 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.568879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.570127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.570127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.570520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.571900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.573425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.585176 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3303/6650] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:18.589511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.604082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a46471-a345-4fd3-b304-da3c69519538 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.618990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c0cf2-6203-4080-b912-0322ecfd424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.619813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0cf2-6203-4080-b912-0322ecfd424e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.620153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0cf2-6203-4080-b912-0322ecfd424e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.620626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c0cf2-6203-4080-b912-0322ecfd424e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.625535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c0cf2-6203-4080-b912-0322ecfd424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.627102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c0cf2-6203-4080-b912-0322ecfd424e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.640736 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3348/6651] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:18.644799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.656417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aeab4b-c386-45dd-a06c-b2d87a9a1af0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.664174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.665468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.665913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.666330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] PATH_INFO: `/v3/projects/8c9a0f7aa15245c5b4c9953576ad4c91/users/3391c09d59034a97a3495c8e29bc6358/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.684806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9a0f7aa15245c5b4c9953576ad4c91, user_id=3391c09d59034a97a3495c8e29bc6358, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:18.687857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:18.733592 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3304/6652] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:18 2022] PUT /identity/v3/projects/8c9a0f7aa15245c5b4c9953576ad4c91/users/3391c09d59034a97a3495c8e29bc6358/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:18.744748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.745655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.745655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.780453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] MFA Rules not processed for user `3391c09d59034a97a3495c8e29bc6358`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:18.782161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.819204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:18.880014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3349/6653] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:18.884284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.967141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:18.968867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:18.983728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18105a3d-142f-4906-9b47-13a4494e6b13 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:18.994843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:18.996378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:18.996768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:18.997536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:18.998418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.002185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.002706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455eaa5-fdab-41bb-9b5a-1f6f0bf96f02 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:19.009997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:19.010890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.011172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.011445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] PATH_INFO: `/v3/projects/1d289d1b4db94b2080a1a260c0a613e5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.013898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d289d1b4db94b2080a1a260c0a613e5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.015846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.095110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3305/6654] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:18 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:19.100182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:19.115216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:19.146436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d289d1b4db94b2080a1a260c0a613e5', 'request_id': 'req-d65450ca-0f7b-4af6-b58a-a2559974f698'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.157493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d289d1b4db94b2080a1a260c0a613e5', 'request_id': 'req-d65450ca-0f7b-4af6-b58a-a2559974f698'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.175030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d289d1b4db94b2080a1a260c0a613e5', 'request_id': 'req-d65450ca-0f7b-4af6-b58a-a2559974f698'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.196374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] The token cache is being invalidate because project 1d289d1b4db94b2080a1a260c0a613e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:19.197153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.198184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.203363 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3350/6655] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:18 2022] DELETE /identity/v3/projects/1d289d1b4db94b2080a1a260c0a613e5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:19.209086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:19.211967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:19.252249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c494-4132-48cb-a77f-9e5c55791c85 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:19.359053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65450ca-0f7b-4af6-b58a-a2559974f698 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:19.370810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:19.371880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.372525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.372993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] PATH_INFO: `/v3/users/58253df94c67452e864c28d55b614c94` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.375793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58253df94c67452e864c28d55b614c94)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.379718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.391688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:19.392980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.393514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.393957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.394829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.398286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.437701 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3306/6656] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:19 2022] POST /identity/v3/users => generated 297 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:19.438658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:19.441407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:19.455322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d96831-510a-4bd0-801f-5ebfc497b106 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:19.461688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58253df94c67452e864c28d55b614c94'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.462817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58253df94c67452e864c28d55b614c94'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.462895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:19.463800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.464764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:19.476326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.476735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] PATH_INFO: `/v3/projects/56cdf5c69af1438d8fd4ea21a05b1f4e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.480603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cdf5c69af1438d8fd4ea21a05b1f4e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.483181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.497134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58253df94c67452e864c28d55b614c94'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.498788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58253df94c67452e864c28d55b614c94'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.507391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58253df94c67452e864c28d55b614c94'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.528518 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3351/6657] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:19 2022] DELETE /identity/v3/users/58253df94c67452e864c28d55b614c94 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:19.532503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:19.536384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:19.577081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cdf5c69af1438d8fd4ea21a05b1f4e', 'request_id': 'req-cd24f33b-84b0-4661-82cd-ac9dd614535b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.588760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cdf5c69af1438d8fd4ea21a05b1f4e', 'request_id': 'req-cd24f33b-84b0-4661-82cd-ac9dd614535b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.601723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cdf5c69af1438d8fd4ea21a05b1f4e', 'request_id': 'req-cd24f33b-84b0-4661-82cd-ac9dd614535b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.626816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] The token cache is being invalidate because project 56cdf5c69af1438d8fd4ea21a05b1f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:19.627103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.629725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.633338 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3307/6658] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:19 2022] DELETE /identity/v3/projects/56cdf5c69af1438d8fd4ea21a05b1f4e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:19.634792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:19.636612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:19.675230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:19.685492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d85e6-3c15-487f-9a0f-a02e9e895504 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:19.740618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f33b-84b0-4661-82cd-ac9dd614535b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:19.746015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:19.746966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.747253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.747529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] PATH_INFO: `/v3/users/39c2337d42bc426abed2ed2fb5000753` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.748807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c2337d42bc426abed2ed2fb5000753)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.750815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.771063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a6cbf-7e89-4dfd-95b2-7df152137902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:19.772024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6cbf-7e89-4dfd-95b2-7df152137902 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.772277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6cbf-7e89-4dfd-95b2-7df152137902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.772552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6cbf-7e89-4dfd-95b2-7df152137902 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.773376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a6cbf-7e89-4dfd-95b2-7df152137902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.775219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a6cbf-7e89-4dfd-95b2-7df152137902 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.789058 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3352/6659] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:19.793701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.795444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.795681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.821295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:19.822671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:19.823111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c2337d42bc426abed2ed2fb5000753'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.824239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c2337d42bc426abed2ed2fb5000753'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.833355 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3353/6660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:19.846709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:19.849521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:19.849898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c2337d42bc426abed2ed2fb5000753'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.850799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c2337d42bc426abed2ed2fb5000753'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.860870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a4de2ae-bb37-44a8-81c1-ab5df0c85ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c2337d42bc426abed2ed2fb5000753'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:19.874626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6702000-b6ef-4c99-9825-ab15daadf226 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:19.883143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:19.887399 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3308/6661] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:19 2022] DELETE /identity/v3/users/39c2337d42bc426abed2ed2fb5000753 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:19.887526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.887526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.887526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] PATH_INFO: `/v3/projects/efd937dd519b45578d41230f02d48827/users/ea3d26ae2dda4213b2f20d0ed79fd0eb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.887763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:19.887763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:19.887763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:19.915322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd937dd519b45578d41230f02d48827, user_id=ea3d26ae2dda4213b2f20d0ed79fd0eb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:19.919134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:19.936202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:19.937838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:19.948244 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3354/6662] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:19 2022] PUT /identity/v3/projects/efd937dd519b45578d41230f02d48827/users/ea3d26ae2dda4213b2f20d0ed79fd0eb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:19.961815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.052277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:20.084415 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3309/6663] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:20.085787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.087887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.091965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42e3c-3da2-4431-9d10-88fdd23de182 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.101105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.101675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9372314-c00f-40df-82c1-995c14c096f7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.102150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.102234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.102881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.103651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.106087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.108742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.110279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.110646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.111042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] PATH_INFO: `/v3/projects/a7e9b2bb051846498f76f355357e246a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.112431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e9b2bb051846498f76f355357e246a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.115077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.126517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3355/6664] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:20.127743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.141022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436174cf-da5b-4773-af33-86039a65c99e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.146827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.147646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.148750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.149192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.150041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:20.150451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.152188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.171611 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3356/6665] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:20.171611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.182173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4c98e-45a8-4ab2-a091-4edb7a95db16 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.187673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.188729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.189615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.189615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] PATH_INFO: `/v3/projects/efd937dd519b45578d41230f02d48827/users/ea3d26ae2dda4213b2f20d0ed79fd0eb/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.192367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd937dd519b45578d41230f02d48827, user_id=ea3d26ae2dda4213b2f20d0ed79fd0eb, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.195933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.206696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:20.211761 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3357/6666] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:20 2022] PUT /identity/v3/projects/efd937dd519b45578d41230f02d48827/users/ea3d26ae2dda4213b2f20d0ed79fd0eb/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:20.221651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.224355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e9b2bb051846498f76f355357e246a', 'request_id': 'req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.242550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e9b2bb051846498f76f355357e246a', 'request_id': 'req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.262949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e9b2bb051846498f76f355357e246a', 'request_id': 'req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.280623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] The token cache is being invalidate because project a7e9b2bb051846498f76f355357e246a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:20.280909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.281904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-be0c050b-3d4e-4911-8a20-2ce76f2f58e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.286760 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3310/6667] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:20 2022] DELETE /identity/v3/projects/a7e9b2bb051846498f76f355357e246a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:20.286760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.286760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.286760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.324861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec956-7693-4ec0-90c1-ccc827d6de56 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.326343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] MFA Rules not processed for user `ea3d26ae2dda4213b2f20d0ed79fd0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:20.327843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.331666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb5b5c-54bc-4a6c-a9ce-560063f004c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.332585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5b5c-54bc-4a6c-a9ce-560063f004c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.333191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5b5c-54bc-4a6c-a9ce-560063f004c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.333672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb5b5c-54bc-4a6c-a9ce-560063f004c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.335150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb5b5c-54bc-4a6c-a9ce-560063f004c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.339819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb5b5c-54bc-4a6c-a9ce-560063f004c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.408149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3358/6668] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:20 2022] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:20.411026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.411830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.413081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.429375 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3311/6669] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:20.429375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.429375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.446503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:20.447488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.453137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9e9ac-8107-42d0-9443-ba50d69fbeaa None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.531238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3359/6670] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:20.532725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.534322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.534777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.535548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.536127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] PATH_INFO: `/v3/projects/8f9a7d50200443418ef0c6a20a608bb9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.536949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.540626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9a7d50200443418ef0c6a20a608bb9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.542795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.551659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796380b-bea1-4dcd-b43e-c45a0ed5a371 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.557866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.558686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.559030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.559312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.560261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.562744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.588139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3360/6671] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:20 2022] POST /identity/v3/users => generated 295 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:20.589007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.592435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.611406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:20.614497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9a7d50200443418ef0c6a20a608bb9', 'request_id': 'req-38e5657b-9905-492d-a8e4-00ece0fade2a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.623308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9a7d50200443418ef0c6a20a608bb9', 'request_id': 'req-38e5657b-9905-492d-a8e4-00ece0fade2a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.628840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:20.641012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9a7d50200443418ef0c6a20a608bb9', 'request_id': 'req-38e5657b-9905-492d-a8e4-00ece0fade2a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.661716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] The token cache is being invalidate because project 8f9a7d50200443418ef0c6a20a608bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:20.663385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.664164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38e5657b-9905-492d-a8e4-00ece0fade2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:20.666148 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3312/6672] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:20 2022] DELETE /identity/v3/projects/8f9a7d50200443418ef0c6a20a608bb9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:20.667307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.667689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.668059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.690090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:20.692145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.693155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102959a-c038-4f63-8bae-28b8507ec944 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.759004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.759913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.760342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.760617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.765639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.770468 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3313/6673] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:20.771341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.772687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.786419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd6913-f326-4a70-bb0a-a836f46a055b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.791988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ac812-d1de-407f-81dc-530fe540b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.792905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ac812-d1de-407f-81dc-530fe540b953 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.793306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ac812-d1de-407f-81dc-530fe540b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.793887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ac812-d1de-407f-81dc-530fe540b953 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.795557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ac812-d1de-407f-81dc-530fe540b953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.816898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ac812-d1de-407f-81dc-530fe540b953 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.846562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3314/6674] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:20.848820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1102e7-bd0d-4ce1-9837-d6b81cd86967 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.849375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1102e7-bd0d-4ce1-9837-d6b81cd86967 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.849874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1102e7-bd0d-4ce1-9837-d6b81cd86967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.893833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.896287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.900114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2a1102e7-bd0d-4ce1-9837-d6b81cd86967 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:20.901142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2a1102e7-bd0d-4ce1-9837-d6b81cd86967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:20.914268 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3361/6675] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:20.926074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.928446 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3315/6676] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:20.929343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1102e7-bd0d-4ce1-9837-d6b81cd86967 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:20.947925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21823985-c63f-49cd-a735-2ef51eeda470 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.960563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1102e7-bd0d-4ce1-9837-d6b81cd86967 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:20.963672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.964650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.965000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.965602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.966890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:20.968274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.970043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.983959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cc04d-79f3-4772-8820-7a14d2c3a95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:20.983959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cc04d-79f3-4772-8820-7a14d2c3a95d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:20.983959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cc04d-79f3-4772-8820-7a14d2c3a95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:20.983959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cc04d-79f3-4772-8820-7a14d2c3a95d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:20.984507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cc04d-79f3-4772-8820-7a14d2c3a95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:20.985385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cc04d-79f3-4772-8820-7a14d2c3a95d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:20.999557 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3316/6677] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:21.004149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3362/6678] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:21.006177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344524-8a19-4b57-be21-e297e3fc62e9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.006735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344524-8a19-4b57-be21-e297e3fc62e9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.007651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344524-8a19-4b57-be21-e297e3fc62e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.008400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.040059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e7344524-8a19-4b57-be21-e297e3fc62e9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:21.041251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e7344524-8a19-4b57-be21-e297e3fc62e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:21.047224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4f6e-fe8b-477a-ad1c-21fc022214f2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.053248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.054044 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3317/6679] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:21.054440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.054830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7344524-8a19-4b57-be21-e297e3fc62e9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.054979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.055590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] PATH_INFO: `/v3/projects/2887ead3272c4b048d7e15584373eafe/users/d430be481f0d46f8922d7da8039f23e0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.069022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7344524-8a19-4b57-be21-e297e3fc62e9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.074655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acfe7d-0cc2-41d9-be08-564d542f4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.075538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acfe7d-0cc2-41d9-be08-564d542f4314 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.075693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acfe7d-0cc2-41d9-be08-564d542f4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.076119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acfe7d-0cc2-41d9-be08-564d542f4314 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.077079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acfe7d-0cc2-41d9-be08-564d542f4314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.077398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2887ead3272c4b048d7e15584373eafe, user_id=d430be481f0d46f8922d7da8039f23e0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.079413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acfe7d-0cc2-41d9-be08-564d542f4314 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.080519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.111921 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3363/6680] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:21 2022] PUT /identity/v3/projects/2887ead3272c4b048d7e15584373eafe/users/d430be481f0d46f8922d7da8039f23e0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:21.111921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.132654 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3318/6681] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:21.134259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd91ab-aa3c-4244-9183-9c47ebfb4710 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.134556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd91ab-aa3c-4244-9183-9c47ebfb4710 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.134838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd91ab-aa3c-4244-9183-9c47ebfb4710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.173153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:21.203480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8cfd91ab-aa3c-4244-9183-9c47ebfb4710 None None] MFA Rules not processed for user `d430be481f0d46f8922d7da8039f23e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:21.204659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8cfd91ab-aa3c-4244-9183-9c47ebfb4710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:21.228120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632188-d105-4eb7-9b8e-95ef97d12cfc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.331258 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3319/6682] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:21.332122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd91ab-aa3c-4244-9183-9c47ebfb4710 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.351237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.352388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.353078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.353460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.354953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:21.355510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.358543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.365484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:21.379871 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3364/6683] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:21.379871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.391252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2acd1f-3804-49fa-99e2-903cc4f7b4f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.397999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.399355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.399818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.400282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.401394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.403237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.434350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd91ab-aa3c-4244-9183-9c47ebfb4710 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.439632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.440681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.440963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.444566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.444709 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3365/6684] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:21.444804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.444910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.445292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.485736 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3320/6685] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:21.487769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.507088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af7ce5-4d91-4572-8bb2-aa99f5b83b7d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.550180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f89090-cb05-46e6-b6c8-854b32545635 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.555907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.556895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.557212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.557490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.558191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.560501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.589590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.590348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.590629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.590914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.591628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.596807 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3366/6686] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:21.596974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.597191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.621151 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3321/6687] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:21.622281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.651233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:21.676146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04315998-a372-4c8a-bc6d-2ee6fc17e302 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.682357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.683029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.683860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.684139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.684925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.686709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.698162 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3367/6688] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:21.698901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.704334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425dbf-aed6-4720-9170-8fc9bd8034f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.708935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218ff7-7241-4159-bea4-0497eddf491c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.713717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.714382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.714663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.714941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.715621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.717734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.739558 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3368/6689] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:21.740554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.751355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09c4bf-b342-4bad-82bc-2216481a1d7f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.754471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:21.756499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.757122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.757326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.757601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.758378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.760280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.779847 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3369/6690] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:21.779847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.780101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3d26ae2dda4213b2f20d0ed79fd0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd937dd519b45578d41230f02d48827', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.780101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.780101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.780381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.780381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:21.780381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.780381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.791672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7ae4c-fc3f-47f0-bde4-6303cdbd1cfd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.800313 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3322/6691] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:21.800313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.801358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.802155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.802465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.803087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.803854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.805542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.811525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5620-a6bf-4383-8488-a63004850ca7 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.819947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.820155 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3370/6692] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:21.820246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.820246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.820246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.820434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.820498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.821209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.831980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf15b7-16ae-412f-aedd-8105a622f095 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.836197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.839988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.840136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3323/6693] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:21.840236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.840236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] PATH_INFO: `/v3/projects/2124d305c6d24b29a15222bbf9f8fe43/users/e00aabf903774fa58924b5963e2f7439/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.840381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.853842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba44043-578d-4be2-b424-bb98784236d4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.856062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2124d305c6d24b29a15222bbf9f8fe43, user_id=e00aabf903774fa58924b5963e2f7439, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.859034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.859759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3d26ae2dda4213b2f20d0ed79fd0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd937dd519b45578d41230f02d48827', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.860772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.860772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.861199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.862338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.865349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:21.879554 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3371/6694] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:21 2022] PUT /identity/v3/projects/2124d305c6d24b29a15222bbf9f8fe43/users/e00aabf903774fa58924b5963e2f7439/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:21.879554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.901465 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3324/6695] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:21 2022] POST /identity/v3/projects => generated 354 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:21.901465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:21.948947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4d9c-bbdb-47a1-8cb8-2a09cb02c9c5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.977934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765fb99-c278-45b0-8904-cde657a82e69 tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:21.984529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:21.994807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:21.995103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:21.995397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:21.996172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:21.997909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.012254 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3325/6696] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:22.012254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.021234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.022148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.030276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.030276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] PATH_INFO: `/v3/projects/3d5918cf07664a5fac93f1c2ad98d832/users/7f0cbaabf46849f39eb093597ab72f2c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.030503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd36c2-b4e0-479a-9b01-cf60b02e45af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.030503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.030503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.030503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.030967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.031947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.033725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.046141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5918cf07664a5fac93f1c2ad98d832, user_id=7f0cbaabf46849f39eb093597ab72f2c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.068521 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3326/6697] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:22.068521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.068936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.091914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:22.101115 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3372/6698] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:21 2022] PUT /identity/v3/projects/3d5918cf07664a5fac93f1c2ad98d832/users/7f0cbaabf46849f39eb093597ab72f2c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:22.103842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.148035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176193a3-13a7-42b6-a85e-6271a49a437a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.197810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:22.201983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88fe6a-0082-4be5-92e1-f2242175bc27 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.210775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29630d-c7f0-4f03-8f07-67dae28676a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.211861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29630d-c7f0-4f03-8f07-67dae28676a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.212285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29630d-c7f0-4f03-8f07-67dae28676a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.212641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29630d-c7f0-4f03-8f07-67dae28676a2 admin admin] PATH_INFO: `/v3/projects/9ccc2b1d2c4a49b59046bfc71b862519/users/1e582eb88d6740c1bf28911a53bd08c0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.235359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29630d-c7f0-4f03-8f07-67dae28676a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccc2b1d2c4a49b59046bfc71b862519, user_id=1e582eb88d6740c1bf28911a53bd08c0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.237686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3d26ae2dda4213b2f20d0ed79fd0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd937dd519b45578d41230f02d48827', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.238379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.238594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29630d-c7f0-4f03-8f07-67dae28676a2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.238714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.238983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.239874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:22.240310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.242042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.256832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3327/6699] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:22.257739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.273393 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3373/6700] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:22 2022] PUT /identity/v3/projects/9ccc2b1d2c4a49b59046bfc71b862519/users/1e582eb88d6740c1bf28911a53bd08c0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:22.275352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbae04-3641-42fb-b4ec-293ed756489b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.275563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbae04-3641-42fb-b4ec-293ed756489b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.276085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbae04-3641-42fb-b4ec-293ed756489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.278918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28891d8-4ece-40be-86c7-8f4113e7aeaf tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.342652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1fcbae04-3641-42fb-b4ec-293ed756489b None None] MFA Rules not processed for user `7f0cbaabf46849f39eb093597ab72f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:22.344039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1fcbae04-3641-42fb-b4ec-293ed756489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.360781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0115880-087a-4729-b93d-e641233255fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.362637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115880-087a-4729-b93d-e641233255fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.363265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115880-087a-4729-b93d-e641233255fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.363544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0115880-087a-4729-b93d-e641233255fe admin admin] PATH_INFO: `/v3/projects/2124d305c6d24b29a15222bbf9f8fe43/users/e00aabf903774fa58924b5963e2f7439/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.368652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0115880-087a-4729-b93d-e641233255fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2124d305c6d24b29a15222bbf9f8fe43, user_id=e00aabf903774fa58924b5963e2f7439, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.372545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0115880-087a-4729-b93d-e641233255fe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.396167 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3328/6701] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:22 2022] PUT /identity/v3/projects/2124d305c6d24b29a15222bbf9f8fe43/users/e00aabf903774fa58924b5963e2f7439/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:22.396167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e58f-88de-46e8-b687-1d239e77f1b9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.396167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e58f-88de-46e8-b687-1d239e77f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.396167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e58f-88de-46e8-b687-1d239e77f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.416780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-91a6e58f-88de-46e8-b687-1d239e77f1b9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:22.419660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-91a6e58f-88de-46e8-b687-1d239e77f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.439204 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3374/6702] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:22.443625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbae04-3641-42fb-b4ec-293ed756489b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.488836 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3329/6703] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:22.490789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.491366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.491652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.515072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbae04-3641-42fb-b4ec-293ed756489b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.523383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] MFA Rules not processed for user `e00aabf903774fa58924b5963e2f7439`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:22.525069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.533666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:22.578421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3d26ae2dda4213b2f20d0ed79fd0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd937dd519b45578d41230f02d48827', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.579608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.580060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.580333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] PATH_INFO: `/v3/projects/43e6377639af4bd3876c17f26fa4fbf6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.581603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=43e6377639af4bd3876c17f26fa4fbf6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.583564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.585672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:22.611764 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3330/6704] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:22.612962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.614411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.648215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e6377639af4bd3876c17f26fa4fbf6', 'request_id': 'req-7dfa1df5-8942-448d-bde6-56a2741f2bef'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:22.655787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e6377639af4bd3876c17f26fa4fbf6', 'request_id': 'req-7dfa1df5-8942-448d-bde6-56a2741f2bef'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:22.670205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e6377639af4bd3876c17f26fa4fbf6', 'request_id': 'req-7dfa1df5-8942-448d-bde6-56a2741f2bef'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:22.683708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] The token cache is being invalidate because project 43e6377639af4bd3876c17f26fa4fbf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:22.684205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:22.684943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:22.687103 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3375/6705] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:22 2022] DELETE /identity/v3/projects/43e6377639af4bd3876c17f26fa4fbf6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:22.688175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.690128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.716404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4cf7f-e8e1-4598-a2f5-0e94d8831d57 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.785126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa1df5-8942-448d-bde6-56a2741f2bef tempest-VolumeQuotaClassesTest-1268814881 tempest-VolumeQuotaClassesTest-1268814881-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.794381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.795690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.796165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.796653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.797934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.800582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.824146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.826114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.826608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.827158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.830025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.837138 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3376/6706] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:22 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:22.838126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:22.840043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.890669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:22.917485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28caa-5c30-474f-a3f3-1227f802a184 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:22.921771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:22.922545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:22.922926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:22.923296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:22.925330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:22.951774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:22.953516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:22.980540 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3331/6707] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:22.981514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.018105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.019598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.031005 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3377/6708] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:23.032094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.043838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796923c4-2172-4a6e-acae-b3422d67ae1f service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.048981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.049712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.049979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.050256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.050953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.053098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.057337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:23.068632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78fd0e-b7eb-4032-b0bb-f45ddd8626a1 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.074828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.075825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.076260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.076690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.079191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:23.085801 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3378/6709] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:23 2022] POST /identity/v3/users => generated 292 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:23.087820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.094373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:23.120538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac23922-f95b-4624-926c-1d31b5cee0b0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.127752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.128803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.129118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.129441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] PATH_INFO: `/v3/users/3391c09d59034a97a3495c8e29bc6358` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.131480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3391c09d59034a97a3495c8e29bc6358)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.134612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.218404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.224044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.243437 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3332/6710] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:23.244390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.250643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3391c09d59034a97a3495c8e29bc6358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:23.251345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3391c09d59034a97a3495c8e29bc6358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:23.263145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d5847-cc8f-4ea7-b508-b95c4d93bb87 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.269569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.270529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.270847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.271141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.272433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.274571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.278889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3391c09d59034a97a3495c8e29bc6358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:23.280243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3391c09d59034a97a3495c8e29bc6358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:23.290251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31d63f7-0784-410b-9a87-1c637a928eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3391c09d59034a97a3495c8e29bc6358'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:23.295567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3333/6711] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:23.297359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.300597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:23.320278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb63e55-5a96-4a49-9297-617f65098d60 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.324904 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3379/6712] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:23 2022] DELETE /identity/v3/users/3391c09d59034a97a3495c8e29bc6358 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:23.329336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1cffa-be52-427e-a657-309498bda802 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.329715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1cffa-be52-427e-a657-309498bda802 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.330174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1cffa-be52-427e-a657-309498bda802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.330485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.331453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.332347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.332631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] PATH_INFO: `/v3/projects/670d9f7f91fa4661b72979e9db3ae261/users/57bf75b3f6d14d3488c4348e81f7a349/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.352941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670d9f7f91fa4661b72979e9db3ae261, user_id=57bf75b3f6d14d3488c4348e81f7a349, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.356171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.376618 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3334/6713] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:23 2022] PUT /identity/v3/projects/670d9f7f91fa4661b72979e9db3ae261/users/57bf75b3f6d14d3488c4348e81f7a349/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:23.377460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3db1cffa-be52-427e-a657-309498bda802 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:23.377642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.379620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3db1cffa-be52-427e-a657-309498bda802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:23.459412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:23.484638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2b835-dcc3-4cef-bd94-2b05911a33a9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.491467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.493095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.493406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.494042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.495579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.499382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.524797 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3380/6714] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:23.540143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1cffa-be52-427e-a657-309498bda802 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.541394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3335/6715] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:23.542293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.543934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3db1cffa-be52-427e-a657-309498bda802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:23.556024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cbc8-1ac4-47fa-a4e5-66b86bc5cd3f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.567242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbec7d3-f8b3-4c49-9f45-c621713c7a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.569304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec7d3-f8b3-4c49-9f45-c621713c7a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.569818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec7d3-f8b3-4c49-9f45-c621713c7a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.570204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbec7d3-f8b3-4c49-9f45-c621713c7a0f admin admin] PATH_INFO: `/v3/projects/670d9f7f91fa4661b72979e9db3ae261/users/57bf75b3f6d14d3488c4348e81f7a349/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.572727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbec7d3-f8b3-4c49-9f45-c621713c7a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=670d9f7f91fa4661b72979e9db3ae261, user_id=57bf75b3f6d14d3488c4348e81f7a349, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.579887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbec7d3-f8b3-4c49-9f45-c621713c7a0f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.626302 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3336/6716] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:23 2022] PUT /identity/v3/projects/670d9f7f91fa4661b72979e9db3ae261/users/57bf75b3f6d14d3488c4348e81f7a349/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:23.627950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6fc7-daad-47c8-97db-6eb9f4377dc2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.628359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6fc7-daad-47c8-97db-6eb9f4377dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.628641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e6fc7-daad-47c8-97db-6eb9f4377dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.659971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1cffa-be52-427e-a657-309498bda802 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.664010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ba5e6fc7-daad-47c8-97db-6eb9f4377dc2 None None] MFA Rules not processed for user `57bf75b3f6d14d3488c4348e81f7a349`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:23.665278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ba5e6fc7-daad-47c8-97db-6eb9f4377dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:23.718182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:23.809414 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3337/6717] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:23.812237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6fc7-daad-47c8-97db-6eb9f4377dc2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:23.836899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e6fc7-daad-47c8-97db-6eb9f4377dc2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:23.837469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.838293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.838912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.839425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.848449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57bf75b3f6d14d3488c4348e81f7a349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670d9f7f91fa4661b72979e9db3ae261', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:23.849071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:23.849374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:23.849637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:23.850663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:23.852542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:23.931491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3338/6718] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:23 2022] POST /identity/v3/projects => generated 358 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:23.936092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:24.032980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92134-cb54-4fe9-818c-6da344b1f507 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:24.039589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.041148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57bf75b3f6d14d3488c4348e81f7a349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670d9f7f91fa4661b72979e9db3ae261', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:24.041888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.042001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.042408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.042701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.043564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.046617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.056521 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3381/6719] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:24.088605 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3339/6720] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:23 2022] POST /identity/v3/users => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:24.092730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:24.107781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96bd3d-8926-4d0e-ab1d-fa1606391d40 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:24.112737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb8b7f-28be-4a30-bcf7-237a16fd2641 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57bf75b3f6d14d3488c4348e81f7a349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670d9f7f91fa4661b72979e9db3ae261', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:24.113582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb8b7f-28be-4a30-bcf7-237a16fd2641 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.113912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb8b7f-28be-4a30-bcf7-237a16fd2641 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.114290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb8b7f-28be-4a30-bcf7-237a16fd2641 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.115612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb8b7f-28be-4a30-bcf7-237a16fd2641 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:24.116141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb8b7f-28be-4a30-bcf7-237a16fd2641 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.119389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb8b7f-28be-4a30-bcf7-237a16fd2641 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.161174 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3382/6721] 10.222.0.30 () {58 vars in 1156 bytes} [Sat Jun 18 22:27:24 2022] GET /identity/v3/users?domain_id=default => generated 8015 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:24.163743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:24.177246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f20c-cb89-4db3-87bc-ca130077e17a tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:24.183194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57bf75b3f6d14d3488c4348e81f7a349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670d9f7f91fa4661b72979e9db3ae261', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:24.184359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.184693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.185102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] PATH_INFO: `/v3/users/f51ee6d6b3db4fa987ea3fb8fab6cc39` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.208582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorizing `identity:update_user(user_id=f51ee6d6b3db4fa987ea3fb8fab6cc39)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.209929 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:27:24.209929 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:27:24.209929 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:27:24.211406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.250322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f51ee6d6b3db4fa987ea3fb8fab6cc39'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.260566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invalidating the token cache because user f51ee6d6b3db4fa987ea3fb8fab6cc39 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:24.261139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.262039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.264850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3340/6722] 10.222.0.30 () {60 vars in 1243 bytes} [Sat Jun 18 22:27:24 2022] PATCH /identity/v3/users/f51ee6d6b3db4fa987ea3fb8fab6cc39 => generated 485 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:24.269595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1516f-5790-495d-8bae-25165040506e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.270484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1516f-5790-495d-8bae-25165040506e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.271135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1516f-5790-495d-8bae-25165040506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.287398 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.auth.plugins.core [None req-a4f1516f-5790-495d-8bae-25165040506e None None] User is disabled: f51ee6d6b3db4fa987ea3fb8fab6cc39: AssertionError: User is disabled: f51ee6d6b3db4fa987ea3fb8fab6cc39 Jun 18 22:27:24.306775 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.server.flask.application [None req-a4f1516f-5790-495d-8bae-25165040506e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 18 22:27:24.314434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3383/6723] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:24 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 43 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Jun 18 22:27:24.316370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:24.318361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:24.332654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c764-d869-4e33-8d75-8ccb9a05ac42 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:24.338412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57bf75b3f6d14d3488c4348e81f7a349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670d9f7f91fa4661b72979e9db3ae261', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:24.339544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.339977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.340257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] PATH_INFO: `/v3/users/f51ee6d6b3db4fa987ea3fb8fab6cc39` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.365535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f51ee6d6b3db4fa987ea3fb8fab6cc39)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.367528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.430652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:24.432785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51ee6d6b3db4fa987ea3fb8fab6cc39'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.433548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51ee6d6b3db4fa987ea3fb8fab6cc39'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.450392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51ee6d6b3db4fa987ea3fb8fab6cc39'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.451532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51ee6d6b3db4fa987ea3fb8fab6cc39'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.459317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51ee6d6b3db4fa987ea3fb8fab6cc39'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.472652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3341/6724] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:24 2022] DELETE /identity/v3/users/f51ee6d6b3db4fa987ea3fb8fab6cc39 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:24.476996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1516f-5790-495d-8bae-25165040506e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:24.478833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a4f1516f-5790-495d-8bae-25165040506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:24.515958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:24.559959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1516f-5790-495d-8bae-25165040506e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:24.565169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57bf75b3f6d14d3488c4348e81f7a349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670d9f7f91fa4661b72979e9db3ae261', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:24.566069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.566377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.566656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] PATH_INFO: `/v3/projects/94c0bc17ccb8425aaeb6aacf8ab19d75` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.567888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94c0bc17ccb8425aaeb6aacf8ab19d75)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.569879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.625530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c0bc17ccb8425aaeb6aacf8ab19d75', 'request_id': 'req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.632497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c0bc17ccb8425aaeb6aacf8ab19d75', 'request_id': 'req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.641734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c0bc17ccb8425aaeb6aacf8ab19d75', 'request_id': 'req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.655090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] The token cache is being invalidate because project 94c0bc17ccb8425aaeb6aacf8ab19d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:24.655447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.656232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.658409 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3384/6725] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:24 2022] DELETE /identity/v3/projects/94c0bc17ccb8425aaeb6aacf8ab19d75 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:24.664201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:24.675425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5cff-8d51-4ee6-a199-06e6511bd173 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:24.738454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c3455-da43-415b-a64b-9a5aae2a8840 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57bf75b3f6d14d3488c4348e81f7a349', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670d9f7f91fa4661b72979e9db3ae261', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:24.739155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3455-da43-415b-a64b-9a5aae2a8840 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.739435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3455-da43-415b-a64b-9a5aae2a8840 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.739712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c3455-da43-415b-a64b-9a5aae2a8840 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.740414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c3455-da43-415b-a64b-9a5aae2a8840 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.742368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c3455-da43-415b-a64b-9a5aae2a8840 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f38c3455-da43-415b-a64b-9a5aae2a8840 tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Could not find domain: 444ec01f99664565b4a65969bb6558f7.: keystone.exception.DomainNotFound: Could not find domain: 444ec01f99664565b4a65969bb6558f7. Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 444ec01f99664565b4a65969bb6558f7. Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:27:24.755786 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:27:24.756904 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.get_or_create( Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application with Lock( Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._enter() Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.creator() Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 18 22:27:24.757925 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application created_value = creator( Jun 18 22:27:24.759119 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 18 22:27:24.759119 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 18 22:27:24.759119 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 444ec01f99664565b4a65969bb6558f7. Jun 18 22:27:24.759119 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:27:24.759119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3342/6726] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:24 2022] POST /identity/v3/users => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:27:24.762138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:24.763661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:24.832116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56214-1b6b-4ec6-8a11-67e68cefcc7e tempest-UsersNegativeTest-1973554357 tempest-UsersNegativeTest-1973554357-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:24.837071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:24.838001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.838306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.838584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] PATH_INFO: `/v3/users/7f0cbaabf46849f39eb093597ab72f2c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.839846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0cbaabf46849f39eb093597ab72f2c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:24.841917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:24.893346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0cbaabf46849f39eb093597ab72f2c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.893951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0cbaabf46849f39eb093597ab72f2c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.905857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:24.908577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0cbaabf46849f39eb093597ab72f2c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.909664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0cbaabf46849f39eb093597ab72f2c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.922891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0cbaabf46849f39eb093597ab72f2c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:24.941272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3385/6727] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:24 2022] DELETE /identity/v3/users/7f0cbaabf46849f39eb093597ab72f2c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:24.945940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:24.946218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:24.946506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:24.965609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:24.966868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:25.058850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3343/6728] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:25.068548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:25.069937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:25.141139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273e9d2-77b9-4e8f-bf4d-f121359ee82e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:25.144952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:25.145987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:25.146275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:25.146553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:25.160407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:25.162266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:25.177750 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3386/6729] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:25.367978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:25.371384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:25.394164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c1d21-8bad-4081-bc1f-a271c6993fc6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:25.410957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:25.412196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:25.412953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:25.413392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] PATH_INFO: `/v3/projects/8c9a0f7aa15245c5b4c9953576ad4c91` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:25.415474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9a0f7aa15245c5b4c9953576ad4c91)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:25.421965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:25.500177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9a0f7aa15245c5b4c9953576ad4c91', 'request_id': 'req-9891d222-9da5-42fc-91dc-f20e13b3d5fb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.510794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9a0f7aa15245c5b4c9953576ad4c91', 'request_id': 'req-9891d222-9da5-42fc-91dc-f20e13b3d5fb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.514572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:25.527380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9a0f7aa15245c5b4c9953576ad4c91', 'request_id': 'req-9891d222-9da5-42fc-91dc-f20e13b3d5fb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.547602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] The token cache is being invalidate because project 8c9a0f7aa15245c5b4c9953576ad4c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:25.548066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.549827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.561823 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3344/6730] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:25 2022] DELETE /identity/v3/projects/8c9a0f7aa15245c5b4c9953576ad4c91 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:25.562361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:25.578813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cf54d-2475-4372-b03f-c22bbfbc9b8c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:25.713860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:25.714941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:25.715229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:25.715505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] PATH_INFO: `/v3/users/ea3d26ae2dda4213b2f20d0ed79fd0eb` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:25.716849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3d26ae2dda4213b2f20d0ed79fd0eb)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:25.719215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:25.829906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3d26ae2dda4213b2f20d0ed79fd0eb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.831228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3d26ae2dda4213b2f20d0ed79fd0eb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.852530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3d26ae2dda4213b2f20d0ed79fd0eb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.853477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3d26ae2dda4213b2f20d0ed79fd0eb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.878590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3d26ae2dda4213b2f20d0ed79fd0eb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:25.897728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:25.911942 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3387/6731] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:25 2022] DELETE /identity/v3/users/ea3d26ae2dda4213b2f20d0ed79fd0eb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:26.337237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:26.338884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:26.360699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d222-9da5-42fc-91dc-f20e13b3d5fb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:26.503954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:26.505137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:26.505423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:26.505809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] PATH_INFO: `/v3/projects/3d5918cf07664a5fac93f1c2ad98d832` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:26.507595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5918cf07664a5fac93f1c2ad98d832)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:26.509846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:26.601498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5918cf07664a5fac93f1c2ad98d832', 'request_id': 'req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.612957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5918cf07664a5fac93f1c2ad98d832', 'request_id': 'req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.633812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5918cf07664a5fac93f1c2ad98d832', 'request_id': 'req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.694757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] The token cache is being invalidate because project 3d5918cf07664a5fac93f1c2ad98d832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:26.697718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.707480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.714997 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3345/6732] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:26 2022] DELETE /identity/v3/projects/3d5918cf07664a5fac93f1c2ad98d832 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:26.718922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:26.720484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:26.739457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a60b86-9c1e-4d68-8317-eedcb2af7636 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:26.834859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:26.834991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:26.835311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:26.836021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] PATH_INFO: `/v3/users/57bf75b3f6d14d3488c4348e81f7a349` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:26.838481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bf75b3f6d14d3488c4348e81f7a349)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:26.843857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:26.951402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:26.952862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:26.960280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bf75b3f6d14d3488c4348e81f7a349'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.961390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bf75b3f6d14d3488c4348e81f7a349'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.978656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7f5f3-c126-4c78-a2d9-ac29bfd58fa4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:26.988437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:26.990578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:26.991003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:26.992375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bf75b3f6d14d3488c4348e81f7a349'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.992752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] PATH_INFO: `/v3/projects/efd937dd519b45578d41230f02d48827` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:26.993385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bf75b3f6d14d3488c4348e81f7a349'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:26.994561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd937dd519b45578d41230f02d48827)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:26.996709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:27.010172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-25123a96-de1f-43b4-8d88-b9a695082d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bf75b3f6d14d3488c4348e81f7a349'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:27.040824 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3388/6733] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:26 2022] DELETE /identity/v3/users/57bf75b3f6d14d3488c4348e81f7a349 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:27.153186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd937dd519b45578d41230f02d48827', 'request_id': 'req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:27.165929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd937dd519b45578d41230f02d48827', 'request_id': 'req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:27.204603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd937dd519b45578d41230f02d48827', 'request_id': 'req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:27.220057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:27.230676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] The token cache is being invalidate because project efd937dd519b45578d41230f02d48827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:27.231681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:27.232798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2d215b44-02a0-4801-8a13-9e7dd8c1e9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:27.235529 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3346/6734] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:26 2022] DELETE /identity/v3/projects/efd937dd519b45578d41230f02d48827 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:27.240394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74210940-a0b4-43e9-9b44-db62be361ef6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.240682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74210940-a0b4-43e9-9b44-db62be361ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.240958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74210940-a0b4-43e9-9b44-db62be361ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.278017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-74210940-a0b4-43e9-9b44-db62be361ef6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:27.280480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74210940-a0b4-43e9-9b44-db62be361ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:27.378280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278dd13-57f5-42b2-af34-32159b4c818a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.378564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278dd13-57f5-42b2-af34-32159b4c818a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.378841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278dd13-57f5-42b2-af34-32159b4c818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.381024 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3389/6735] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:27.403550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0278dd13-57f5-42b2-af34-32159b4c818a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:27.404827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0278dd13-57f5-42b2-af34-32159b4c818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:27.425743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74210940-a0b4-43e9-9b44-db62be361ef6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:27.431111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3347/6736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:27.438750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74210940-a0b4-43e9-9b44-db62be361ef6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:27.446222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:27.446995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.447344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.447694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.448502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:27.448866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:27.450856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:27.468699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278dd13-57f5-42b2-af34-32159b4c818a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:27.479333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278dd13-57f5-42b2-af34-32159b4c818a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:27.479888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3390/6737] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:27.488828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:27.489721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.490066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.490401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.491628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:27.498127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:27.552204 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3348/6738] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:27 2022] POST /identity/v3/projects => generated 401 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:27.556567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:27.572762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422ac8a-e3f1-45eb-864a-27b3cc3ca2a8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:27.579956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:27.731631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:27.732637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.733074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.733466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.734280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:27.736423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:27.764469 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3391/6739] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:27 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:27.769124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:27.782693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ea611-4d8b-4f45-8f8e-6c4b84dc8a6b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:27.787871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:27.788458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.788741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.789013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.790157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:27.791789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:27.808383 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3349/6740] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:27.809136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:27.840081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb97b4f-308d-41c0-8ed7-d2d3832c7f20 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:27.869840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a7a8-ee65-48d6-8c0a-0dd048d395b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:27.870443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a7a8-ee65-48d6-8c0a-0dd048d395b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.870727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a7a8-ee65-48d6-8c0a-0dd048d395b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.871004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a7a8-ee65-48d6-8c0a-0dd048d395b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.872281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934a7a8-ee65-48d6-8c0a-0dd048d395b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:27.874215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934a7a8-ee65-48d6-8c0a-0dd048d395b2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:27.914611 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3392/6741] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:27:27.915833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:27.935177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4cf1b-6482-4377-8021-f73456e1340b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:27.941962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:27.942776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:27.943057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:27.943414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] PATH_INFO: `/v3/projects/0a0a5e05f446472ab2f36dcb5a530771/users/06a69c369e4c4d0496d29997bef4254e/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:27.987335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0a5e05f446472ab2f36dcb5a530771, user_id=06a69c369e4c4d0496d29997bef4254e, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:27.990738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:28.034983 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3350/6742] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:27 2022] PUT /identity/v3/projects/0a0a5e05f446472ab2f36dcb5a530771/users/06a69c369e4c4d0496d29997bef4254e/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:28.045136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:28.051834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:28.052229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:28.109343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] MFA Rules not processed for user `06a69c369e4c4d0496d29997bef4254e`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:28.125270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:28.266161 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3393/6743] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:28.271454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:28.349829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:28.352064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:28.519711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e7bae-050e-410e-88c2-69cc0209f670 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:28.550116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:28.550116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:28.550429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:28.550692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:28.553311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:28.555267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:28.579129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d25e0-48a7-4b3f-b2f6-9d425f43eb84 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:28.594512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:28.601596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:28.602692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:28.603560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] PATH_INFO: `/v3/projects/670d9f7f91fa4661b72979e9db3ae261` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:28.607540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] RBAC: Authorizing `identity:delete_project(project_id=670d9f7f91fa4661b72979e9db3ae261)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:28.630579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:28.645563 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3351/6744] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:28 2022] POST /identity/v3/projects => generated 399 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:28.652600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:28.694935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:28.800166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670d9f7f91fa4661b72979e9db3ae261', 'request_id': 'req-3be0712e-5d01-4245-8bbf-f1da3966363d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:28.821492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670d9f7f91fa4661b72979e9db3ae261', 'request_id': 'req-3be0712e-5d01-4245-8bbf-f1da3966363d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:28.843655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670d9f7f91fa4661b72979e9db3ae261', 'request_id': 'req-3be0712e-5d01-4245-8bbf-f1da3966363d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:28.877616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] The token cache is being invalidate because project 670d9f7f91fa4661b72979e9db3ae261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:28.879263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:28.880629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3be0712e-5d01-4245-8bbf-f1da3966363d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:28.884149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3394/6745] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:28 2022] DELETE /identity/v3/projects/670d9f7f91fa4661b72979e9db3ae261 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:28.893599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee24f-bef0-4200-a70f-2f1598bf7175 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:28.894423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee24f-bef0-4200-a70f-2f1598bf7175 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:28.894736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f8629-5691-47bf-b7d2-d806b7a1a53b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:28.895387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ee24f-bef0-4200-a70f-2f1598bf7175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:28.977900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:28.990253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-291ee24f-bef0-4200-a70f-2f1598bf7175 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:28.992983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-291ee24f-bef0-4200-a70f-2f1598bf7175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:29.057540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.059554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.060512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.061244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.066868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.072287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.123628 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3352/6746] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:28 2022] POST /identity/v3/users => generated 306 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:29.127158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.131116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:29.156507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ba30-c737-476c-95da-6bb357352e08 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.169712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.171243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.171580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.171903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.176092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.180200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.195856 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3395/6747] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:29.197681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08354-04fa-45db-80a4-d3c88b566fcf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.197938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08354-04fa-45db-80a4-d3c88b566fcf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.198176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08354-04fa-45db-80a4-d3c88b566fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.205776 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3353/6748] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:29.209205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.226778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dff08354-04fa-45db-80a4-d3c88b566fcf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:29.228688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed5a2a-1aac-4325-a4fc-fade69d351cb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.228821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dff08354-04fa-45db-80a4-d3c88b566fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:29.241586 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3396/6749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:29.244221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.245611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.245815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff08354-04fa-45db-80a4-d3c88b566fcf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.245915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.246094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] PATH_INFO: `/v3/projects/a92ac5456ae04970938f7799acf29646/users/875e6d62d80a473c89c457b849b808dd/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.266401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff08354-04fa-45db-80a4-d3c88b566fcf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.279489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.280303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.280610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.280876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.281651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:29.281959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.285564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92ac5456ae04970938f7799acf29646, user_id=875e6d62d80a473c89c457b849b808dd, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.285793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.288794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.320041 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3354/6750] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:29 2022] PUT /identity/v3/projects/a92ac5456ae04970938f7799acf29646/users/875e6d62d80a473c89c457b849b808dd/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:29.324712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.329219 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3397/6751] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:27:29.334035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.345735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f345e-d07e-4791-98f4-4d84c0be19ab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.455913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.456217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d00cc-82e7-40e5-8981-1eb4fda1cc8f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.456521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.456831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.457143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.457808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.459774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.470277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.471039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.471330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.471607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.472350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.477282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.503374 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3355/6752] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:29.509266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.532907 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3398/6753] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:29 2022] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:29.537413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.539730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e81c7-4a43-4ecf-98c4-04fb3948621d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.556326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:29.640861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336d29a-93ef-4e41-9de7-de8bfb8dae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.642090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336d29a-93ef-4e41-9de7-de8bfb8dae35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.642815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336d29a-93ef-4e41-9de7-de8bfb8dae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.643094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336d29a-93ef-4e41-9de7-de8bfb8dae35 admin admin] PATH_INFO: `/v3/projects/a92ac5456ae04970938f7799acf29646/users/875e6d62d80a473c89c457b849b808dd/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.646579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336d29a-93ef-4e41-9de7-de8bfb8dae35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92ac5456ae04970938f7799acf29646, user_id=875e6d62d80a473c89c457b849b808dd, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.650410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336d29a-93ef-4e41-9de7-de8bfb8dae35 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.677136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3356/6754] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:29 2022] PUT /identity/v3/projects/a92ac5456ae04970938f7799acf29646/users/875e6d62d80a473c89c457b849b808dd/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:29.681190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.683116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.684846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.691733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579d091-3960-4293-ab1d-0a6551d74a26 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.731177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:29.753863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] MFA Rules not processed for user `875e6d62d80a473c89c457b849b808dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:29.755438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:29.843006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.843518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.843518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.843800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.844505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.854652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:29.908704 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3399/6755] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:29 2022] POST /identity/v3/users => generated 297 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:29.912805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.937812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c18819-dc9e-4b67-8a1a-08640593e5bd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:29.945498 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3357/6756] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:29.963474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:29.965898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:29.966145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:29.966467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:29.967522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:29.976371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:29.976371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:29.977611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:30.016163 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3400/6757] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:30.018953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:30.041425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7171e-0957-42e2-b473-30daf2cea7f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:30.058459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:30.059160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.059494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.059771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.060584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:30.064978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:30.097927 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3401/6758] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:30.100140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:30.121256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ef19-6440-432b-95c2-62783a5b898f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:30.128678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb42c85-6836-4745-8e7e-918d16134d4d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:30.133926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:30.135698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.135983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.136299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] PATH_INFO: `/v3/projects/59150bf002254bccaad1de98b7a830ed/users/9aae8892f6514732a336b5e639467323/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.140553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf0ddf-78b0-4f3d-afe2-a06665a47a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:30.141276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0ddf-78b0-4f3d-afe2-a06665a47a19 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.141561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0ddf-78b0-4f3d-afe2-a06665a47a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.141857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf0ddf-78b0-4f3d-afe2-a06665a47a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.167528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0ddf-78b0-4f3d-afe2-a06665a47a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:30.170647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf0ddf-78b0-4f3d-afe2-a06665a47a19 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:30.179870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59150bf002254bccaad1de98b7a830ed, user_id=9aae8892f6514732a336b5e639467323, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:30.184869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:30.206848 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3358/6759] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:30.219796 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3402/6760] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:30 2022] PUT /identity/v3/projects/59150bf002254bccaad1de98b7a830ed/users/9aae8892f6514732a336b5e639467323/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:30.231458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa6c8-b28a-4d00-b733-a19217a1af4f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.231853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa6c8-b28a-4d00-b733-a19217a1af4f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.232116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fa6c8-b28a-4d00-b733-a19217a1af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.316141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-aa1fa6c8-b28a-4d00-b733-a19217a1af4f None None] MFA Rules not processed for user `9aae8892f6514732a336b5e639467323`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:30.318913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aa1fa6c8-b28a-4d00-b733-a19217a1af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:30.351338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:30.472052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd3ed1-9770-4dd1-ac99-2d929b7ac391 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:30.498012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be642638-4d26-4209-8ba9-4eac803d7e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:30.498889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be642638-4d26-4209-8ba9-4eac803d7e09 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.499326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be642638-4d26-4209-8ba9-4eac803d7e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.499606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be642638-4d26-4209-8ba9-4eac803d7e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.504196 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3359/6761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:30.505225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-be642638-4d26-4209-8ba9-4eac803d7e09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:30.508891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fa6c8-b28a-4d00-b733-a19217a1af4f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:30.528423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fa6c8-b28a-4d00-b733-a19217a1af4f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:30.547994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:30.549491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.549665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.549934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.551126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:create_application_credential(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:30.552506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:30.561281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:30.608538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:30.682849 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3360/6762] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Jun 18 22:27:30 2022] POST /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 788 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:30.686852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:30.717508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be642638-4d26-4209-8ba9-4eac803d7e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:30.722526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6974d76-9469-4eb3-9d82-c77bb9b2411f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:30.723285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be642638-4d26-4209-8ba9-4eac803d7e09 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:30.736243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:30.739566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.740019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.740378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/4345f0480fda4b4c92d3bf674fb86164` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.752937 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3403/6763] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:30.765688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:get_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=4345f0480fda4b4c92d3bf674fb86164)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:30.771601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:30.774190 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3361/6764] 10.222.0.30 () {58 vars in 1391 bytes} [Sat Jun 18 22:27:30 2022] GET /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/4345f0480fda4b4c92d3bf674fb86164 => generated 688 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:30.778602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb725-1c1c-4cbf-940d-5b6f95d92f1c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:30.778977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb725-1c1c-4cbf-940d-5b6f95d92f1c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:30.779261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb725-1c1c-4cbf-940d-5b6f95d92f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:30.803260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-14deb725-1c1c-4cbf-940d-5b6f95d92f1c None None] MFA Rules not processed for user `9aae8892f6514732a336b5e639467323`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:30.804544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14deb725-1c1c-4cbf-940d-5b6f95d92f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:30.968900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:30.971393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:31.059164 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3404/6765] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:30 2022] POST /identity/v3/auth/tokens => generated 3416 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jun 18 22:27:31.063923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb725-1c1c-4cbf-940d-5b6f95d92f1c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:31.084996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb725-1c1c-4cbf-940d-5b6f95d92f1c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:31.089554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:31.091348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:31.091566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:31.091849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/4345f0480fda4b4c92d3bf674fb86164` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:31.093675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=4345f0480fda4b4c92d3bf674fb86164)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:31.095835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:31.137281 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3405/6766] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:27:31 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/4345f0480fda4b4c92d3bf674fb86164 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:31.142676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:31.149188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724bf80-2748-481e-b1a7-f908351afb92 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:31.159559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ff7b-0e05-4d41-b888-31d302d3df5b tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:31.170526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:31.171595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:31.172102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:31.172597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:31.178576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:31.186162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:31.190499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:31.190794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:31.191914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:31.194996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:create_application_credential(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:31.199483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:31.308687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:31.313108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:31.330041 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3362/6767] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:31.358582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:31.441893 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3406/6768] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Jun 18 22:27:31 2022] POST /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 920 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:31.442666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:31.457373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faba24-257e-4b7d-859a-066f8e184101 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:31.463076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:31.464201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:31.464681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:31.465075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/3f91eef3141e43df992fabcda77a75a0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:31.480236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=3f91eef3141e43df992fabcda77a75a0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:31.482872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:31.525421 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3363/6769] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:27:31 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/3f91eef3141e43df992fabcda77a75a0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:31.531365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:31.546026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47340d-e404-4cff-a5bb-421cab345666 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:31.553922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:31.555196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:31.555697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:31.556219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:31.559236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:create_application_credential(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:31.562807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:31.700241 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3407/6770] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Jun 18 22:27:31 2022] POST /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 813 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:31.704471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:31.721202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbce3b-7832-4e6b-826b-6907e04366b4 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:31.733582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:31.734564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:31.734852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:31.735136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/4494115c32e44f899ada02f0d054729a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:31.753814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=4494115c32e44f899ada02f0d054729a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:31.757394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:31.768727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:31.807099 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3364/6771] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:27:31 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/4494115c32e44f899ada02f0d054729a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:31.812139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:31.824093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83cace-7e97-4640-bbb1-b75d04958771 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:31.830005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:31.831572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:31.832067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:31.832425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:31.833502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:create_application_credential(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:31.834816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:31.991635 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3408/6772] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Jun 18 22:27:31 2022] POST /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 789 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:31.992816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:32.005390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c078-7446-4a4e-910a-a9285c5fa98e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:32.015370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:32.019108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:32.019636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:32.020102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:32.021190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:create_application_credential(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:32.022689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:32.165450 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3365/6773] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Jun 18 22:27:31 2022] POST /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 788 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:32.169223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:32.185830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f65dcb-d4a6-4a03-948d-2e2a2fea4e9f tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:32.199667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:32.202098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:32.204737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:32.205321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:32.207965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:32.209885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:32.230839 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3409/6774] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:27:32 2022] GET /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 1501 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:32.232437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:32.244990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c6e7-e3d9-41ae-bf14-008c1b315df7 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:32.256567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:32.258471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:32.259318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:32.260160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/b6a54356cdd54183bdbfcc42b50b39cd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:32.290354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=b6a54356cdd54183bdbfcc42b50b39cd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:32.292702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:32.350646 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3366/6775] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:27:32 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/b6a54356cdd54183bdbfcc42b50b39cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:32.352055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:32.369577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461a918-52dc-45c3-be8a-8942ced4c986 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:32.388855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:32.390068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:32.390581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:32.390986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/824b4d11c5c544d1bca415473f68f2d1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:32.415422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=824b4d11c5c544d1bca415473f68f2d1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:32.431240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:32.488030 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3410/6776] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:27:32 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/824b4d11c5c544d1bca415473f68f2d1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:32.493245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:32.516558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623856f-ed08-4fd0-a61a-aa26fa0a9493 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:32.535798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:32.539679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:32.540302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:32.540622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:32.541514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:create_application_credential(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:32.547748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:32.738567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3367/6777] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Jun 18 22:27:32 2022] POST /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 789 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:32.740244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:32.755182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f880621-e708-4a5c-80c8-07f1bd50b123 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:32.766025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:32.766998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:32.767295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:32.767572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:32.771836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:create_application_credential(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:32.774148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:32.809840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:32.969795 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3411/6778] 10.222.0.30 () {60 vars in 1313 bytes} [Sat Jun 18 22:27:32 2022] POST /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials => generated 788 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:32.970696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:32.984195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88713-86a2-46bb-b3c7-12cf1622d018 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:32.998590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:32.999513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:32.999803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:33.000084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:33.000821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Adding query filter params (name=tempest-application_credential-506227539) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:33.001164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:list_application_credentials(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:33.002995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:33.030852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3368/6779] 10.222.0.30 () {58 vars in 1383 bytes} [Sat Jun 18 22:27:32 2022] GET /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials?name=tempest-application_credential-506227539 => generated 885 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:33.035019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:33.048765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b177a-7b1f-465e-9a28-d59e8cf01efc tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:33.063662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:33.064205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:33.064861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:33.066634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/283cbc08ff7c44f6be29f44a1c127738` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:33.102488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=283cbc08ff7c44f6be29f44a1c127738)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:33.104477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:33.157922 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3412/6780] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:27:33 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/283cbc08ff7c44f6be29f44a1c127738 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:33.161801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:33.173424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf64b4f-f373-49ca-b39a-d429cc2df656 tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:33.192096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b97e38-5b8b-40c9-96a9-2b7769a483ce tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aae8892f6514732a336b5e639467323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59150bf002254bccaad1de98b7a830ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:33.204127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b97e38-5b8b-40c9-96a9-2b7769a483ce tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:33.204127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b97e38-5b8b-40c9-96a9-2b7769a483ce tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:33.204127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b97e38-5b8b-40c9-96a9-2b7769a483ce tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/9c29614f27634c81b7c1cae252cf00d3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:33.225774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b97e38-5b8b-40c9-96a9-2b7769a483ce tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorizing `identity:delete_application_credential(user_id=9aae8892f6514732a336b5e639467323, application_credential_id=9c29614f27634c81b7c1cae252cf00d3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:33.232463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b97e38-5b8b-40c9-96a9-2b7769a483ce tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:33.280974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3369/6781] 10.222.0.30 () {58 vars in 1394 bytes} [Sat Jun 18 22:27:33 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323/application_credentials/9c29614f27634c81b7c1cae252cf00d3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:33.286124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:33.427524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a638c-0232-4786-8f6f-743291b6538e tempest-ApplicationCredentialsV3Test-2039268008 tempest-ApplicationCredentialsV3Test-2039268008-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:33.434873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:33.436100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:33.436621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:33.437269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] PATH_INFO: `/v3/users/9aae8892f6514732a336b5e639467323` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:33.440385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aae8892f6514732a336b5e639467323)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:33.442632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:33.539313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aae8892f6514732a336b5e639467323'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:33.540287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aae8892f6514732a336b5e639467323'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:33.577311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aae8892f6514732a336b5e639467323'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:33.578238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aae8892f6514732a336b5e639467323'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:33.589917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aae8892f6514732a336b5e639467323'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:33.605829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:33.620188 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3413/6782] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:33 2022] DELETE /identity/v3/users/9aae8892f6514732a336b5e639467323 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:33.626180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:33.626831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:33.627314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:33.663275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:33.664782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:33.682630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:33.832604 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3370/6783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:33.964505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:33.966400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:34.236242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71459d6e-d002-42ac-aec4-f9c1c9c98cbd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:34.250958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:34.258637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:34.259267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:34.259687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:34.290236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:34.296174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:34.319300 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3414/6784] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:36.125658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:36.127747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:36.155075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd5ec1-9117-432f-9f60-ae826cc7f3b1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:36.166967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:36.168965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:36.170280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:36.170568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] PATH_INFO: `/v3/users/06a69c369e4c4d0496d29997bef4254e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:36.173882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a69c369e4c4d0496d29997bef4254e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:36.179280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:36.317474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a69c369e4c4d0496d29997bef4254e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.318179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a69c369e4c4d0496d29997bef4254e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.348637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:36.350245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:36.369749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a69c369e4c4d0496d29997bef4254e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.371569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a69c369e4c4d0496d29997bef4254e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.376075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270292d-c1f7-439e-985c-83fc66aaeee6 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:36.386972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-342eeb6b-46a2-46e7-a00e-941ebf7fe4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a69c369e4c4d0496d29997bef4254e'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.392996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:36.397985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:36.398279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:36.398554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] PATH_INFO: `/v3/projects/59150bf002254bccaad1de98b7a830ed` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:36.403780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59150bf002254bccaad1de98b7a830ed)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:36.408904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:36.428312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3371/6785] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:36 2022] DELETE /identity/v3/users/06a69c369e4c4d0496d29997bef4254e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:36.433212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:36.434243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:36.435477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:36.475722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:36.477297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:36.556821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59150bf002254bccaad1de98b7a830ed', 'request_id': 'req-f57010fb-0138-4f2e-989f-2aacac8bc93b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.589780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59150bf002254bccaad1de98b7a830ed', 'request_id': 'req-f57010fb-0138-4f2e-989f-2aacac8bc93b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.617801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59150bf002254bccaad1de98b7a830ed', 'request_id': 'req-f57010fb-0138-4f2e-989f-2aacac8bc93b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.670238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] The token cache is being invalidate because project 59150bf002254bccaad1de98b7a830ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:36.670529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.672572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f57010fb-0138-4f2e-989f-2aacac8bc93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:36.679017 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3415/6786] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:36 2022] DELETE /identity/v3/projects/59150bf002254bccaad1de98b7a830ed => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:36.680784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:36.681025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:36.681332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:36.705991 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3372/6787] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:36.744775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:36.746048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:36.760347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:36.761981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:36.837500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:36.927907 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3416/6788] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:36.929073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:36.932304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189efe9-9fdf-4357-a939-d3ef74038895 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:36.941567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:36.978599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de356c-d911-4bc4-b4a6-b45d54f2bf30 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:36.985957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:36.987013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:36.987390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:36.987761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] PATH_INFO: `/v3/users/d430be481f0d46f8922d7da8039f23e0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:36.989147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d430be481f0d46f8922d7da8039f23e0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:36.992763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.038633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:37.059719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3de0-7f83-49cd-8867-b3adf008fd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.069559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3de0-7f83-49cd-8867-b3adf008fd7c service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.070877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3de0-7f83-49cd-8867-b3adf008fd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.071329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3de0-7f83-49cd-8867-b3adf008fd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.086563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3de0-7f83-49cd-8867-b3adf008fd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:37.089019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3de0-7f83-49cd-8867-b3adf008fd7c service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.110018 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3373/6789] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:37.112305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845dfb-c2a5-4028-a27f-b44e3fdbe319 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.112721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845dfb-c2a5-4028-a27f-b44e3fdbe319 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.113176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845dfb-c2a5-4028-a27f-b44e3fdbe319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.125674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd430be481f0d46f8922d7da8039f23e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:37.126700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd430be481f0d46f8922d7da8039f23e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:37.147948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd430be481f0d46f8922d7da8039f23e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:37.148881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd430be481f0d46f8922d7da8039f23e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:37.167106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5aaa9c6e-3202-427c-910b-3d75ab5cb6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd430be481f0d46f8922d7da8039f23e0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:37.178279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2a845dfb-c2a5-4028-a27f-b44e3fdbe319 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:37.179544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2a845dfb-c2a5-4028-a27f-b44e3fdbe319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:37.193861 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3417/6790] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:36 2022] DELETE /identity/v3/users/d430be481f0d46f8922d7da8039f23e0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:37.200799 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3374/6791] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:37.204890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845dfb-c2a5-4028-a27f-b44e3fdbe319 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.206754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f50a-4382-4889-bab7-4e351e9a5ee5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.214712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f50a-4382-4889-bab7-4e351e9a5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.214712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533f50a-4382-4889-bab7-4e351e9a5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.221801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845dfb-c2a5-4028-a27f-b44e3fdbe319 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:37.238827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4533f50a-4382-4889-bab7-4e351e9a5ee5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:37.240188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4533f50a-4382-4889-bab7-4e351e9a5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:37.304247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0d660-6e02-4ad1-ad67-dbe1d04c7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.305519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d660-6e02-4ad1-ad67-dbe1d04c7de3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.305519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d660-6e02-4ad1-ad67-dbe1d04c7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.305701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d660-6e02-4ad1-ad67-dbe1d04c7de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.306643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0d660-6e02-4ad1-ad67-dbe1d04c7de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:37.306643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0d660-6e02-4ad1-ad67-dbe1d04c7de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:37.308257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0d660-6e02-4ad1-ad67-dbe1d04c7de3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.337268 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3375/6792] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:37.337268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011baf1-7d1f-463e-a012-ca03deb63723 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.337268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011baf1-7d1f-463e-a012-ca03deb63723 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.337268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011baf1-7d1f-463e-a012-ca03deb63723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.347504 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3418/6793] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:37.348477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f50a-4382-4889-bab7-4e351e9a5ee5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.372029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6011baf1-7d1f-463e-a012-ca03deb63723 None None] MFA Rules not processed for user `1e582eb88d6740c1bf28911a53bd08c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:37.375016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533f50a-4382-4889-bab7-4e351e9a5ee5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:37.376427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6011baf1-7d1f-463e-a012-ca03deb63723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:37.392328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.394066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.394507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.395114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.396265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:37.398905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.446807 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3419/6794] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:37 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:37.448183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.456637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:37.501353 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3376/6795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:37.502019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011baf1-7d1f-463e-a012-ca03deb63723 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.507537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:37.518427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011baf1-7d1f-463e-a012-ca03deb63723 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:37.577797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c9696-4537-45c7-816a-7d6af52df136 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:37.584013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e77fa9-18db-4ce9-8229-e9f9cb268b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.584906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77fa9-18db-4ce9-8229-e9f9cb268b65 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.585461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77fa9-18db-4ce9-8229-e9f9cb268b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.585864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77fa9-18db-4ce9-8229-e9f9cb268b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.632795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:37.679880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.681814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.682255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.682742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.683649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:37.685487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77fa9-18db-4ce9-8229-e9f9cb268b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:37.686588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.687313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77fa9-18db-4ce9-8229-e9f9cb268b65 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.703482 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3420/6796] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:37.705789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.705978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.706661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.728366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] MFA Rules not processed for user `1e582eb88d6740c1bf28911a53bd08c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:37.730042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:37.742941 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3377/6797] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:37 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:37.747735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.776267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41ed9-db33-4002-81f4-38b4c144198a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:37.784996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.786006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.786442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.786922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.788879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:37.790783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.821682 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3378/6798] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:37.826317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.829390 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3421/6799] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:37.837077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.840433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0d949-2052-47a1-9305-51d090902f4b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:37.841389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:37.847039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.848912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.849348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.849729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.850582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:37.852516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:37.869947 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3379/6800] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:27:37.874428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:37.909799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a604bca-3e01-4033-b35d-a9009e9b9836 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:37.925334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:37.928155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:37.928889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:37.930434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] PATH_INFO: `/v3/projects/ad4b952e60c846b3bb0e8f7b79f357a5/users/75c46ed16fd14be5b99edec5b6b12992/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:37.997288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4b952e60c846b3bb0e8f7b79f357a5, user_id=75c46ed16fd14be5b99edec5b6b12992, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:38.000166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:38.005971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945ded-b06e-470c-bb95-61c147ab8b83 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:38.014093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe9eeb-5f05-409c-bfe0-16a35efc892b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:38.015056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9eeb-5f05-409c-bfe0-16a35efc892b service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:38.015480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9eeb-5f05-409c-bfe0-16a35efc892b service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:38.015877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9eeb-5f05-409c-bfe0-16a35efc892b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:38.037706 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3380/6801] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:37 2022] PUT /identity/v3/projects/ad4b952e60c846b3bb0e8f7b79f357a5/users/75c46ed16fd14be5b99edec5b6b12992/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:38.037706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:38.041446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:38.043673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe9eeb-5f05-409c-bfe0-16a35efc892b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:38.046151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe9eeb-5f05-409c-bfe0-16a35efc892b service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:38.073301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3422/6802] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:38.075368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:38.076310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:38.076736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:38.121068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] MFA Rules not processed for user `75c46ed16fd14be5b99edec5b6b12992`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:38.122512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:38.179850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:38.228002 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3423/6803] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:38.234688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:38.244247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:38.300134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2b2e-4d38-46c6-965a-601a82acb179 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:38.308879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:38.310697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:38.310992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:38.311271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] PATH_INFO: `/v3/projects/0a0a5e05f446472ab2f36dcb5a530771` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:38.312706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0a5e05f446472ab2f36dcb5a530771)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:38.315209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:38.427764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8109c04-0167-42df-aa1d-c527f519ae6b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:38.445933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:38.447289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:38.447749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:38.448219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] PATH_INFO: `/v3/projects/2887ead3272c4b048d7e15584373eafe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:38.449993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2887ead3272c4b048d7e15584373eafe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:38.452190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:38.466254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:38.468736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0a5e05f446472ab2f36dcb5a530771', 'request_id': 'req-fc2dfef3-0ffd-455c-818c-6dac4aae8972'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.485391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0a5e05f446472ab2f36dcb5a530771', 'request_id': 'req-fc2dfef3-0ffd-455c-818c-6dac4aae8972'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.519078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0a5e05f446472ab2f36dcb5a530771', 'request_id': 'req-fc2dfef3-0ffd-455c-818c-6dac4aae8972'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.538802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] The token cache is being invalidate because project 0a0a5e05f446472ab2f36dcb5a530771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:38.539128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.540690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.546484 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3381/6804] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:38 2022] DELETE /identity/v3/projects/0a0a5e05f446472ab2f36dcb5a530771 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:38.547364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:38.556087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:38.574051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2887ead3272c4b048d7e15584373eafe', 'request_id': 'req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.603401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2887ead3272c4b048d7e15584373eafe', 'request_id': 'req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.622567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2887ead3272c4b048d7e15584373eafe', 'request_id': 'req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.650045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] The token cache is being invalidate because project 2887ead3272c4b048d7e15584373eafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:38.650622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.652607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:38.654884 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3424/6805] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:38 2022] DELETE /identity/v3/projects/2887ead3272c4b048d7e15584373eafe => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:38.656183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:38.660243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:38.734317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfef3-0ffd-455c-818c-6dac4aae8972 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:38.816685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee1d1f-6223-420c-88f9-e8e4d4acac4e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:38.838401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:38.839577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:38.842410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:38.846286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] PATH_INFO: `/v3/users/875e6d62d80a473c89c457b849b808dd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:38.857217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=875e6d62d80a473c89c457b849b808dd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:38.859233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:38.883357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c46ed16fd14be5b99edec5b6b12992', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad4b952e60c846b3bb0e8f7b79f357a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:38.883978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:38.884268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:38.884551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:38.885324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:38.886454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:38.889740 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3382/6806] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:27:38 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:38.890642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:38.893285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:38.924053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d18021-2007-4925-84f0-9527a8353d9f tempest-IdentityCatalogTest-1025059755 tempest-IdentityCatalogTest-1025059755-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:38.931873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:38.932883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:38.933383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:38.933662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] PATH_INFO: `/v3/users/e00aabf903774fa58924b5963e2f7439` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:38.935329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00aabf903774fa58924b5963e2f7439)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:38.938599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:38.940240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:39.012352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '875e6d62d80a473c89c457b849b808dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.014863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '875e6d62d80a473c89c457b849b808dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.029482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00aabf903774fa58924b5963e2f7439'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.030560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00aabf903774fa58924b5963e2f7439'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.057521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00aabf903774fa58924b5963e2f7439'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.058291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00aabf903774fa58924b5963e2f7439'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.061264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '875e6d62d80a473c89c457b849b808dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.062099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '875e6d62d80a473c89c457b849b808dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.068742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00aabf903774fa58924b5963e2f7439'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.072042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '875e6d62d80a473c89c457b849b808dd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.092165 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3425/6807] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:38 2022] DELETE /identity/v3/users/875e6d62d80a473c89c457b849b808dd => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:39.093528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:39.096194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:39.166750 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3383/6808] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:38 2022] DELETE /identity/v3/users/e00aabf903774fa58924b5963e2f7439 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:39.173236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:39.179752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:39.229119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:39.331916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f7664-7010-43ab-a0d0-bfdf087723e8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:39.405307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe200d1-17a4-4844-b664-ea1edd132f4b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:39.417520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566341b-4bcf-4e7e-a28d-ff4460424a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:39.418461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566341b-4bcf-4e7e-a28d-ff4460424a44 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:39.419714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566341b-4bcf-4e7e-a28d-ff4460424a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:39.422181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566341b-4bcf-4e7e-a28d-ff4460424a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:39.425579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c566341b-4bcf-4e7e-a28d-ff4460424a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:39.461680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566341b-4bcf-4e7e-a28d-ff4460424a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:39.463167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566341b-4bcf-4e7e-a28d-ff4460424a44 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:39.486907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:39.488465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:39.488928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:39.491254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] PATH_INFO: `/v3/users/75c46ed16fd14be5b99edec5b6b12992` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:39.496879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c46ed16fd14be5b99edec5b6b12992)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:39.499196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:39.505726 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3384/6809] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:39.599322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:39.622551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c46ed16fd14be5b99edec5b6b12992'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.631874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c46ed16fd14be5b99edec5b6b12992'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.683689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c46ed16fd14be5b99edec5b6b12992'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.684829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c46ed16fd14be5b99edec5b6b12992'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.718502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c46ed16fd14be5b99edec5b6b12992'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:39.758062 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3426/6810] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:39 2022] DELETE /identity/v3/users/75c46ed16fd14be5b99edec5b6b12992 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:39.763385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:39.763880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:39.764270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:39.785784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:39.787167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:39.883221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3385/6811] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:39.911730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:39.914304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:40.095534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb45c-2636-46b4-800c-3c2ed4b0cc30 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:40.110203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb94ce1-6758-4356-aef2-5b0b6bc9c2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:40.110445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:40.110565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb94ce1-6758-4356-aef2-5b0b6bc9c2ee service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:40.110565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb94ce1-6758-4356-aef2-5b0b6bc9c2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:40.110761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb94ce1-6758-4356-aef2-5b0b6bc9c2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:40.111196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:40.132899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb94ce1-6758-4356-aef2-5b0b6bc9c2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:40.133618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd72f9-d4e6-4855-8374-3ac156108b74 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:40.136835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb94ce1-6758-4356-aef2-5b0b6bc9c2ee service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:40.154241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:40.156829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:40.159538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:40.159835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] PATH_INFO: `/v3/projects/a92ac5456ae04970938f7799acf29646` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:40.166003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92ac5456ae04970938f7799acf29646)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:40.175357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:40.179465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3427/6812] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:40.343238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92ac5456ae04970938f7799acf29646', 'request_id': 'req-8db3c713-24fe-44dc-9999-b8d7bda6383f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.361379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92ac5456ae04970938f7799acf29646', 'request_id': 'req-8db3c713-24fe-44dc-9999-b8d7bda6383f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.385750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92ac5456ae04970938f7799acf29646', 'request_id': 'req-8db3c713-24fe-44dc-9999-b8d7bda6383f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.403830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] The token cache is being invalidate because project a92ac5456ae04970938f7799acf29646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:40.404368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.405602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8db3c713-24fe-44dc-9999-b8d7bda6383f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.412570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3386/6813] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:40 2022] DELETE /identity/v3/projects/a92ac5456ae04970938f7799acf29646 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:40.414608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a48e3-9d91-472b-88c7-9fae6c3fdcf4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:40.415198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a48e3-9d91-472b-88c7-9fae6c3fdcf4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:40.415708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a48e3-9d91-472b-88c7-9fae6c3fdcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:40.460405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-159a48e3-9d91-472b-88c7-9fae6c3fdcf4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:40.461970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-159a48e3-9d91-472b-88c7-9fae6c3fdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:40.560364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3428/6814] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:40.570306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:40.570677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:40.570868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:40.600379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:40.601933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:40.612249 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3387/6815] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:40.617131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a48e3-9d91-472b-88c7-9fae6c3fdcf4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:40.628984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:40.633987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a48e3-9d91-472b-88c7-9fae6c3fdcf4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:40.635536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:40.655446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:40.657452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:40.659041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:40.659415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:40.660670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:40.661680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:40.678686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:40.688561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3963-16b1-45ae-b14b-acce8651e9d6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:40.702405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:40.703332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:40.703593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:40.703863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] PATH_INFO: `/v3/projects/2124d305c6d24b29a15222bbf9f8fe43` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:40.715994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2124d305c6d24b29a15222bbf9f8fe43)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:40.720940 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3429/6816] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:40.721079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:40.724059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:40.748631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b481-995e-44c9-9da5-5b76dccecb39 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:40.762483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:40.763771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:40.763771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:40.764335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:40.764719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:40.769200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:40.782125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:40.828450 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3430/6817] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:40 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:40.833445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:40.837934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:40.845505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2124d305c6d24b29a15222bbf9f8fe43', 'request_id': 'req-765e5595-82ae-4248-8f28-161aea7d1129'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.855914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2124d305c6d24b29a15222bbf9f8fe43', 'request_id': 'req-765e5595-82ae-4248-8f28-161aea7d1129'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.893795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2124d305c6d24b29a15222bbf9f8fe43', 'request_id': 'req-765e5595-82ae-4248-8f28-161aea7d1129'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.924815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] The token cache is being invalidate because project 2124d305c6d24b29a15222bbf9f8fe43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:40.925132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.926101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:40.930797 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3388/6818] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:40 2022] DELETE /identity/v3/projects/2124d305c6d24b29a15222bbf9f8fe43 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:40.932843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:40.942507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:40.946550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:41.054714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e5595-82ae-4248-8f28-161aea7d1129 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.060478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386009a6-be1e-4ce4-99ef-38cd31cabc81 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.061022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9fe14-e638-4b9b-8e0e-1d0c34cb4f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.061922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9fe14-e638-4b9b-8e0e-1d0c34cb4f26 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.062346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9fe14-e638-4b9b-8e0e-1d0c34cb4f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.062626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9fe14-e638-4b9b-8e0e-1d0c34cb4f26 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.063611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9fe14-e638-4b9b-8e0e-1d0c34cb4f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.066660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9fe14-e638-4b9b-8e0e-1d0c34cb4f26 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.067163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.068255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.068608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.068971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] PATH_INFO: `/v3/projects/ad4b952e60c846b3bb0e8f7b79f357a5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.070471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4b952e60c846b3bb0e8f7b79f357a5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.074324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.107745 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3389/6819] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:40 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:41.109184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb3c8b-5f6f-4b12-aaad-e7ebace6fc48 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.109472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb3c8b-5f6f-4b12-aaad-e7ebace6fc48 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.109747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb3c8b-5f6f-4b12-aaad-e7ebace6fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.146368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-83eb3c8b-5f6f-4b12-aaad-e7ebace6fc48 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:41.147759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-83eb3c8b-5f6f-4b12-aaad-e7ebace6fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:41.173636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4b952e60c846b3bb0e8f7b79f357a5', 'request_id': 'req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:41.191559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4b952e60c846b3bb0e8f7b79f357a5', 'request_id': 'req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:41.218475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4b952e60c846b3bb0e8f7b79f357a5', 'request_id': 'req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:41.234011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] The token cache is being invalidate because project ad4b952e60c846b3bb0e8f7b79f357a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:41.234904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:41.236037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:41.239308 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3431/6820] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:40 2022] DELETE /identity/v3/projects/ad4b952e60c846b3bb0e8f7b79f357a5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:41.240628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.249551 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3390/6821] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:41.249551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7caa-6d50-4b40-90ee-88f9137e6457 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.249551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7caa-6d50-4b40-90ee-88f9137e6457 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.249551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a7caa-6d50-4b40-90ee-88f9137e6457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.253565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:41.273233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985abc2f-c5d9-4eb3-a985-97846c7e5bbf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.280753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917069fd-1b1d-41ae-8f08-4b309c10b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.282373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917069fd-1b1d-41ae-8f08-4b309c10b969 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.283643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917069fd-1b1d-41ae-8f08-4b309c10b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.284096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917069fd-1b1d-41ae-8f08-4b309c10b969 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.285549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917069fd-1b1d-41ae-8f08-4b309c10b969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.288326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917069fd-1b1d-41ae-8f08-4b309c10b969 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.297713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-372a7caa-6d50-4b40-90ee-88f9137e6457 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:41.305898 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3432/6822] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:41.308157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d51bc-4f95-466d-8337-276000bd228a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.308692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d51bc-4f95-466d-8337-276000bd228a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.309280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d51bc-4f95-466d-8337-276000bd228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.310012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-372a7caa-6d50-4b40-90ee-88f9137e6457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:41.335231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bd7d51bc-4f95-466d-8337-276000bd228a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:41.336589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bd7d51bc-4f95-466d-8337-276000bd228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:41.337073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3391/6823] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:41.337818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a7caa-6d50-4b40-90ee-88f9137e6457 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.348648 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3433/6824] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:41.348648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f406ef-5e00-409c-a47c-b20185226188 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.348648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f406ef-5e00-409c-a47c-b20185226188 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.348648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f406ef-5e00-409c-a47c-b20185226188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.361434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a7caa-6d50-4b40-90ee-88f9137e6457 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.375678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.376510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.377132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.377516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.378283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.381620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.394507 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3392/6825] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:41.395232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.406173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9707-5462-4486-9131-435a505ef237 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.411745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.412648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.413139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.413570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.414654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:41.415108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.416911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.421048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c9f406ef-5e00-409c-a47c-b20185226188 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:41.426278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c9f406ef-5e00-409c-a47c-b20185226188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:41.434704 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3393/6826] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:41.436623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.449487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44aee27-2ffa-4f71-9893-49b0d8dd3163 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.451927 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3434/6827] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:41.453140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f406ef-5e00-409c-a47c-b20185226188 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.456245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.457910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.458401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.458920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] PATH_INFO: `/v3/projects/ea6c943410914eda8c1e667ce13923d2/users/583c280b393c4ac6814623966146eb55/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.464368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:41.469699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f406ef-5e00-409c-a47c-b20185226188 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.483765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99f7f7-2d8c-42f8-8adb-6ab2f6b6a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.487571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99f7f7-2d8c-42f8-8adb-6ab2f6b6a56c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.488555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99f7f7-2d8c-42f8-8adb-6ab2f6b6a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.488648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6c943410914eda8c1e667ce13923d2, user_id=583c280b393c4ac6814623966146eb55, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.489487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99f7f7-2d8c-42f8-8adb-6ab2f6b6a56c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.490951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99f7f7-2d8c-42f8-8adb-6ab2f6b6a56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.495443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.497807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99f7f7-2d8c-42f8-8adb-6ab2f6b6a56c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.551816 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3394/6828] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:41 2022] PUT /identity/v3/projects/ea6c943410914eda8c1e667ce13923d2/users/583c280b393c4ac6814623966146eb55/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:41.552656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.616644 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3435/6829] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:41.621257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecaed-7903-4793-9110-37e0b63e75a2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.621601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecaed-7903-4793-9110-37e0b63e75a2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.622234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aecaed-7903-4793-9110-37e0b63e75a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.682733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a32903-eecd-47a0-b3c3-8260a6b656bc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.684403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-48aecaed-7903-4793-9110-37e0b63e75a2 None None] MFA Rules not processed for user `583c280b393c4ac6814623966146eb55`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:41.685726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-48aecaed-7903-4793-9110-37e0b63e75a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:41.792382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.793130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.793423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.794091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.794894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:41.797069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.798740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.835084 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3436/6830] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:41.836342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aecaed-7903-4793-9110-37e0b63e75a2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.846798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:41.871776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aecaed-7903-4793-9110-37e0b63e75a2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.875402 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3395/6831] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:41.876305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.890670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.891391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.891673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.891952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.900171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.911172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bae2d-372c-4181-b6d7-8d6f9eee9e3f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.913096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.926954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.926954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.926954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.926954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.928052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.936896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:41.963036 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3437/6832] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:41.964008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:41.981620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c450d-3016-47f8-a28f-a74327c13af3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:41.987163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:41.987900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:41.988192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:41.988470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:41.989436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:41.994046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.032448 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3438/6833] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:42.033728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.057499 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3396/6834] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:41 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:42.058491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.218792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81814c3-a807-4d63-8a4e-226107f4a38c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.268275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710afe74-08e3-4237-996a-1852bccebceb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.282182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.283126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.284148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.284148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.285125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.289489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.311538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:42.345406 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3397/6835] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:42 2022] POST /identity/v3/users => generated 305 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:42.347025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.364594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965c14d-7e03-405e-b88c-c3820ad7cf18 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.375907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.376893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.377228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.377663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.378423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.380715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.404342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.404658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.404976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.406295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.407584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.409361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.431547 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3439/6836] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:42.435128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3398/6837] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:42 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:42.436540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.437539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.462823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c912-b247-46af-84aa-f79bc55cc26c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.467157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920b976-a0ab-4a2d-94bf-0b16af96f716 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.471739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.472872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.473348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.474381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.475663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.477806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.478242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.478548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.478834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.479104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.491857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.497439 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3399/6838] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:42.497585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.497659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.518388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963ae3-a5e1-401f-bdff-b5019e4fe546 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.520859 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3440/6839] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:42.522663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.531399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.532887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.533205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.533488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.534283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.540986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.549918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14b9f7-9dbd-472f-bca6-9f5772291b81 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.559272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.560485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.560777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.561236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] PATH_INFO: `/v3/projects/83ec0be3125e417eaf69306e6098c373/users/21f71cf06f4f4ee3bd6fb41a7916edb2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.563236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3400/6840] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:42.563965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.578974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b711816-a44d-48a9-b91d-7f7539128324 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.588552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ec0be3125e417eaf69306e6098c373, user_id=21f71cf06f4f4ee3bd6fb41a7916edb2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.592279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.595438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084ff19-f84e-4390-b3e8-899fde0d0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.596801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ff19-f84e-4390-b3e8-899fde0d0ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.597023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ff19-f84e-4390-b3e8-899fde0d0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.597229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ff19-f84e-4390-b3e8-899fde0d0ee1 admin admin] PATH_INFO: `/v3/projects/7a23f76007aa4775a9011b214e6408a7/users/f369222313e449a8a29141bf36035633/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.618017 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3441/6841] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:42 2022] PUT /identity/v3/projects/83ec0be3125e417eaf69306e6098c373/users/21f71cf06f4f4ee3bd6fb41a7916edb2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:42.618618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.629947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084ff19-f84e-4390-b3e8-899fde0d0ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a23f76007aa4775a9011b214e6408a7, user_id=f369222313e449a8a29141bf36035633, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.634579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084ff19-f84e-4390-b3e8-899fde0d0ee1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.677489 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3401/6842] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:42 2022] PUT /identity/v3/projects/7a23f76007aa4775a9011b214e6408a7/users/f369222313e449a8a29141bf36035633/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:42.679488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1cb7-afa2-4431-8ac0-6ef8dbf4085d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.679785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1cb7-afa2-4431-8ac0-6ef8dbf4085d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.680105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb1cb7-afa2-4431-8ac0-6ef8dbf4085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.697255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:42.743139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e7cb1cb7-afa2-4431-8ac0-6ef8dbf4085d None None] MFA Rules not processed for user `21f71cf06f4f4ee3bd6fb41a7916edb2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:42.746190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e7cb1cb7-afa2-4431-8ac0-6ef8dbf4085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:42.749624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9ad19-6913-48af-8b4b-b89ad9eb810d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.852175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.853784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.854129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.854473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] PATH_INFO: `/v3/projects/1973f6b91ac541c89aa7a53d3b7ace60/users/0da28cf647e94f1980cb44f1c81bb7cf/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.863123 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3402/6843] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:42.864130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb1cb7-afa2-4431-8ac0-6ef8dbf4085d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.875551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1973f6b91ac541c89aa7a53d3b7ace60, user_id=0da28cf647e94f1980cb44f1c81bb7cf, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.876418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb1cb7-afa2-4431-8ac0-6ef8dbf4085d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.878987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.881361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.882050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.882334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.882608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.883346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.885828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.900426 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3403/6844] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:42.900605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3442/6845] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:42 2022] PUT /identity/v3/projects/1973f6b91ac541c89aa7a53d3b7ace60/users/0da28cf647e94f1980cb44f1c81bb7cf/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:42.900709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.901201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:42.911541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90f171-de50-4d47-992d-e0a3e598ffa5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.978819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cb1f6-683a-406f-a75e-c9f777ee25d9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:42.983914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.984552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.985103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.985387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.985622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:42.986274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.986380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:42.986573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:42.987641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:42.987895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.988019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:42.991265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:42.999840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3443/6846] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:27:43.001156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.009458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:43.014258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf038a9-13a4-49a6-83aa-c20482189af1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.024011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.026007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.026496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.026969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] PATH_INFO: `/v3/projects/7a23f76007aa4775a9011b214e6408a7/users/f369222313e449a8a29141bf36035633/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.030238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a23f76007aa4775a9011b214e6408a7, user_id=f369222313e449a8a29141bf36035633, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.034901 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3404/6847] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:42 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:43.036078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.042403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:43.065956 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3444/6848] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:43 2022] PUT /identity/v3/projects/7a23f76007aa4775a9011b214e6408a7/users/f369222313e449a8a29141bf36035633/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:43.067390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.164077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:43.186677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a853c6a-fca9-47a2-9fae-44fbf3feb938 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.188729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc935b-a653-4442-9652-9c95330809fa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.194401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebede02-97dc-4fac-84b0-9841feae2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.195303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebede02-97dc-4fac-84b0-9841feae2845 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.195817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebede02-97dc-4fac-84b0-9841feae2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.196173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebede02-97dc-4fac-84b0-9841feae2845 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.197106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebede02-97dc-4fac-84b0-9841feae2845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.199569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebede02-97dc-4fac-84b0-9841feae2845 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:43.207326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.210901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.212272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.212602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] PATH_INFO: `/v3/projects/1973f6b91ac541c89aa7a53d3b7ace60/users/0da28cf647e94f1980cb44f1c81bb7cf/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.220640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1973f6b91ac541c89aa7a53d3b7ace60, user_id=0da28cf647e94f1980cb44f1c81bb7cf, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.226549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:43.269598 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3445/6849] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:43 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:43.269598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8c18-528e-4009-bf4d-d54ae3209d99 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.269598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8c18-528e-4009-bf4d-d54ae3209d99 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.272485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8c18-528e-4009-bf4d-d54ae3209d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.273961 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3405/6850] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:43 2022] PUT /identity/v3/projects/1973f6b91ac541c89aa7a53d3b7ace60/users/0da28cf647e94f1980cb44f1c81bb7cf/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:43.275297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.339103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6faf8c18-528e-4009-bf4d-d54ae3209d99 None None] MFA Rules not processed for user `f369222313e449a8a29141bf36035633`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:43.341876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6faf8c18-528e-4009-bf4d-d54ae3209d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:43.420493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802acb8-db48-4b29-8745-1888a07d53f0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.433148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e2c1d-3664-45db-bc92-20359fc56930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.435222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e2c1d-3664-45db-bc92-20359fc56930 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.438008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e2c1d-3664-45db-bc92-20359fc56930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.438540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e2c1d-3664-45db-bc92-20359fc56930 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.441455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e2c1d-3664-45db-bc92-20359fc56930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.444317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e2c1d-3664-45db-bc92-20359fc56930 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:43.468069 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3406/6851] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:43.469270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7828c4-b3de-44f8-b6f4-9ea1e67c63d0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.469636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7828c4-b3de-44f8-b6f4-9ea1e67c63d0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.470007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7828c4-b3de-44f8-b6f4-9ea1e67c63d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.520870 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3446/6852] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:43.521600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8c18-528e-4009-bf4d-d54ae3209d99 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.522676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ac7828c4-b3de-44f8-b6f4-9ea1e67c63d0 None None] MFA Rules not processed for user `0da28cf647e94f1980cb44f1c81bb7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:43.523933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ac7828c4-b3de-44f8-b6f4-9ea1e67c63d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:43.534361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8c18-528e-4009-bf4d-d54ae3209d99 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.539624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.540954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.541116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.541778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] PATH_INFO: `/v3/projects/32c891f4bf72484fa2f1f9d3def24020/users/691310f56229444b8606a9995e959310/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.560977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c891f4bf72484fa2f1f9d3def24020, user_id=691310f56229444b8606a9995e959310, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.563797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:43.598902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3447/6853] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:43 2022] PUT /identity/v3/projects/32c891f4bf72484fa2f1f9d3def24020/users/691310f56229444b8606a9995e959310/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:43.605213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.622956 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3407/6854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:43.622956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7828c4-b3de-44f8-b6f4-9ea1e67c63d0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.637296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7828c4-b3de-44f8-b6f4-9ea1e67c63d0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.643497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:43.774220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.775093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.776251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.776251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.776638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.778631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:43.791608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0742f2-e6da-43aa-8b53-7ac346aee23b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.807690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.810638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.811015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.811346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.812086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.817287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:43.832740 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3408/6855] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:43.835549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.855674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3448/6856] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:43 2022] POST /identity/v3/projects => generated 395 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:43.857014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:43.858051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:43.885816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:43.972773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d91ad-178c-4edb-bfae-cb268fb11c84 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.975596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a26f-e484-4c3b-9fb7-fca3b001aba5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:43.988465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:43.989630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:43.990120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:43.990569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] PATH_INFO: `/v3/projects/32c891f4bf72484fa2f1f9d3def24020/users/691310f56229444b8606a9995e959310/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:43.992886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c891f4bf72484fa2f1f9d3def24020, user_id=691310f56229444b8606a9995e959310, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:43.995799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:44.007712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3449/6857] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:43 2022] PUT /identity/v3/projects/32c891f4bf72484fa2f1f9d3def24020/users/691310f56229444b8606a9995e959310/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:44.008670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:44.081555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:44.084110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.086163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.086456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.105162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84db8b-5b47-49e9-8cb4-f65ab9a573a3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:44.116935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32388f4a-4a96-4b1f-8cea-88de5df86d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:44.117947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388f4a-4a96-4b1f-8cea-88de5df86d41 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.118235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388f4a-4a96-4b1f-8cea-88de5df86d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.118568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388f4a-4a96-4b1f-8cea-88de5df86d41 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.119301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32388f4a-4a96-4b1f-8cea-88de5df86d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:44.121426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32388f4a-4a96-4b1f-8cea-88de5df86d41 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:44.165824 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3450/6858] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:44 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:44.168968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.169310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.169801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.203734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:44.205807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:44.219511 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3409/6859] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:44.220659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:44.243180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c4b91-1add-4e2c-bb56-41a4db0e7689 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:44.252129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:44.253166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] MFA Rules not processed for user `691310f56229444b8606a9995e959310`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:44.253998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.254328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.254780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.255579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:44.261092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:44.263254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:44.271830 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3410/6860] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:44.275876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:44.297141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:44.304011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7c097-8c08-4c24-aa6f-e2dba97e3bc1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:44.319106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:44.319819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.320100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.320374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.321196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:44.322831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:44.341466 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3411/6861] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:27:44.345967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:44.361467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596f96-fc6b-4508-83da-bf556940f252 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:44.372954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e850-bdf2-4398-beed-e4fa1a0c0105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:44.372954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e850-bdf2-4398-beed-e4fa1a0c0105 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.372954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e850-bdf2-4398-beed-e4fa1a0c0105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.372954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e850-bdf2-4398-beed-e4fa1a0c0105 admin admin] PATH_INFO: `/v3/projects/d1f379a241d2444fbe6c19aa4c66b2a4/users/124c8dbaa4374f71b99d3f8376525bdf/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.412587 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3451/6862] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:44.423364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e850-bdf2-4398-beed-e4fa1a0c0105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f379a241d2444fbe6c19aa4c66b2a4, user_id=124c8dbaa4374f71b99d3f8376525bdf, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:44.427604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e850-bdf2-4398-beed-e4fa1a0c0105 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:44.444854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:44.446587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:44.448940 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3412/6863] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:44 2022] PUT /identity/v3/projects/d1f379a241d2444fbe6c19aa4c66b2a4/users/124c8dbaa4374f71b99d3f8376525bdf/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:44.474050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.475570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.479703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.542704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] MFA Rules not processed for user `124c8dbaa4374f71b99d3f8376525bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:44.544140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:44.563534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:44.632945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a987cf-cfe6-4744-b755-a71f9a772b49 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:44.715471 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3413/6864] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:44.725373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:44.727509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:44.771919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:44.772609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.772922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.773283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.874156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9823e-97dc-4ea3-9f30-0fb8d0279ade None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:44.888418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7f116-f87b-465c-a360-8fc0a5b5b274 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:44.892791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f116-f87b-465c-a360-8fc0a5b5b274 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:44.893173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f116-f87b-465c-a360-8fc0a5b5b274 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:44.893470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f116-f87b-465c-a360-8fc0a5b5b274 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:44.952247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:44.956602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:44.999853 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3452/6865] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:45.142762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f116-f87b-465c-a360-8fc0a5b5b274 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:45.145547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f116-f87b-465c-a360-8fc0a5b5b274 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:45.154117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:45.166197 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3414/6866] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:45.726786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:45.843328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a95f-5aa3-475f-ac54-87dd0c0538ad service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:45.851976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:45.852961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:45.853727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:45.853727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] PATH_INFO: `/v3/users/f369222313e449a8a29141bf36035633` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:45.855045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f369222313e449a8a29141bf36035633)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:45.861856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:45.931858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:45.938111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f369222313e449a8a29141bf36035633'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:45.938952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f369222313e449a8a29141bf36035633'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:45.955354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f369222313e449a8a29141bf36035633'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:45.956246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f369222313e449a8a29141bf36035633'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:45.964183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f369222313e449a8a29141bf36035633'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:45.982047 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3453/6867] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:45 2022] DELETE /identity/v3/users/f369222313e449a8a29141bf36035633 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:45.986650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:45.987168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:45.987266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:46.009231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:46.010590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:46.107991 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3415/6868] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:46.120626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:46.123872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:46.183021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:46.184666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:46.231916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af0d6e-7d4f-408d-864d-b2f483f3e300 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:46.239532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:46.242087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:46.242376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:46.242654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:46.264057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:46.266993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:46.293187 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3454/6869] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:46.331250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3a417-adf2-4898-8c24-35835a261266 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:46.335941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:46.336923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:46.337330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:46.337611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:46.340031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:46.438656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:46.441376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:46.454084 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3416/6870] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:47.133924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:47.136247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:47.157927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b235-355e-4949-816c-386d97be4f86 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:47.186630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:47.190499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:47.191580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:47.193707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] PATH_INFO: `/v3/projects/7a23f76007aa4775a9011b214e6408a7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:47.196464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a23f76007aa4775a9011b214e6408a7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:47.202237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:47.289883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a23f76007aa4775a9011b214e6408a7', 'request_id': 'req-c1101fbc-9f99-47cd-8704-f328ebbcbc79'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.300285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a23f76007aa4775a9011b214e6408a7', 'request_id': 'req-c1101fbc-9f99-47cd-8704-f328ebbcbc79'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.323208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a23f76007aa4775a9011b214e6408a7', 'request_id': 'req-c1101fbc-9f99-47cd-8704-f328ebbcbc79'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.346678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] The token cache is being invalidate because project 7a23f76007aa4775a9011b214e6408a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:47.347163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.350111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.352075 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3455/6871] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:47 2022] DELETE /identity/v3/projects/7a23f76007aa4775a9011b214e6408a7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:47.356558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:47.382914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31a44d-d90f-4869-af70-289dbe9fa394 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:47.462475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:47.491191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:47.494157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:47.494477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:47.494847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] PATH_INFO: `/v3/users/124c8dbaa4374f71b99d3f8376525bdf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:47.496403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=124c8dbaa4374f71b99d3f8376525bdf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:47.499320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:47.575023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124c8dbaa4374f71b99d3f8376525bdf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.576197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124c8dbaa4374f71b99d3f8376525bdf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.593601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124c8dbaa4374f71b99d3f8376525bdf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.595291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124c8dbaa4374f71b99d3f8376525bdf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.608264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b4e45630-066c-4a48-8865-86660529fe5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124c8dbaa4374f71b99d3f8376525bdf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:47.632229 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3417/6872] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:47 2022] DELETE /identity/v3/users/124c8dbaa4374f71b99d3f8376525bdf => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:48.011755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:48.013571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:48.027873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1101fbc-9f99-47cd-8704-f328ebbcbc79 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:48.088352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:48.109412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:48.110307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.110583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.110854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] PATH_INFO: `/v3/projects/d1f379a241d2444fbe6c19aa4c66b2a4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.113003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f379a241d2444fbe6c19aa4c66b2a4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:48.115071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:48.177505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f379a241d2444fbe6c19aa4c66b2a4', 'request_id': 'req-f1ba2955-acb7-453d-871b-e94055f8062d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:48.186040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f379a241d2444fbe6c19aa4c66b2a4', 'request_id': 'req-f1ba2955-acb7-453d-871b-e94055f8062d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:48.195157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f379a241d2444fbe6c19aa4c66b2a4', 'request_id': 'req-f1ba2955-acb7-453d-871b-e94055f8062d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:48.208959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] The token cache is being invalidate because project d1f379a241d2444fbe6c19aa4c66b2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:48.208959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:48.209631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f1ba2955-acb7-453d-871b-e94055f8062d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:48.212620 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3456/6873] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:48 2022] DELETE /identity/v3/projects/d1f379a241d2444fbe6c19aa4c66b2a4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:48.217908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc723cd-5e4b-4e59-b7e0-b25061421af9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.218383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc723cd-5e4b-4e59-b7e0-b25061421af9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.218668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc723cd-5e4b-4e59-b7e0-b25061421af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.268188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ebc723cd-5e4b-4e59-b7e0-b25061421af9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:48.272611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ebc723cd-5e4b-4e59-b7e0-b25061421af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:48.395333 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3418/6874] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:48.404468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee90d9-6b5b-4674-ae81-0e6f39211c6e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.404765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee90d9-6b5b-4674-ae81-0e6f39211c6e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.405061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee90d9-6b5b-4674-ae81-0e6f39211c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.424444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-eeee90d9-6b5b-4674-ae81-0e6f39211c6e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:48.425722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eeee90d9-6b5b-4674-ae81-0e6f39211c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:48.437569 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3457/6875] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:48.438967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc723cd-5e4b-4e59-b7e0-b25061421af9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:48.450711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc723cd-5e4b-4e59-b7e0-b25061421af9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:48.458459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:48.459275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.459627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.460195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.460756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:48.461214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:48.463024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:48.491255 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3419/6876] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:48.491594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee90d9-6b5b-4674-ae81-0e6f39211c6e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:48.507749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee90d9-6b5b-4674-ae81-0e6f39211c6e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:48.519322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:48.520026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.520422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.520809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.523542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:48.527292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:48.563765 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3458/6877] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:48 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:48.565448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:48.577402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8c34a-c9df-476b-a9eb-6d01ac98bcec admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:48.650527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:48.659175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:48.660173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.661247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.661993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.663098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:48.665608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:48.699866 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3420/6878] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:48 2022] POST /identity/v3/users => generated 297 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:48.700420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:48.713089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be69bf9-047f-47b9-aa35-1e95d8defccf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:48.718452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:48.719407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.719779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.720694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.721785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:48.723659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:48.740859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:48.742067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3459/6879] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:48.755388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bba1b9-ddba-49e5-adfa-629184075c97 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:48.761775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:48.763008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.763398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.763674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] PATH_INFO: `/v3/projects/6807313a53284029a0c0f66fb0a080b3/users/9f62a890b703494c9cd0bd2efb7be725/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.785355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6807313a53284029a0c0f66fb0a080b3, user_id=9f62a890b703494c9cd0bd2efb7be725, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:48.788564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:48.815305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3421/6880] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:48 2022] PUT /identity/v3/projects/6807313a53284029a0c0f66fb0a080b3/users/9f62a890b703494c9cd0bd2efb7be725/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:48.819256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:48.836466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e32012-4bcd-4d16-90bf-8571d7cbdcf8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:48.972066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256a1e-4d8c-4e69-a6bb-757fb69dc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:48.972861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256a1e-4d8c-4e69-a6bb-757fb69dc9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:48.973217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256a1e-4d8c-4e69-a6bb-757fb69dc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:48.973575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256a1e-4d8c-4e69-a6bb-757fb69dc9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:48.974458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256a1e-4d8c-4e69-a6bb-757fb69dc9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:48.976499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256a1e-4d8c-4e69-a6bb-757fb69dc9c8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:49.016672 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3460/6881] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:49.020579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:49.035736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680bb7b-a03c-4ece-8bad-f40ceb68401b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:49.048380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:49.049018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.049338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.049707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] PATH_INFO: `/v3/projects/6807313a53284029a0c0f66fb0a080b3/users/9f62a890b703494c9cd0bd2efb7be725/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:49.056026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6807313a53284029a0c0f66fb0a080b3, user_id=9f62a890b703494c9cd0bd2efb7be725, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:49.059021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:49.095229 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3422/6882] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:49 2022] PUT /identity/v3/projects/6807313a53284029a0c0f66fb0a080b3/users/9f62a890b703494c9cd0bd2efb7be725/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:49.097798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb20d6-88ed-4e58-bcad-6b94cad7ad87 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.098356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb20d6-88ed-4e58-bcad-6b94cad7ad87 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.098842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb20d6-88ed-4e58-bcad-6b94cad7ad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:49.168748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-48cb20d6-88ed-4e58-bcad-6b94cad7ad87 None None] MFA Rules not processed for user `9f62a890b703494c9cd0bd2efb7be725`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:49.171177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-48cb20d6-88ed-4e58-bcad-6b94cad7ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:49.236874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:49.341785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:49.343608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:49.364992 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3461/6883] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:49.369297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb20d6-88ed-4e58-bcad-6b94cad7ad87 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:49.483003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4e3a-9d34-440f-961f-f4587e7ec723 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:49.483520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb20d6-88ed-4e58-bcad-6b94cad7ad87 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:49.488006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:49.488645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:49.488866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.488945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.489262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:49.489936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:49.490743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.491215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.491660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:49.491997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:49.494865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:49.541079 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3462/6884] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:49 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:27:49.553729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:49.573926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:49.575900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:49.601202 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3423/6885] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:27:49.680170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da283383-f91c-4d55-82ee-f07c521b3baf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:49.699096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:49.700785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.705504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.708785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:49.709782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:49.717080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:49.762148 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3463/6886] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:49 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:49.766247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:49.808214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fc76e-624e-4c72-a6fc-fb7b3fd8db9c service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:49.825273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:49.825987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.826273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.826614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:49.827700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:49.834271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:49.865420 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3424/6887] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:49.869813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:49.890529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a27e7-dbf5-4165-b7ee-fd4cc17d51f6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:49.900644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d624f9-8725-4d69-a838-ced574b3a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:49.902804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d624f9-8725-4d69-a838-ced574b3a86f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.903269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d624f9-8725-4d69-a838-ced574b3a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.904759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d624f9-8725-4d69-a838-ced574b3a86f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:49.907614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d624f9-8725-4d69-a838-ced574b3a86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:49.910478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d624f9-8725-4d69-a838-ced574b3a86f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:49.958589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:49.965830 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3464/6888] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:27:49.976334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1f68b-b5a2-4f6b-a095-d05dda25585e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:49.983487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:49.984957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:49.984957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:49.985219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] PATH_INFO: `/v3/projects/656daa52e2d8451eaa206e6c46dff97e/users/46fd2ff473654684888a4f25bb917765/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:50.006891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] RBAC: Authorizing `identity:create_grant(project_id=656daa52e2d8451eaa206e6c46dff97e, user_id=46fd2ff473654684888a4f25bb917765, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:50.011700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:50.044700 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3425/6889] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:49 2022] PUT /identity/v3/projects/656daa52e2d8451eaa206e6c46dff97e/users/46fd2ff473654684888a4f25bb917765/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:50.055411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:50.055700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:50.056090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:50.087224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] MFA Rules not processed for user `46fd2ff473654684888a4f25bb917765`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:50.089116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:50.109943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:50.213354 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3465/6890] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:50.227020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:50.229164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:50.263198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:50.316932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02a16-cca7-49dc-9060-673bb1c3238f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:50.326879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:50.327868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:50.328274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:50.329067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:50.432865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:50.434755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:50.450184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3426/6891] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:51.052767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:51.054551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:51.211369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d246d7-8467-4ad7-879f-4227b3ef1f92 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:51.223574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:51.224577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:51.229354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:51.229354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] PATH_INFO: `/v3/users/dcd1462ff001498e8776b711e121817f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:51.230509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd1462ff001498e8776b711e121817f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:51.232562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:51.336403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:51.360407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e80df1-371d-4a78-9037-2f1180c24096 service glance] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:51.363481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd1462ff001498e8776b711e121817f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.364155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd1462ff001498e8776b711e121817f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.371388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:51.372340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:51.372665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:51.372940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] PATH_INFO: `/v3/users/9f62a890b703494c9cd0bd2efb7be725` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:51.374472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f62a890b703494c9cd0bd2efb7be725)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:51.376592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:51.401412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd1462ff001498e8776b711e121817f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.402178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd1462ff001498e8776b711e121817f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.419847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b25f3cd7-d563-4ec5-b607-f746d34b5a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd1462ff001498e8776b711e121817f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.443463 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3466/6892] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:51 2022] DELETE /identity/v3/users/dcd1462ff001498e8776b711e121817f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:51.491854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f62a890b703494c9cd0bd2efb7be725'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.492545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f62a890b703494c9cd0bd2efb7be725'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.510370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f62a890b703494c9cd0bd2efb7be725'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.511286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f62a890b703494c9cd0bd2efb7be725'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.522961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f62a890b703494c9cd0bd2efb7be725'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:51.546021 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3427/6893] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:51 2022] DELETE /identity/v3/users/9f62a890b703494c9cd0bd2efb7be725 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:51.551570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:51.551832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:51.552163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:51.576689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:51.580934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:51.669403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:51.754566 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3467/6894] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:51.760693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:51.762300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:51.861929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:51.874519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012cde-65b2-422f-87c2-52d5b54bc53f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:51.882987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:51.884125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:51.884540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:51.884975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:51.898772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:51.900889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:51.918122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3428/6895] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:52.688139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:52.692014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:52.732953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2794a-ffdb-42b9-976a-7e56456aa968 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:52.753780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:52.755488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:52.755967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:52.756425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] PATH_INFO: `/v3/projects/6807313a53284029a0c0f66fb0a080b3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:52.758407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6807313a53284029a0c0f66fb0a080b3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:52.760949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:52.824919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6807313a53284029a0c0f66fb0a080b3', 'request_id': 'req-232484bf-de79-4a41-b6b7-d26a4b7626a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:52.834319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6807313a53284029a0c0f66fb0a080b3', 'request_id': 'req-232484bf-de79-4a41-b6b7-d26a4b7626a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:52.845161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6807313a53284029a0c0f66fb0a080b3', 'request_id': 'req-232484bf-de79-4a41-b6b7-d26a4b7626a7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:52.861637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] The token cache is being invalidate because project 6807313a53284029a0c0f66fb0a080b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:52.861827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:52.862573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:52.868808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:52.876379 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3468/6896] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:52 2022] DELETE /identity/v3/projects/6807313a53284029a0c0f66fb0a080b3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:52.884790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8aab-5cf0-4b50-aae9-140a752d1bbb service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:52.985207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:52.986394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:52.986858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:52.987279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] PATH_INFO: `/v3/users/46fd2ff473654684888a4f25bb917765` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:52.988793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fd2ff473654684888a4f25bb917765)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:52.990997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:53.064744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:53.066397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:53.096124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232484bf-de79-4a41-b6b7-d26a4b7626a7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:53.100780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fd2ff473654684888a4f25bb917765'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.101783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fd2ff473654684888a4f25bb917765'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.110240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:53.111134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:53.111419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:53.111752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] PATH_INFO: `/v3/projects/17e29d31b0974eeebe8ef48f0de23582` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:53.117716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e29d31b0974eeebe8ef48f0de23582)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:53.125314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:53.130817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fd2ff473654684888a4f25bb917765'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.132476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fd2ff473654684888a4f25bb917765'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.143800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fd2ff473654684888a4f25bb917765'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.170101 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3429/6897] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:52 2022] DELETE /identity/v3/users/46fd2ff473654684888a4f25bb917765 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:53.275994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e29d31b0974eeebe8ef48f0de23582', 'request_id': 'req-73b806bf-1e57-4897-9c05-cef07b757e0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.287593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e29d31b0974eeebe8ef48f0de23582', 'request_id': 'req-73b806bf-1e57-4897-9c05-cef07b757e0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.299356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e29d31b0974eeebe8ef48f0de23582', 'request_id': 'req-73b806bf-1e57-4897-9c05-cef07b757e0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.321325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] The token cache is being invalidate because project 17e29d31b0974eeebe8ef48f0de23582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:53.322018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.322952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.328657 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3469/6898] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:53 2022] DELETE /identity/v3/projects/17e29d31b0974eeebe8ef48f0de23582 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:53.332795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:53.334314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:53.480428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece54d-a850-478f-aa32-8b6804b74105 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:53.499924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:53.584287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:53.585264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:53.585579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:53.585916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] PATH_INFO: `/v3/users/7cef12225f8e46b68753e71512b6d43f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:53.588134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cef12225f8e46b68753e71512b6d43f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:53.590759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:53.683125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cef12225f8e46b68753e71512b6d43f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.683964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cef12225f8e46b68753e71512b6d43f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.702355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cef12225f8e46b68753e71512b6d43f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.703782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cef12225f8e46b68753e71512b6d43f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.722200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-decd2c55-16e9-4529-8c80-bbd7c13975d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cef12225f8e46b68753e71512b6d43f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:53.744599 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3430/6899] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:53 2022] DELETE /identity/v3/users/7cef12225f8e46b68753e71512b6d43f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:53.981620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:53.983733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:54.007070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b806bf-1e57-4897-9c05-cef07b757e0a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:54.088685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:54.130855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:54.131881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.132259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.132763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] PATH_INFO: `/v3/projects/656daa52e2d8451eaa206e6c46dff97e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.134885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] RBAC: Authorizing `identity:delete_project(project_id=656daa52e2d8451eaa206e6c46dff97e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:54.137465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:54.207360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656daa52e2d8451eaa206e6c46dff97e', 'request_id': 'req-eec5d20e-de62-4099-8569-6dbae230743f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.215887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656daa52e2d8451eaa206e6c46dff97e', 'request_id': 'req-eec5d20e-de62-4099-8569-6dbae230743f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.227332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656daa52e2d8451eaa206e6c46dff97e', 'request_id': 'req-eec5d20e-de62-4099-8569-6dbae230743f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.242003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] The token cache is being invalidate because project 656daa52e2d8451eaa206e6c46dff97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:54.242370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.243325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-eec5d20e-de62-4099-8569-6dbae230743f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.245463 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3470/6900] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:53 2022] DELETE /identity/v3/projects/656daa52e2d8451eaa206e6c46dff97e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:54.251078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cfc25-b39b-4abe-883a-a3b126396ebd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.251600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cfc25-b39b-4abe-883a-a3b126396ebd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.251816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cfc25-b39b-4abe-883a-a3b126396ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.275603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f54cfc25-b39b-4abe-883a-a3b126396ebd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:54.276849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f54cfc25-b39b-4abe-883a-a3b126396ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:54.361377 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3431/6901] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:54.370901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d101e93-ca05-484e-a533-889153eeacf9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.371292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d101e93-ca05-484e-a533-889153eeacf9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.371711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d101e93-ca05-484e-a533-889153eeacf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.398607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3d101e93-ca05-484e-a533-889153eeacf9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:54.400672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d101e93-ca05-484e-a533-889153eeacf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:54.415562 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3471/6902] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:54.416901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cfc25-b39b-4abe-883a-a3b126396ebd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:54.433852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cfc25-b39b-4abe-883a-a3b126396ebd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:54.448352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:54.449305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.450545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.450545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.452275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:54.452275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:54.460075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:54.475505 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3432/6903] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:54.480984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d101e93-ca05-484e-a533-889153eeacf9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:54.495824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d101e93-ca05-484e-a533-889153eeacf9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:54.502430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:54.504258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:54.533426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:54.533426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.533426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.533426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.533921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:54.537977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:54.540807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919217e-b84e-4af2-9750-c5bd021b25e3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:54.553396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:54.554505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.554797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.555079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] PATH_INFO: `/v3/projects/348d4ac5e1604df6ba679613824208bb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.557814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348d4ac5e1604df6ba679613824208bb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:54.564820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:54.601878 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3472/6904] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:54 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:54.605608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:54.624049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:54.713051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348d4ac5e1604df6ba679613824208bb', 'request_id': 'req-a697de34-c80e-41e8-a755-9c81e3aae8b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.730193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348d4ac5e1604df6ba679613824208bb', 'request_id': 'req-a697de34-c80e-41e8-a755-9c81e3aae8b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.751134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348d4ac5e1604df6ba679613824208bb', 'request_id': 'req-a697de34-c80e-41e8-a755-9c81e3aae8b8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.753825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10ba4f-487f-4f40-8160-57eb0d9f57ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:54.783533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] The token cache is being invalidate because project 348d4ac5e1604df6ba679613824208bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:54.783834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.784529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a697de34-c80e-41e8-a755-9c81e3aae8b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:54.789244 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3433/6905] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:54 2022] DELETE /identity/v3/projects/348d4ac5e1604df6ba679613824208bb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:54.795073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51962372-5aec-436c-9922-302533d1953c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.795333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51962372-5aec-436c-9922-302533d1953c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.795623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51962372-5aec-436c-9922-302533d1953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.834961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-51962372-5aec-436c-9922-302533d1953c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:54.836209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-51962372-5aec-436c-9922-302533d1953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:54.844611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:54.911143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:54.911882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:54.912156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:54.913903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:54.918178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:54.924531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.006489 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3473/6906] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:54 2022] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:55.008957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.014703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:55.051268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd450-965b-4fdb-8bb6-c2c8c4a16560 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.057656 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3434/6907] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:55.075256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.078645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.078645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.078645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.080992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.084829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.103791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689455f-c7ab-4a37-80f2-141088be7c6b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.104635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689455f-c7ab-4a37-80f2-141088be7c6b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.107651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689455f-c7ab-4a37-80f2-141088be7c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.116526 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3474/6908] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:55.118932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.142548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd531a-b133-4640-9df2-570d312f774c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.153680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.157234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.158792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.159281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.160302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.164918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.184116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a689455f-c7ab-4a37-80f2-141088be7c6b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:55.186626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a689455f-c7ab-4a37-80f2-141088be7c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:55.207019 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3475/6909] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:27:55.212279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.218365 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3435/6910] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:55.222646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689455f-c7ab-4a37-80f2-141088be7c6b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.241796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400a9fd-9168-4ae8-bfc5-62cf98d5243d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.242718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689455f-c7ab-4a37-80f2-141088be7c6b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.253439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e7fd8-76aa-4959-a893-810b6727f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.254633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7fd8-76aa-4959-a893-810b6727f89b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.255179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7fd8-76aa-4959-a893-810b6727f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.255641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7fd8-76aa-4959-a893-810b6727f89b admin admin] PATH_INFO: `/v3/projects/e10d5c000bf045e9be23eb0fea2250a7/users/a56da595a3ab46ba80554cf2691f188f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.259143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.259903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.260189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.260472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.262237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:27:55.262237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.268007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.287183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e7fd8-76aa-4959-a893-810b6727f89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10d5c000bf045e9be23eb0fea2250a7, user_id=a56da595a3ab46ba80554cf2691f188f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.290067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e7fd8-76aa-4959-a893-810b6727f89b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.305523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3436/6911] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:27:55.310222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.331070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241747c-42c4-4d4a-9973-5cf0b59a7ee4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.338294 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3476/6912] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:55 2022] PUT /identity/v3/projects/e10d5c000bf045e9be23eb0fea2250a7/users/a56da595a3ab46ba80554cf2691f188f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:55.348592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.349262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.349736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.406127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] MFA Rules not processed for user `a56da595a3ab46ba80554cf2691f188f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:55.407707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:55.471861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.473079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.473503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.473959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.474860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.477538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.502093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3477/6913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:27:55.515462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.517223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:55.554136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3437/6914] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:27:55 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:55.557204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.600451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:55.607752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4d36d-40ca-4a8c-98a1-25b7df96dccb None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.653311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:55.683180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.684185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.684780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.684780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.746047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84053a-94bf-4925-a5f2-46afdc5941e3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.757363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.758371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.758818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.759249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.760241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.763497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.790948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.792540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.804853 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3478/6915] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:55.805925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.807535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:55.811855 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3438/6916] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:27:55 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:27:55.815206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.830628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9833-874a-43d5-be91-f6b5f52103dc service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.837905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.839421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.841603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.841988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] PATH_INFO: `/v3/users/583c280b393c4ac6814623966146eb55` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.843993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=583c280b393c4ac6814623966146eb55)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.846171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd830c7f-bd40-42e5-a4a9-fcdb9ea5c57f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.849167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.860576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.861303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.861603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.861904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.862772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.864389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.894080 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3439/6917] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:55.899803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.923197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06ab1b-b796-4d1b-a41e-c90d0c56c0d4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:55.936875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:55.939409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:55.939854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:55.940148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:55.941223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583c280b393c4ac6814623966146eb55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:55.942168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583c280b393c4ac6814623966146eb55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:55.942346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:55.947225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:55.968128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583c280b393c4ac6814623966146eb55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:55.968999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583c280b393c4ac6814623966146eb55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:55.971519 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3440/6918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:27:55.976269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:55.978638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:55.985702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f10bc608-8f4b-4245-8649-d173e935f75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583c280b393c4ac6814623966146eb55'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:55.997327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49d17-cd74-475b-99ad-9da34177c1b4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:56.006157 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3479/6919] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:55 2022] DELETE /identity/v3/users/583c280b393c4ac6814623966146eb55 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:56.008457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79b1d-f851-4b28-a03b-961db1b84664 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:56.009000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79b1d-f851-4b28-a03b-961db1b84664 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:56.009236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203e5cc-defc-4f24-9cec-1d2ecefd339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:56.009390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79b1d-f851-4b28-a03b-961db1b84664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:56.010234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203e5cc-defc-4f24-9cec-1d2ecefd339d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:56.010460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203e5cc-defc-4f24-9cec-1d2ecefd339d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:56.010735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203e5cc-defc-4f24-9cec-1d2ecefd339d admin admin] PATH_INFO: `/v3/projects/af9143a191884663bcdc718ca7b8a8ef/users/590f78868fd942e6906cab1b4822bde5/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:56.043253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203e5cc-defc-4f24-9cec-1d2ecefd339d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9143a191884663bcdc718ca7b8a8ef, user_id=590f78868fd942e6906cab1b4822bde5, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:56.052630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203e5cc-defc-4f24-9cec-1d2ecefd339d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:56.056989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7ff79b1d-f851-4b28-a03b-961db1b84664 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:56.058312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ff79b1d-f851-4b28-a03b-961db1b84664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:56.110182 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3441/6920] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:27:55 2022] PUT /identity/v3/projects/af9143a191884663bcdc718ca7b8a8ef/users/590f78868fd942e6906cab1b4822bde5/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:27:56.111542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:56.111823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:56.112092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:56.129419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:56.153831 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3480/6921] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:56.153831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:56.153831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:56.160914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:56.162340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:56.169529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:56.249799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] MFA Rules not processed for user `590f78868fd942e6906cab1b4822bde5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:56.252682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:56.269344 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3442/6922] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:56.272621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:56.275700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:56.426574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:56.452699 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3481/6923] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:27:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:56.455713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:56.459768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:56.468498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132e432-c48d-4596-bfa1-4a94d8501a27 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:56.476138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:56.477597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:56.477597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:56.477597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:56.561994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:56.564574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:56.576389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3443/6924] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:56.587652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:56.589440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:56.606894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591f890-9958-43fd-a796-ba561d981f87 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:56.618280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:56.619042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:56.619397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:56.619881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:56.648725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:56.650726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:56.673870 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3482/6925] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:56.786729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399675a8-eda2-46ba-9f9a-b459e0b39c2c service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:56.790915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f4c52-b023-4b41-883e-8d6cbd6c31a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:56.791938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4c52-b023-4b41-883e-8d6cbd6c31a4 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:56.792383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4c52-b023-4b41-883e-8d6cbd6c31a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:56.792895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f4c52-b023-4b41-883e-8d6cbd6c31a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:56.803506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f4c52-b023-4b41-883e-8d6cbd6c31a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:56.805098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f4c52-b023-4b41-883e-8d6cbd6c31a4 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:56.825397 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3444/6926] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:57.123146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:57.144505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b696f-4313-4ab1-8650-86c2f23bd504 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:57.167025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:57.169803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:57.173068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:57.173407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:57.183121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:57.224742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:57.238561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:57.275532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3483/6927] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:27:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:27:57.372067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:57.372067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:57.372566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:57.396734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:57.399058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:57.417986 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3445/6928] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:57.426216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:57.478905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682f9df-bcad-4840-8b12-e910d670898f service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:57.495917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff2bcb-577c-4caf-8189-6fb25d6d9398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:57.501208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff2bcb-577c-4caf-8189-6fb25d6d9398 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:57.501890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff2bcb-577c-4caf-8189-6fb25d6d9398 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:57.502534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff2bcb-577c-4caf-8189-6fb25d6d9398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:57.560056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff2bcb-577c-4caf-8189-6fb25d6d9398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:57.563567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff2bcb-577c-4caf-8189-6fb25d6d9398 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:57.611624 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3484/6929] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:58.202673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:58.204378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:58.234127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eff8fa-c7be-4335-b3b4-b8e289e8dd2e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:58.247260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:58.248222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:58.248512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:58.248816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] PATH_INFO: `/v3/projects/ea6c943410914eda8c1e667ce13923d2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:58.250193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6c943410914eda8c1e667ce13923d2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:58.252380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:58.310161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecad4-5062-4ec4-a05d-a55bc92a824e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:58.310772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecad4-5062-4ec4-a05d-a55bc92a824e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:58.310772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecad4-5062-4ec4-a05d-a55bc92a824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:58.348388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d1aecad4-5062-4ec4-a05d-a55bc92a824e None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:58.349869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d1aecad4-5062-4ec4-a05d-a55bc92a824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:58.375779 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3485/6930] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 18 22:27:58.383455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecad4-5062-4ec4-a05d-a55bc92a824e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:58.400781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6c943410914eda8c1e667ce13923d2', 'request_id': 'req-b8c6c0d7-9624-4fc5-b64c-2188af20381b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.409227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecad4-5062-4ec4-a05d-a55bc92a824e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:58.414028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6c943410914eda8c1e667ce13923d2', 'request_id': 'req-b8c6c0d7-9624-4fc5-b64c-2188af20381b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.432973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6c943410914eda8c1e667ce13923d2', 'request_id': 'req-b8c6c0d7-9624-4fc5-b64c-2188af20381b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.441966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:58.455525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] The token cache is being invalidate because project ea6c943410914eda8c1e667ce13923d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:27:58.457309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.461263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.466282 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3446/6931] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:27:58 2022] DELETE /identity/v3/projects/ea6c943410914eda8c1e667ce13923d2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:58.471513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:58.474556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:58.567063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:58.605788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2855a-b35a-46ca-abbb-ad5fadaafbf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:58.606471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2855a-b35a-46ca-abbb-ad5fadaafbf3 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:58.606733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2855a-b35a-46ca-abbb-ad5fadaafbf3 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:58.607002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2855a-b35a-46ca-abbb-ad5fadaafbf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:58.616617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-76d2855a-b35a-46ca-abbb-ad5fadaafbf3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:58.679998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c0d7-9624-4fc5-b64c-2188af20381b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:58.694336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:58.695379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:58.695761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:58.696132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] PATH_INFO: `/v3/users/0da28cf647e94f1980cb44f1c81bb7cf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:58.697550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da28cf647e94f1980cb44f1c81bb7cf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:58.699795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:58.761210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2855a-b35a-46ca-abbb-ad5fadaafbf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:58.763184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2855a-b35a-46ca-abbb-ad5fadaafbf3 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:58.778580 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3486/6932] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:58.827082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da28cf647e94f1980cb44f1c81bb7cf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.829451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da28cf647e94f1980cb44f1c81bb7cf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.881477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da28cf647e94f1980cb44f1c81bb7cf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.884847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da28cf647e94f1980cb44f1c81bb7cf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.919846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da28cf647e94f1980cb44f1c81bb7cf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:27:58.962359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3447/6933] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:27:58 2022] DELETE /identity/v3/users/0da28cf647e94f1980cb44f1c81bb7cf => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:27:59.150116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43712-5a03-4d08-9692-cd21ad14c77a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:59.150368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43712-5a03-4d08-9692-cd21ad14c77a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:59.150646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43712-5a03-4d08-9692-cd21ad14c77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:59.177476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-79e43712-5a03-4d08-9692-cd21ad14c77a None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:27:59.179140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-79e43712-5a03-4d08-9692-cd21ad14c77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:59.272250 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3487/6934] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:27:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:27:59.286194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:27:59.287730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:27:59.431104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223c2dc-5a0d-4247-8bd1-36b19552eb21 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:27:59.440481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:27:59.441290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:27:59.441578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:27:59.441858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:27:59.458618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:27:59.462587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:27:59.480774 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3448/6935] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:00.040927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.041569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.041946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.074633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:00.079147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.098062 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3488/6936] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:00.123772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:00.134179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:00.143228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17f75-b366-4cad-a970-d0b488ec1ffc service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:00.153376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:00.155858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.157133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.159444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.178778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:00.181844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:00.204066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:00.205544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.211023 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3449/6937] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:28:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:00.380314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:00.383114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.393909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdbf55-1b26-47bf-a217-d537ac38d943 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:00.419468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:00.423849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.425577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf12298-bb47-479b-9e75-2d2f4cdda238 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:00.426041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.426416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] PATH_INFO: `/v3/users/590f78868fd942e6906cab1b4822bde5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.431470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590f78868fd942e6906cab1b4822bde5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:00.454588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:00.460004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:00.462478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.469640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.476916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] PATH_INFO: `/v3/projects/1973f6b91ac541c89aa7a53d3b7ace60` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.484246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1973f6b91ac541c89aa7a53d3b7ace60)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:00.507105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:00.591971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:00.610165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590f78868fd942e6906cab1b4822bde5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.610989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590f78868fd942e6906cab1b4822bde5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.632880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1973f6b91ac541c89aa7a53d3b7ace60', 'request_id': 'req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.636740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590f78868fd942e6906cab1b4822bde5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.638123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590f78868fd942e6906cab1b4822bde5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.642718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1973f6b91ac541c89aa7a53d3b7ace60', 'request_id': 'req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.651301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-26a2170c-eeb5-4459-8169-091b86c78f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590f78868fd942e6906cab1b4822bde5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.656495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1973f6b91ac541c89aa7a53d3b7ace60', 'request_id': 'req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.673233 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3489/6938] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:00 2022] DELETE /identity/v3/users/590f78868fd942e6906cab1b4822bde5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:00.675173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] The token cache is being invalidate because project 1973f6b91ac541c89aa7a53d3b7ace60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:00.675291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6534e5-3a25-45c3-b270-0a071313890e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.675551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6534e5-3a25-45c3-b270-0a071313890e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.676344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6534e5-3a25-45c3-b270-0a071313890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.676714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.677686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-56ffb5c3-cda3-4cbd-adcd-4f1d58d0c412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:00.680526 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3450/6939] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:00 2022] DELETE /identity/v3/projects/1973f6b91ac541c89aa7a53d3b7ace60 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:00.682874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.683327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.685450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.701472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bb6534e5-3a25-45c3-b270-0a071313890e None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:00.703277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bb6534e5-3a25-45c3-b270-0a071313890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.725310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:00.727357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.806134 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3490/6940] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:00.807723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d0c1-29d3-4363-a23f-435bef86bd52 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.808164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d0c1-29d3-4363-a23f-435bef86bd52 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.808649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d0c1-29d3-4363-a23f-435bef86bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.833513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e530d0c1-29d3-4363-a23f-435bef86bd52 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:00.834946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e530d0c1-29d3-4363-a23f-435bef86bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.892376 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3451/6941] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:00.896328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:00.896328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.928952 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3491/6942] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:00.939342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a863e0c-1859-4078-9af5-5953e25d4e45 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.939681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a863e0c-1859-4078-9af5-5953e25d4e45 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.939895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a863e0c-1859-4078-9af5-5953e25d4e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.960382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5a863e0c-1859-4078-9af5-5953e25d4e45 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:00.961562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5a863e0c-1859-4078-9af5-5953e25d4e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:00.973794 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3492/6943] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:00.974753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a863e0c-1859-4078-9af5-5953e25d4e45 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:00.985593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a863e0c-1859-4078-9af5-5953e25d4e45 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:00.990951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:00.991703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:00.992061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:00.992401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:00.993320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:00.993691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:00.995529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.011804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a89b5-0d41-4296-bab2-86f0e7e9edd9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.013684 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3493/6944] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:01.014982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.018125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.019157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.021477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.023781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.039477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612ab2-e2c0-48ef-a7f6-a3ef520cf43b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.047325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.049024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.055877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.057163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.057448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.057722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.058425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.060595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.066187 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3452/6945] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:28:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:01.068690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.071886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:01.082044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:01.120970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3494/6946] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:01 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:01.122252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.171117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:01.195086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cd079-80e6-42f3-bc54-fd0fbfcfd432 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.271913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84343e91-4ed6-4cba-b603-c022767fcbf9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.287316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.288008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.288327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.288639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.289347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.296809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.316627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.318381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.319603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.319966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.336398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3495/6947] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:01 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:01.338037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.340011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:01.349766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.351349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.356171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c14a6-815d-4cd0-ad91-e3cda06e13c3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.368955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.370469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.370828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.371248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] PATH_INFO: `/v3/users/a56da595a3ab46ba80554cf2691f188f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.373658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56da595a3ab46ba80554cf2691f188f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.376715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.380541 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3453/6948] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:01.381854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.394634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7235a-e857-436c-ac29-09caec2f54ff service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.399846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.401068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.401205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.401556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.402690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.404877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.419367 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3454/6949] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:01.423389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.434949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20e300-003b-4899-abac-163740cbac3e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.441598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.442520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.443221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.443673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.444425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.446098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.456930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56da595a3ab46ba80554cf2691f188f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:01.457925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56da595a3ab46ba80554cf2691f188f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:01.461582 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3455/6950] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:01.466174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.468596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:01.472319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56da595a3ab46ba80554cf2691f188f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:01.473083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56da595a3ab46ba80554cf2691f188f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:01.480632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3ecc005-bb01-41f5-bf58-4c0452799c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56da595a3ab46ba80554cf2691f188f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:01.482421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d075c4a-cda5-486a-b24b-4e29e44de899 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.487928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d476a-b6c2-4364-acba-0d6e1e5b23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.489197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d476a-b6c2-4364-acba-0d6e1e5b23f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.489489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d476a-b6c2-4364-acba-0d6e1e5b23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.489818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d476a-b6c2-4364-acba-0d6e1e5b23f0 admin admin] PATH_INFO: `/v3/projects/39a9dc50952e4973a4bc26a098eaccff/users/2b6d36bff3c94a1eb74330d86296516d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.497739 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3496/6951] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:01 2022] DELETE /identity/v3/users/a56da595a3ab46ba80554cf2691f188f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:01.502383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2fcbb-3f18-457a-8787-bae3bae0877a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.502738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2fcbb-3f18-457a-8787-bae3bae0877a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.503087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2fcbb-3f18-457a-8787-bae3bae0877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.510633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d476a-b6c2-4364-acba-0d6e1e5b23f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a9dc50952e4973a4bc26a098eaccff, user_id=2b6d36bff3c94a1eb74330d86296516d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.514047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d476a-b6c2-4364-acba-0d6e1e5b23f0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.528143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-74a2fcbb-3f18-457a-8787-bae3bae0877a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:01.529375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74a2fcbb-3f18-457a-8787-bae3bae0877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:01.538642 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3456/6952] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:01 2022] PUT /identity/v3/projects/39a9dc50952e4973a4bc26a098eaccff/users/2b6d36bff3c94a1eb74330d86296516d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:01.550823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fff3-33c6-466a-a09d-af3fef081145 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.551524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fff3-33c6-466a-a09d-af3fef081145 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.552178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fff3-33c6-466a-a09d-af3fef081145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.637220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6c88fff3-33c6-466a-a09d-af3fef081145 None None] MFA Rules not processed for user `2b6d36bff3c94a1eb74330d86296516d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:01.638872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6c88fff3-33c6-466a-a09d-af3fef081145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:01.736139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3497/6953] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:01.776564 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3457/6954] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:01.781578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2fcbb-3f18-457a-8787-bae3bae0877a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.806476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2fcbb-3f18-457a-8787-bae3bae0877a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.826652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:01.840376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:01.841488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:01.842548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:01.843935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:01.850766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:01.879378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:01.893429 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3498/6955] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:01 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:01.896635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88fff3-33c6-466a-a09d-af3fef081145 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.911681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:01.915282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:01.915647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88fff3-33c6-466a-a09d-af3fef081145 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:01.923439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:02.097628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e57ad1-60f3-4224-9d0b-dcf987b44d10 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:02.102983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.103791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.105607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.105607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.105607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.109782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.110660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.112284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.113214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.114708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.126246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.128545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.150886 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3499/6956] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:02.169921 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3458/6957] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:01 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:02.173721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:02.189682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc316d-5f21-420b-94ee-04448d1723f6 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:02.195589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.196367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.196780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.197807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.197992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.200588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.212460 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3500/6958] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:02.216339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:02.228165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1416e4-5342-4fc6-a391-7d0a52cb7121 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:02.235669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71efa5-22e7-4d33-aa46-4e84dfee5694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.236463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71efa5-22e7-4d33-aa46-4e84dfee5694 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.236812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71efa5-22e7-4d33-aa46-4e84dfee5694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.237223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71efa5-22e7-4d33-aa46-4e84dfee5694 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.238197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71efa5-22e7-4d33-aa46-4e84dfee5694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.239981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71efa5-22e7-4d33-aa46-4e84dfee5694 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.252853 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3459/6959] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:02.257644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:02.273633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e471a-f5ce-474b-b48b-34c8012d464a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:02.280144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.281306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.281703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.282347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] PATH_INFO: `/v3/projects/a00b2b10d1af41b196c501af992c3c71/users/7e6a27c29a3a4f94a8f2c56b9727f963/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.318371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00b2b10d1af41b196c501af992c3c71, user_id=7e6a27c29a3a4f94a8f2c56b9727f963, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.323956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.374913 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3501/6960] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:02 2022] PUT /identity/v3/projects/a00b2b10d1af41b196c501af992c3c71/users/7e6a27c29a3a4f94a8f2c56b9727f963/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:02.384910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.385273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.385588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.391771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:02.393743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:02.456557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] MFA Rules not processed for user `7e6a27c29a3a4f94a8f2c56b9727f963`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:02.458834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:02.487716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e359766-d141-4de7-a697-828ffac72a48 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:02.495289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.496288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.496573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.496921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] PATH_INFO: `/v3/users/21f71cf06f4f4ee3bd6fb41a7916edb2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.498458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f71cf06f4f4ee3bd6fb41a7916edb2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.501925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.587116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f71cf06f4f4ee3bd6fb41a7916edb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.588161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f71cf06f4f4ee3bd6fb41a7916edb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.605697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f71cf06f4f4ee3bd6fb41a7916edb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.606912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f71cf06f4f4ee3bd6fb41a7916edb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.609390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:02.609722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3460/6961] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:02.610906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:02.612829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:02.619413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f71cf06f4f4ee3bd6fb41a7916edb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.633484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778a435-6a5a-41fc-8fd2-98b6b29e1de0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:02.639176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.640225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.640610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.640983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] PATH_INFO: `/v3/projects/af9143a191884663bcdc718ca7b8a8ef` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.646221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9143a191884663bcdc718ca7b8a8ef)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.646757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.647652 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3502/6962] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:02 2022] DELETE /identity/v3/users/21f71cf06f4f4ee3bd6fb41a7916edb2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:02.648770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:02.651430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:02.753160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9143a191884663bcdc718ca7b8a8ef', 'request_id': 'req-2f9e790f-4ee1-4d90-992f-724e2e2fe480'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.760500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9143a191884663bcdc718ca7b8a8ef', 'request_id': 'req-2f9e790f-4ee1-4d90-992f-724e2e2fe480'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.769304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed522-e655-45dc-a53c-779d8f508900 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:02.771188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9143a191884663bcdc718ca7b8a8ef', 'request_id': 'req-2f9e790f-4ee1-4d90-992f-724e2e2fe480'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.780205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:02.788066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] The token cache is being invalidate because project af9143a191884663bcdc718ca7b8a8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:02.790289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.792468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f9e790f-4ee1-4d90-992f-724e2e2fe480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:02.809096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3461/6963] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:02 2022] DELETE /identity/v3/projects/af9143a191884663bcdc718ca7b8a8ef => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:02.809096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.809096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.809096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.859074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:02.860444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:02.888509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:02.889243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:02.889540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:02.889802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:02.890511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:02.893786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:02.965405 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3503/6964] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:02 2022] POST /identity/v3/projects => generated 381 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:02.970642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:02.974623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:03.025875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3462/6965] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:03.043333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.045013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:03.097373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981d539-ca84-439e-8b6b-bec366765591 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.104635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.105909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.106562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.107143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.108102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.110558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.193730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3504/6966] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:02 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:03.194836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.198604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:03.219692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6d2ee-2fe1-4a18-b8ca-26e3406cea27 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.223802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fdc2f-f1e0-443a-9964-4a17803af571 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.229359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.231653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.231938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.232218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] PATH_INFO: `/v3/projects/e10d5c000bf045e9be23eb0fea2250a7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.233845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10d5c000bf045e9be23eb0fea2250a7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.236926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.239392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:03.313668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10d5c000bf045e9be23eb0fea2250a7', 'request_id': 'req-63908d93-0f3a-48c7-ac85-746a086c2019'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:03.322286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10d5c000bf045e9be23eb0fea2250a7', 'request_id': 'req-63908d93-0f3a-48c7-ac85-746a086c2019'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:03.333533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10d5c000bf045e9be23eb0fea2250a7', 'request_id': 'req-63908d93-0f3a-48c7-ac85-746a086c2019'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:03.340534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a279b-774a-4981-b672-72e1bbef7ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.341282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a279b-774a-4981-b672-72e1bbef7ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.341565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a279b-774a-4981-b672-72e1bbef7ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.341846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a279b-774a-4981-b672-72e1bbef7ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.348584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] The token cache is being invalidate because project e10d5c000bf045e9be23eb0fea2250a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:03.349621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:03.349736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:03.351803 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3505/6967] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:03 2022] DELETE /identity/v3/projects/e10d5c000bf045e9be23eb0fea2250a7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:03.353291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.355409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a279b-774a-4981-b672-72e1bbef7ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.355531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:03.357240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a279b-774a-4981-b672-72e1bbef7ea9 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.384116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3463/6968] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:03.386848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f88a-1878-455f-b520-d775c3ee9fba None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.387365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f88a-1878-455f-b520-d775c3ee9fba None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.387818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f88a-1878-455f-b520-d775c3ee9fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.428631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-aba0f88a-1878-455f-b520-d775c3ee9fba None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:03.430218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aba0f88a-1878-455f-b520-d775c3ee9fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:03.441508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63908d93-0f3a-48c7-ac85-746a086c2019 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.446447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3464/6969] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:03.446845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.447523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.447799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.448069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.448807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.450860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.456022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6ad3-8de4-4a53-a74f-44e4fcf9d9af None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.456531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6ad3-8de4-4a53-a74f-44e4fcf9d9af None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.457060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6ad3-8de4-4a53-a74f-44e4fcf9d9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.462486 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3506/6970] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:03.467579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.478717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae7ad-6a9a-4ff9-9d40-b9a4874840a7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.487186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.488284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.489519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.489877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] PATH_INFO: `/v3/projects/a1c84c6018f149f08b1ebd6853c06061/users/1f4ca6ad1ab74ce1b20c21244323dfe0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.508267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cc8d6ad3-8de4-4a53-a74f-44e4fcf9d9af None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:03.513591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c84c6018f149f08b1ebd6853c06061, user_id=1f4ca6ad1ab74ce1b20c21244323dfe0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.513772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cc8d6ad3-8de4-4a53-a74f-44e4fcf9d9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:03.516740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.541428 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3465/6972] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:03.546019 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3507/6972] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:03 2022] PUT /identity/v3/projects/a1c84c6018f149f08b1ebd6853c06061/users/1f4ca6ad1ab74ce1b20c21244323dfe0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:03.547190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6ad3-8de4-4a53-a74f-44e4fcf9d9af None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.547675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.566921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6ad3-8de4-4a53-a74f-44e4fcf9d9af None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.623073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691c6e0-0f96-46f1-b816-bb1a4c992946 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.633362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.634389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.634982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.636489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.637768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:03.639512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.641423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.653070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:03.663243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3508/6973] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:03.664282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.676226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a0309-b1a0-4900-82c3-18c52bcd7e84 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.682554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.683317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.683735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.684080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.684918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.687549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:03.689746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.724173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.725135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.725549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.725831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.726590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.728273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.750319 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3509/6974] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:03 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:03.752783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.759381 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3466/6975] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:03.760491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.774148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c16ab8-8a05-49df-9d9f-b78031937556 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.850180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc5642-62d4-4d5b-850a-48436b2a44c6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.855937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.856956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.857336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.857680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.858572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.860579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.889707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f6b5-23e6-4179-854e-113fce85fca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.890901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f6b5-23e6-4179-854e-113fce85fca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.891334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f6b5-23e6-4179-854e-113fce85fca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.891749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f6b5-23e6-4179-854e-113fce85fca0 admin admin] PATH_INFO: `/v3/projects/a1c84c6018f149f08b1ebd6853c06061/users/1f4ca6ad1ab74ce1b20c21244323dfe0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.897983 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3510/6976] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:03 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:03.898149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f6b5-23e6-4179-854e-113fce85fca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c84c6018f149f08b1ebd6853c06061, user_id=1f4ca6ad1ab74ce1b20c21244323dfe0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.899690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.902509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f6b5-23e6-4179-854e-113fce85fca0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.914655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdcc97-bfb2-4cd9-91ee-e7e9aeb2439e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:03.925094 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3467/6977] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:03 2022] PUT /identity/v3/projects/a1c84c6018f149f08b1ebd6853c06061/users/1f4ca6ad1ab74ce1b20c21244323dfe0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:03.926806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:03.928293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.928727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.929216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.930908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:03.933878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:03.935466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:03.935770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:03.936369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:03.961999 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3511/6978] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:03.963627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:03.973723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] MFA Rules not processed for user `1f4ca6ad1ab74ce1b20c21244323dfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:03.975497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:03.978642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5491c-2e18-4f7d-b1f1-10e761020ac0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:04.096448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:04.097480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.097913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.098334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.099220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:04.101003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:04.118616 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3468/6979] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:04.119623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:04.121475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:04.142976 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3512/6980] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:04.144100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:04.146143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:04.149687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e224aa-923a-4107-bcf7-0e2cf8b3d1ff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:04.158315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:04.159215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.159546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.159754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] PATH_INFO: `/v3/projects/83ec0be3125e417eaf69306e6098c373` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.161175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ec0be3125e417eaf69306e6098c373)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:04.163160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:04.242751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:04.243570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ec0be3125e417eaf69306e6098c373', 'request_id': 'req-812fd4b5-8bbb-48f2-a5d1-887c8664619c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.249775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bae5e2-d5e7-4a8c-87a6-0a8ca38c245a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:04.251333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ec0be3125e417eaf69306e6098c373', 'request_id': 'req-812fd4b5-8bbb-48f2-a5d1-887c8664619c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.253293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:04.264755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ec0be3125e417eaf69306e6098c373', 'request_id': 'req-812fd4b5-8bbb-48f2-a5d1-887c8664619c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.289524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] The token cache is being invalidate because project 83ec0be3125e417eaf69306e6098c373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:04.289829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.290496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.299112 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3469/6981] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:04 2022] DELETE /identity/v3/projects/83ec0be3125e417eaf69306e6098c373 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:04.299112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:04.300475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:04.326637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:04.327317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.327601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.327875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.333493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:04.403938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fd4b5-8bbb-48f2-a5d1-887c8664619c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:04.409674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8d78c-963a-4a9f-ac1d-a95a7555edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:04.410642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8d78c-963a-4a9f-ac1d-a95a7555edb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.410923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8d78c-963a-4a9f-ac1d-a95a7555edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.411312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8d78c-963a-4a9f-ac1d-a95a7555edb3 admin admin] PATH_INFO: `/v3/projects/5a66af534c864816a68b5d4a3ed0f769/users/eb618d62ad804a63be1b0cb7dfb49677/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.418538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:04.420215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:04.429956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8d78c-963a-4a9f-ac1d-a95a7555edb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a66af534c864816a68b5d4a3ed0f769, user_id=eb618d62ad804a63be1b0cb7dfb49677, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:04.432581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3513/6982] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:04.432864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8d78c-963a-4a9f-ac1d-a95a7555edb3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:04.434089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:04.436078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:04.453221 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3470/6983] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:04 2022] PUT /identity/v3/projects/5a66af534c864816a68b5d4a3ed0f769/users/eb618d62ad804a63be1b0cb7dfb49677/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:04.461470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8401518-24a8-488d-aa5a-6f66c28bb920 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:04.465017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0687-0f69-4bf2-9adb-c671b37bc7da None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.465898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0687-0f69-4bf2-9adb-c671b37bc7da None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.466197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0687-0f69-4bf2-9adb-c671b37bc7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.503088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2abd0687-0f69-4bf2-9adb-c671b37bc7da None None] MFA Rules not processed for user `eb618d62ad804a63be1b0cb7dfb49677`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:04.504519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2abd0687-0f69-4bf2-9adb-c671b37bc7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:04.581137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:04.583110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.583401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.583681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] PATH_INFO: `/v3/users/691310f56229444b8606a9995e959310` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.585248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691310f56229444b8606a9995e959310)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:04.587219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:04.611921 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3471/6984] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:04.616969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0687-0f69-4bf2-9adb-c671b37bc7da None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:04.640516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0687-0f69-4bf2-9adb-c671b37bc7da None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:04.646268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:04.647772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.647772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.648763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.650110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:04.656338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:04.689456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691310f56229444b8606a9995e959310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.691486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691310f56229444b8606a9995e959310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.713197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:04.714732 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3472/6985] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:04 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:04.719223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:04.719863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691310f56229444b8606a9995e959310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.721118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691310f56229444b8606a9995e959310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.722101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:04.743329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691310f56229444b8606a9995e959310'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:04.767580 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3514/6986] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:04 2022] DELETE /identity/v3/users/691310f56229444b8606a9995e959310 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:04.794345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:04.849357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afc5d2-a584-41a4-b92e-2ddf645ea591 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:04.991555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:04.992343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:04.992704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:04.993105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:04.993933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:04.999048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.066715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3473/6987] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:04 2022] POST /identity/v3/users => generated 291 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:05.071440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.089204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9f6f-4df0-4851-8983-54c0912fa8b2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.101664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.102555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.102835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.103107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.103847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.109675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.153243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3515/6988] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:05.157294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.176564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41289b1-2234-4b51-8e86-5f23dbd01f4a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.184653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c96ea-ff90-4b98-90a8-0cf9e1043b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.185747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c96ea-ff90-4b98-90a8-0cf9e1043b13 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.186620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c96ea-ff90-4b98-90a8-0cf9e1043b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.187008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c96ea-ff90-4b98-90a8-0cf9e1043b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.188079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c96ea-ff90-4b98-90a8-0cf9e1043b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.192192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c96ea-ff90-4b98-90a8-0cf9e1043b13 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.211621 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3474/6989] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:05.212161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.227176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9bae-3d6f-4104-aae6-a6f6d49ed67d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.241147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.242070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.242348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.242623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] PATH_INFO: `/v3/projects/be7c8e87ded6443ab934791765f694a5/users/ce53a3f9013a47188f8de63a69ca647b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.272324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7c8e87ded6443ab934791765f694a5, user_id=ce53a3f9013a47188f8de63a69ca647b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.275043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.303416 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3516/6990] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:05 2022] PUT /identity/v3/projects/be7c8e87ded6443ab934791765f694a5/users/ce53a3f9013a47188f8de63a69ca647b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:05.315162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7bc2-3e89-4b6f-8fcb-d3eca20c5c04 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.315684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7bc2-3e89-4b6f-8fcb-d3eca20c5c04 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.316112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7bc2-3e89-4b6f-8fcb-d3eca20c5c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.352073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-37da7bc2-3e89-4b6f-8fcb-d3eca20c5c04 None None] MFA Rules not processed for user `ce53a3f9013a47188f8de63a69ca647b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:05.354492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-37da7bc2-3e89-4b6f-8fcb-d3eca20c5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:05.439694 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3475/6991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:05.444944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.535033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322dfda-d73c-477a-ac33-c2b0a8f300a1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.540845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.540845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.540845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.541234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.541841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.544157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.577960 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3517/6992] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:05 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:05.581514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7bc2-3e89-4b6f-8fcb-d3eca20c5c04 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.598112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7bc2-3e89-4b6f-8fcb-d3eca20c5c04 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.670720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:05.692281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.693388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.693910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.694359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.695168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.697389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.732782 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3476/6993] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:05 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:05.737139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.751338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.753241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:05.767625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53849b62-e460-4bb4-a0bc-abcfbee4ae84 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.773934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0973a-0c8b-46f6-9def-7e8f6efc5440 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.775859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.776673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.777080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.777774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.778944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.782559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.783093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.783860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.784297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.784886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] PATH_INFO: `/v3/projects/32c891f4bf72484fa2f1f9d3def24020` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.787288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c891f4bf72484fa2f1f9d3def24020)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.796762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.837992 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3518/6994] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:05.842344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.853200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff101fd-6bf1-462e-89f4-efb18f4ab655 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:05.861228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:05.863636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.864075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.864525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] PATH_INFO: `/v3/projects/70fb96c4276944649ea075bcb4100ea9/users/f079df47e395467aa299a8c843df5a66/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.876439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c891f4bf72484fa2f1f9d3def24020', 'request_id': 'req-24911f4e-d5b0-4689-b940-89a52d72ca0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:05.885148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fb96c4276944649ea075bcb4100ea9, user_id=f079df47e395467aa299a8c843df5a66, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:05.885848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c891f4bf72484fa2f1f9d3def24020', 'request_id': 'req-24911f4e-d5b0-4689-b940-89a52d72ca0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:05.888511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:05.898698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c891f4bf72484fa2f1f9d3def24020', 'request_id': 'req-24911f4e-d5b0-4689-b940-89a52d72ca0b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:05.913968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3519/6995] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:05 2022] PUT /identity/v3/projects/70fb96c4276944649ea075bcb4100ea9/users/f079df47e395467aa299a8c843df5a66/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:05.915418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:05.925696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] The token cache is being invalidate because project 32c891f4bf72484fa2f1f9d3def24020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:05.925696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:05.926293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-24911f4e-d5b0-4689-b940-89a52d72ca0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:05.928247 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3477/6996] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:05 2022] DELETE /identity/v3/projects/32c891f4bf72484fa2f1f9d3def24020 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:05.933548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:05.933837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:05.934122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:05.952908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:05.954274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.004423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:06.020738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b221622-ae10-4c5d-b529-a39f17d684b7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.043484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5464b7-6a14-42b9-bcd9-393869a8d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.044192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5464b7-6a14-42b9-bcd9-393869a8d1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.046466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5464b7-6a14-42b9-bcd9-393869a8d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.046756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5464b7-6a14-42b9-bcd9-393869a8d1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.051229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5464b7-6a14-42b9-bcd9-393869a8d1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.062104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5464b7-6a14-42b9-bcd9-393869a8d1f7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:06.071964 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3478/6997] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:06.124661 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3520/6998] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:06.129714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:06.131193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.180370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a3eb9-34ec-42e8-bb83-346b515d538b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.192055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271129bd-9a5c-49f5-8c68-35b291bb064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.193234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271129bd-9a5c-49f5-8c68-35b291bb064e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.193525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271129bd-9a5c-49f5-8c68-35b291bb064e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.195703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488197c-47b1-4418-9a7e-5306b27687b9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.196218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488197c-47b1-4418-9a7e-5306b27687b9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.196336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488197c-47b1-4418-9a7e-5306b27687b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.197807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271129bd-9a5c-49f5-8c68-35b291bb064e admin admin] PATH_INFO: `/v3/projects/70fb96c4276944649ea075bcb4100ea9/users/f079df47e395467aa299a8c843df5a66/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.214931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271129bd-9a5c-49f5-8c68-35b291bb064e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fb96c4276944649ea075bcb4100ea9, user_id=f079df47e395467aa299a8c843df5a66, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.217865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271129bd-9a5c-49f5-8c68-35b291bb064e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:06.237561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3488197c-47b1-4418-9a7e-5306b27687b9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:06.241163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3488197c-47b1-4418-9a7e-5306b27687b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.254896 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3479/6999] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:06 2022] PUT /identity/v3/projects/70fb96c4276944649ea075bcb4100ea9/users/f079df47e395467aa299a8c843df5a66/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:06.270000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49addb7f-9edf-4b7a-9fab-c420a9fe5116 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.270294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49addb7f-9edf-4b7a-9fab-c420a9fe5116 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.270601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49addb7f-9edf-4b7a-9fab-c420a9fe5116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.335829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-49addb7f-9edf-4b7a-9fab-c420a9fe5116 None None] MFA Rules not processed for user `f079df47e395467aa299a8c843df5a66`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:06.338044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-49addb7f-9edf-4b7a-9fab-c420a9fe5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.386027 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3521/7000] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:06.392078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488197c-47b1-4418-9a7e-5306b27687b9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:06.416882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488197c-47b1-4418-9a7e-5306b27687b9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.423293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.423983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.424265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.424541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.425322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:06.425632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.427277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:06.430055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:06.443021 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3522/7001] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:06.443961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:06.449000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.489378 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3480/7002] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:06.490390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49addb7f-9edf-4b7a-9fab-c420a9fe5116 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:06.503121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49addb7f-9edf-4b7a-9fab-c420a9fe5116 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.515137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.515946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.516332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.516712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.517585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.520403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:06.540358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda326e3-5d4c-487e-8476-831567b13d55 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.544851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.545588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.546070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.546355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.548411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.565783 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3481/7003] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:06 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:06.566946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:06.569019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.659967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.661435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:06.684239 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3523/7004] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:06.685282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:06.722083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f95b9d-99a3-46e3-9579-4fb4b0ea3ebe service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.722806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf18ef-a510-41dc-b431-521c50cab775 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.732299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.733667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.734240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.734412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.738959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:06.804744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:06.889930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.891091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.894279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.894612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.895387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.897419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:06.907280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.910163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:06.933088 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3482/7005] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:06.949767 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3524/7006] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:06 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:06.953459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:06.980596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330544d-20d8-44af-a71c-2598af3ab22b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:06.991042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:06.991761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:06.992049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:06.992326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:06.996008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:06.997872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:07.031003 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3483/7007] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:07.035248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:07.051126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d6ec4-082c-4298-9af6-ae94e50d8910 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:07.064352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8a250-0264-4590-af6e-509645f6a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:07.065364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a250-0264-4590-af6e-509645f6a106 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:07.066014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a250-0264-4590-af6e-509645f6a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:07.067648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8a250-0264-4590-af6e-509645f6a106 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:07.070830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8a250-0264-4590-af6e-509645f6a106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:07.073795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8a250-0264-4590-af6e-509645f6a106 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:07.110353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:07.112015 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3525/7008] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:07.130840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18802803-2f78-4682-b92b-ebd40be004cc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:07.143143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:07.144446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:07.144706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:07.145069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] PATH_INFO: `/v3/projects/9fe7a5f731e54e54a71647b5e63e70b1/users/94f056e08209489898c02dc73e910873/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:07.170459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe7a5f731e54e54a71647b5e63e70b1, user_id=94f056e08209489898c02dc73e910873, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:07.179008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:07.212309 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3484/7009] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:07 2022] PUT /identity/v3/projects/9fe7a5f731e54e54a71647b5e63e70b1/users/94f056e08209489898c02dc73e910873/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:07.219019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06614e-f19e-4a96-9b25-fd333dfca492 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:07.220179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06614e-f19e-4a96-9b25-fd333dfca492 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:07.220659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06614e-f19e-4a96-9b25-fd333dfca492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:07.302858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-db06614e-f19e-4a96-9b25-fd333dfca492 None None] MFA Rules not processed for user `94f056e08209489898c02dc73e910873`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:07.304192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-db06614e-f19e-4a96-9b25-fd333dfca492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:07.474094 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3526/7010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:07.474736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:07.551148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:07.589275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e79bf-bec5-4707-b385-768aa3e37773 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:07.597374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:07.598198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:07.598673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:07.598782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:07.599474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:07.602074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:07.642550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3485/7011] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:07 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:07.649232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06614e-f19e-4a96-9b25-fd333dfca492 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:07.676350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06614e-f19e-4a96-9b25-fd333dfca492 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:07.750316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:07.803373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:07.804468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:07.804896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:07.805863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:07.807654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:07.810489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:07.841744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3527/7012] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:07 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:07.843654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:07.845786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:07.870244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105d44c-f7d5-4a57-9fcd-b0470b8dfc91 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:07.875546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:07.876559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:07.876919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:07.877294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] PATH_INFO: `/v3/users/1e582eb88d6740c1bf28911a53bd08c0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:07.878668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e582eb88d6740c1bf28911a53bd08c0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:07.880740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:07.895972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc440c9-afb7-420c-99c9-13166068905f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:07.900344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:07.901153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:07.901446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:07.901894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:07.904383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:07.912880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:07.946877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e582eb88d6740c1bf28911a53bd08c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:07.947706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e582eb88d6740c1bf28911a53bd08c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:07.976713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e582eb88d6740c1bf28911a53bd08c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:07.977546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e582eb88d6740c1bf28911a53bd08c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:07.988958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e582eb88d6740c1bf28911a53bd08c0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:08.009576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3528/7013] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:07 2022] DELETE /identity/v3/users/1e582eb88d6740c1bf28911a53bd08c0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:08.012588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.014006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:08.029138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.030745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.051198 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3486/7014] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:08.113748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ebb6-dbd3-43c4-902f-19fba13f4ce4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.120912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.122311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.122607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.123357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.123719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.125389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.144320 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3529/7015] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:08.148677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.163541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5bb31-9c24-41f2-835a-ba4018cc9b78 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.172168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.173875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.173875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.174105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] PATH_INFO: `/v3/projects/0e35a1d51e1c45989dea1e26e6c97c34/users/12dac2b09cc84a4fbe29d889d4bf9a0c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.203548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e35a1d51e1c45989dea1e26e6c97c34, user_id=12dac2b09cc84a4fbe29d889d4bf9a0c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.207885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.234494 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3487/7016] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:08 2022] PUT /identity/v3/projects/0e35a1d51e1c45989dea1e26e6c97c34/users/12dac2b09cc84a4fbe29d889d4bf9a0c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:08.238906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.253822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbcb39-bd70-4564-93c9-7810a89359fe admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.332070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.335683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:08.337606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.338409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.338953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.339240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.340609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.343125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.354344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62f97-4eeb-4a62-ba4c-12f21786723d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.361553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.361791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.362051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.362324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] PATH_INFO: `/v3/projects/9ccc2b1d2c4a49b59046bfc71b862519` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.364639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ccc2b1d2c4a49b59046bfc71b862519)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.367043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.368427 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3530/7017] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:08.369454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.387649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b8b1-706b-4ba9-8bd5-73e22a4af4c1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.392971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df007ab-4a66-42c2-b590-892e2be0c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.393907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df007ab-4a66-42c2-b590-892e2be0c87f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.394189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df007ab-4a66-42c2-b590-892e2be0c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.394464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df007ab-4a66-42c2-b590-892e2be0c87f admin admin] PATH_INFO: `/v3/projects/0e35a1d51e1c45989dea1e26e6c97c34/users/12dac2b09cc84a4fbe29d889d4bf9a0c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.396887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df007ab-4a66-42c2-b590-892e2be0c87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e35a1d51e1c45989dea1e26e6c97c34, user_id=12dac2b09cc84a4fbe29d889d4bf9a0c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.399594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df007ab-4a66-42c2-b590-892e2be0c87f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.417502 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3531/7018] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:08 2022] PUT /identity/v3/projects/0e35a1d51e1c45989dea1e26e6c97c34/users/12dac2b09cc84a4fbe29d889d4bf9a0c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:08.429306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2e1f-83ad-4966-8970-3ac7bd053d79 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.429620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2e1f-83ad-4966-8970-3ac7bd053d79 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.429810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d2e1f-83ad-4966-8970-3ac7bd053d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.442697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:08.458983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ccc2b1d2c4a49b59046bfc71b862519', 'request_id': 'req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:08.468334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fa1d2e1f-83ad-4966-8970-3ac7bd053d79 None None] MFA Rules not processed for user `12dac2b09cc84a4fbe29d889d4bf9a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:08.469607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fa1d2e1f-83ad-4966-8970-3ac7bd053d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:08.470760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ccc2b1d2c4a49b59046bfc71b862519', 'request_id': 'req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:08.480577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:08.485216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ccc2b1d2c4a49b59046bfc71b862519', 'request_id': 'req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:08.508360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] The token cache is being invalidate because project 9ccc2b1d2c4a49b59046bfc71b862519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:08.509500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:08.510504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ff3f2d7a-5a9c-4e96-b7a3-f51b9216db16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:08.517072 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3488/7019] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:08 2022] DELETE /identity/v3/projects/9ccc2b1d2c4a49b59046bfc71b862519 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:08.518492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dd59e-6e86-436f-8294-0a73e1ea4b1d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.518854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dd59e-6e86-436f-8294-0a73e1ea4b1d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.519211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dd59e-6e86-436f-8294-0a73e1ea4b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.553886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2a2dd59e-6e86-436f-8294-0a73e1ea4b1d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:08.555225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2a2dd59e-6e86-436f-8294-0a73e1ea4b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:08.585629 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3532/7020] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:08.590102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d2e1f-83ad-4966-8970-3ac7bd053d79 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.603721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d2e1f-83ad-4966-8970-3ac7bd053d79 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.612041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12dac2b09cc84a4fbe29d889d4bf9a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e35a1d51e1c45989dea1e26e6c97c34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.613250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.613707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.614164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.615328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:08.615811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.618293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.646264 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3489/7021] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:08.653693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3533/7022] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:08.654727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36964364-bc2e-4dde-b749-b069985a2fed None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.655613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36964364-bc2e-4dde-b749-b069985a2fed None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.656624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.657009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36964364-bc2e-4dde-b749-b069985a2fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.683079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcd0a3-08aa-4912-bd57-b1abcd88b8cd tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.691979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12dac2b09cc84a4fbe29d889d4bf9a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e35a1d51e1c45989dea1e26e6c97c34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.693436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.694608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.695118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.696453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.698998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.708331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-36964364-bc2e-4dde-b749-b069985a2fed None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:08.709761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36964364-bc2e-4dde-b749-b069985a2fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:08.731597 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3490/7023] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:08.732618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36964364-bc2e-4dde-b749-b069985a2fed None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.746821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36964364-bc2e-4dde-b749-b069985a2fed None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.750280 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3534/7024] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:08 2022] POST /identity/v3/projects => generated 349 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:08.753877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.836952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b67e1-efd0-48ca-a00a-9cfa8bfdc9a8 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.842795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12dac2b09cc84a4fbe29d889d4bf9a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e35a1d51e1c45989dea1e26e6c97c34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.843542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.843768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.844043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.844839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:08.845124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.846868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.864840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3535/7025] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:08.865229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.865993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.866386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.866735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.867549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:08.867962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.869881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.871896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.874177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:08.885195 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3491/7026] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:28:08.890639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.901320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c973201-85b2-4833-915e-82cafee5a0c8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.906238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:08.906969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:08.907335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:08.907675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:08.908471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:08.911756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:08.949366 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3492/7027] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:08 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:08.953098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:08.969716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30080-da03-4372-8ef9-79507adc1280 tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:08.990019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:09.025772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:09.040076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:09.040863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:09.041893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:09.042177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:09.070984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda4fca-0735-4205-b271-748ffc449212 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:09.077487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:09.078603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:09.079078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:09.079515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:09.080483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:09.085290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:09.113467 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3493/7028] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:08 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:09.117348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:09.124105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:09.126279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:09.130301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1868a-7df8-40d3-8ffc-3e303d9e787c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:09.137428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:09.139174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:09.139476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:09.139802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:09.140558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:09.143738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:09.143951 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3536/7029] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:09.161103 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3494/7030] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:09.164522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:09.178101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dea9e7-b649-449d-8405-923ff123b129 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:09.183081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befa1c4-7e54-42e9-8ba4-a063dd497b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:09.183844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa1c4-7e54-42e9-8ba4-a063dd497b5a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:09.184120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa1c4-7e54-42e9-8ba4-a063dd497b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:09.184390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa1c4-7e54-42e9-8ba4-a063dd497b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:09.185162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa1c4-7e54-42e9-8ba4-a063dd497b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:09.186939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa1c4-7e54-42e9-8ba4-a063dd497b5a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:09.210379 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3537/7031] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:09.210811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:09.227300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0940bf-4f23-4a12-9dfc-d839530e18f5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:09.232758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:09.234244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:09.234526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:09.234802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] PATH_INFO: `/v3/projects/44001d561e9f47a3a9981075fda8a9ee/users/654c2c17af464af2940f09d5e0cdbacf/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:09.258503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44001d561e9f47a3a9981075fda8a9ee, user_id=654c2c17af464af2940f09d5e0cdbacf, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:09.265005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:09.293551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021352fb-76b0-4ce8-994e-077a63af02b5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:09.294300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021352fb-76b0-4ce8-994e-077a63af02b5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:09.294559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021352fb-76b0-4ce8-994e-077a63af02b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:09.296263 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3495/7032] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:09 2022] PUT /identity/v3/projects/44001d561e9f47a3a9981075fda8a9ee/users/654c2c17af464af2940f09d5e0cdbacf/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:09.329786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-021352fb-76b0-4ce8-994e-077a63af02b5 None None] MFA Rules not processed for user `654c2c17af464af2940f09d5e0cdbacf`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:09.331221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-021352fb-76b0-4ce8-994e-077a63af02b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:09.419408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3538/7033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:09.427477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:09.429786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:09.571423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2653-78d9-4757-baf6-52403da174d7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:09.587734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac161c3-f8b1-4883-a4c6-e3e161fbe325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:09.590511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac161c3-f8b1-4883-a4c6-e3e161fbe325 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:09.591241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac161c3-f8b1-4883-a4c6-e3e161fbe325 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:09.591525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac161c3-f8b1-4883-a4c6-e3e161fbe325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:09.618572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac161c3-f8b1-4883-a4c6-e3e161fbe325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:09.625285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac161c3-f8b1-4883-a4c6-e3e161fbe325 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:09.647697 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3496/7034] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:09.984182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021352fb-76b0-4ce8-994e-077a63af02b5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:10.058872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:10.079093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021352fb-76b0-4ce8-994e-077a63af02b5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:10.085250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:10.086380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:10.086684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:10.087053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] PATH_INFO: `/v3/users/654c2c17af464af2940f09d5e0cdbacf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:10.089745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654c2c17af464af2940f09d5e0cdbacf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:10.093199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:10.163781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654c2c17af464af2940f09d5e0cdbacf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:10.164737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654c2c17af464af2940f09d5e0cdbacf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:10.183680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654c2c17af464af2940f09d5e0cdbacf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:10.184426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654c2c17af464af2940f09d5e0cdbacf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:10.195178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654c2c17af464af2940f09d5e0cdbacf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:10.212208 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3539/7035] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:09 2022] DELETE /identity/v3/users/654c2c17af464af2940f09d5e0cdbacf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:10.217072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:10.217923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:10.218203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:10.239142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:10.240375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:10.325868 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3497/7036] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:10.337161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:10.338662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:10.431404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002545d-034b-4c59-8247-4d5b3b33d4d6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:10.436201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b8d9d-0425-42a9-8cbf-73fae99f131a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:10.437162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b8d9d-0425-42a9-8cbf-73fae99f131a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:10.437706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b8d9d-0425-42a9-8cbf-73fae99f131a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:10.438042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b8d9d-0425-42a9-8cbf-73fae99f131a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:10.454249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b8d9d-0425-42a9-8cbf-73fae99f131a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:10.463816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b8d9d-0425-42a9-8cbf-73fae99f131a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:10.487522 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3540/7037] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:11.741235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:11.744145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:11.763281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34016ee3-f9c7-4133-a6e9-8fb64cfe5bd8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:11.772322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:11.773408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:11.773937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:11.774288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] PATH_INFO: `/v3/projects/44001d561e9f47a3a9981075fda8a9ee` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:11.776136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44001d561e9f47a3a9981075fda8a9ee)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:11.779314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:11.796497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:11.912635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44001d561e9f47a3a9981075fda8a9ee', 'request_id': 'req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:11.945867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44001d561e9f47a3a9981075fda8a9ee', 'request_id': 'req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:11.969526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44001d561e9f47a3a9981075fda8a9ee', 'request_id': 'req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:11.983994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] The token cache is being invalidate because project 44001d561e9f47a3a9981075fda8a9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:11.984615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:11.985691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ecb0955f-1cb9-4fcc-a256-51e05d2ab691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:11.987772 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3498/7038] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:11 2022] DELETE /identity/v3/projects/44001d561e9f47a3a9981075fda8a9ee => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:11.999716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211578-b95c-450a-ab70-2617af2f22cb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.000192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211578-b95c-450a-ab70-2617af2f22cb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.001161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211578-b95c-450a-ab70-2617af2f22cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.042669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8f211578-b95c-450a-ab70-2617af2f22cb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:12.044225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8f211578-b95c-450a-ab70-2617af2f22cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:12.186982 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3541/7039] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:12.189572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ea0fd-583c-4885-b11d-3283f45fa99d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.189900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ea0fd-583c-4885-b11d-3283f45fa99d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.190183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ea0fd-583c-4885-b11d-3283f45fa99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.211182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c67ea0fd-583c-4885-b11d-3283f45fa99d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:12.213425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c67ea0fd-583c-4885-b11d-3283f45fa99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:12.227962 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3499/7040] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:12.232548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211578-b95c-450a-ab70-2617af2f22cb None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.243706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211578-b95c-450a-ab70-2617af2f22cb None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.249663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.250670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.251169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.251637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.252380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:12.252688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.254392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:12.262680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:12.273547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ea0fd-583c-4885-b11d-3283f45fa99d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.281850 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3542/7041] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:28:12.286933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ea0fd-583c-4885-b11d-3283f45fa99d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.291725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.292596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.293126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.293456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.294245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.296306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:12.337657 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3500/7042] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:12 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:12.341879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.353183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8304d1-21eb-42e7-99a8-291c1825a9c3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.432245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.437868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.438161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.438856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.439721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.441587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:12.476887 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3543/7043] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:12 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:12.477086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.495314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.499674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab70e65-69b8-46b9-ac17-16ebceb1b31e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.501754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:12.513281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.513987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.514269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.514715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.517607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.519967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:12.529696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1f36-c6e6-44d2-b79b-375e2094e590 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.535714 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3501/7044] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:12.539011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.539952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.540215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.540320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.540492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] PATH_INFO: `/v3/users/2b6d36bff3c94a1eb74330d86296516d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.544558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6d36bff3c94a1eb74330d86296516d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.546580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:12.556447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c4503-f011-4851-90f0-3fa6b0c78d17 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.564779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.567415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.568222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.568832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.571034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.574039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:12.592347 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3502/7045] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:12.602204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.618772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ea14b-4e5f-487d-88d6-e0c67e54aa47 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.624939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96796e49-9f22-4af9-8405-72b64d335e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.626244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96796e49-9f22-4af9-8405-72b64d335e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.626530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96796e49-9f22-4af9-8405-72b64d335e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.626806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96796e49-9f22-4af9-8405-72b64d335e45 admin admin] PATH_INFO: `/v3/projects/0344b5559b4146ac892f9c4d2648374c/users/b25c977b5dc549869498e57b33f4ce87/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.632393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6d36bff3c94a1eb74330d86296516d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:12.633111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6d36bff3c94a1eb74330d86296516d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:12.648336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96796e49-9f22-4af9-8405-72b64d335e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0344b5559b4146ac892f9c4d2648374c, user_id=b25c977b5dc549869498e57b33f4ce87, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.651593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96796e49-9f22-4af9-8405-72b64d335e45 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:12.663321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6d36bff3c94a1eb74330d86296516d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:12.664635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6d36bff3c94a1eb74330d86296516d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:12.676846 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3503/7046] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:12 2022] PUT /identity/v3/projects/0344b5559b4146ac892f9c4d2648374c/users/b25c977b5dc549869498e57b33f4ce87/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:12.677202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64760c6c-fe11-4b70-b2da-73bcc75ca292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6d36bff3c94a1eb74330d86296516d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:12.698754 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3544/7047] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:12 2022] DELETE /identity/v3/users/2b6d36bff3c94a1eb74330d86296516d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:12.703898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.704926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.705513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.732140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:12.734128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:12.762437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.763183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.764147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.797379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] MFA Rules not processed for user `b25c977b5dc549869498e57b33f4ce87`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:12.799110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:12.833165 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3504/7048] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:12.847942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.851110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:12.889615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:12.915331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:12.963621 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3545/7049] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:12.964660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:12.964791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdffc7-b5a9-4d8b-8384-1f0e0e4fc5e5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:12.968139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:12.968481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:12.969198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:12.969568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:12.970134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:12.984246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:12.986452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.006811 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3505/7050] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:13.010585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60284a1-033a-4749-9005-b63c543bcc58 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.022201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.023032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.023310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.023580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.024293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.029061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.079277 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3546/7051] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:12 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:13.083639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:13.099361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292132-926c-4298-a05d-629676ae8547 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.221459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:13.223640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:13.272936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.274159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.275561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.276120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.277252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.280233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.341463 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3506/7052] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:13 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:13.342526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:13.356077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebe03c-a53b-4ecb-8889-100b62967867 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.361840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.362779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.362894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.363119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.364035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.366351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.383869 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3507/7053] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:13.384396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046983-bb92-41e0-b621-ae37ed989e1d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.384813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:13.393782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12dac2b09cc84a4fbe29d889d4bf9a0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e35a1d51e1c45989dea1e26e6c97c34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.394696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.394967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.395244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] PATH_INFO: `/v3/projects/9290d2ec6a3d4a5395ddd8de64529d04` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.396343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6e762-25ee-423e-8245-d3b259b0ba9d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.397581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9290d2ec6a3d4a5395ddd8de64529d04)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.399575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.403146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.404493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.404823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.405130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] PATH_INFO: `/v3/projects/cac94f3d6c6f42439be80d604aeea8a1/users/625dfee7bf814b4ab564265d960016f0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.440854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac94f3d6c6f42439be80d604aeea8a1, user_id=625dfee7bf814b4ab564265d960016f0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.446133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.470346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9290d2ec6a3d4a5395ddd8de64529d04', 'request_id': 'req-fecc7eef-1438-4213-921f-144d7673010d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.475229 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3508/7054] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:13 2022] PUT /identity/v3/projects/cac94f3d6c6f42439be80d604aeea8a1/users/625dfee7bf814b4ab564265d960016f0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:13.478884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9290d2ec6a3d4a5395ddd8de64529d04', 'request_id': 'req-fecc7eef-1438-4213-921f-144d7673010d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.479175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:13.495446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9290d2ec6a3d4a5395ddd8de64529d04', 'request_id': 'req-fecc7eef-1438-4213-921f-144d7673010d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.510482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] The token cache is being invalidate because project 9290d2ec6a3d4a5395ddd8de64529d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:13.510824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.511500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.520335 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3547/7055] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:13 2022] DELETE /identity/v3/projects/9290d2ec6a3d4a5395ddd8de64529d04 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:13.521441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:13.522862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:13.608928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:13.619740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7eef-1438-4213-921f-144d7673010d tempest-QuotasNegativeTest-1322120979 tempest-QuotasNegativeTest-1322120979-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.653832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221e0a5-9455-49c7-a531-a6a90f5e2eca admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.682213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.683881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.685989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.685989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.686606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.694844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.729011 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3509/7056] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:13.732473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:13.735731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:13.762480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.763458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.763697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.763983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] PATH_INFO: `/v3/users/94f056e08209489898c02dc73e910873` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.765677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f056e08209489898c02dc73e910873)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.768288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.775238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc467cf8-775e-4361-a6a9-e41d6c93c83b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:13.787780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd628fbe-f127-4d4c-a161-b6c8c50c017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:13.791165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd628fbe-f127-4d4c-a161-b6c8c50c017f admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.791484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd628fbe-f127-4d4c-a161-b6c8c50c017f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.791775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd628fbe-f127-4d4c-a161-b6c8c50c017f admin admin] PATH_INFO: `/v3/projects/cac94f3d6c6f42439be80d604aeea8a1/users/625dfee7bf814b4ab564265d960016f0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.797107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd628fbe-f127-4d4c-a161-b6c8c50c017f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac94f3d6c6f42439be80d604aeea8a1, user_id=625dfee7bf814b4ab564265d960016f0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:13.799812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd628fbe-f127-4d4c-a161-b6c8c50c017f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:13.807673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:13.814032 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3510/7057] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:13 2022] PUT /identity/v3/projects/cac94f3d6c6f42439be80d604aeea8a1/users/625dfee7bf814b4ab564265d960016f0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:13.826513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.826859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.827145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.830032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f056e08209489898c02dc73e910873'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.830787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f056e08209489898c02dc73e910873'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.853914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f056e08209489898c02dc73e910873'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.854769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f056e08209489898c02dc73e910873'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.888554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a94b89ed-55cc-435d-b7b7-c8d85298334c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f056e08209489898c02dc73e910873'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:13.910518 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3548/7058] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:13 2022] DELETE /identity/v3/users/94f056e08209489898c02dc73e910873 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:13.922365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:13.923007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:13.923424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:13.929268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] MFA Rules not processed for user `625dfee7bf814b4ab564265d960016f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:13.930529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:13.955344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:13.958529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.040735 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3549/7059] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:14.041984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.043604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.055122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3511/7060] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:14.055122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.055122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.067492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba734b3-5099-4f3d-a3e6-5d7b2006bf94 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.092320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.093318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.093598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.093877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] PATH_INFO: `/v3/projects/39a9dc50952e4973a4bc26a098eaccff` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.095203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a9dc50952e4973a4bc26a098eaccff)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.097813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.133879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:14.154854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7556e-f4fa-440e-aec8-c54994257c13 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.159955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.161306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.161605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.162160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.175900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.177505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.183602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a9dc50952e4973a4bc26a098eaccff', 'request_id': 'req-260b0760-4e31-47d1-8c5d-c191c01a4b6c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.193877 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3512/7061] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:14.194831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.197571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a9dc50952e4973a4bc26a098eaccff', 'request_id': 'req-260b0760-4e31-47d1-8c5d-c191c01a4b6c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.207745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b38cd-cd5b-4e61-ad31-5d11a46f2089 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.212833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a9dc50952e4973a4bc26a098eaccff', 'request_id': 'req-260b0760-4e31-47d1-8c5d-c191c01a4b6c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.245208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] The token cache is being invalidate because project 39a9dc50952e4973a4bc26a098eaccff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:14.246390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.247573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.252095 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3550/7062] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:14 2022] DELETE /identity/v3/projects/39a9dc50952e4973a4bc26a098eaccff => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:14.255100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.261339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.286479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.288079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.288673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.289216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.290209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.291700 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:14.291700 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:28:14.291700 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:14.293264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.328147 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3513/7063] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Jun 18 22:28:14 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:14.331184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.335596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.372450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e4d74-0f6f-49d7-b8ca-4fc323fcdabe tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.386820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.388193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.388634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.392536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a512c3e39cb14809b515c87aba304f4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.393454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a512c3e39cb14809b515c87aba304f4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.395411 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:14.395411 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:28:14.395411 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:14.398810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.417665 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3514/7064] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:28:14 2022] GET /identity/v3/OS-OAUTH1/consumers/a512c3e39cb14809b515c87aba304f4b => generated 221 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:14.421477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.426803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0760-4e31-47d1-8c5d-c191c01a4b6c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.438120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.439803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.440090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.440370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] PATH_INFO: `/v3/users/7e6a27c29a3a4f94a8f2c56b9727f963` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.445930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6a27c29a3a4f94a8f2c56b9727f963)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.447991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bf95-fbf5-4701-bd40-d8d146042ace tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.454414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.463320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.464412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.464937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.465581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a512c3e39cb14809b515c87aba304f4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.466671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a512c3e39cb14809b515c87aba304f4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.468433 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:14.468433 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:28:14.468433 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:14.471004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.471732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invalidating token cache because consumer a512c3e39cb14809b515c87aba304f4b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:14.472230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.473558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.497703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:14.508052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a512c3e39cb14809b515c87aba304f4b', 'request_id': 'req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.531535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3515/7065] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:28:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a512c3e39cb14809b515c87aba304f4b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:14.538321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.540355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.548081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6a27c29a3a4f94a8f2c56b9727f963'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.549249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6a27c29a3a4f94a8f2c56b9727f963'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.555279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb048-413c-4aa9-8299-60d1e3cb15c7 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.561319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.561981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.562272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.562732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.563266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.565284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.571974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6a27c29a3a4f94a8f2c56b9727f963'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.572815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6a27c29a3a4f94a8f2c56b9727f963'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.583317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6a27c29a3a4f94a8f2c56b9727f963'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.601610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3516/7066] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Jun 18 22:28:14 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:14.603637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.609431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.616572 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3551/7067] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:14 2022] DELETE /identity/v3/users/7e6a27c29a3a4f94a8f2c56b9727f963 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:14.627728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaea2b9-06f6-4d85-bc66-9af0a179ec28 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.692615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.694143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.695349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.695626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.696440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=db3e56035be241d793ebea98975a4c95)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.698240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.704928 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3517/7068] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:28:14 2022] GET /identity/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95 => generated 220 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:14.709261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.721257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995af9-0cf1-41fd-8f3a-1b5ac919b29c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.725916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.726768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.727052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.727326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.727988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=db3e56035be241d793ebea98975a4c95)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.729209 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:14.729209 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:28:14.729209 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:28:14.730042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.730538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invalidating token cache because consumer db3e56035be241d793ebea98975a4c95 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:14.730753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.731730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.758225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'db3e56035be241d793ebea98975a4c95', 'request_id': 'req-dfb8125e-de82-4c2c-9730-f4350dbec21d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.773849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:14.784933 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3552/7069] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:28:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:14.786857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.789769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.812256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff8f2-f676-431b-8c13-5ee0b3a57fee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.820372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.821386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.821715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.822030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.822725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=db3e56035be241d793ebea98975a4c95)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.827513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jun 18 22:28:14.859613 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jun 18 22:28:14.860764 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:28:14.865923 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3518/7070] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:28:14 2022] GET /identity/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95 => generated 74 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:28:14.866290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.890206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8125e-de82-4c2c-9730-f4350dbec21d tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.903581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.904543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.904900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.905272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.906136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=db3e56035be241d793ebea98975a4c95)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.907855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.908200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invalidating token cache because consumer db3e56035be241d793ebea98975a4c95 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:14.908574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.909362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jun 18 22:28:14.937468 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jun 18 22:28:14.939037 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:28:14.939645 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3553/7071] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:28:14 2022] DELETE /identity/v3/OS-OAUTH1/consumers/db3e56035be241d793ebea98975a4c95 => generated 74 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:28:14.944521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.947085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:14.963077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44002-8467-4a84-8593-17ddd4e864ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:14.969458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:14.970251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:14.970635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:14.971022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:14.971860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:14.973630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:14.994072 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3519/7072] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Jun 18 22:28:14 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:14.994570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.995163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:14.996349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.016983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9ff40-0e87-4ba0-858f-35537184b008 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.024217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.025894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.026342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.026910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.028335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.030607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.054185 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3520/7073] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Jun 18 22:28:14 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:15.058290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.078258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6a8d-c2e1-45e4-959e-bf2215971fa4 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.082887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d120e-c34b-4c8f-8b3e-527869f249ee tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.083461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.084445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.084821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.085273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] PATH_INFO: `/v3/projects/9fe7a5f731e54e54a71647b5e63e70b1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.087441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe7a5f731e54e54a71647b5e63e70b1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.089760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.089944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.091041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.091333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.091931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.092891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.095738 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:15.095738 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:28:15.095738 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:15.096981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.125863 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3521/7074] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Jun 18 22:28:15 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:15.127358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.140389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f2262-9fc3-4df8-a375-93dd39227cc5 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.171965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe7a5f731e54e54a71647b5e63e70b1', 'request_id': 'req-e6f91b65-ef78-47f4-a3fa-5978f241c488'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.184568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe7a5f731e54e54a71647b5e63e70b1', 'request_id': 'req-e6f91b65-ef78-47f4-a3fa-5978f241c488'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.201774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe7a5f731e54e54a71647b5e63e70b1', 'request_id': 'req-e6f91b65-ef78-47f4-a3fa-5978f241c488'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.217296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] The token cache is being invalidate because project 9fe7a5f731e54e54a71647b5e63e70b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:15.218069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.220353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.222689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.227350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.227350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.227350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/099ab4b773bb4b57bddd15318e838e04` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.227350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=099ab4b773bb4b57bddd15318e838e04)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.227811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.227811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invalidating token cache because consumer 099ab4b773bb4b57bddd15318e838e04 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:15.227811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.227811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.229912 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3554/7075] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:14 2022] DELETE /identity/v3/projects/9fe7a5f731e54e54a71647b5e63e70b1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:15.232248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.237272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.243869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '099ab4b773bb4b57bddd15318e838e04', 'request_id': 'req-c2adf6e6-872b-4a96-a911-4bdc42fc43db'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.267490 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3522/7076] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/OS-OAUTH1/consumers/099ab4b773bb4b57bddd15318e838e04 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:15.271814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.274227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.288420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adf6e6-872b-4a96-a911-4bdc42fc43db tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.293937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.294896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.295287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.295694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7f318114df694667b6a357f62de0555b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.296734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=7f318114df694667b6a357f62de0555b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.298648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.299030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invalidating token cache because consumer 7f318114df694667b6a357f62de0555b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:15.299413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.300248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.304601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:15.320024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '7f318114df694667b6a357f62de0555b', 'request_id': 'req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.348660 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3523/7077] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/OS-OAUTH1/consumers/7f318114df694667b6a357f62de0555b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:15.353777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.358161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.371045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ee98-2918-48d7-b51d-b2fa4525bb37 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.376700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.377480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.380581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.380581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.380767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91b65-ef78-47f4-a3fa-5978f241c488 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.380845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.380845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.385708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.386670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.387073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.387372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] PATH_INFO: `/v3/users/12dac2b09cc84a4fbe29d889d4bf9a0c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.388870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12dac2b09cc84a4fbe29d889d4bf9a0c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.391721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.401102 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3524/7078] 10.222.0.30 () {60 vars in 1184 bytes} [Sat Jun 18 22:28:15 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:15.405506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.407608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.424104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d040-3f35-4a89-a7f5-414c91f0d476 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.424440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:15.430518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.431372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.431670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.431974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] PATH_INFO: `/v3/projects/a00b2b10d1af41b196c501af992c3c71` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.434670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00b2b10d1af41b196c501af992c3c71)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.436668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.471900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12dac2b09cc84a4fbe29d889d4bf9a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.473098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12dac2b09cc84a4fbe29d889d4bf9a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.486926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12dac2b09cc84a4fbe29d889d4bf9a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.487815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12dac2b09cc84a4fbe29d889d4bf9a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.498460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12dac2b09cc84a4fbe29d889d4bf9a0c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.510039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00b2b10d1af41b196c501af992c3c71', 'request_id': 'req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.518221 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3555/7079] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/users/12dac2b09cc84a4fbe29d889d4bf9a0c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:15.520904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.522401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00b2b10d1af41b196c501af992c3c71', 'request_id': 'req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.529130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.535331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00b2b10d1af41b196c501af992c3c71', 'request_id': 'req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.548143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] The token cache is being invalidate because project a00b2b10d1af41b196c501af992c3c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:15.548436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.549145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.551141 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3525/7080] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/projects/a00b2b10d1af41b196c501af992c3c71 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:15.555503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.557140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.633353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f25b-e525-4929-8ed5-140e1e4eb575 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.640115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.642066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.643653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.644065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8c6700bc85474e969e16643bb0d530c3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.645019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=8c6700bc85474e969e16643bb0d530c3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.647268 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:15.647268 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:28:15.647268 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:28:15.648594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.678331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3556/7081] 10.222.0.30 () {60 vars in 1284 bytes} [Sat Jun 18 22:28:15 2022] PATCH /identity/v3/OS-OAUTH1/consumers/8c6700bc85474e969e16643bb0d530c3 => generated 220 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:15.678507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4db92-6647-424f-9d6f-de6fff2fe5c9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.679483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.682240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.723573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d1ae-8de3-43cc-aa0c-5fcfdec78a7c tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.734632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.736983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.738007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.738663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8c6700bc85474e969e16643bb0d530c3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.739743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=8c6700bc85474e969e16643bb0d530c3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.741332 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:15.741332 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:28:15.741332 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:28:15.743412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.754158 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3557/7082] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:28:15 2022] GET /identity/v3/OS-OAUTH1/consumers/8c6700bc85474e969e16643bb0d530c3 => generated 220 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:15.759011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.784256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b1b0a-045d-4b33-a1f2-cd6729bcb28f tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.791047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '625dfee7bf814b4ab564265d960016f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac94f3d6c6f42439be80d604aeea8a1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.792509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.793203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.793746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8c6700bc85474e969e16643bb0d530c3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.794624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8c6700bc85474e969e16643bb0d530c3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.796882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.797222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.797852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invalidating token cache because consumer 8c6700bc85474e969e16643bb0d530c3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:15.798222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.798919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.799211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] PATH_INFO: `/v3/users/1f4ca6ad1ab74ce1b20c21244323dfe0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.799551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.800766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.801977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4ca6ad1ab74ce1b20c21244323dfe0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.804298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.807277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:15.819877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8c6700bc85474e969e16643bb0d530c3', 'request_id': 'req-8861eebe-cc71-4837-b322-982471686725'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.852986 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3558/7083] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/OS-OAUTH1/consumers/8c6700bc85474e969e16643bb0d530c3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:15.865177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.867350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.891507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861eebe-cc71-4837-b322-982471686725 tempest-OAUTHConsumersV3Test-299108015 tempest-OAUTHConsumersV3Test-299108015-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:15.896177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4ca6ad1ab74ce1b20c21244323dfe0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.898115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4ca6ad1ab74ce1b20c21244323dfe0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.898269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:15.899040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:15.899325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:15.899715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] PATH_INFO: `/v3/users/b25c977b5dc549869498e57b33f4ce87` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:15.901300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25c977b5dc549869498e57b33f4ce87)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:15.903785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:15.924761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4ca6ad1ab74ce1b20c21244323dfe0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.925864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4ca6ad1ab74ce1b20c21244323dfe0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.934817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4ca6ad1ab74ce1b20c21244323dfe0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.951454 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3526/7084] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/users/1f4ca6ad1ab74ce1b20c21244323dfe0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:15.954990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:15.954990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:15.972645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25c977b5dc549869498e57b33f4ce87'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.973795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25c977b5dc549869498e57b33f4ce87'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.975785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:15.992848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25c977b5dc549869498e57b33f4ce87'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:15.994219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25c977b5dc549869498e57b33f4ce87'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:16.011305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ad835677-6c90-4a1c-a74d-850a8554a8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25c977b5dc549869498e57b33f4ce87'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:16.030869 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3559/7085] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/users/b25c977b5dc549869498e57b33f4ce87 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:16.035451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.036068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.036359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.060387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3518b46-4652-4ddb-ab84-1630c2ad4466 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.066907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:16.068781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:16.144053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.144879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.145173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.145447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] PATH_INFO: `/v3/projects/0e35a1d51e1c45989dea1e26e6c97c34` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.147025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e35a1d51e1c45989dea1e26e6c97c34)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.151262 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3560/7086] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:16.151814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.181592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.185897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:16.211947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:16.256271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e35a1d51e1c45989dea1e26e6c97c34', 'request_id': 'req-fff6d398-4ea0-4d5f-863d-8f55470934e0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:16.268892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e35a1d51e1c45989dea1e26e6c97c34', 'request_id': 'req-fff6d398-4ea0-4d5f-863d-8f55470934e0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:16.279300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e35a1d51e1c45989dea1e26e6c97c34', 'request_id': 'req-fff6d398-4ea0-4d5f-863d-8f55470934e0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:16.291499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2ba2b-e328-4f6c-98dc-ee070e397e9e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.296761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] The token cache is being invalidate because project 0e35a1d51e1c45989dea1e26e6c97c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:16.297307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:16.298185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fff6d398-4ea0-4d5f-863d-8f55470934e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:16.304271 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3527/7087] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:15 2022] DELETE /identity/v3/projects/0e35a1d51e1c45989dea1e26e6c97c34 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:16.307404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e8a4-0276-4fb2-bc53-ba3f1006d136 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.308012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e8a4-0276-4fb2-bc53-ba3f1006d136 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.308621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e8a4-0276-4fb2-bc53-ba3f1006d136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.345696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a3b8e8a4-0276-4fb2-bc53-ba3f1006d136 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:16.349983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a3b8e8a4-0276-4fb2-bc53-ba3f1006d136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:16.377792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.378646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.378899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.379327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.382743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:16.434227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:16.436909 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3528/7088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:16.445260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e7cf-f639-4abb-b7c9-fd1e29cfd910 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.446867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e7cf-f639-4abb-b7c9-fd1e29cfd910 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.449179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e7cf-f639-4abb-b7c9-fd1e29cfd910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.480983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-80b0e7cf-f639-4abb-b7c9-fd1e29cfd910 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:16.482928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-80b0e7cf-f639-4abb-b7c9-fd1e29cfd910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:16.485121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.486639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.498667 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3529/7089] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:16.500362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e7cf-f639-4abb-b7c9-fd1e29cfd910 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.507937 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3561/7090] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:16.522577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e7cf-f639-4abb-b7c9-fd1e29cfd910 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.528478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.529210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.529498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.529780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.530991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:16.531307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.532972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.556819 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3530/7091] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:28:16.557277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.571337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5c21-f438-4e20-8197-9a49455eb3d3 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.584617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.585605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.585886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.586159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.587041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.589775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.641080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3562/7092] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:16 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:16.644134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.656884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fafb1-6e25-4127-a369-43150c1149a2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.700981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.704097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:16.806352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.807472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.807754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.808063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.808775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.810916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.856931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3531/7093] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:16 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:16.860883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.879464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0986-1369-4fa0-bbec-b1ea4108f392 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.889561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221044c-4b59-4adb-abc7-3fe389592255 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.894716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.895940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.896406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.897279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] PATH_INFO: `/v3/projects/a1c84c6018f149f08b1ebd6853c06061` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.899602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c84c6018f149f08b1ebd6853c06061)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.903126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.903735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.903862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.904154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.904430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.905794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.907975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.921713 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3532/7094] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:16.925359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.939490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a23f8-049e-4ce5-8ffe-9e14cef760ed admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:16.945808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:16.945808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:16.946069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:16.946503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:16.947368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:16.949652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:16.963662 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3533/7095] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:16.967653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:16.981089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:16.987844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d30911-9ff0-428a-8043-0991cd81d942 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.002059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04a68-0f4c-4425-8615-e1af9bc90904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.004294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04a68-0f4c-4425-8615-e1af9bc90904 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.008110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04a68-0f4c-4425-8615-e1af9bc90904 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.008485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04a68-0f4c-4425-8615-e1af9bc90904 admin admin] PATH_INFO: `/v3/projects/d25232a6f8d9481fa02b00dacc5280ad/users/2e800ba202d54729b4c0c5b4aa0b4a01/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.016700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c84c6018f149f08b1ebd6853c06061', 'request_id': 'req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.028728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04a68-0f4c-4425-8615-e1af9bc90904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25232a6f8d9481fa02b00dacc5280ad, user_id=2e800ba202d54729b4c0c5b4aa0b4a01, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.034237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04a68-0f4c-4425-8615-e1af9bc90904 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.035575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c84c6018f149f08b1ebd6853c06061', 'request_id': 'req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.049102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c84c6018f149f08b1ebd6853c06061', 'request_id': 'req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.068211 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3534/7096] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:16 2022] PUT /identity/v3/projects/d25232a6f8d9481fa02b00dacc5280ad/users/2e800ba202d54729b4c0c5b4aa0b4a01/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:17.080543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.080836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.081149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.083737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] The token cache is being invalidate because project a1c84c6018f149f08b1ebd6853c06061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:17.084026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.084938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3264ecbd-0dcb-42c8-87d2-10fc131e1ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.091685 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3563/7097] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:16 2022] DELETE /identity/v3/projects/a1c84c6018f149f08b1ebd6853c06061 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:17.093642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01b49-7341-4ed9-b01c-dd8532e07ddc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.093799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01b49-7341-4ed9-b01c-dd8532e07ddc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.093993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01b49-7341-4ed9-b01c-dd8532e07ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.120114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-55d01b49-7341-4ed9-b01c-dd8532e07ddc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:17.120984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-55d01b49-7341-4ed9-b01c-dd8532e07ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.133420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] MFA Rules not processed for user `2e800ba202d54729b4c0c5b4aa0b4a01`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:17.136272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.156096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:17.228144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3564/7098] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:17.236450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaee2a-ba35-4bb7-aa24-858a66962f29 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.236745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaee2a-ba35-4bb7-aa24-858a66962f29 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.237044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaee2a-ba35-4bb7-aa24-858a66962f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.257350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5dbaee2a-ba35-4bb7-aa24-858a66962f29 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:17.258726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5dbaee2a-ba35-4bb7-aa24-858a66962f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.270981 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3535/7099] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:17.272778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.278581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3565/7100] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:17.280438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaee2a-ba35-4bb7-aa24-858a66962f29 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.285277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.294516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaee2a-ba35-4bb7-aa24-858a66962f29 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.300362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.303794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.304105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.304387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.305398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:17.305643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.308088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.323897 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3566/7101] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:17.328989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.330579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10c05-82c1-4c8b-909c-4ca4612d89f1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.331051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.350122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.351061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.351576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.351857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] PATH_INFO: `/v3/projects/0344b5559b4146ac892f9c4d2648374c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.356776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0344b5559b4146ac892f9c4d2648374c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.359736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.421348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ca710-4805-4609-bc58-448f3934b3a0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.431692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0344b5559b4146ac892f9c4d2648374c', 'request_id': 'req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.441218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0344b5559b4146ac892f9c4d2648374c', 'request_id': 'req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.454066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0344b5559b4146ac892f9c4d2648374c', 'request_id': 'req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.469425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] The token cache is being invalidate because project 0344b5559b4146ac892f9c4d2648374c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:17.469888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.470693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.472824 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3536/7102] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:17 2022] DELETE /identity/v3/projects/0344b5559b4146ac892f9c4d2648374c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:17.475071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.476685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.516211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.517294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.517785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.518208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.520681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.548189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:17.566052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b9aae-cbdc-439a-97f8-4033c3f4fa71 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.572498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.574022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.574651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.575309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.576226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.579409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.600674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.602757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.618272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3567/7103] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:17.619206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.621926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.639152 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3537/7104] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:17 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:17.639574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa84ef-180b-458a-92f9-fb734a98ba3c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.643172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.695105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:17.741599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14ba0d-8155-493d-bfc0-4564b8be465d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.742451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.743630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.744018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.744589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] PATH_INFO: `/v3/users/625dfee7bf814b4ab564265d960016f0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.746207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625dfee7bf814b4ab564265d960016f0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.749455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.750349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.751265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.751846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.752323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.753548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.755751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.793558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3538/7105] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:17 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:17.797868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.810722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941965b-14d1-4adb-a2e9-3126577a7f8e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.816929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.817711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.818060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.818426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.819961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.821501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625dfee7bf814b4ab564265d960016f0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.822128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.822273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625dfee7bf814b4ab564265d960016f0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.834366 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3539/7106] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:17.838903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:17.844910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:17.859237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625dfee7bf814b4ab564265d960016f0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.860244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625dfee7bf814b4ab564265d960016f0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.871516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625dfee7bf814b4ab564265d960016f0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:17.878364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8179f90-6e42-4d74-9783-42fe7f8bce51 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:17.889676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefed63d-fbab-4628-9e71-89c91bde0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:17.893534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed63d-fbab-4628-9e71-89c91bde0197 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:17.893822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed63d-fbab-4628-9e71-89c91bde0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:17.894242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed63d-fbab-4628-9e71-89c91bde0197 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:17.898067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefed63d-fbab-4628-9e71-89c91bde0197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:17.899677 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3568/7107] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:17 2022] DELETE /identity/v3/users/625dfee7bf814b4ab564265d960016f0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:17.902529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefed63d-fbab-4628-9e71-89c91bde0197 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:17.940150 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3540/7108] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:17.940745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:18.061887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27404b06-df7f-4174-a20d-970488c706c9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:18.076564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:18.077520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:18.077797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:18.078124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] PATH_INFO: `/v3/projects/d2657072934844f9952c9c5e6b383d77/users/8bf0e99cc3bf40f29a8c1e6023718c56/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:18.100190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2657072934844f9952c9c5e6b383d77, user_id=8bf0e99cc3bf40f29a8c1e6023718c56, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:18.103803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:18.122900 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3569/7109] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:17 2022] PUT /identity/v3/projects/d2657072934844f9952c9c5e6b383d77/users/8bf0e99cc3bf40f29a8c1e6023718c56/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:18.137009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:18.138000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:18.138430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:18.178908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] MFA Rules not processed for user `8bf0e99cc3bf40f29a8c1e6023718c56`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:18.180200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:18.271865 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3541/7110] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:18.282008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:18.284951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:18.339598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:18.374450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445a93f-4d70-47d4-bc69-e29810c68e4a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:18.378289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bab329-b3a0-4a07-98f8-196ca2c73ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:18.379167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab329-b3a0-4a07-98f8-196ca2c73ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:18.379522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab329-b3a0-4a07-98f8-196ca2c73ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:18.379865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bab329-b3a0-4a07-98f8-196ca2c73ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:18.390218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bab329-b3a0-4a07-98f8-196ca2c73ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:18.391815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bab329-b3a0-4a07-98f8-196ca2c73ca9 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:18.406527 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3570/7111] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:18.800023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:18.805433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:18.889713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:18.923383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e7a2a-252b-4558-a12e-6703ebfb4d02 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:18.930472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:18.931420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:18.931705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:18.931988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] PATH_INFO: `/v3/projects/cac94f3d6c6f42439be80d604aeea8a1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:18.934474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac94f3d6c6f42439be80d604aeea8a1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:18.937949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:18.998057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac94f3d6c6f42439be80d604aeea8a1', 'request_id': 'req-184be54e-760b-4868-9c1e-9b1322a30fc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:19.005227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac94f3d6c6f42439be80d604aeea8a1', 'request_id': 'req-184be54e-760b-4868-9c1e-9b1322a30fc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:19.014664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac94f3d6c6f42439be80d604aeea8a1', 'request_id': 'req-184be54e-760b-4868-9c1e-9b1322a30fc0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:19.028610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] The token cache is being invalidate because project cac94f3d6c6f42439be80d604aeea8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:19.028996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:19.030860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-184be54e-760b-4868-9c1e-9b1322a30fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:19.033312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3542/7112] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:18 2022] DELETE /identity/v3/projects/cac94f3d6c6f42439be80d604aeea8a1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:19.038818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45a01-1e8a-46df-ac2c-d4d376f0fa60 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.039110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45a01-1e8a-46df-ac2c-d4d376f0fa60 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.039479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45a01-1e8a-46df-ac2c-d4d376f0fa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.062776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-03b45a01-1e8a-46df-ac2c-d4d376f0fa60 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:19.064518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-03b45a01-1e8a-46df-ac2c-d4d376f0fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:19.176342 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3571/7113] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:19.186687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5299-0cab-4b3a-bf07-de92712ba463 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.188028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5299-0cab-4b3a-bf07-de92712ba463 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.189144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5299-0cab-4b3a-bf07-de92712ba463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.242321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c6ba5299-0cab-4b3a-bf07-de92712ba463 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:19.243633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6ba5299-0cab-4b3a-bf07-de92712ba463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:19.253136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3543/7114] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:19.258194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45a01-1e8a-46df-ac2c-d4d376f0fa60 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.278279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45a01-1e8a-46df-ac2c-d4d376f0fa60 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:19.286902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:19.289310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.289596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.290027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.291690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:19.292532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:19.295369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:19.332597 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3572/7115] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:19.337646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba5299-0cab-4b3a-bf07-de92712ba463 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.348644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba5299-0cab-4b3a-bf07-de92712ba463 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:19.353887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:19.354578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.354906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.355307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.356019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:19.358006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:19.397813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3544/7116] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:19 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:19.402705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.421187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eafbf-95a7-45b0-aca6-0b9e4adca62d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:19.422204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.425930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:19.532989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca4e92-37a2-49ec-a240-1ee83e63fd75 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:19.533195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:19.533960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.534472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.535069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.536472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:19.538500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:19.539452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.539841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:19.540169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.540825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.543040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:19.584970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3573/7117] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:19 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:19.590706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.616757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea5bb7-3e5f-4ab7-9a0f-bef92542b3d0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:19.631473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:19.632928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.633346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.633729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.634587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:19.637082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:19.645836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:19.654575 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3574/7118] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:19.659155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.676355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f10e31-5d43-4c7e-95fe-e03148ffd0ac admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:19.682683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:19.683484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7836d97-51cd-4e99-bc26-c306585a8f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:19.684341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:19.685022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836d97-51cd-4e99-bc26-c306585a8f7f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.685340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836d97-51cd-4e99-bc26-c306585a8f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.685634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7836d97-51cd-4e99-bc26-c306585a8f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.686364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7836d97-51cd-4e99-bc26-c306585a8f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:19.697185 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3545/7119] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:19.698564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7836d97-51cd-4e99-bc26-c306585a8f7f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:19.722233 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3575/7120] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:19.726766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.740780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5741666-e3d4-4d58-8e3a-88f3331b123b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:19.748613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e989bf1-2131-45ac-849e-17eaf07e7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:19.749857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989bf1-2131-45ac-849e-17eaf07e7448 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.750567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989bf1-2131-45ac-849e-17eaf07e7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.750965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e989bf1-2131-45ac-849e-17eaf07e7448 admin admin] PATH_INFO: `/v3/projects/e6571c9508c7461b9fcc79d0501f3387/users/a18429154aee49e09fa4b916cf33174d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.768203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e989bf1-2131-45ac-849e-17eaf07e7448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6571c9508c7461b9fcc79d0501f3387, user_id=a18429154aee49e09fa4b916cf33174d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:19.771342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e989bf1-2131-45ac-849e-17eaf07e7448 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:19.813132 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3546/7121] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:19 2022] PUT /identity/v3/projects/e6571c9508c7461b9fcc79d0501f3387/users/a18429154aee49e09fa4b916cf33174d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:19.820711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed9f26-f2a0-420e-818a-c373e14ddd13 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.821004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed9f26-f2a0-420e-818a-c373e14ddd13 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.821603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed9f26-f2a0-420e-818a-c373e14ddd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.851519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-07ed9f26-f2a0-420e-818a-c373e14ddd13 None None] MFA Rules not processed for user `a18429154aee49e09fa4b916cf33174d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:19.852744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-07ed9f26-f2a0-420e-818a-c373e14ddd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:19.856977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291af61-68d1-4eb8-bc31-328fc03da785 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:19.857742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291af61-68d1-4eb8-bc31-328fc03da785 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:19.858333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291af61-68d1-4eb8-bc31-328fc03da785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:19.876385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:19.884851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0291af61-68d1-4eb8-bc31-328fc03da785 None None] MFA Rules not processed for user `8bf0e99cc3bf40f29a8c1e6023718c56`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:19.886718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0291af61-68d1-4eb8-bc31-328fc03da785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:19.931380 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3576/7122] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:19.936050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed9f26-f2a0-420e-818a-c373e14ddd13 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:19.959852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3547/7123] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:20.020152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed9f26-f2a0-420e-818a-c373e14ddd13 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.027701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.028404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.028680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.029010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.029883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.034323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.074235 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3577/7124] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:19 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:20.075108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291af61-68d1-4eb8-bc31-328fc03da785 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.093742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291af61-68d1-4eb8-bc31-328fc03da785 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.178014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.179277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.180060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.180391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.181174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.183636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.213429 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3548/7125] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:20 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:20.214835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.230049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92a275-7757-415d-afba-c908981f88ab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.239888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.240730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.241549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.241909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.243225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.245449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.272786 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3578/7126] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:20.274234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.292801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba802a-1740-4b61-a113-b8470adf3acc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.299619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.300813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.301208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.301558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] PATH_INFO: `/v3/projects/6f2ee9f22dd64a33ac59cfb63e597c0f/users/fcf086aa99294672a665102f7b214264/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.319380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2ee9f22dd64a33ac59cfb63e597c0f, user_id=fcf086aa99294672a665102f7b214264, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.322341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.338890 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3549/7127] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:20 2022] PUT /identity/v3/projects/6f2ee9f22dd64a33ac59cfb63e597c0f/users/fcf086aa99294672a665102f7b214264/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:20.343026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.354302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f3f0-289b-4ca0-9c62-6ca512919ace admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.434470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a679e4a-df7d-499d-9438-e5028ec648d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.436245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679e4a-df7d-499d-9438-e5028ec648d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.437106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679e4a-df7d-499d-9438-e5028ec648d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.437821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a679e4a-df7d-499d-9438-e5028ec648d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.439517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a679e4a-df7d-499d-9438-e5028ec648d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.442540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a679e4a-df7d-499d-9438-e5028ec648d5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.459937 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3579/7128] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:20.461181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.477194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acdc06-4ec3-4af8-970d-86add976594d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.485063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.486172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.486456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.486744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] PATH_INFO: `/v3/projects/6f2ee9f22dd64a33ac59cfb63e597c0f/users/fcf086aa99294672a665102f7b214264/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.489304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2ee9f22dd64a33ac59cfb63e597c0f, user_id=fcf086aa99294672a665102f7b214264, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.492630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.507850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3550/7129] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:20 2022] PUT /identity/v3/projects/6f2ee9f22dd64a33ac59cfb63e597c0f/users/fcf086aa99294672a665102f7b214264/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:20.518659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0ff6-cd7e-4761-b144-bfea13714efa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.519442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0ff6-cd7e-4761-b144-bfea13714efa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.520414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0ff6-cd7e-4761-b144-bfea13714efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.571496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c17b0ff6-cd7e-4761-b144-bfea13714efa None None] MFA Rules not processed for user `fcf086aa99294672a665102f7b214264`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:20.572730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c17b0ff6-cd7e-4761-b144-bfea13714efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:20.607522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:20.684714 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3580/7130] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:20.693304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.705311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8e12d-8410-4561-85a5-3f04ff9be7f0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.714976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.716191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.716600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.717743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.718908 ncdv-master-1 devstack@keystone.service[91204]: WARNING oslo_log.versionutils [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 18 22:28:20.719666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.723030 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:20.723030 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:28:20.723030 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:20.733792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.765169 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3551/7131] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:28:20 2022] POST /identity/v3/policies => generated 228 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:20.769992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b0ff6-cd7e-4761-b144-bfea13714efa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.785866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b0ff6-cd7e-4761-b144-bfea13714efa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.791727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.794383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.794383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.794383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies/15f46593dd7b4ca692cd018741d46774` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.794726 ncdv-master-1 devstack@keystone.service[91205]: WARNING oslo_log.versionutils [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 18 22:28:20.795327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=15f46593dd7b4ca692cd018741d46774)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.797274 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:20.797274 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:28:20.797274 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:28:20.798182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.828109 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3581/7132] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Jun 18 22:28:20 2022] PATCH /identity/v3/policies/15f46593dd7b4ca692cd018741d46774 => generated 235 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:20.833561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.856778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed92985-c949-46d5-addd-d1029d0bed68 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.862866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.864572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.865351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.865770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies/15f46593dd7b4ca692cd018741d46774` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.867108 ncdv-master-1 devstack@keystone.service[91204]: WARNING oslo_log.versionutils [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 18 22:28:20.867884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=15f46593dd7b4ca692cd018741d46774)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.870018 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:20.870018 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:28:20.870018 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:20.871749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.873828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:20.890035 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3552/7133] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:28:20 2022] GET /identity/v3/policies/15f46593dd7b4ca692cd018741d46774 => generated 235 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:20.895042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.911574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9ba52-d176-40bf-a59a-556581ac71db tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.920050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.920788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.921300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.926792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies/15f46593dd7b4ca692cd018741d46774` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.928835 ncdv-master-1 devstack@keystone.service[91205]: WARNING oslo_log.versionutils [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 18 22:28:20.931103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=15f46593dd7b4ca692cd018741d46774)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.934094 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:20.934094 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:28:20.934094 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:28:20.935207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:20.963482 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3582/7134] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:20 2022] DELETE /identity/v3/policies/15f46593dd7b4ca692cd018741d46774 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:20.964250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:20.980048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404f5c4-1cdd-4119-9a39-70019f413f9e tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:20.993168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:20.993887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:20.994142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:20.994417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:20.995770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:20.997933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.023107 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3553/7135] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:28:20 2022] POST /identity/v3/policies => generated 229 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:21.026057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.042105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96243d-a35c-4a7a-b8ef-7346c215844c tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.051091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.052464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.052958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.053559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.059619 ncdv-master-1 devstack@keystone.service[91205]: WARNING oslo_log.versionutils [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 18 22:28:21.059940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.061718 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:21.061718 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:28:21.061718 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:28:21.063111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.103787 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3583/7136] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:28:21 2022] POST /identity/v3/policies => generated 229 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:21.109601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.122392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee94b-953d-4194-8dd7-6aba4ab63a26 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.128820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.129913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.130588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.131156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.132630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.135464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.166071 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3554/7137] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:28:21 2022] POST /identity/v3/policies => generated 230 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:21.166823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.183344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd49b-7e60-4cb6-a57e-3c46231e99a6 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.192601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.193278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.193589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.193859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.194745 ncdv-master-1 devstack@keystone.service[91205]: WARNING oslo_log.versionutils [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 18 22:28:21.195363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.198170 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:21.198170 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:28:21.198170 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:28:21.199446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.211492 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3584/7138] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:28:21 2022] GET /identity/v3/policies => generated 764 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:21.216114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.227845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad0c8a-ffa6-4623-88eb-178b82a8f984 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.235012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.236075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.236960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.237432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies/3e056d32dabd4bcdbf73e585057101cf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.238268 ncdv-master-1 devstack@keystone.service[91204]: WARNING oslo_log.versionutils [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jun 18 22:28:21.239073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3e056d32dabd4bcdbf73e585057101cf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.240537 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:21.240537 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(msg) Jun 18 22:28:21.240537 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:21.241425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.279639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3555/7139] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:21 2022] DELETE /identity/v3/policies/3e056d32dabd4bcdbf73e585057101cf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:21.284108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.295346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0977b-727f-4233-b913-6d4e9d966786 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.300301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.301238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.301518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.301790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies/e85834e3b19a4de99fa421f51b528248` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.303034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e85834e3b19a4de99fa421f51b528248)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.304923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.325942 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3585/7140] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:21 2022] DELETE /identity/v3/policies/e85834e3b19a4de99fa421f51b528248 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:21.330619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.347460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85187f7b-86d4-453a-913c-f99309fde9b3 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.353712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aca5f-8f8d-408c-8d21-3402b926265b tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf086aa99294672a665102f7b214264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.355019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aca5f-8f8d-408c-8d21-3402b926265b tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.355400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aca5f-8f8d-408c-8d21-3402b926265b tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.356338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aca5f-8f8d-408c-8d21-3402b926265b tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] PATH_INFO: `/v3/policies/fa8e99f3165f4a97a26cee7ae4374f9c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.357683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aca5f-8f8d-408c-8d21-3402b926265b tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=fa8e99f3165f4a97a26cee7ae4374f9c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.361440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aca5f-8f8d-408c-8d21-3402b926265b tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.390617 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3556/7141] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:21 2022] DELETE /identity/v3/policies/fa8e99f3165f4a97a26cee7ae4374f9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:21.397113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.484158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f38dd-052a-4cb5-a5b5-d3fa776cde31 tempest-PoliciesTestJSON-1378156191 tempest-PoliciesTestJSON-1378156191-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.494151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.495511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.495851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.496134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] PATH_INFO: `/v3/users/a18429154aee49e09fa4b916cf33174d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.497539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18429154aee49e09fa4b916cf33174d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.500326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.571518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18429154aee49e09fa4b916cf33174d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:21.572335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18429154aee49e09fa4b916cf33174d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:21.574718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:21.589156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18429154aee49e09fa4b916cf33174d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:21.589901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18429154aee49e09fa4b916cf33174d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:21.607440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18429154aee49e09fa4b916cf33174d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:21.637025 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3586/7142] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:21 2022] DELETE /identity/v3/users/a18429154aee49e09fa4b916cf33174d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:21.639087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.639378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.639709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.664076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:21.665802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:21.753119 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3557/7143] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:21.777680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:21.779765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:21.866418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bde4fd-8e52-4692-9b12-88ab7e93d89b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:21.884707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:21.885504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:21.885879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:21.886138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:21.897235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:21.898708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:21.914341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3587/7144] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:22.334989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:22.337527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:22.353457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521fa47-b388-44c6-87d7-712d023808c7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:22.369259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:22.370330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:22.370846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:22.371196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] PATH_INFO: `/v3/projects/e6571c9508c7461b9fcc79d0501f3387` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:22.372651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6571c9508c7461b9fcc79d0501f3387)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:22.374922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:22.430459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6571c9508c7461b9fcc79d0501f3387', 'request_id': 'req-ea4ce509-d112-49dd-b203-1b8e076550ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.441180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6571c9508c7461b9fcc79d0501f3387', 'request_id': 'req-ea4ce509-d112-49dd-b203-1b8e076550ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.451848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6571c9508c7461b9fcc79d0501f3387', 'request_id': 'req-ea4ce509-d112-49dd-b203-1b8e076550ff'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.467503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] The token cache is being invalidate because project e6571c9508c7461b9fcc79d0501f3387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:22.467903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.469419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.477130 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3558/7145] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:22 2022] DELETE /identity/v3/projects/e6571c9508c7461b9fcc79d0501f3387 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:22.480351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:22.493263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fc31d-567d-4509-813a-75cec3e83230 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:22.569103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:22.570532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:22.570987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:22.571439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] PATH_INFO: `/v3/users/fcf086aa99294672a665102f7b214264` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:22.572687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf086aa99294672a665102f7b214264)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:22.574860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:22.638061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf086aa99294672a665102f7b214264'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.639245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf086aa99294672a665102f7b214264'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.651815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf086aa99294672a665102f7b214264'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.652598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf086aa99294672a665102f7b214264'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.658639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:22.661972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d27a7ae5-21d2-42bf-9a3b-ac572b7be4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf086aa99294672a665102f7b214264'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:22.685873 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3588/7146] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:22 2022] DELETE /identity/v3/users/fcf086aa99294672a665102f7b214264 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:23.027439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.027439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:23.052117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ce509-d112-49dd-b203-1b8e076550ff admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.086104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:23.128093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.129276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.129559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.129836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] PATH_INFO: `/v3/projects/6f2ee9f22dd64a33ac59cfb63e597c0f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.131037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2ee9f22dd64a33ac59cfb63e597c0f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.132963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.182999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'request_id': 'req-d140f7df-6f58-49f8-841f-aad0f757aa04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:23.190511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'request_id': 'req-d140f7df-6f58-49f8-841f-aad0f757aa04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:23.198021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2ee9f22dd64a33ac59cfb63e597c0f', 'request_id': 'req-d140f7df-6f58-49f8-841f-aad0f757aa04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:23.208777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] The token cache is being invalidate because project 6f2ee9f22dd64a33ac59cfb63e597c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:23.209102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:23.209747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d140f7df-6f58-49f8-841f-aad0f757aa04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:23.211461 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3559/7147] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:23 2022] DELETE /identity/v3/projects/6f2ee9f22dd64a33ac59cfb63e597c0f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:23.216699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49beaa6-4336-4e8c-8864-398d09569c0b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.216991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49beaa6-4336-4e8c-8864-398d09569c0b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.217309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49beaa6-4336-4e8c-8864-398d09569c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.236434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a49beaa6-4336-4e8c-8864-398d09569c0b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:23.238369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a49beaa6-4336-4e8c-8864-398d09569c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:23.304478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3589/7148] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:23.315712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10489-f159-4b92-8ab2-198263bb76fe None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.316371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10489-f159-4b92-8ab2-198263bb76fe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.316706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10489-f159-4b92-8ab2-198263bb76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.340054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-30b10489-f159-4b92-8ab2-198263bb76fe None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:23.341329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-30b10489-f159-4b92-8ab2-198263bb76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:23.350407 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3560/7149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:23.354952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49beaa6-4336-4e8c-8864-398d09569c0b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.365996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49beaa6-4336-4e8c-8864-398d09569c0b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.370654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.371316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.371599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.371967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.372718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:23.373019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.374682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.390497 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3590/7150] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:23.395066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b10489-f159-4b92-8ab2-198263bb76fe None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.405654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b10489-f159-4b92-8ab2-198263bb76fe None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.411254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.411934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.412215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.412481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.413413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.415353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.445961 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3561/7151] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:23 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:23.450693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.462172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584349b-761c-4733-9ecf-c0a67b7eb4ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.525275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.526208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.526659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.527027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.527825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.529952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.553194 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3591/7152] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:23 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:23.557483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.569288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a580c2-c01b-4fc1-9190-7527458c6c89 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.574533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.575255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.575595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.575813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.576559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.578208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.590116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3562/7153] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:23.594332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.605576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f28cbc-7a39-4ce3-9f26-9e365d59b8e0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.610706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1db50-aac2-4666-9409-43d4f6ab2206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.611481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1db50-aac2-4666-9409-43d4f6ab2206 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.611837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1db50-aac2-4666-9409-43d4f6ab2206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.612190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1db50-aac2-4666-9409-43d4f6ab2206 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.612944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1db50-aac2-4666-9409-43d4f6ab2206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.614624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1db50-aac2-4666-9409-43d4f6ab2206 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.630131 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3592/7154] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:23.631533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.642394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153de4d-3a92-474a-ade5-9431cff767e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.647372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.648290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.648594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.648875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] PATH_INFO: `/v3/projects/2174305627b54bd4ae8bdd716e3d0d51/users/e71d78d0ac7c4266bcee0e72cb3d23e5/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.666585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2174305627b54bd4ae8bdd716e3d0d51, user_id=e71d78d0ac7c4266bcee0e72cb3d23e5, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.670724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.688116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3563/7155] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:23 2022] PUT /identity/v3/projects/2174305627b54bd4ae8bdd716e3d0d51/users/e71d78d0ac7c4266bcee0e72cb3d23e5/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:23.699534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc983b-1a8a-4420-ae5e-07f3575822a3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.699938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc983b-1a8a-4420-ae5e-07f3575822a3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.700288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc983b-1a8a-4420-ae5e-07f3575822a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.730421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fbcc983b-1a8a-4420-ae5e-07f3575822a3 None None] MFA Rules not processed for user `e71d78d0ac7c4266bcee0e72cb3d23e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:23.731752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fbcc983b-1a8a-4420-ae5e-07f3575822a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:23.778844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:23.802724 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3593/7156] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:23.807469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.868998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:23.882477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e8ad7-3f21-444a-a171-184b40f6e53c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:23.888732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:23.889461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:23.889727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:23.890001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:23.890724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:23.892822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:23.940883 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3564/7157] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:23 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:23.943207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc983b-1a8a-4420-ae5e-07f3575822a3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:23.960811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc983b-1a8a-4420-ae5e-07f3575822a3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.046303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.047210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.047649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.048067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.051033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.055260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.088642 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3594/7158] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:23 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:24.092401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.106335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ed877-57ee-4d34-a62c-830ffef38695 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.114026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.115081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.115605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.115891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.116669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.118337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.139528 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3565/7159] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:24.141934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.153902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4fbec-46a1-40b6-a271-2046bde1bf4b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.159959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.160880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.161583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.161841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] PATH_INFO: `/v3/projects/5b6882499e2f446ab07b27505b2b43db/users/a0053fed1db940c1bc97fa4e9334a9d7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.188178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6882499e2f446ab07b27505b2b43db, user_id=a0053fed1db940c1bc97fa4e9334a9d7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.191967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.214473 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3595/7160] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:24 2022] PUT /identity/v3/projects/5b6882499e2f446ab07b27505b2b43db/users/a0053fed1db940c1bc97fa4e9334a9d7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:24.216149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.226859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfa53-749b-437a-bd63-8d0c2760c00b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.304035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10190799-1a43-4392-bdc8-f64514a14eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.304728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190799-1a43-4392-bdc8-f64514a14eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.305010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190799-1a43-4392-bdc8-f64514a14eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.305321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10190799-1a43-4392-bdc8-f64514a14eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.306170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190799-1a43-4392-bdc8-f64514a14eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.309405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10190799-1a43-4392-bdc8-f64514a14eb2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.328743 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3566/7161] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:24.329560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.344525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a1836-fa2a-4fad-9ce5-ba14c4b9b75e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.351939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.353161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.354072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.354192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] PATH_INFO: `/v3/projects/5b6882499e2f446ab07b27505b2b43db/users/a0053fed1db940c1bc97fa4e9334a9d7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.356553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6882499e2f446ab07b27505b2b43db, user_id=a0053fed1db940c1bc97fa4e9334a9d7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.359556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.377315 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3596/7162] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:24 2022] PUT /identity/v3/projects/5b6882499e2f446ab07b27505b2b43db/users/a0053fed1db940c1bc97fa4e9334a9d7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:24.383575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32622fe-1846-48a2-acfb-e93c479b95c1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.384101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32622fe-1846-48a2-acfb-e93c479b95c1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.384200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32622fe-1846-48a2-acfb-e93c479b95c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.411614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f32622fe-1846-48a2-acfb-e93c479b95c1 None None] MFA Rules not processed for user `a0053fed1db940c1bc97fa4e9334a9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:24.412842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f32622fe-1846-48a2-acfb-e93c479b95c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:24.488385 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3567/7163] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:24.493366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.504779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2e40f-7367-4682-a78c-0c001bfb9e51 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.509489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.510144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.510397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.510696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.511377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.513262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.551693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3597/7164] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:24 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:24.552767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32622fe-1846-48a2-acfb-e93c479b95c1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.563795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32622fe-1846-48a2-acfb-e93c479b95c1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.611120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:24.629065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.629993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.630278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.630556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-1373357762` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.631859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=7d01c78269c2434e88a69fda06ba9f92, value=tempest-tag-1373357762)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.634077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.692200 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1373357762. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:28:24.692200 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:28:24.692200 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:24.703546 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3568/7165] 10.222.0.30 () {60 vars in 1332 bytes} [Sat Jun 18 22:28:24 2022] PUT /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-1373357762 => generated 0 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 291 bytes (2 switches on core 0) Jun 18 22:28:24.705457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.727385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffa714-5bc5-4b79-8578-79eb4ebc4b5e tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.733201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.734235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.734610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.734981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-1373357762` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.755859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=7d01c78269c2434e88a69fda06ba9f92, value=tempest-tag-1373357762)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.758735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.779403 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3598/7166] 10.222.0.30 () {58 vars in 1313 bytes} [Sat Jun 18 22:28:24 2022] GET /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-1373357762 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:24.780885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.799662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a1208-f1ab-44c8-8c0e-36a1300ac6a9 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.805171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.806235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.806723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.807282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.808884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=7d01c78269c2434e88a69fda06ba9f92)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.812280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.873352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3569/7167] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Jun 18 22:28:24 2022] PUT /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags => generated 139 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:24.875278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.890616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213d956-9492-4ac9-8f6d-e9ef6dda8cb4 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.896866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.898370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.898659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.899097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.912880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=7d01c78269c2434e88a69fda06ba9f92)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.915581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:24.934097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3599/7168] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:28:24 2022] GET /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags => generated 139 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:24.935567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:24.948566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754030b-ccb4-4830-aad4-19dea64d9099 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:24.954219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:24.955106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:24.955399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:24.955682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-777531630` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:24.957151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=7d01c78269c2434e88a69fda06ba9f92, value=tempest-tag-777531630)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:24.960127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:25.018997 ncdv-master-1 devstack@keystone.service[91204]: WARNING py.warnings [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-777531630. To ensure interoperability, identifiers should be a valid uuid. Jun 18 22:28:25.018997 ncdv-master-1 devstack@keystone.service[91204]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jun 18 22:28:25.018997 ncdv-master-1 devstack@keystone.service[91204]: Jun 18 22:28:25.032877 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3570/7169] 10.222.0.30 () {58 vars in 1313 bytes} [Sat Jun 18 22:28:24 2022] DELETE /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-777531630 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:25.038485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:25.053841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bf759-cd3b-4140-baf8-09eba95b45ef tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:25.058807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:25.059752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:25.060528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:25.060528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-777531630` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:25.073821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=7d01c78269c2434e88a69fda06ba9f92, value=tempest-tag-777531630)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:25.076201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Could not find project tag: tempest-tag-777531630.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-777531630. Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jun 18 22:28:25.139088 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jun 18 22:28:25.140231 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:25.140231 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:25.140231 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jun 18 22:28:25.140231 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jun 18 22:28:25.140231 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-777531630. Jun 18 22:28:25.140231 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:28:25.141243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3600/7170] 10.222.0.30 () {58 vars in 1310 bytes} [Sat Jun 18 22:28:25 2022] GET /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags/tempest-tag-777531630 => generated 106 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:28:25.145526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:25.158898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5defb-da9d-4d69-92fb-2b5c312286c5 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:25.166067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:25.167164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:25.167435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:25.167722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:25.169006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=7d01c78269c2434e88a69fda06ba9f92)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:25.171326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:25.229807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3571/7171] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:28:25 2022] DELETE /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:25.235335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:25.247908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc64f98-692e-4bea-9ca3-f80517447ed0 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:25.255083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:25.256111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:25.256508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:25.256911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:25.261217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:25.275218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=7d01c78269c2434e88a69fda06ba9f92)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:25.279646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:25.294670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3601/7172] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:28:25 2022] GET /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92/tags => generated 66 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jun 18 22:28:25.298746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:25.312102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6726da-724b-4508-811a-4f0f03e763d1 tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:25.317401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0053fed1db940c1bc97fa4e9334a9d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6882499e2f446ab07b27505b2b43db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:25.318280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:25.318565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:25.318842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] PATH_INFO: `/v3/projects/7d01c78269c2434e88a69fda06ba9f92` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:25.320167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d01c78269c2434e88a69fda06ba9f92)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:25.322389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:25.398344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:25.419559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d01c78269c2434e88a69fda06ba9f92', 'request_id': 'req-5f520a63-97fb-4750-b853-3d2d184378be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.429282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d01c78269c2434e88a69fda06ba9f92', 'request_id': 'req-5f520a63-97fb-4750-b853-3d2d184378be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.444965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d01c78269c2434e88a69fda06ba9f92', 'request_id': 'req-5f520a63-97fb-4750-b853-3d2d184378be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.467028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] The token cache is being invalidate because project 7d01c78269c2434e88a69fda06ba9f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:25.470407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.471117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5f520a63-97fb-4750-b853-3d2d184378be tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.485137 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3572/7173] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:25 2022] DELETE /identity/v3/projects/7d01c78269c2434e88a69fda06ba9f92 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:25.489831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:25.492906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:25.580821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac1936-93dc-419e-bcfb-534439025ccc tempest-IdentityV3ProjectTagsTest-783656131 tempest-IdentityV3ProjectTagsTest-783656131-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:25.645856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:25.646847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:25.647342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:25.647684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] PATH_INFO: `/v3/users/e71d78d0ac7c4266bcee0e72cb3d23e5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:25.649394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71d78d0ac7c4266bcee0e72cb3d23e5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:25.651470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:25.717204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71d78d0ac7c4266bcee0e72cb3d23e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.718301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71d78d0ac7c4266bcee0e72cb3d23e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.737667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71d78d0ac7c4266bcee0e72cb3d23e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.739461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71d78d0ac7c4266bcee0e72cb3d23e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.751982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71d78d0ac7c4266bcee0e72cb3d23e5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:25.807360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3602/7174] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:25 2022] DELETE /identity/v3/users/e71d78d0ac7c4266bcee0e72cb3d23e5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:25.810785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:25.811798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:25.812149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:25.836204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:25.837565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:25.920399 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3573/7175] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:25.950794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:25.953089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:25.976476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:26.072942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15499edc-ec50-43ed-9683-06b865316324 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:26.077673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:26.078609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:26.078953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:26.079230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:26.092920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:26.094586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:26.107916 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3603/7176] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:26.953366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:26.954872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:26.972881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22cef-9fe8-4d72-bcfa-59066122b848 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:26.991011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:26.992101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:26.992646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:26.993500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] PATH_INFO: `/v3/projects/2174305627b54bd4ae8bdd716e3d0d51` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:26.995706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2174305627b54bd4ae8bdd716e3d0d51)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:26.997952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:27.099538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2174305627b54bd4ae8bdd716e3d0d51', 'request_id': 'req-68965cf2-746d-4982-bd24-e733d479eb7f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.107989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2174305627b54bd4ae8bdd716e3d0d51', 'request_id': 'req-68965cf2-746d-4982-bd24-e733d479eb7f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.122011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2174305627b54bd4ae8bdd716e3d0d51', 'request_id': 'req-68965cf2-746d-4982-bd24-e733d479eb7f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.154168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] The token cache is being invalidate because project 2174305627b54bd4ae8bdd716e3d0d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:27.154563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.155319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.157870 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3574/7177] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:26 2022] DELETE /identity/v3/projects/2174305627b54bd4ae8bdd716e3d0d51 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:27.161642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:27.173324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ee15-e231-4ebc-85f1-2dc04c9daa98 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:27.256797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:27.257709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:27.257989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:27.258296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] PATH_INFO: `/v3/users/a0053fed1db940c1bc97fa4e9334a9d7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:27.259517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0053fed1db940c1bc97fa4e9334a9d7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:27.261915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:27.323959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0053fed1db940c1bc97fa4e9334a9d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.324657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0053fed1db940c1bc97fa4e9334a9d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.341566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0053fed1db940c1bc97fa4e9334a9d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.342310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0053fed1db940c1bc97fa4e9334a9d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.355485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-743183f4-da4b-4345-a064-1c378aafe46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0053fed1db940c1bc97fa4e9334a9d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:27.379886 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3604/7178] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:27 2022] DELETE /identity/v3/users/a0053fed1db940c1bc97fa4e9334a9d7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:28.205891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:28.208523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:28.222577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68965cf2-746d-4982-bd24-e733d479eb7f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:28.283594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:28.304774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:28.306326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.306866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.307658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] PATH_INFO: `/v3/projects/5b6882499e2f446ab07b27505b2b43db` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.310101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6882499e2f446ab07b27505b2b43db)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:28.313449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:28.368489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6882499e2f446ab07b27505b2b43db', 'request_id': 'req-37e7be76-911f-4657-a142-58165d302272'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.375681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6882499e2f446ab07b27505b2b43db', 'request_id': 'req-37e7be76-911f-4657-a142-58165d302272'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.384944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6882499e2f446ab07b27505b2b43db', 'request_id': 'req-37e7be76-911f-4657-a142-58165d302272'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.403992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] The token cache is being invalidate because project 5b6882499e2f446ab07b27505b2b43db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:28.404475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.405292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-37e7be76-911f-4657-a142-58165d302272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.412548 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3575/7179] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:28 2022] DELETE /identity/v3/projects/5b6882499e2f446ab07b27505b2b43db => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:28.415013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93a87e-6de5-4532-b5e5-2aafc25beaf3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.415525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93a87e-6de5-4532-b5e5-2aafc25beaf3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.415643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93a87e-6de5-4532-b5e5-2aafc25beaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.442695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6d93a87e-6de5-4532-b5e5-2aafc25beaf3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:28.443886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6d93a87e-6de5-4532-b5e5-2aafc25beaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:28.497503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:28.535900 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3605/7180] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:28.547812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cae4-9288-4d77-a010-5ff2e4d52b44 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.548844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cae4-9288-4d77-a010-5ff2e4d52b44 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.550399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736cae4-9288-4d77-a010-5ff2e4d52b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.592693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b736cae4-9288-4d77-a010-5ff2e4d52b44 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:28.594381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b736cae4-9288-4d77-a010-5ff2e4d52b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:28.605197 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3576/7181] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:28.610680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93a87e-6de5-4532-b5e5-2aafc25beaf3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:28.621975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93a87e-6de5-4532-b5e5-2aafc25beaf3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:28.626859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:28.628629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.629252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.630109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.631327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:28.631740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:28.633530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:28.650459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3606/7182] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:28.658236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736cae4-9288-4d77-a010-5ff2e4d52b44 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:28.671845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736cae4-9288-4d77-a010-5ff2e4d52b44 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:28.684615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:28.685774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.686149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.687466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.688763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:28.692267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:28.719323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:28.722422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:28.746308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ac94e-5437-4345-9d2d-0e42f4fc64b9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:28.752700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:28.754136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.754598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.755015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] PATH_INFO: `/v3/users/0d6fa9e59bb649fea86593d00f379562` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.758242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6fa9e59bb649fea86593d00f379562)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:28.758449 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3577/7183] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:28 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:28.761189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:28.764343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:28.852293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6fa9e59bb649fea86593d00f379562'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.853072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6fa9e59bb649fea86593d00f379562'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.869471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6fa9e59bb649fea86593d00f379562'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.871000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6fa9e59bb649fea86593d00f379562'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.883057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79486d43-0846-4b1f-97ad-9060b2dc91b2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:28.884750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c86bbb30-2567-4036-bc84-50810c69fb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6fa9e59bb649fea86593d00f379562'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:28.889656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:28.890624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.891121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.891551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.893783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:28.896362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:28.911022 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3607/7184] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:28 2022] DELETE /identity/v3/users/0d6fa9e59bb649fea86593d00f379562 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:28.916011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:28.916334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:28.916795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:28.934934 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3578/7185] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:28 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:28.937707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:28.940173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:28.940643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:28.943106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:28.955556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab03b0-86cd-44a3-b987-b47311d8a50d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.012471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:29.048511 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3608/7186] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:29.048720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.049874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.050262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.050662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.051516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:29.053472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:29.066319 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3579/7187] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:29.067711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.069344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:29.070208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.092858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c89e-30a3-44a2-a5ca-3372ef93d002 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.099599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.100672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.101176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.101658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.102703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:29.104564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:29.116805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3580/7188] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:29.121580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.134326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9b4a3-f700-4804-94e6-3f31215c02a9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.135860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:29.140816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287e992-bbf5-4ab0-bb52-2dc51f9f0de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.142147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287e992-bbf5-4ab0-bb52-2dc51f9f0de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.142605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287e992-bbf5-4ab0-bb52-2dc51f9f0de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.143101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287e992-bbf5-4ab0-bb52-2dc51f9f0de0 admin admin] PATH_INFO: `/v3/projects/c0adcaf083284062a602ad74bc55f129/users/a9242796366c49d1aafc132807eccfb0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.181162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dc85f-d7bd-4cd7-9446-0286cec2558a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.181789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287e992-bbf5-4ab0-bb52-2dc51f9f0de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0adcaf083284062a602ad74bc55f129, user_id=a9242796366c49d1aafc132807eccfb0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:29.185367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287e992-bbf5-4ab0-bb52-2dc51f9f0de0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:29.186942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.187095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.187318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.187592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.201971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:29.203691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:29.208168 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3581/7189] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:29 2022] PUT /identity/v3/projects/c0adcaf083284062a602ad74bc55f129/users/a9242796366c49d1aafc132807eccfb0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:29.218983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35650d-4d67-4b40-b777-5ae264157081 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.219273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35650d-4d67-4b40-b777-5ae264157081 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.219604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35650d-4d67-4b40-b777-5ae264157081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.222495 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3609/7190] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:29.252135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4a35650d-4d67-4b40-b777-5ae264157081 None None] MFA Rules not processed for user `a9242796366c49d1aafc132807eccfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:29.253431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4a35650d-4d67-4b40-b777-5ae264157081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:29.289712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.291982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:29.309110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68236436-4e2e-424a-9413-3cc15b59d727 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.397405 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3582/7191] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:29.402223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.402484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35650d-4d67-4b40-b777-5ae264157081 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.405900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.405900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.405900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.408046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:29.427831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35650d-4d67-4b40-b777-5ae264157081 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.443681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2b1eb-a1bf-489a-93e7-05e770de1fdf tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9242796366c49d1aafc132807eccfb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0adcaf083284062a602ad74bc55f129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.444412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2b1eb-a1bf-489a-93e7-05e770de1fdf tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.444584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2b1eb-a1bf-489a-93e7-05e770de1fdf tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.444867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2b1eb-a1bf-489a-93e7-05e770de1fdf tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] PATH_INFO: `/v3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.457091 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3583/7192] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/v3 => generated 255 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:29.459284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2b1eb-a1bf-489a-93e7-05e770de1fdf tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.470058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2b1eb-a1bf-489a-93e7-05e770de1fdf tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.475233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8f032-4e02-4085-9aa3-62ee9cb803a6 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9242796366c49d1aafc132807eccfb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0adcaf083284062a602ad74bc55f129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.475921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f032-4e02-4085-9aa3-62ee9cb803a6 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.476466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f032-4e02-4085-9aa3-62ee9cb803a6 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.476747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f032-4e02-4085-9aa3-62ee9cb803a6 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] PATH_INFO: `/v3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.478185 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3584/7193] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/v3 => generated 255 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:29.484170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8f032-4e02-4085-9aa3-62ee9cb803a6 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.497823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8f032-4e02-4085-9aa3-62ee9cb803a6 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.502827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3b4b1-e49e-49b7-931d-487437709075 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9242796366c49d1aafc132807eccfb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0adcaf083284062a602ad74bc55f129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.511093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3b4b1-e49e-49b7-931d-487437709075 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.511778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3b4b1-e49e-49b7-931d-487437709075 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.513072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3b4b1-e49e-49b7-931d-487437709075 tempest-TestApiDiscovery-1963733711 tempest-TestApiDiscovery-1963733711-project] PATH_INFO: `/v3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.521596 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3585/7194] 10.222.0.30 () {58 vars in 1103 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/v3 => generated 255 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:28:29.523183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216492-64b0-4818-8576-7d8ef96359d9 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.523573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216492-64b0-4818-8576-7d8ef96359d9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.523953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29216492-64b0-4818-8576-7d8ef96359d9 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.530495 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3586/7195] 10.222.0.30 () {56 vars in 894 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/ => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:28:29.532363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5ba5e-2434-4ffe-aebf-eb5887bcca17 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.532758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5ba5e-2434-4ffe-aebf-eb5887bcca17 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.533307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5ba5e-2434-4ffe-aebf-eb5887bcca17 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.538707 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3587/7196] 10.222.0.30 () {56 vars in 894 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:28:29.539881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5ba5e-2434-4ffe-aebf-eb5887bcca17 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.576378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:29.577501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:29.604459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3610/7197] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:29.626676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5ba5e-2434-4ffe-aebf-eb5887bcca17 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.631961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.632787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.633248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.634190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] PATH_INFO: `/v3/users/a9242796366c49d1aafc132807eccfb0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.634963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9242796366c49d1aafc132807eccfb0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:29.637063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:29.671988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:29.737324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9242796366c49d1aafc132807eccfb0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.738111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9242796366c49d1aafc132807eccfb0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.738566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:29.740168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:29.757516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9242796366c49d1aafc132807eccfb0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.758603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9242796366c49d1aafc132807eccfb0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.767478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a1bf2-5143-42f9-8a64-6f26ad946c27 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:29.768541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-281018f7-9662-484d-b957-fcb337b08a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9242796366c49d1aafc132807eccfb0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.781014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:29.782928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.783581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.784317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] PATH_INFO: `/v3/projects/ec7319b9bddb4284a4c84f76c1f86452` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.786638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7319b9bddb4284a4c84f76c1f86452)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:29.789205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:29.794325 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3588/7198] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:29 2022] DELETE /identity/v3/users/a9242796366c49d1aafc132807eccfb0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:29.798904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.799532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.799919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.824248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:29.825625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:29.902315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7319b9bddb4284a4c84f76c1f86452', 'request_id': 'req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.910608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7319b9bddb4284a4c84f76c1f86452', 'request_id': 'req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.923175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7319b9bddb4284a4c84f76c1f86452', 'request_id': 'req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.957544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] The token cache is being invalidate because project ec7319b9bddb4284a4c84f76c1f86452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:29.958074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.959641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e7210e10-0ee9-458e-9d3d-cbee3d74e6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:29.963443 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3611/7199] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:29 2022] DELETE /identity/v3/projects/ec7319b9bddb4284a4c84f76c1f86452 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:29.967162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3589/7200] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:29.972756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c3dd1-a92f-449e-9320-964fc1a1568d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:29.973308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c3dd1-a92f-449e-9320-964fc1a1568d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:29.973411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c3dd1-a92f-449e-9320-964fc1a1568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:29.994086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-092c3dd1-a92f-449e-9320-964fc1a1568d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:29.995614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-092c3dd1-a92f-449e-9320-964fc1a1568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.004198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.008170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.010078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:30.100582 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3612/7201] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:30.110193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b509f6-607a-4cbc-9a8e-cb0dbdd74be2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.112918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b509f6-607a-4cbc-9a8e-cb0dbdd74be2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.113293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b509f6-607a-4cbc-9a8e-cb0dbdd74be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.140075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b649f-874e-482a-bf0f-51b1a6c7f6e3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.148038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c4b509f6-607a-4cbc-9a8e-cb0dbdd74be2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:30.152331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c4b509f6-607a-4cbc-9a8e-cb0dbdd74be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.176778 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3613/7202] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:30.178246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b509f6-607a-4cbc-9a8e-cb0dbdd74be2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.191476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b509f6-607a-4cbc-9a8e-cb0dbdd74be2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.197428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.198029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.198566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.198929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.199779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:30.200185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.202566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.216919 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3614/7203] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:30.232289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.232969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.233617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.233912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.236881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.237180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.257151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a4e18-10d2-4174-9a2d-d39bb7eda4aa admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.258872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.261260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.263359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.264153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.264534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.265597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.265746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.267882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.270367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:30.280945 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3590/7204] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:30.309498 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3615/7205] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:30 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:30.311824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.326708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b309a-ec90-4c3b-a9fb-52fd8018c8bf service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.417143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.418072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.418937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.419090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.420319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.422520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.452804 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3591/7206] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:30 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:30.456723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.479005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e7404-4335-4e12-a929-0db4fdd63f6a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.489691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.490522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.491023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.491408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.492256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.494349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.508563 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3616/7207] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:30.512854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.526032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3e2b7-8005-423b-8c45-df2cbff71c77 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.533763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.535532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.535532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.535711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.536692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.538428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.552759 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3592/7208] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:30.556586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.569469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740ccee-725d-48ee-86cb-35f644ec1a27 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.575458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca03f57-06de-4d86-92fe-cce8f1fc389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.576526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03f57-06de-4d86-92fe-cce8f1fc389b admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.577116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03f57-06de-4d86-92fe-cce8f1fc389b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.577116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03f57-06de-4d86-92fe-cce8f1fc389b admin admin] PATH_INFO: `/v3/projects/8f9264803e034deea5335c1299291069/users/0a0c625e337748ca81395db44103a6fe/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.594541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca03f57-06de-4d86-92fe-cce8f1fc389b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9264803e034deea5335c1299291069, user_id=0a0c625e337748ca81395db44103a6fe, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.598140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca03f57-06de-4d86-92fe-cce8f1fc389b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.615408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3617/7209] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:30 2022] PUT /identity/v3/projects/8f9264803e034deea5335c1299291069/users/0a0c625e337748ca81395db44103a6fe/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:30.624779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.624779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.627224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.627675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.628208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.643865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd28e25-fb3b-4a8b-8ca9-4548b5c14dd6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.664375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] MFA Rules not processed for user `0a0c625e337748ca81395db44103a6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:30.665718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.742262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.743233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.743520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.743801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] PATH_INFO: `/v3/projects/c0adcaf083284062a602ad74bc55f129` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.745157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0adcaf083284062a602ad74bc55f129)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:30.747828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:30.765295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3618/7210] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:30.772612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:30.774370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.803421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0adcaf083284062a602ad74bc55f129', 'request_id': 'req-5da46c81-336f-45ee-a959-d0ca335e9ca8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:30.825064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0adcaf083284062a602ad74bc55f129', 'request_id': 'req-5da46c81-336f-45ee-a959-d0ca335e9ca8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:30.827652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:30.843704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0adcaf083284062a602ad74bc55f129', 'request_id': 'req-5da46c81-336f-45ee-a959-d0ca335e9ca8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:30.861331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] The token cache is being invalidate because project c0adcaf083284062a602ad74bc55f129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:30.861633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:30.862392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5da46c81-336f-45ee-a959-d0ca335e9ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:30.864517 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3593/7211] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:30 2022] DELETE /identity/v3/projects/c0adcaf083284062a602ad74bc55f129 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:30.865989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b24c2-b99b-44c6-a6a8-661393791c44 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:30.874089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b90f6-31cf-40ce-a01a-090442fe5407 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.874702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b90f6-31cf-40ce-a01a-090442fe5407 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.875022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b90f6-31cf-40ce-a01a-090442fe5407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.893368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:30.901934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-929b90f6-31cf-40ce-a01a-090442fe5407 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:30.903930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-929b90f6-31cf-40ce-a01a-090442fe5407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:30.969380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:30.970553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:30.970841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:30.971117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:30.973758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:31.006086 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3594/7212] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:31.015913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdf51-e7bc-44ec-a192-ff268e568dca None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.017714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdf51-e7bc-44ec-a192-ff268e568dca None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.017838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdf51-e7bc-44ec-a192-ff268e568dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.043769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-684cdf51-e7bc-44ec-a192-ff268e568dca None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:31.047840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-684cdf51-e7bc-44ec-a192-ff268e568dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:31.061799 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3595/7213] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:31.066574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdf51-e7bc-44ec-a192-ff268e568dca None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.072354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.074364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.087262 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3619/7214] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:31.100697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdf51-e7bc-44ec-a192-ff268e568dca None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.108764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.110810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.111294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.111755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.114482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:31.115006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.117587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.136854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3596/7215] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:28:31.141451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.154817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e2bcc-d334-4b16-a70f-12fc287fd6ff service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.173915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.174750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.175032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.175328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.177392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.179762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.235070 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3620/7216] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:31 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:31.236381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.255462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f146809-403d-49f5-a800-e235de7d7014 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.339771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.347662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.349404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.349404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.349404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.353526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.390110 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3597/7217] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:31 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:31.396218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.415352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31477951-a1bb-4310-870d-b5e2e0d702b1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.425265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.426194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.426729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.427845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.428770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.431774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.473451 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3621/7218] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:31.478084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.497262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a7550-f660-4d8a-9add-87829540673d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.504329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd150d78-c0e9-43b5-aa95-8ed59e24c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.505338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd150d78-c0e9-43b5-aa95-8ed59e24c3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.505771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd150d78-c0e9-43b5-aa95-8ed59e24c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.506221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd150d78-c0e9-43b5-aa95-8ed59e24c3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.508340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd150d78-c0e9-43b5-aa95-8ed59e24c3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.510619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd150d78-c0e9-43b5-aa95-8ed59e24c3c5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.525760 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3598/7219] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:31.530552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.542309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fe232-8350-4815-8201-450ec3b5c5a6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.547740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.548663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.548946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.549253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] PATH_INFO: `/v3/projects/7e651949122744239ee41e3f05730704/users/d7aed70b3c754ed6b6dcaac82f3a24ed/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.566774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e651949122744239ee41e3f05730704, user_id=d7aed70b3c754ed6b6dcaac82f3a24ed, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.569635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.591327 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3622/7220] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:31 2022] PUT /identity/v3/projects/7e651949122744239ee41e3f05730704/users/d7aed70b3c754ed6b6dcaac82f3a24ed/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:31.604411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab54d-3e0a-4a20-8057-6bb78a5d26ed None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.604411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab54d-3e0a-4a20-8057-6bb78a5d26ed None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.604411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab54d-3e0a-4a20-8057-6bb78a5d26ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.640536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-833ab54d-3e0a-4a20-8057-6bb78a5d26ed None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:31.641817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-833ab54d-3e0a-4a20-8057-6bb78a5d26ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:31.665719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.669186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:31.710292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:31.725410 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3599/7221] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:31.726203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab54d-3e0a-4a20-8057-6bb78a5d26ed None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.732772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:31.736415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab54d-3e0a-4a20-8057-6bb78a5d26ed None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.741721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49be3f-2409-4664-a394-bee4809b0124 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.742823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49be3f-2409-4664-a394-bee4809b0124 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.743115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49be3f-2409-4664-a394-bee4809b0124 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.743751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49be3f-2409-4664-a394-bee4809b0124 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.760291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157daa4-f9da-4004-b88f-5238a4c75982 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:31.768418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:31.769448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.769724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.770109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] PATH_INFO: `/v3/users/0a0c625e337748ca81395db44103a6fe` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.771400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0c625e337748ca81395db44103a6fe)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:31.773538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:31.793945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ee49be3f-2409-4664-a394-bee4809b0124 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:31.805550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3600/7222] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:31 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:31.828835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0c625e337748ca81395db44103a6fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:31.829537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0c625e337748ca81395db44103a6fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:31.842113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0c625e337748ca81395db44103a6fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:31.842790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0c625e337748ca81395db44103a6fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:31.849484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0c625e337748ca81395db44103a6fe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:31.863021 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3623/7223] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:31 2022] DELETE /identity/v3/users/0a0c625e337748ca81395db44103a6fe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:31.875935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:31.876228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:31.876509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:31.895968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:31.897226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:31.964797 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3601/7224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:31.976062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:31.980367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.052880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92058af-fab6-4845-8edf-4e388a2184ad admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:32.057643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e6f30-f17c-4f12-9725-a74f8a75135b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:32.058528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6f30-f17c-4f12-9725-a74f8a75135b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.058963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6f30-f17c-4f12-9725-a74f8a75135b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.059416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6f30-f17c-4f12-9725-a74f8a75135b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.074376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e6f30-f17c-4f12-9725-a74f8a75135b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:32.076129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e6f30-f17c-4f12-9725-a74f8a75135b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:32.088124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3624/7225] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:32.456745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:32.458511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.471584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f896a-b10a-4c25-9038-05db6ce1a6da None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:32.476976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:32.477914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.478253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.478556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] PATH_INFO: `/v3/users/2e800ba202d54729b4c0c5b4aa0b4a01` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.480078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e800ba202d54729b4c0c5b4aa0b4a01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:32.482237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:32.538410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e800ba202d54729b4c0c5b4aa0b4a01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.539118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e800ba202d54729b4c0c5b4aa0b4a01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.551738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e800ba202d54729b4c0c5b4aa0b4a01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.552584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e800ba202d54729b4c0c5b4aa0b4a01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.559841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e800ba202d54729b4c0c5b4aa0b4a01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.576610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3602/7226] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:32 2022] DELETE /identity/v3/users/2e800ba202d54729b4c0c5b4aa0b4a01 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:32.582766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.583057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.583337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.601456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:32.602661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.671603 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3625/7227] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:32.681404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:32.681559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:32.683041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.684159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.692018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:32.710695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f1df-0f4b-4760-b415-953f6a7880b8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:32.728605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:32.729853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.730219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.730446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] PATH_INFO: `/v3/projects/8f9264803e034deea5335c1299291069` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.732186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9264803e034deea5335c1299291069)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:32.735389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:32.783731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=13 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:32.798537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6b32d-5ef3-4b04-bef2-194897642326 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:32.810343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9264803e034deea5335c1299291069', 'request_id': 'req-78f0bca7-12d9-451e-866b-119276291ce8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.822361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9264803e034deea5335c1299291069', 'request_id': 'req-78f0bca7-12d9-451e-866b-119276291ce8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.837021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9264803e034deea5335c1299291069', 'request_id': 'req-78f0bca7-12d9-451e-866b-119276291ce8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.857710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] The token cache is being invalidate because project 8f9264803e034deea5335c1299291069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:32.858060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.858754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-78f0bca7-12d9-451e-866b-119276291ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:32.860624 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3603/7228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:32 2022] DELETE /identity/v3/projects/8f9264803e034deea5335c1299291069 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:32.861740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95aab-ac20-456e-802c-de2bcc3e6602 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.862084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95aab-ac20-456e-802c-de2bcc3e6602 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.862369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b95aab-ac20-456e-802c-de2bcc3e6602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.876784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cd505-75af-4a74-b323-553d91c69b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:32.877591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cd505-75af-4a74-b323-553d91c69b0b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.877967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cd505-75af-4a74-b323-553d91c69b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.878304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cd505-75af-4a74-b323-553d91c69b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.880191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b97cd505-75af-4a74-b323-553d91c69b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.880342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a6b95aab-ac20-456e-802c-de2bcc3e6602 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:32.881587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a6b95aab-ac20-456e-802c-de2bcc3e6602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.887978 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3604/7229] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:32.887978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080e6ce-f350-4aec-8652-2f7a1425f3dc None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.887978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080e6ce-f350-4aec-8652-2f7a1425f3dc None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.887978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080e6ce-f350-4aec-8652-2f7a1425f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.909983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f080e6ce-f350-4aec-8652-2f7a1425f3dc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:32.911225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f080e6ce-f350-4aec-8652-2f7a1425f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:32.966998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cd505-75af-4a74-b323-553d91c69b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:32.968573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cd505-75af-4a74-b323-553d91c69b0b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:32.979677 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3626/7230] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:32.981245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c13ef-528b-4703-a397-5b537238c0c4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.981475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c13ef-528b-4703-a397-5b537238c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.981715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3605/7231] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:32.981855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c13ef-528b-4703-a397-5b537238c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.988838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabcbd6-4103-4997-ac20-cb4aae8600d8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:32.989829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabcbd6-4103-4997-ac20-cb4aae8600d8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:32.990182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabcbd6-4103-4997-ac20-cb4aae8600d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:32.999734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b08c13ef-528b-4703-a397-5b537238c0c4 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:33.000953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b08c13ef-528b-4703-a397-5b537238c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.010013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3aabcbd6-4103-4997-ac20-cb4aae8600d8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:33.011378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3aabcbd6-4103-4997-ac20-cb4aae8600d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.019601 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3606/7232] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:33.025086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabcbd6-4103-4997-ac20-cb4aae8600d8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.034506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabcbd6-4103-4997-ac20-cb4aae8600d8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.040532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.041242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.041602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.041975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.043793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:33.044064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.045733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.064690 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3607/7233] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:33.065640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.069769 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3627/7234] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:33.070849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c13ef-528b-4703-a397-5b537238c0c4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.076917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08477c-0da2-4e49-853d-c3e4b09f2e89 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.079860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c13ef-528b-4703-a397-5b537238c0c4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.082650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.083313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.083602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.083887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.084495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000eb3b-5324-40b2-9786-a8959f144f44 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.084624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.085487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000eb3b-5324-40b2-9786-a8959f144f44 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.085839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000eb3b-5324-40b2-9786-a8959f144f44 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.086185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000eb3b-5324-40b2-9786-a8959f144f44 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.086544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.105634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:33.131998 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3608/7235] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:33.133702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-c000eb3b-5324-40b2-9786-a8959f144f44 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:28:33.147827 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 18 22:28:33.148753 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:28:33.151603 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3628/7236] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 188 bytes in 80 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 18 22:28:33.155659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000eb3b-5324-40b2-9786-a8959f144f44 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.168159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000eb3b-5324-40b2-9786-a8959f144f44 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.224132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a7735-9553-4f76-a255-7076c91a3554 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.230000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.230694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.230975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.231311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.233072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.235185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.247090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.248098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.248410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.248716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.261924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:33.275778 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3609/7237] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/users => generated 284 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:33.277723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.300076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc14a90-9579-499e-bae8-0964ef9900f7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:28:33.306176 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jun 18 22:28:33.307131 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:28:33.308213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.308302 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3629/7238] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 188 bytes in 153 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jun 18 22:28:33.308599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.312715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.313663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.314036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.314867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.315793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.316744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.329158 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3610/7239] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:33.330523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.334565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d8787-e5e3-4b6d-bd16-2dc0b42f6685 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.343662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d567975-7638-4c4f-962a-cdd929a9c7b9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.344508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.345452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.345732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.346014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] PATH_INFO: `/v3/projects/d25232a6f8d9481fa02b00dacc5280ad` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.347272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25232a6f8d9481fa02b00dacc5280ad)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.348996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355cf31-fdab-45e7-8de4-f688366965fb tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.349409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.350111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355cf31-fdab-45e7-8de4-f688366965fb tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.350463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355cf31-fdab-45e7-8de4-f688366965fb tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.350773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355cf31-fdab-45e7-8de4-f688366965fb tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.410260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25232a6f8d9481fa02b00dacc5280ad', 'request_id': 'req-32d376a9-53ee-4a3e-a247-7ddc353a5dad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:33.412475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1355cf31-fdab-45e7-8de4-f688366965fb tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:33.421075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25232a6f8d9481fa02b00dacc5280ad', 'request_id': 'req-32d376a9-53ee-4a3e-a247-7ddc353a5dad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:33.428440 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3611/7240] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:33.429438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355cf31-fdab-45e7-8de4-f688366965fb tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.438963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25232a6f8d9481fa02b00dacc5280ad', 'request_id': 'req-32d376a9-53ee-4a3e-a247-7ddc353a5dad'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:33.457740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] The token cache is being invalidate because project d25232a6f8d9481fa02b00dacc5280ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:33.458039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:33.458830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-32d376a9-53ee-4a3e-a247-7ddc353a5dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:33.460854 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3630/7241] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:33 2022] DELETE /identity/v3/projects/d25232a6f8d9481fa02b00dacc5280ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:33.462600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355cf31-fdab-45e7-8de4-f688366965fb tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.469630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491655e-9c3a-4244-9f28-99ec2b8390f3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.470059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491655e-9c3a-4244-9f28-99ec2b8390f3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.470441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491655e-9c3a-4244-9f28-99ec2b8390f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.491239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a491655e-9c3a-4244-9f28-99ec2b8390f3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:33.492392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a491655e-9c3a-4244-9f28-99ec2b8390f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.577434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.579152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.579445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.579743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.580470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.583984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.600432 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3612/7242] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:33.600606 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3631/7243] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:33.603105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.605072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.608252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40d8c-e1c4-446f-8ac6-79b4ff590c47 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.608714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40d8c-e1c4-446f-8ac6-79b4ff590c47 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.608901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40d8c-e1c4-446f-8ac6-79b4ff590c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.630304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:33.635764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150d376-27a1-4d2f-b888-9898261cf09c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.642057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-30f40d8c-e1c4-446f-8ac6-79b4ff590c47 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:33.643282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30f40d8c-e1c4-446f-8ac6-79b4ff590c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.645141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e761f9-338e-49dd-8fb1-d2a1a5511f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.646293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e761f9-338e-49dd-8fb1-d2a1a5511f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.646748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e761f9-338e-49dd-8fb1-d2a1a5511f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.647194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e761f9-338e-49dd-8fb1-d2a1a5511f38 admin admin] PATH_INFO: `/v3/projects/dc34a77b076a477d8af43328f522e209/users/b7ccf136672e4af793c6eec34952c860/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.676398 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3632/7244] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:33.677515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e761f9-338e-49dd-8fb1-d2a1a5511f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc34a77b076a477d8af43328f522e209, user_id=b7ccf136672e4af793c6eec34952c860, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.680889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f40d8c-e1c4-446f-8ac6-79b4ff590c47 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.683314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e761f9-338e-49dd-8fb1-d2a1a5511f38 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.698593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f40d8c-e1c4-446f-8ac6-79b4ff590c47 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.706287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.707846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.708083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.708362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.709228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:33.709542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.710288 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3613/7245] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:33 2022] PUT /identity/v3/projects/dc34a77b076a477d8af43328f522e209/users/b7ccf136672e4af793c6eec34952c860/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:33.711480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.722149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.722690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.723447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.728495 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3633/7246] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:33.729846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.748723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57d02f-a6c6-4ecd-bfdb-985922b7136e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.756670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] MFA Rules not processed for user `b7ccf136672e4af793c6eec34952c860`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:33.758280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.824214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.825327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.828606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.828606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.828606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.828868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:33.854723 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3614/7247] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:33.865408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3634/7248] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:33.866726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.868159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:33.879183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:33.904109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:33.958558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda38376-ccdb-48a9-80f2-8e0763346233 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.962296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e527f3-b97c-47b8-b880-4e63ed657d25 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:33.968473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:33.969835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:33.970564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:33.970992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:33.972168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:33.974928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:34.012483 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3635/7249] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:33 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:34.013833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:34.019169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12894e-5413-459c-8a60-6e994c0a5c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:34.019930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12894e-5413-459c-8a60-6e994c0a5c96 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.020565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12894e-5413-459c-8a60-6e994c0a5c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.020921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12894e-5413-459c-8a60-6e994c0a5c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.038544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c833e3f-fa7f-437d-83b5-2e9668b72498 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:34.047729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:34.048425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.048706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.048985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.049948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:34.051587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:34.062796 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3636/7250] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:34.067299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:34.084837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492ba89-e672-4bf2-acc5-e4384ec298fc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:34.090571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:34.091364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.091721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.092061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.092879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:34.094607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:34.105962 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3637/7251] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:34.109890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:34.116826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12894e-5413-459c-8a60-6e994c0a5c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:34.118407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12894e-5413-459c-8a60-6e994c0a5c96 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:34.125015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a4170-1fd4-46b7-9836-a1f1f9ce4c3d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:34.129645 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3615/7252] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:34.129783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:34.130642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.130992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.131275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] PATH_INFO: `/v3/projects/76e7971827414007a2ca34b416ae182d/users/3d6d754800294b598d92abe957746887/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.147815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e7971827414007a2ca34b416ae182d, user_id=3d6d754800294b598d92abe957746887, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:34.150679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:34.169122 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3638/7253] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:34 2022] PUT /identity/v3/projects/76e7971827414007a2ca34b416ae182d/users/3d6d754800294b598d92abe957746887/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:34.177176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73942e-698d-4113-af00-1f6176763ac7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.177545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73942e-698d-4113-af00-1f6176763ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.177835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73942e-698d-4113-af00-1f6176763ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.210867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3a73942e-698d-4113-af00-1f6176763ac7 None None] MFA Rules not processed for user `3d6d754800294b598d92abe957746887`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:34.212102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3a73942e-698d-4113-af00-1f6176763ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:34.293506 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3616/7254] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:34.310079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:34.312758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:34.364836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:34.416848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338a52e-848b-4617-912c-e75c00583bdb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:34.421398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc2e83-d564-48fe-a78a-6bfbca6c9a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:34.422246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc2e83-d564-48fe-a78a-6bfbca6c9a6d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.422683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc2e83-d564-48fe-a78a-6bfbca6c9a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.423119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc2e83-d564-48fe-a78a-6bfbca6c9a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.434804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816d57-d768-41cf-ab01-f10f6afaeb3f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.435509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816d57-d768-41cf-ab01-f10f6afaeb3f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.435916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816d57-d768-41cf-ab01-f10f6afaeb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.436287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc2e83-d564-48fe-a78a-6bfbca6c9a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:34.439442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc2e83-d564-48fe-a78a-6bfbca6c9a6d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:34.457768 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3639/7255] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:34.466052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eb816d57-d768-41cf-ab01-f10f6afaeb3f None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:34.468951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eb816d57-d768-41cf-ab01-f10f6afaeb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:34.479616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfca7-781f-4e15-bc3e-3bff03993980 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.480340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfca7-781f-4e15-bc3e-3bff03993980 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.480813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfca7-781f-4e15-bc3e-3bff03993980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.489184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3617/7256] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 18 22:28:34.510512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e05cfca7-781f-4e15-bc3e-3bff03993980 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:34.512419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e05cfca7-781f-4e15-bc3e-3bff03993980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:34.632754 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3640/7257] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:34.633881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816d57-d768-41cf-ab01-f10f6afaeb3f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:34.648106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816d57-d768-41cf-ab01-f10f6afaeb3f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:34.652271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e3474-c365-46b9-9f29-243f8f3c438d tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:34.654010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3474-c365-46b9-9f29-243f8f3c438d tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:34.654127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3474-c365-46b9-9f29-243f8f3c438d tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:34.654497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e3474-c365-46b9-9f29-243f8f3c438d tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:34.669467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:34.716265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6a6e3474-c365-46b9-9f29-243f8f3c438d tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:34.731046 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3618/7258] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:34 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:35.735216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a4b2-6fa9-4161-ba6e-5268a266fd06 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:35.735769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a4b2-6fa9-4161-ba6e-5268a266fd06 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:35.735769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a4b2-6fa9-4161-ba6e-5268a266fd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:35.756202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7845a4b2-6fa9-4161-ba6e-5268a266fd06 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:35.757895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7845a4b2-6fa9-4161-ba6e-5268a266fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:35.762192 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3641/7259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:35.766976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e9087-c1a2-454a-a59d-969719985610 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:35.767488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e9087-c1a2-454a-a59d-969719985610 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:35.767604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e9087-c1a2-454a-a59d-969719985610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:35.787066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-682e9087-c1a2-454a-a59d-969719985610 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:35.788307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-682e9087-c1a2-454a-a59d-969719985610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:35.799190 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3619/7260] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:35.803496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a4b2-6fa9-4161-ba6e-5268a266fd06 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:35.817720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a4b2-6fa9-4161-ba6e-5268a266fd06 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:35.822455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72dbe7-bde4-401e-bd0f-053121b09a3c tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:35.823643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72dbe7-bde4-401e-bd0f-053121b09a3c tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:35.823993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72dbe7-bde4-401e-bd0f-053121b09a3c tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:35.824337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72dbe7-bde4-401e-bd0f-053121b09a3c tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:35.883772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ce72dbe7-bde4-401e-bd0f-053121b09a3c tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:35.897049 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3642/7261] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:35 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:36.902794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfef0cd-45ff-4eeb-b1b2-3e8a7591dc8e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:36.903753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfef0cd-45ff-4eeb-b1b2-3e8a7591dc8e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:36.904202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfef0cd-45ff-4eeb-b1b2-3e8a7591dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:36.952562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2cfef0cd-45ff-4eeb-b1b2-3e8a7591dc8e None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:36.956114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2cfef0cd-45ff-4eeb-b1b2-3e8a7591dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:36.963048 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3620/7262] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:36 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:36.968051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da0b85-9894-46e5-a4e8-f252e7579dda None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:36.968588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da0b85-9894-46e5-a4e8-f252e7579dda None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:36.968588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da0b85-9894-46e5-a4e8-f252e7579dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:37.022057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-40da0b85-9894-46e5-a4e8-f252e7579dda None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:37.023620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40da0b85-9894-46e5-a4e8-f252e7579dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:37.035762 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3643/7263] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:37.037303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfef0cd-45ff-4eeb-b1b2-3e8a7591dc8e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:37.056876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfef0cd-45ff-4eeb-b1b2-3e8a7591dc8e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:37.072757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:37.082175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:37.082671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:37.083473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:37.152397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:37.175407 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3621/7264] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:37 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:37.767601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65efb1a-3d90-4139-b5b1-7205beea99bd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:37.768037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65efb1a-3d90-4139-b5b1-7205beea99bd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:37.768413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65efb1a-3d90-4139-b5b1-7205beea99bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:37.793004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e65efb1a-3d90-4139-b5b1-7205beea99bd None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:37.795317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e65efb1a-3d90-4139-b5b1-7205beea99bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:37.898694 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3644/7265] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:28:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:37.915514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:37.918088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:38.006337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689858de-b465-4956-bb04-74fc68658f2a tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:38.013787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f6f20-abf0-4633-9dc0-bca331f975ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:38.014770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6f20-abf0-4633-9dc0-bca331f975ab service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:38.015161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6f20-abf0-4633-9dc0-bca331f975ab service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:38.015642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6f20-abf0-4633-9dc0-bca331f975ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:38.027023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f6f20-abf0-4633-9dc0-bca331f975ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:38.028999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f6f20-abf0-4633-9dc0-bca331f975ab service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:38.052209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3622/7266] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:28:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:38.178976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df59715-919c-417c-a1e2-51fef1051c31 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:38.179632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df59715-919c-417c-a1e2-51fef1051c31 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:38.179918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df59715-919c-417c-a1e2-51fef1051c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:38.230639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4df59715-919c-417c-a1e2-51fef1051c31 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:38.241907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4df59715-919c-417c-a1e2-51fef1051c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:38.259822 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3645/7267] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:38.877170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4286fe-6e20-4cc6-a0fe-2152dc159e39 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:38.877892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4286fe-6e20-4cc6-a0fe-2152dc159e39 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:38.878398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4286fe-6e20-4cc6-a0fe-2152dc159e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:38.901482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ff4286fe-6e20-4cc6-a0fe-2152dc159e39 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:38.903410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ff4286fe-6e20-4cc6-a0fe-2152dc159e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:38.920409 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3623/7268] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:28:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:38.925187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df59715-919c-417c-a1e2-51fef1051c31 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:38.949691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df59715-919c-417c-a1e2-51fef1051c31 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:38.964605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818346f1-5ec2-499e-bab9-91fca06b5d1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:38.965547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818346f1-5ec2-499e-bab9-91fca06b5d1b service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:38.966033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818346f1-5ec2-499e-bab9-91fca06b5d1b service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:38.966410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818346f1-5ec2-499e-bab9-91fca06b5d1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:38.980056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818346f1-5ec2-499e-bab9-91fca06b5d1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:38.982511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818346f1-5ec2-499e-bab9-91fca06b5d1b service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:38.994594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:39.013150 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3646/7269] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:39.266375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274383ce-c505-4d2f-8ee9-105fdd32b900 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.268129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274383ce-c505-4d2f-8ee9-105fdd32b900 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.268463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274383ce-c505-4d2f-8ee9-105fdd32b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:39.298251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-274383ce-c505-4d2f-8ee9-105fdd32b900 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:39.299679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-274383ce-c505-4d2f-8ee9-105fdd32b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:39.317653 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3624/7270] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:39.325348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b75c-78e0-4eb7-92ee-f5136b2f8cc9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.326600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b75c-78e0-4eb7-92ee-f5136b2f8cc9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.327198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b75c-78e0-4eb7-92ee-f5136b2f8cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:39.351858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde829-c556-4066-bab3-27e5986ea76e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.352296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde829-c556-4066-bab3-27e5986ea76e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.352675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde829-c556-4066-bab3-27e5986ea76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:39.361099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8fb1b75c-78e0-4eb7-92ee-f5136b2f8cc9 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:39.362548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8fb1b75c-78e0-4eb7-92ee-f5136b2f8cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:39.372252 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3647/7271] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:39 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:39.381595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b26f8-c409-4d9b-9c3f-fd550256c509 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.382027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b26f8-c409-4d9b-9c3f-fd550256c509 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.382316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b26f8-c409-4d9b-9c3f-fd550256c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:39.385271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e1cde829-c556-4066-bab3-27e5986ea76e None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:39.386628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e1cde829-c556-4066-bab3-27e5986ea76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:39.416054 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3625/7272] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:28:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:39.435894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde829-c556-4066-bab3-27e5986ea76e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:39.455378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde829-c556-4066-bab3-27e5986ea76e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:39.462582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef37f7-b79d-4e2d-9702-934c5081f3e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:39.463414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef37f7-b79d-4e2d-9702-934c5081f3e5 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.463764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef37f7-b79d-4e2d-9702-934c5081f3e5 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.464214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef37f7-b79d-4e2d-9702-934c5081f3e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:39.473731 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.server.flask.application [None req-5b3b26f8-c409-4d9b-9c3f-fd550256c509 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 18 22:28:39.479667 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3648/7273] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 104 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 18 22:28:39.481519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8559b6-2c4d-476f-92f5-9df9329c5e79 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.482420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef37f7-b79d-4e2d-9702-934c5081f3e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:39.484056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef37f7-b79d-4e2d-9702-934c5081f3e5 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:39.486042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8559b6-2c4d-476f-92f5-9df9329c5e79 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.486171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8559b6-2c4d-476f-92f5-9df9329c5e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:39.497636 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3626/7274] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:28:39.547061 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.server.flask.application [None req-ea8559b6-2c4d-476f-92f5-9df9329c5e79 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 18 22:28:39.548957 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3649/7275] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 68 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 18 22:28:39.554090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf997fa-f7f6-4991-bcb1-63015c97eaf5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.554597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf997fa-f7f6-4991-bcb1-63015c97eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.555050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf997fa-f7f6-4991-bcb1-63015c97eaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:39.605532 ncdv-master-1 devstack@keystone.service[91204]: WARNING keystone.server.flask.application [None req-baf997fa-f7f6-4991-bcb1-63015c97eaf5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 18 22:28:39.607771 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3627/7276] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:39 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 55 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 18 22:28:39.997256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:39.997753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:39.998059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:40.035198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:40.039830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:40.075665 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3650/7277] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:28:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:40.076875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf997fa-f7f6-4991-bcb1-63015c97eaf5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:40.105263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf997fa-f7f6-4991-bcb1-63015c97eaf5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:40.111103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f423beb-126d-4dfb-a9f9-95227300673f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:40.112080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f423beb-126d-4dfb-a9f9-95227300673f service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:40.145530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f423beb-126d-4dfb-a9f9-95227300673f service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:40.147735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f423beb-126d-4dfb-a9f9-95227300673f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:40.159343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f423beb-126d-4dfb-a9f9-95227300673f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:40.161249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f423beb-126d-4dfb-a9f9-95227300673f service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:40.175010 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3628/7278] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:41.707345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:41.709105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:41.859547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40418a6d-62a6-4c05-b446-cb718ca9aa20 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:41.865561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:41.867148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:41.867652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:41.868123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] PATH_INFO: `/v3/users/eb618d62ad804a63be1b0cb7dfb49677` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:41.869968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb618d62ad804a63be1b0cb7dfb49677)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:41.872508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:42.052059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb618d62ad804a63be1b0cb7dfb49677'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.057358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb618d62ad804a63be1b0cb7dfb49677'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.092960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb618d62ad804a63be1b0cb7dfb49677'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.094363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb618d62ad804a63be1b0cb7dfb49677'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.108641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb618d62ad804a63be1b0cb7dfb49677'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.148480 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3651/7279] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:41 2022] DELETE /identity/v3/users/eb618d62ad804a63be1b0cb7dfb49677 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:42.153113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:42.153652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:42.153652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:42.206450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:42.209548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:42.239041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:42.317570 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3629/7280] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:42.334832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:42.336334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:42.391367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:UPDATE=2,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:42.436807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5747033-c509-40ea-ae08-6d96a84983ca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:42.441630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cd551-97ec-400f-81a4-9a5cde91c9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:42.442412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cd551-97ec-400f-81a4-9a5cde91c9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:42.442719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cd551-97ec-400f-81a4-9a5cde91c9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:42.448345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cd551-97ec-400f-81a4-9a5cde91c9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:42.450113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:42.451826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:42.465426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cd551-97ec-400f-81a4-9a5cde91c9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:42.467225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cd551-97ec-400f-81a4-9a5cde91c9f5 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:42.468981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d2ec-b362-4c72-9005-e22c55fe6536 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:42.476258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:42.477354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:42.477641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:42.477921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] PATH_INFO: `/v3/users/3d6d754800294b598d92abe957746887` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:42.479224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6d754800294b598d92abe957746887)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:42.480023 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3652/7281] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:42.481697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:42.568933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6d754800294b598d92abe957746887'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.570305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6d754800294b598d92abe957746887'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.615238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6d754800294b598d92abe957746887'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.616348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6d754800294b598d92abe957746887'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.630553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6d754800294b598d92abe957746887'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.649090 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3630/7282] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:42 2022] DELETE /identity/v3/users/3d6d754800294b598d92abe957746887 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:42.654548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:42.655002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:42.655329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:42.674263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:42.675851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:42.703583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:42.705998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:42.754339 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3653/7283] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:42.764605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:42.766187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:42.804270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbd5b8-93b3-4d7d-b753-d8ebccfb7a49 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:42.810624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:42.811720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:42.812010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:42.812288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] PATH_INFO: `/v3/projects/5a66af534c864816a68b5d4a3ed0f769` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:42.813943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a66af534c864816a68b5d4a3ed0f769)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:42.815911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:42.829333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f1bb5-b6c3-471a-8422-b3310f0e6fd2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:42.833008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:42.833701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:42.833986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:42.834263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:42.844788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:42.846301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:42.860096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:42.872506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a66af534c864816a68b5d4a3ed0f769', 'request_id': 'req-eeca762b-f226-4c78-8be4-84d1bf149f71'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.873113 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3654/7284] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:42.882137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a66af534c864816a68b5d4a3ed0f769', 'request_id': 'req-eeca762b-f226-4c78-8be4-84d1bf149f71'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.890988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a66af534c864816a68b5d4a3ed0f769', 'request_id': 'req-eeca762b-f226-4c78-8be4-84d1bf149f71'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.905115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] The token cache is being invalidate because project 5a66af534c864816a68b5d4a3ed0f769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:42.905439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.906128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:42.909127 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3631/7285] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:42 2022] DELETE /identity/v3/projects/5a66af534c864816a68b5d4a3ed0f769 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:42.911810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:42.929232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981ffdd-2998-4d44-b070-6d96f943e923 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:42.937126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:42.939405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.007653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.008815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.009392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.009930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] PATH_INFO: `/v3/users/ce53a3f9013a47188f8de63a69ca647b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.011879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce53a3f9013a47188f8de63a69ca647b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.014758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.026687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca762b-f226-4c78-8be4-84d1bf149f71 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.031585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.032659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.033063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.033474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] PATH_INFO: `/v3/users/8bf0e99cc3bf40f29a8c1e6023718c56` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.035011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf0e99cc3bf40f29a8c1e6023718c56)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.037102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.051852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:43.116585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce53a3f9013a47188f8de63a69ca647b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.117328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce53a3f9013a47188f8de63a69ca647b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.122060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf0e99cc3bf40f29a8c1e6023718c56'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.122978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf0e99cc3bf40f29a8c1e6023718c56'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.132278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce53a3f9013a47188f8de63a69ca647b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.133150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce53a3f9013a47188f8de63a69ca647b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.141405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce53a3f9013a47188f8de63a69ca647b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.141579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf0e99cc3bf40f29a8c1e6023718c56'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.142688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf0e99cc3bf40f29a8c1e6023718c56'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.151056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b5b9c5fa-5109-4efa-b090-cffaec3649f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf0e99cc3bf40f29a8c1e6023718c56'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.158253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3655/7286] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:42 2022] DELETE /identity/v3/users/ce53a3f9013a47188f8de63a69ca647b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:43.158928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:43.167295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.173106 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3632/7287] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:42 2022] DELETE /identity/v3/users/8bf0e99cc3bf40f29a8c1e6023718c56 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:43.175682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.176060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.176428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.201370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:43.202609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.260031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:43.270960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a335f2-8ac2-4292-b800-4c8a8bbe5fa9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.286144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3633/7288] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:43.298486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:43.301328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.342943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.344075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.345012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.345012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] PATH_INFO: `/v3/projects/76e7971827414007a2ca34b416ae182d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.346183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e7971827414007a2ca34b416ae182d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.349147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.387900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6d332-7f1f-4903-8659-ba5e53f14364 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.392734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb47ee-cd5c-4de6-90c5-ae42a5d7e867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.394053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb47ee-cd5c-4de6-90c5-ae42a5d7e867 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.394612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb47ee-cd5c-4de6-90c5-ae42a5d7e867 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.405184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb47ee-cd5c-4de6-90c5-ae42a5d7e867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.417944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb47ee-cd5c-4de6-90c5-ae42a5d7e867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.419670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb47ee-cd5c-4de6-90c5-ae42a5d7e867 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.432312 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3634/7289] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:43.444110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:43.460783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e7971827414007a2ca34b416ae182d', 'request_id': 'req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.473539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e7971827414007a2ca34b416ae182d', 'request_id': 'req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.486064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e7971827414007a2ca34b416ae182d', 'request_id': 'req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.509315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] The token cache is being invalidate because project 76e7971827414007a2ca34b416ae182d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:43.509697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.510589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.513241 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3656/7290] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:43 2022] DELETE /identity/v3/projects/76e7971827414007a2ca34b416ae182d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:43.518586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d8ad-f2c4-4b9b-84e3-14e8fece710e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.519750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d8ad-f2c4-4b9b-84e3-14e8fece710e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.520162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d8ad-f2c4-4b9b-84e3-14e8fece710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.543400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6209d8ad-f2c4-4b9b-84e3-14e8fece710e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:43.544531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6209d8ad-f2c4-4b9b-84e3-14e8fece710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.560120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:43.561669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.638008 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3635/7291] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:43.647788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88719b-789e-47d1-ab4a-dfc53287d350 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.648448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88719b-789e-47d1-ab4a-dfc53287d350 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.648954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88719b-789e-47d1-ab4a-dfc53287d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.650880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f0e8-aac6-4b3b-afa7-a357033c4d35 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.656381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.657373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.657742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.658084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] PATH_INFO: `/v3/projects/be7c8e87ded6443ab934791765f694a5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.659549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7c8e87ded6443ab934791765f694a5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.662258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.672489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ce88719b-789e-47d1-ab4a-dfc53287d350 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:43.674387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce88719b-789e-47d1-ab4a-dfc53287d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.686164 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3636/7292] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:43.687458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88719b-789e-47d1-ab4a-dfc53287d350 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:43.699987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88719b-789e-47d1-ab4a-dfc53287d350 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.706874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.707702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.707993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.708344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.718641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:43.719446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.721139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.726326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7c8e87ded6443ab934791765f694a5', 'request_id': 'req-65b26a12-09cc-43d2-9e9b-2710a032845d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.734326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7c8e87ded6443ab934791765f694a5', 'request_id': 'req-65b26a12-09cc-43d2-9e9b-2710a032845d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.737467 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3637/7293] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:43.740548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:43.746624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7c8e87ded6443ab934791765f694a5', 'request_id': 'req-65b26a12-09cc-43d2-9e9b-2710a032845d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.751328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ed890-4133-40ec-82d5-37b0610a28da admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.761955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] The token cache is being invalidate because project be7c8e87ded6443ab934791765f694a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:43.763033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.763910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:43.766496 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3657/7294] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:43 2022] DELETE /identity/v3/projects/be7c8e87ded6443ab934791765f694a5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:43.770083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:43.772536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.827685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.828366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.828657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.829103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.829793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.831759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.849269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:43.871487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b26a12-09cc-43d2-9e9b-2710a032845d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.877262 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3638/7295] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:43 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:43.878158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:43.879924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:43.881558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:43.967307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.968772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.969111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.969509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] PATH_INFO: `/v3/users/f079df47e395467aa299a8c843df5a66` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.969616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab4478-4458-4902-bf6c-c1b18926b375 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:43.970893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f079df47e395467aa299a8c843df5a66)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.972870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:43.975942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:43.976657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:43.976938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:43.977247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:43.978000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:43.980091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.005470 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3639/7296] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:43 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:44.007267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.008515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.022217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0df72-6730-41c7-9c8a-90820e3b6506 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.034113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.035096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.035385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.035661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] PATH_INFO: `/v3/projects/d2657072934844f9952c9c5e6b383d77` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.037293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2657072934844f9952c9c5e6b383d77)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.040183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f079df47e395467aa299a8c843df5a66'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.040334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.042096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f079df47e395467aa299a8c843df5a66'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.058388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f079df47e395467aa299a8c843df5a66'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.059396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f079df47e395467aa299a8c843df5a66'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.069226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f079df47e395467aa299a8c843df5a66'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.091714 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3658/7297] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:43 2022] DELETE /identity/v3/users/f079df47e395467aa299a8c843df5a66 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:44.091714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.091714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.110695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2657072934844f9952c9c5e6b383d77', 'request_id': 'req-32830a00-3ca0-451a-ae9b-701726f3c722'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.118159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2657072934844f9952c9c5e6b383d77', 'request_id': 'req-32830a00-3ca0-451a-ae9b-701726f3c722'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.128657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2657072934844f9952c9c5e6b383d77', 'request_id': 'req-32830a00-3ca0-451a-ae9b-701726f3c722'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.145338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] The token cache is being invalidate because project d2657072934844f9952c9c5e6b383d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:44.145882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.146882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-32830a00-3ca0-451a-ae9b-701726f3c722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.149249 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3640/7298] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:44 2022] DELETE /identity/v3/projects/d2657072934844f9952c9c5e6b383d77 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:44.158805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c339-1000-446f-bc49-cf05aee079a5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.159157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c339-1000-446f-bc49-cf05aee079a5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.159454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6c339-1000-446f-bc49-cf05aee079a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.190715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-85a6c339-1000-446f-bc49-cf05aee079a5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:44.192685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85a6c339-1000-446f-bc49-cf05aee079a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.196482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e96eaf-95c1-43ca-988f-0dc1d6d0ec4a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.204483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.205567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.206196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.206574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.208027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.210105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.214708 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3641/7299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:44.224124 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3659/7300] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:44.226640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48613-d3be-4892-a671-faae0c03dc5e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.226979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48613-d3be-4892-a671-faae0c03dc5e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.227310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48613-d3be-4892-a671-faae0c03dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.228283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.232164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.249498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-16e48613-d3be-4892-a671-faae0c03dc5e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:44.250943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-16e48613-d3be-4892-a671-faae0c03dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.261166 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3642/7301] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:44.265972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e48613-d3be-4892-a671-faae0c03dc5e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.269729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f06934-b6e6-4142-90b5-53ba20d2f1bd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.278444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.278689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e48613-d3be-4892-a671-faae0c03dc5e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.279151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.279432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.279706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.282743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.284452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.284966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.286040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.286452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.286735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.287507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:44.287836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.289575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.304305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3643/7302] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:28:44.308863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.321302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d634fda-09ea-4475-8813-cb74fedb70f6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.327189 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3660/7303] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:44.327908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.328851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.329102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.329602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.330078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.330980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.333480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.342142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383078ad-1a97-4794-8e3a-d3b5a264af43 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.348655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8bc48-b89f-43d2-a1ab-97990ac66178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.349783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8bc48-b89f-43d2-a1ab-97990ac66178 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.350064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8bc48-b89f-43d2-a1ab-97990ac66178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.350346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8bc48-b89f-43d2-a1ab-97990ac66178 admin admin] PATH_INFO: `/v3/projects/1364520360544486b40ad60a167c88ce/users/65888393c3764f5d9f711bd79d7739be/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.370156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:44.391019 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3644/7304] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:44.394815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8bc48-b89f-43d2-a1ab-97990ac66178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1364520360544486b40ad60a167c88ce, user_id=65888393c3764f5d9f711bd79d7739be, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.395437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.397708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8bc48-b89f-43d2-a1ab-97990ac66178 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.426453 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3661/7305] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:44 2022] PUT /identity/v3/projects/1364520360544486b40ad60a167c88ce/users/65888393c3764f5d9f711bd79d7739be/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:44.428616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:44.431237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.431541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.431849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.488854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] MFA Rules not processed for user `65888393c3764f5d9f711bd79d7739be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:44.490959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.540692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff705f5-a440-49e0-b73e-84f54b3f05c8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.601182 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3662/7306] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:44.602937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.604835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.616216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.616921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.617239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.617513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.618212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.620190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.645928 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3645/7307] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:44.646632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.660719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef14b0-f0eb-4e3f-b5aa-bad4128b3113 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.668019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.668846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.669189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.669447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.670450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.672160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.689212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fb586-f7ab-4789-b242-68a250068a16 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.694316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.695226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.695536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.695917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] PATH_INFO: `/v3/projects/70fb96c4276944649ea075bcb4100ea9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.697933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fb96c4276944649ea075bcb4100ea9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.700882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.709532 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3646/7308] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:44.710730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.760215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fb96c4276944649ea075bcb4100ea9', 'request_id': 'req-14a3fe93-668c-4816-8d39-8f3c7d3c971b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.767054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fb96c4276944649ea075bcb4100ea9', 'request_id': 'req-14a3fe93-668c-4816-8d39-8f3c7d3c971b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.775574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fb96c4276944649ea075bcb4100ea9', 'request_id': 'req-14a3fe93-668c-4816-8d39-8f3c7d3c971b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.784918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7210b-0cc9-4469-a25a-d1083e05b224 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.787677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] The token cache is being invalidate because project 70fb96c4276944649ea075bcb4100ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:44.787983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.788628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:44.790334 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3663/7309] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:44 2022] DELETE /identity/v3/projects/70fb96c4276944649ea075bcb4100ea9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:44.794341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.796824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.808544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:44.827443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:44.859503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a85309-35ad-4a00-a39c-bbc9dccbe4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.860193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85309-35ad-4a00-a39c-bbc9dccbe4af admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.860474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85309-35ad-4a00-a39c-bbc9dccbe4af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.860748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85309-35ad-4a00-a39c-bbc9dccbe4af admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.861530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a85309-35ad-4a00-a39c-bbc9dccbe4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.863296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a85309-35ad-4a00-a39c-bbc9dccbe4af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.875613 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3647/7310] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:44.876754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.877077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.877441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.893873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3fe93-668c-4816-8d39-8f3c7d3c971b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.902823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20031ac-40d3-4ccc-be9f-09031f048a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.903974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20031ac-40d3-4ccc-be9f-09031f048a60 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.904598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20031ac-40d3-4ccc-be9f-09031f048a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.905092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20031ac-40d3-4ccc-be9f-09031f048a60 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.906005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20031ac-40d3-4ccc-be9f-09031f048a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.906188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:44.907409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.908756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20031ac-40d3-4ccc-be9f-09031f048a60 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.928008 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3648/7311] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:44.930750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.932284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.937182 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3664/7312] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:44.939345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c183ea-8341-42d9-bb5f-a1938ece5f72 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.939756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c183ea-8341-42d9-bb5f-a1938ece5f72 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.940647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c183ea-8341-42d9-bb5f-a1938ece5f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.952261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0638023-fea5-4f23-baeb-4180ab24e65e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.957996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.958719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.959078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.959345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.960073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.961860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.966843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a5c183ea-8341-42d9-bb5f-a1938ece5f72 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:44.968085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a5c183ea-8341-42d9-bb5f-a1938ece5f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:44.973936 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3649/7313] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:44.976910 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3665/7314] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:44.978023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.981550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c183ea-8341-42d9-bb5f-a1938ece5f72 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:44.988599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece092-e53a-4f70-849d-0ccc771e0402 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.991251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c183ea-8341-42d9-bb5f-a1938ece5f72 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:44.994124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.994959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.995300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.995575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:44.996409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:44.997063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:44.998018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:44.998318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:44.998430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:44.998598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] PATH_INFO: `/v3/projects/e9a9696c07e1419b93df7b56eec5fc8a/users/d372d0f2489b4b0f86ccfc560cd27efd/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.012147 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3650/7315] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:45.012147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.022431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a9696c07e1419b93df7b56eec5fc8a, user_id=d372d0f2489b4b0f86ccfc560cd27efd, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.022853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3ab2f-3319-4c8a-a53c-760dff719124 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.025650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.033119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa9846-b10f-4466-a6bd-dd657d993cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.034255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa9846-b10f-4466-a6bd-dd657d993cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.034837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa9846-b10f-4466-a6bd-dd657d993cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.035455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa9846-b10f-4466-a6bd-dd657d993cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.036258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa9846-b10f-4466-a6bd-dd657d993cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:45.036684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa9846-b10f-4466-a6bd-dd657d993cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.038566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa9846-b10f-4466-a6bd-dd657d993cd0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.045758 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3666/7316] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:44 2022] PUT /identity/v3/projects/e9a9696c07e1419b93df7b56eec5fc8a/users/d372d0f2489b4b0f86ccfc560cd27efd/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:45.046946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.058834 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3651/7317] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:45.058834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2892-fba0-422c-9a7f-fc385bb027fd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.058834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2892-fba0-422c-9a7f-fc385bb027fd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.058834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d2892-fba0-422c-9a7f-fc385bb027fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.075750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-027d2892-fba0-422c-9a7f-fc385bb027fd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:45.076976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-027d2892-fba0-422c-9a7f-fc385bb027fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:45.120469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f426b1-48c7-4fe4-a821-769cdbcad19d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.125400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.126303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.126583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.126987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] PATH_INFO: `/v3/projects/5adb8488801f4c4caf618c57a8137dd4/users/91d397a892634042b2d95c5a8175301f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.143305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adb8488801f4c4caf618c57a8137dd4, user_id=91d397a892634042b2d95c5a8175301f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.148728 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3652/7318] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:45.148886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.148967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d2892-fba0-422c-9a7f-fc385bb027fd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.163661 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3667/7319] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:45 2022] PUT /identity/v3/projects/5adb8488801f4c4caf618c57a8137dd4/users/91d397a892634042b2d95c5a8175301f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:45.168704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.168704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:45.169132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d2892-fba0-422c-9a7f-fc385bb027fd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.228998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:45.234708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e1b1-e935-451c-917c-6ff49a0e8900 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.236126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.236892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.237231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.237495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.238377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.240505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.240636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.241353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.242007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.242343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.253164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.254745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.266717 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3668/7320] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:45.268691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.281418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd3c4a-825c-4c2a-bf85-44254b526916 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.284762 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3653/7321] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:45 2022] POST /identity/v3/projects => generated 399 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:45.287613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.288603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.288884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.289189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.289930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.290513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.291865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.307992 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3669/7322] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:45.309431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.319727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef6283-552d-4e22-afc3-518d4638e772 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.321633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:45.394454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6f12-45eb-4f3a-bbdc-5fdc703d9d9c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.400548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.401149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521370-416f-4f93-8ff7-5816196a605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.401886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.402176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.402458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.402558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521370-416f-4f93-8ff7-5816196a605d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.402907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521370-416f-4f93-8ff7-5816196a605d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.403252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521370-416f-4f93-8ff7-5816196a605d admin admin] PATH_INFO: `/v3/projects/5adb8488801f4c4caf618c57a8137dd4/users/91d397a892634042b2d95c5a8175301f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.403354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.405579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521370-416f-4f93-8ff7-5816196a605d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adb8488801f4c4caf618c57a8137dd4, user_id=91d397a892634042b2d95c5a8175301f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.405859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.408246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521370-416f-4f93-8ff7-5816196a605d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.426811 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3670/7323] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:45 2022] PUT /identity/v3/projects/5adb8488801f4c4caf618c57a8137dd4/users/91d397a892634042b2d95c5a8175301f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:45.437551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.438239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.442023 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3654/7324] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:45 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:45.442159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.446115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.468284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab782e1-b358-44e8-93d7-995ea95aaa75 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.489849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] MFA Rules not processed for user `91d397a892634042b2d95c5a8175301f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:45.491068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:45.564102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.564783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.565251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.566445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.566445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.568075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.584334 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3655/7325] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:45.586536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.603289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc2d90-a1f1-4406-9c09-80fdc19faa5f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.604550 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3671/7326] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:45.609961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.610502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.610879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.611273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.612993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.615079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.615222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.616651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:45.631975 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3656/7327] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:45.633508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.653047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ad61-d2e9-47ae-9624-ae0ea2b86f57 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.660230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e59ed5-ef2d-4107-b737-6d454e714727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.661901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59ed5-ef2d-4107-b737-6d454e714727 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.662202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59ed5-ef2d-4107-b737-6d454e714727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.662481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e59ed5-ef2d-4107-b737-6d454e714727 admin admin] PATH_INFO: `/v3/projects/68a1d25166f8467fa1bf53905dc9bdc1/users/c072719e93fc4885b63578f93baa848f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.686462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e59ed5-ef2d-4107-b737-6d454e714727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a1d25166f8467fa1bf53905dc9bdc1, user_id=c072719e93fc4885b63578f93baa848f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.690007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e59ed5-ef2d-4107-b737-6d454e714727 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.699589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326468a3-7073-48ea-abac-ad859a6850e7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.711767 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3657/7328] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:45 2022] PUT /identity/v3/projects/68a1d25166f8467fa1bf53905dc9bdc1/users/c072719e93fc4885b63578f93baa848f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:45.718213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:45.722625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe861a-6545-4adb-a608-92694e44d8fe None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.723137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe861a-6545-4adb-a608-92694e44d8fe None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.723488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe861a-6545-4adb-a608-92694e44d8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.771038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.771972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.772254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.772870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.773710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6cbe861a-6545-4adb-a608-92694e44d8fe None None] MFA Rules not processed for user `c072719e93fc4885b63578f93baa848f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:45.774984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6cbe861a-6545-4adb-a608-92694e44d8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:45.844436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:45.848329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.850127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.852558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3658/7329] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:45.861097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe861a-6545-4adb-a608-92694e44d8fe None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:45.861405 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3672/7330] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:45.940321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe861a-6545-4adb-a608-92694e44d8fe None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:45.949253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:45.949947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:45.950228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:45.951098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:45.951906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:45.954495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:45.993373 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3659/7331] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:45 2022] POST /identity/v3/projects => generated 397 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:45.994798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.006782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4731c-55ea-45cf-9ec1-3570975e40ca service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.028706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.094821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.095535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.095816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.096095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.096952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.098946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.101505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb502f2-fa0d-4410-a464-8a56b3913210 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.107171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.108244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.108654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.108939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] PATH_INFO: `/v3/users/65888393c3764f5d9f711bd79d7739be` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.110519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65888393c3764f5d9f711bd79d7739be)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.112420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.127267 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3673/7332] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:45 2022] POST /identity/v3/users => generated 305 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:46.128190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.151786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e81bdf-4c2b-4f95-8c44-925009326bd6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.158243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.158928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.159208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.159635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.160380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.162145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.181845 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3674/7333] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:46.187653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.195798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65888393c3764f5d9f711bd79d7739be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:46.196737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65888393c3764f5d9f711bd79d7739be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:46.200169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ebefe-8e2e-4457-b8e7-6ce3cf20734e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.205950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.207227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.207659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.208437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] PATH_INFO: `/v3/projects/b789cf878df042a9b031309018d819c2/users/7730cea4a41f440a8388bd0a98cdfaa9/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.215745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65888393c3764f5d9f711bd79d7739be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:46.216647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65888393c3764f5d9f711bd79d7739be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:46.227435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-373f4425-5e50-4913-bc21-ff4501103e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65888393c3764f5d9f711bd79d7739be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:46.229557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b789cf878df042a9b031309018d819c2, user_id=7730cea4a41f440a8388bd0a98cdfaa9, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.232550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.249682 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3660/7334] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:46 2022] DELETE /identity/v3/users/65888393c3764f5d9f711bd79d7739be => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:46.251896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.252190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.252513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.253538 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3675/7335] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:46 2022] PUT /identity/v3/projects/b789cf878df042a9b031309018d819c2/users/7730cea4a41f440a8388bd0a98cdfaa9/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:46.261189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:46.264188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.267860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:46.276326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:46.277836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:46.307206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:46.362379 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3661/7336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:46.369821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84ab8f-46a0-4aaf-83f2-f91a9b29e473 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.373506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.375477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:46.377202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.377988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.378375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.378687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.379619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.381753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.398619 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3676/7337] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:46.399092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.414305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f9051-766b-4428-93cf-81484f048760 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.421332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0ce07-0a8e-4da5-b995-b6d93e02fb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.422504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0ce07-0a8e-4da5-b995-b6d93e02fb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.422799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0ce07-0a8e-4da5-b995-b6d93e02fb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.423075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0ce07-0a8e-4da5-b995-b6d93e02fb3e admin admin] PATH_INFO: `/v3/projects/b789cf878df042a9b031309018d819c2/users/7730cea4a41f440a8388bd0a98cdfaa9/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.425677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0ce07-0a8e-4da5-b995-b6d93e02fb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b789cf878df042a9b031309018d819c2, user_id=7730cea4a41f440a8388bd0a98cdfaa9, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.428547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea0ce07-0a8e-4da5-b995-b6d93e02fb3e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.443664 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3677/7338] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:46 2022] PUT /identity/v3/projects/b789cf878df042a9b031309018d819c2/users/7730cea4a41f440a8388bd0a98cdfaa9/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:28:46.453347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f071f4-2e4c-492a-ab11-3560db8a9870 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.453347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f071f4-2e4c-492a-ab11-3560db8a9870 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.453347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f071f4-2e4c-492a-ab11-3560db8a9870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.458602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c46d-9f66-497a-ad21-fbe2e559820a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.481126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-26f071f4-2e4c-492a-ab11-3560db8a9870 None None] MFA Rules not processed for user `d372d0f2489b4b0f86ccfc560cd27efd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:46.482808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-26f071f4-2e4c-492a-ab11-3560db8a9870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:46.528488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.529558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.529981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.531156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.583946 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3678/7339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:46.585485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1039439-df39-429e-afee-a052add44b1f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.585771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1039439-df39-429e-afee-a052add44b1f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.586042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1039439-df39-429e-afee-a052add44b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.611826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.613309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.621738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c1039439-df39-429e-afee-a052add44b1f None None] MFA Rules not processed for user `7730cea4a41f440a8388bd0a98cdfaa9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:46.622959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c1039439-df39-429e-afee-a052add44b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:46.624659 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3662/7340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:46.625651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.626995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:46.641152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e0305-fb02-4df9-9bc1-612444c80c07 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.646259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.646936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.647215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.647490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.648225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.650486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.655870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:46.693436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3663/7341] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:46 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:46.697992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.745961 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3679/7342] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:46.771403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1039439-df39-429e-afee-a052add44b1f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.789209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1039439-df39-429e-afee-a052add44b1f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.816398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad93382-e66a-46bd-80a7-3edecb2a8838 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.821707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.822584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.822921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.823198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.823906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.826604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.831246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:46.862511 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3664/7343] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:46 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:46.866429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.885243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28ca2b-cc42-4005-81cf-029872475dd2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.894227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.895169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.895697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.896649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.897496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.897613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.898444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.898869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.899396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.900059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.902858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:46.912636 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3665/7344] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:28:46.919418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:46.937110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8fe71-4a18-492e-bb58-3a549c74660a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:46.950412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:46.952416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:46.952416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:46.952416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] PATH_INFO: `/v3/projects/cca0588184324e06bc1b42b30d4f8599/users/bdd7df768f654bbf8c27cee4e5c027c2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:46.980153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca0588184324e06bc1b42b30d4f8599, user_id=bdd7df768f654bbf8c27cee4e5c027c2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.984360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:46.995389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:46.997355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:47.017404 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3680/7345] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:47.018920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:47.020598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:47.021558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3666/7346] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:46 2022] PUT /identity/v3/projects/cca0588184324e06bc1b42b30d4f8599/users/bdd7df768f654bbf8c27cee4e5c027c2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:47.022505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:47.041586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f16c-7c54-4515-a5c6-ab6ab548b1e3 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:47.135793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:47.136850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:47.137297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:47.137700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] PATH_INFO: `/v3/projects/1364520360544486b40ad60a167c88ce` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:47.139147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1364520360544486b40ad60a167c88ce)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:47.142154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:47.165900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f23d5-f5ea-4ad4-8cb4-9cd703b5901e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:47.173259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:47.174263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:47.174845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:47.175199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:47.176554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:47.178914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:47.199449 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3667/7347] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:47.203589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:47.219691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbab7-8bb2-4dfa-b3d3-ee268c36f5f2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:47.249011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1364520360544486b40ad60a167c88ce', 'request_id': 'req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.257254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1364520360544486b40ad60a167c88ce', 'request_id': 'req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.263860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:47.275086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1364520360544486b40ad60a167c88ce', 'request_id': 'req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.295461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:47.296775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:47.296906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] The token cache is being invalidate because project 1364520360544486b40ad60a167c88ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:47.297195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.297883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:47.298680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] PATH_INFO: `/v3/projects/cca0588184324e06bc1b42b30d4f8599/users/bdd7df768f654bbf8c27cee4e5c027c2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:47.300935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.302759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca0588184324e06bc1b42b30d4f8599, user_id=bdd7df768f654bbf8c27cee4e5c027c2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:47.308409 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3681/7348] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:47 2022] DELETE /identity/v3/projects/1364520360544486b40ad60a167c88ce => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:47.310059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:47.310357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:47.319215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:47.328480 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3668/7349] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:47 2022] PUT /identity/v3/projects/cca0588184324e06bc1b42b30d4f8599/users/bdd7df768f654bbf8c27cee4e5c027c2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:47.336197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:47.344835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446b2fd-fbbb-4e6e-bbd1-7a05fdc85fb2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:47.415322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:47.417935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:47.475111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:47.476101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:47.476529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:47.476921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] PATH_INFO: `/v3/users/91d397a892634042b2d95c5a8175301f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:47.478408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d397a892634042b2d95c5a8175301f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:47.480485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:47.552418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d397a892634042b2d95c5a8175301f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.552667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352b5d0-819e-4a0c-a649-25b8ec193b0d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:47.553347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d397a892634042b2d95c5a8175301f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.559374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1fd88-7f1e-428f-af24-3beab5b6c047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:47.560057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1fd88-7f1e-428f-af24-3beab5b6c047 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:47.560320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1fd88-7f1e-428f-af24-3beab5b6c047 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:47.560590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1fd88-7f1e-428f-af24-3beab5b6c047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:47.563192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f7a1fd88-7f1e-428f-af24-3beab5b6c047 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:47.571859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d397a892634042b2d95c5a8175301f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.572831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d397a892634042b2d95c5a8175301f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.582535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d397a892634042b2d95c5a8175301f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:47.599521 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3682/7350] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:47 2022] DELETE /identity/v3/users/91d397a892634042b2d95c5a8175301f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:47.646573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1fd88-7f1e-428f-af24-3beab5b6c047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:47.648362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1fd88-7f1e-428f-af24-3beab5b6c047 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:47.660863 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3669/7351] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:47.900426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:47.901654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:47.975488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf475-e35b-4786-b796-d49f39086bc5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:47.980486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:47.981415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:47.981693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:47.982073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] PATH_INFO: `/v3/projects/5adb8488801f4c4caf618c57a8137dd4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:47.983426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adb8488801f4c4caf618c57a8137dd4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:47.985514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.012492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:48.036500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adb8488801f4c4caf618c57a8137dd4', 'request_id': 'req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:48.044558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adb8488801f4c4caf618c57a8137dd4', 'request_id': 'req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:48.053141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adb8488801f4c4caf618c57a8137dd4', 'request_id': 'req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:48.064629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] The token cache is being invalidate because project 5adb8488801f4c4caf618c57a8137dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:48.064918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:48.065636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ebe9fe4c-00be-4e55-a050-83c5cb2cfb0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:48.067258 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3683/7352] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:47 2022] DELETE /identity/v3/projects/5adb8488801f4c4caf618c57a8137dd4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:48.072533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da6423-98d1-4d17-b781-86d8a109a9f2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.072817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da6423-98d1-4d17-b781-86d8a109a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.073117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da6423-98d1-4d17-b781-86d8a109a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.092170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-29da6423-98d1-4d17-b781-86d8a109a9f2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:48.093458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-29da6423-98d1-4d17-b781-86d8a109a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:48.159571 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3670/7353] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:48.169664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a188b-345e-413b-8cdb-b7a001987df8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.170016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a188b-345e-413b-8cdb-b7a001987df8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.170286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a188b-345e-413b-8cdb-b7a001987df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.194734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a13a188b-345e-413b-8cdb-b7a001987df8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:48.196287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a13a188b-345e-413b-8cdb-b7a001987df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:48.205489 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3684/7354] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:48.210130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da6423-98d1-4d17-b781-86d8a109a9f2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.217322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:48.221825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da6423-98d1-4d17-b781-86d8a109a9f2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.228777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:48.229637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.229922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.230221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.231008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:48.231258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:48.232886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.249832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3671/7355] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:48.251091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a188b-345e-413b-8cdb-b7a001987df8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.261471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a188b-345e-413b-8cdb-b7a001987df8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.266731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:48.267522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.267794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.268081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.268904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:48.271192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.300307 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3685/7356] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:48.304597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.316356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398354-b803-4904-8ab1-99dc8da02e82 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.409959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:48.411010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.411517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.411862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.412805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:48.415592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.465180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3672/7357] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:48.469731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.505101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be94ae-9304-4f29-90ea-75655f0485eb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.526068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:48.527776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.528178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.528576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.529527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:48.531910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.551689 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3686/7358] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:48.556068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.572789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d113e5a-27de-4724-8de7-93633bd92439 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.583490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbc9e2-722a-4ae9-b694-d70b07de5a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:48.584191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc9e2-722a-4ae9-b694-d70b07de5a20 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.584524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc9e2-722a-4ae9-b694-d70b07de5a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.585401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc9e2-722a-4ae9-b694-d70b07de5a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.586160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbc9e2-722a-4ae9-b694-d70b07de5a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:48.587943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbc9e2-722a-4ae9-b694-d70b07de5a20 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.600424 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3673/7359] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:48.605071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.617456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc43ce-1b61-4646-995d-3b60d6ba5e11 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.623286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:48.624315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.624602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.624881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] PATH_INFO: `/v3/projects/b55b24bd3f4842329c7ad09562be1b7e/users/38ba41d0a25b47d19a21a0b225b725a0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.643756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55b24bd3f4842329c7ad09562be1b7e, user_id=38ba41d0a25b47d19a21a0b225b725a0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:48.646692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.665187 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3687/7360] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:48 2022] PUT /identity/v3/projects/b55b24bd3f4842329c7ad09562be1b7e/users/38ba41d0a25b47d19a21a0b225b725a0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:48.676095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd3aa6-fc8d-4076-880f-76ef33a6a6e6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.676587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd3aa6-fc8d-4076-880f-76ef33a6a6e6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.677020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd3aa6-fc8d-4076-880f-76ef33a6a6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.710688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-02dd3aa6-fc8d-4076-880f-76ef33a6a6e6 None None] MFA Rules not processed for user `38ba41d0a25b47d19a21a0b225b725a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:48.712176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-02dd3aa6-fc8d-4076-880f-76ef33a6a6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:48.791039 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3674/7361] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:48.795827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.888917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad52d3-158d-430c-ba9e-970461e400d7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.901168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d345149-519b-4d03-af37-8619da6b8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:48.902416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d345149-519b-4d03-af37-8619da6b8103 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.902810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d345149-519b-4d03-af37-8619da6b8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.903191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d345149-519b-4d03-af37-8619da6b8103 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:48.904400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d345149-519b-4d03-af37-8619da6b8103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:48.907421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d345149-519b-4d03-af37-8619da6b8103 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:48.951211 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3688/7362] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:48.955276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd3aa6-fc8d-4076-880f-76ef33a6a6e6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:48.969260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd3aa6-fc8d-4076-880f-76ef33a6a6e6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:48.981653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc50d65-50f5-4d9f-8d0d-738466dd8841 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:48.981943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc50d65-50f5-4d9f-8d0d-738466dd8841 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:48.982225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc50d65-50f5-4d9f-8d0d-738466dd8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.011274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8dc50d65-50f5-4d9f-8d0d-738466dd8841 None None] MFA Rules not processed for user `bdd7df768f654bbf8c27cee4e5c027c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:49.012978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8dc50d65-50f5-4d9f-8d0d-738466dd8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:49.037605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:49.057595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.058877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.059310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.059713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.060546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.063343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.074059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:49.103360 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3675/7363] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:49.109985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.126734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e65505-c0d2-4958-bfdd-2a8070c77026 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.132244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35fa4d-c782-4d56-a857-b52c4dad2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.133079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35fa4d-c782-4d56-a857-b52c4dad2cbe admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.133463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35fa4d-c782-4d56-a857-b52c4dad2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.133836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35fa4d-c782-4d56-a857-b52c4dad2cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.134756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35fa4d-c782-4d56-a857-b52c4dad2cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.136461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35fa4d-c782-4d56-a857-b52c4dad2cbe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.157098 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3689/7364] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:49.157400 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3676/7365] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:49.160219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc50d65-50f5-4d9f-8d0d-738466dd8841 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.164903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.166710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.169597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.175604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc50d65-50f5-4d9f-8d0d-738466dd8841 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.183189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.184285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.184722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.185205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.188227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.188426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.213753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] MFA Rules not processed for user `d372d0f2489b4b0f86ccfc560cd27efd`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:49.216741 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3690/7366] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:49.217601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:49.218279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.232694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3850dd-3104-437f-9cbd-5156027f8f50 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.237788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba347c-5bea-4dfe-a1ae-b24e3bcad07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.238700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba347c-5bea-4dfe-a1ae-b24e3bcad07c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.238979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba347c-5bea-4dfe-a1ae-b24e3bcad07c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.239254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba347c-5bea-4dfe-a1ae-b24e3bcad07c admin admin] PATH_INFO: `/v3/projects/3ce4a4bad015474fac2489168ad82790/users/783f6bd870cb41199b6cc6c533499000/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.257334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba347c-5bea-4dfe-a1ae-b24e3bcad07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce4a4bad015474fac2489168ad82790, user_id=783f6bd870cb41199b6cc6c533499000, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.260369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba347c-5bea-4dfe-a1ae-b24e3bcad07c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.279690 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3691/7367] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:49 2022] PUT /identity/v3/projects/3ce4a4bad015474fac2489168ad82790/users/783f6bd870cb41199b6cc6c533499000/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:49.284558 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3677/7368] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:49.291124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae02b-fe6a-4df8-a40b-478c87d55b7b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.291425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae02b-fe6a-4df8-a40b-478c87d55b7b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.291982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae02b-fe6a-4df8-a40b-478c87d55b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.300136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.301922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:49.345256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-81bae02b-fe6a-4df8-a40b-478c87d55b7b None None] MFA Rules not processed for user `783f6bd870cb41199b6cc6c533499000`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:49.348281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-81bae02b-fe6a-4df8-a40b-478c87d55b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:49.418470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae8bcc-694b-4a1f-86a7-380b4dda05b9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.486490 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3692/7369] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:49.496731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bae02b-fe6a-4df8-a40b-478c87d55b7b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.533646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.534513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.535036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.535363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.537529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:49.563165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:49.582695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bae02b-fe6a-4df8-a40b-478c87d55b7b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.588822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.589915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.590340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.590785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.591516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.593476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.616783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:49.632092 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3693/7370] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:49 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:49.632860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.639987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.641645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.651838 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3678/7371] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:28:49.733705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cf5cf-4f16-4967-8db6-b0a55ed56f49 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.740827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.741801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.742155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.742498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.743433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.745999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.772948 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3694/7372] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:49 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:28:49.774512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.787708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f2d92-edf9-4209-823e-5d4ff8a7eb6e service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.792925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.793956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.794252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.794511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.795288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.796950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.811780 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3679/7373] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:49.813432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.824032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb31b7c-62b3-47bb-bd2b-98978cb5feea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:49.829138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:49.830126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:49.830469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:49.830808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] PATH_INFO: `/v3/projects/78bc11513c204016933020ebe1275dc8/users/4404fd69a6924bdca2f8aac7adb8c470/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:49.855373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bc11513c204016933020ebe1275dc8, user_id=4404fd69a6924bdca2f8aac7adb8c470, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:49.858919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:49.877012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3695/7374] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:49 2022] PUT /identity/v3/projects/78bc11513c204016933020ebe1275dc8/users/4404fd69a6924bdca2f8aac7adb8c470/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:49.880989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:49.903532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5364283-5b26-4064-8ef0-1f4f17de48a8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:50.001538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbf51c-a5a9-4dae-8d27-1ec52a6443ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:50.004096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf51c-a5a9-4dae-8d27-1ec52a6443ae admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:50.004096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf51c-a5a9-4dae-8d27-1ec52a6443ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:50.004096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbf51c-a5a9-4dae-8d27-1ec52a6443ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:50.004096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbf51c-a5a9-4dae-8d27-1ec52a6443ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:50.004764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbf51c-a5a9-4dae-8d27-1ec52a6443ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:50.016920 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3680/7375] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:50.021190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:50.037968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37676adb-2376-4ab1-9e4d-351f7a1556fb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:50.053206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:50.054376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:50.054833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:50.055255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] PATH_INFO: `/v3/projects/78bc11513c204016933020ebe1275dc8/users/4404fd69a6924bdca2f8aac7adb8c470/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:50.058443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bc11513c204016933020ebe1275dc8, user_id=4404fd69a6924bdca2f8aac7adb8c470, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:50.061733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:50.078123 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3696/7376] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:50 2022] PUT /identity/v3/projects/78bc11513c204016933020ebe1275dc8/users/4404fd69a6924bdca2f8aac7adb8c470/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:50.089354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b53d-2db3-4645-a21c-7a246403be3d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:50.089745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b53d-2db3-4645-a21c-7a246403be3d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:50.090072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b53d-2db3-4645-a21c-7a246403be3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:50.124711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0150b53d-2db3-4645-a21c-7a246403be3d None None] MFA Rules not processed for user `4404fd69a6924bdca2f8aac7adb8c470`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:50.127794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0150b53d-2db3-4645-a21c-7a246403be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:50.238059 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3681/7377] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:50.253514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:50.259927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:50.391564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5ccb-4f1d-4c60-ab75-d52b43588546 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:50.403765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:50.404667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:50.405657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:50.406202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:50.422264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:50.424080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:50.442425 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3697/7378] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:50.628752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:50.628752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:50.628752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:50.709012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:50.710241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:50.716520 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3682/7379] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:50 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:50.722396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:50.728508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:50.840281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:50.845999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fd28f-1e2c-4db4-adbc-9d6d05d1a276 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:50.852322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33fd20-5e8f-48c0-b789-e68e48d3b703 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:50.853978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33fd20-5e8f-48c0-b789-e68e48d3b703 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:50.854612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33fd20-5e8f-48c0-b789-e68e48d3b703 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:50.855259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33fd20-5e8f-48c0-b789-e68e48d3b703 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:50.953951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f33fd20-5e8f-48c0-b789-e68e48d3b703 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:50.973424 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3698/7380] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:50 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:51.206128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:51.208471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:51.226107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b9f8b-fcce-48c0-9e67-17c4e22c35c9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:51.232508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab8355-db48-4caa-9f31-df71123182ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:51.234811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8355-db48-4caa-9f31-df71123182ec service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:51.235159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8355-db48-4caa-9f31-df71123182ec service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:51.235764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8355-db48-4caa-9f31-df71123182ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:51.242799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:51.318380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab8355-db48-4caa-9f31-df71123182ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:51.319941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab8355-db48-4caa-9f31-df71123182ec service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:51.330798 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3683/7381] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:51.976898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612fdb7-2257-4c72-8ae3-e72f0f0fadf6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:51.977445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612fdb7-2257-4c72-8ae3-e72f0f0fadf6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:51.977760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612fdb7-2257-4c72-8ae3-e72f0f0fadf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:52.003841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2612fdb7-2257-4c72-8ae3-e72f0f0fadf6 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:52.005277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2612fdb7-2257-4c72-8ae3-e72f0f0fadf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:52.009670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3699/7382] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:51 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:52.014125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301cd7a-0466-49ef-9276-1c7ab57893d4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:52.014665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301cd7a-0466-49ef-9276-1c7ab57893d4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:52.015013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301cd7a-0466-49ef-9276-1c7ab57893d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application [None req-f301cd7a-0466-49ef-9276-1c7ab57893d4 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jun 18 22:28:52.077859 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application self.check_revocation(token) Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:52.079756 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: ERROR keystone.server.flask.application Jun 18 22:28:52.080704 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3684/7383] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:52 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:28:52.084477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98e231-4bc0-4688-9eb1-649fee6963c1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:52.084770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98e231-4bc0-4688-9eb1-649fee6963c1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:52.085160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98e231-4bc0-4688-9eb1-649fee6963c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:52.187387 ncdv-master-1 devstack@keystone.service[91205]: WARNING keystone.server.flask.application [None req-7e98e231-4bc0-4688-9eb1-649fee6963c1 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.30: keystone.exception.Unauthorized: The request you have made requires authentication. Jun 18 22:28:52.193957 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3700/7384] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:52 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 111 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jun 18 22:28:52.200608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ab5b4-e87e-47bc-9dfa-5ea715c83994 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:52.201128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ab5b4-e87e-47bc-9dfa-5ea715c83994 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:52.201568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ab5b4-e87e-47bc-9dfa-5ea715c83994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:52.243634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5a7ab5b4-e87e-47bc-9dfa-5ea715c83994 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:52.245635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5a7ab5b4-e87e-47bc-9dfa-5ea715c83994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:52.255347 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3685/7385] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:52.259458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98e231-4bc0-4688-9eb1-649fee6963c1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:52.274172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98e231-4bc0-4688-9eb1-649fee6963c1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:52.283623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbf117-6f74-433f-90ae-23d17ff5a3ca tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:52.286861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbf117-6f74-433f-90ae-23d17ff5a3ca tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:52.287154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbf117-6f74-433f-90ae-23d17ff5a3ca tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:52.287439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbf117-6f74-433f-90ae-23d17ff5a3ca tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:52.341480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-14bbf117-6f74-433f-90ae-23d17ff5a3ca tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:52.361090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3701/7386] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:52 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:53.366528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9534-9228-4385-a7ed-8bb5de9150a6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:53.367669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9534-9228-4385-a7ed-8bb5de9150a6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:53.368262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9534-9228-4385-a7ed-8bb5de9150a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:53.390651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d92a9534-9228-4385-a7ed-8bb5de9150a6 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:53.392173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d92a9534-9228-4385-a7ed-8bb5de9150a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:53.396173 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3686/7387] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:53 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:53.401387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2ec89-ed3a-4441-b9ca-823201e57ffc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:53.402509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2ec89-ed3a-4441-b9ca-823201e57ffc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:53.402869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2ec89-ed3a-4441-b9ca-823201e57ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:53.435441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9ad2ec89-ed3a-4441-b9ca-823201e57ffc None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:53.440320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9ad2ec89-ed3a-4441-b9ca-823201e57ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:53.455625 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3702/7388] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:53.460537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9534-9228-4385-a7ed-8bb5de9150a6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:53.488782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9534-9228-4385-a7ed-8bb5de9150a6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:53.501647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3662c30-7b30-49a1-89e6-91b2413a6d04 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:53.503629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3662c30-7b30-49a1-89e6-91b2413a6d04 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:53.504022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3662c30-7b30-49a1-89e6-91b2413a6d04 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:53.504555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3662c30-7b30-49a1-89e6-91b2413a6d04 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:53.582940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d3662c30-7b30-49a1-89e6-91b2413a6d04 tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:53.605146 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3687/7389] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:53 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:54.608175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf45c-ea50-4259-828c-f2ec7ba2c490 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:54.609428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf45c-ea50-4259-828c-f2ec7ba2c490 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:54.609907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf45c-ea50-4259-828c-f2ec7ba2c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:54.638020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0accf45c-ea50-4259-828c-f2ec7ba2c490 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:54.639512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0accf45c-ea50-4259-828c-f2ec7ba2c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:54.644678 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3703/7390] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:54 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:54.649236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d254c00-0b14-4aad-be0e-ffa6607e9c95 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:54.650138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d254c00-0b14-4aad-be0e-ffa6607e9c95 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:54.650847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d254c00-0b14-4aad-be0e-ffa6607e9c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:54.682832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8d254c00-0b14-4aad-be0e-ffa6607e9c95 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:54.684126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8d254c00-0b14-4aad-be0e-ffa6607e9c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:54.696517 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3688/7391] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:54.698134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf45c-ea50-4259-828c-f2ec7ba2c490 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:54.719312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf45c-ea50-4259-828c-f2ec7ba2c490 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:54.731175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fb8f-747a-4dca-a218-078f82c12cae tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7aed70b3c754ed6b6dcaac82f3a24ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e651949122744239ee41e3f05730704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:54.733492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fb8f-747a-4dca-a218-078f82c12cae tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:54.733980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fb8f-747a-4dca-a218-078f82c12cae tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:54.736487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fb8f-747a-4dca-a218-078f82c12cae tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:54.809140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b61fb8f-747a-4dca-a218-078f82c12cae tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:54.830664 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3704/7392] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:28:54 2022] POST /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed/password => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:55.836131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354f59-0e5f-45c6-9fe5-d71e1a0a77d2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:55.836680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354f59-0e5f-45c6-9fe5-d71e1a0a77d2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:55.836942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354f59-0e5f-45c6-9fe5-d71e1a0a77d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:55.864153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4f354f59-0e5f-45c6-9fe5-d71e1a0a77d2 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:55.865591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4f354f59-0e5f-45c6-9fe5-d71e1a0a77d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:55.872021 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3689/7393] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:55 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:56.067190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fb8f-747a-4dca-a218-078f82c12cae tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:56.084021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fb8f-747a-4dca-a218-078f82c12cae tempest-IdentityV3UsersTest-1636199838 tempest-IdentityV3UsersTest-1636199838-project] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:56.091041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:56.091847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:56.092278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:56.092693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:56.188634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:56.190290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:56.218683 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3705/7394] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:56.875673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95f74-f74c-45a0-88d7-cfa1b46565a6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:56.876558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95f74-f74c-45a0-88d7-cfa1b46565a6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:56.877019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a95f74-f74c-45a0-88d7-cfa1b46565a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:56.908619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f7a95f74-f74c-45a0-88d7-cfa1b46565a6 None None] MFA Rules not processed for user `d7aed70b3c754ed6b6dcaac82f3a24ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:56.909928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f7a95f74-f74c-45a0-88d7-cfa1b46565a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:56.918254 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3690/7395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:56.923732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:56.925363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:56.952399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:UPDATE=4,keystone:INSERT=6,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:57.034969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95b734-9acd-4a72-a753-e33930dabd1f service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:57.050889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:57.053739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:57.054431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:57.054909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] PATH_INFO: `/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:57.057594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7aed70b3c754ed6b6dcaac82f3a24ed)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:57.060841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:57.140748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:57.142256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:57.160874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:57.162482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:57.176468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7aed70b3c754ed6b6dcaac82f3a24ed'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:57.197374 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3706/7396] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:56 2022] DELETE /identity/v3/users/d7aed70b3c754ed6b6dcaac82f3a24ed => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:57.199080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:57.199545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:57.199962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:57.218847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:57.220345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:57.403819 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3691/7397] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:57.415793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:57.417570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:57.557856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9bee-bf00-4d5c-9c16-b173e7ef9b90 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:57.563706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:57.564706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:57.565081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:57.565347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:57.582984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:57.586099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:57.605840 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3707/7398] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:58.238425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:58.241083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:58.256795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51449277-978b-4ca3-b15a-613d4d231d00 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:58.261872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:58.262858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.263439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.263926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] PATH_INFO: `/v3/users/c072719e93fc4885b63578f93baa848f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.265781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c072719e93fc4885b63578f93baa848f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:58.268552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:58.295653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:58.357412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c072719e93fc4885b63578f93baa848f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.358300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c072719e93fc4885b63578f93baa848f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.375592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c072719e93fc4885b63578f93baa848f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.377007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c072719e93fc4885b63578f93baa848f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.388839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5ee31bd0-15fe-44b4-8a19-ab4a36543916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c072719e93fc4885b63578f93baa848f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.389493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:58.391520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:58.412279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee108-5258-4200-bf52-e432b0833088 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:58.419971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:58.422520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.422825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.423113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] PATH_INFO: `/v3/projects/7e651949122744239ee41e3f05730704` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.424490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e651949122744239ee41e3f05730704)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:58.429503 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3692/7399] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:58 2022] DELETE /identity/v3/users/c072719e93fc4885b63578f93baa848f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:58.435709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.436152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.436758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.436921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:58.463769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:58.465510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:58.505026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:58.519953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e651949122744239ee41e3f05730704', 'request_id': 'req-00e27851-b82d-4f9d-907c-6cec9cc3ae95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.531130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e651949122744239ee41e3f05730704', 'request_id': 'req-00e27851-b82d-4f9d-907c-6cec9cc3ae95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.543281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e651949122744239ee41e3f05730704', 'request_id': 'req-00e27851-b82d-4f9d-907c-6cec9cc3ae95'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.557728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] The token cache is being invalidate because project 7e651949122744239ee41e3f05730704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:58.558295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.559221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-00e27851-b82d-4f9d-907c-6cec9cc3ae95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:58.561156 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3708/7400] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:58 2022] DELETE /identity/v3/projects/7e651949122744239ee41e3f05730704 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:58.567981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ca6b3-3733-4e81-8993-7e6faa33c1fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.568452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ca6b3-3733-4e81-8993-7e6faa33c1fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.569132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ca6b3-3733-4e81-8993-7e6faa33c1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.583931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3693/7401] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:58.592672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:58.594965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:58.610683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c61ca6b3-3733-4e81-8993-7e6faa33c1fd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:58.612186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c61ca6b3-3733-4e81-8993-7e6faa33c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:58.692561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb317a5-25a1-43f1-88bc-efd289d40286 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:58.720299 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3709/7402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:28:58.728201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734d2a-d127-4822-a94c-5acdde21639e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.728636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734d2a-d127-4822-a94c-5acdde21639e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.728926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734d2a-d127-4822-a94c-5acdde21639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.754157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-52734d2a-d127-4822-a94c-5acdde21639e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:58.755429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-52734d2a-d127-4822-a94c-5acdde21639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:58.768837 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3710/7403] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:58.769855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52734d2a-d127-4822-a94c-5acdde21639e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:58.780388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52734d2a-d127-4822-a94c-5acdde21639e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:58.785460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:58.786176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.787146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.787463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.788294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:28:58.788635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:58.790795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:58.795573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:58.796466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.797097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.797097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.809067 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3711/7404] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:28:58.810593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:58.811278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:58.814966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:58.817586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:58.822640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96d13f-22bc-40ab-b13c-cad4357fdc84 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:58.829617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:58.830558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.830987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.831293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.832218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:58.832848 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3694/7405] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:58.834398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:58.876484 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3712/7406] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:28:58 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:58.879223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:58.897461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069a81f-9c58-483a-8b4a-3a836af55f28 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:58.956750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:58.959432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:58.988775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:58.990033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:58.990640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:58.991219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:58.993396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:58.996379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.029097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3695/7407] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:28:58 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:28:59.029097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:59.043097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053dd85-d439-40f8-8a2e-1f7bb2200771 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:59.052615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:59.054514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.054949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.055330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.056834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:59.058898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.068793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043493d1-901c-4fc5-af86-ab3a0adc64cb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:59.076323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:59.078058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.078417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.078696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] PATH_INFO: `/v3/users/38ba41d0a25b47d19a21a0b225b725a0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.080716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ba41d0a25b47d19a21a0b225b725a0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:59.083418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.098807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3696/7408] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:59.098807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:59.100082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:59.117706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe49c6-5c33-4116-855b-c59d629fe4fc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:59.126407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:59.127432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.128221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.128625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] PATH_INFO: `/v3/projects/68a1d25166f8467fa1bf53905dc9bdc1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.130913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a1d25166f8467fa1bf53905dc9bdc1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:59.131865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:59.142498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.166606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ba41d0a25b47d19a21a0b225b725a0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.167171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ba41d0a25b47d19a21a0b225b725a0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.184750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ba41d0a25b47d19a21a0b225b725a0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.186140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ba41d0a25b47d19a21a0b225b725a0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.202516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ba41d0a25b47d19a21a0b225b725a0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.212058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a1d25166f8467fa1bf53905dc9bdc1', 'request_id': 'req-1e950945-6f78-42ca-8e3e-681c4be39819'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.223198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a1d25166f8467fa1bf53905dc9bdc1', 'request_id': 'req-1e950945-6f78-42ca-8e3e-681c4be39819'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.226838 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3713/7409] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:58 2022] DELETE /identity/v3/users/38ba41d0a25b47d19a21a0b225b725a0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:59.228832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:59.231432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:59.237768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a1d25166f8467fa1bf53905dc9bdc1', 'request_id': 'req-1e950945-6f78-42ca-8e3e-681c4be39819'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.253691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] The token cache is being invalidate because project 68a1d25166f8467fa1bf53905dc9bdc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:28:59.254390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.255630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1e950945-6f78-42ca-8e3e-681c4be39819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.260515 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3697/7410] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:28:59 2022] DELETE /identity/v3/projects/68a1d25166f8467fa1bf53905dc9bdc1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:59.260515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.260515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.260515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.281415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:28:59.282855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:59.379779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c760eb1-1c8b-45c8-88af-87ecce5f309f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:59.382910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:59.401666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:59.402271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.402573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.402849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.403789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:59.405526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.410340 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3698/7411] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:28:59.412113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:59.415146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:59.431485 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3714/7412] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:28:59.435355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:59.440483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c51d3-d817-4cad-8482-341a00e000b0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:59.442607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:59.446392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:59.447727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.448211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.448700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] PATH_INFO: `/v3/users/7730cea4a41f440a8388bd0a98cdfaa9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.450476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7730cea4a41f440a8388bd0a98cdfaa9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:59.452788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.545566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a56e-c7c7-4336-a29d-1a0ec75117ed admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:59.550112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7730cea4a41f440a8388bd0a98cdfaa9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.550927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7730cea4a41f440a8388bd0a98cdfaa9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.554290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce027704-fa0b-4b4a-997c-b77f591b3ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:59.554967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027704-fa0b-4b4a-997c-b77f591b3ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.555307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027704-fa0b-4b4a-997c-b77f591b3ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.555529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027704-fa0b-4b4a-997c-b77f591b3ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.559373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce027704-fa0b-4b4a-997c-b77f591b3ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:59.568805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7730cea4a41f440a8388bd0a98cdfaa9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.569606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7730cea4a41f440a8388bd0a98cdfaa9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.578168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7730cea4a41f440a8388bd0a98cdfaa9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:28:59.585328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce027704-fa0b-4b4a-997c-b77f591b3ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:59.587558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce027704-fa0b-4b4a-997c-b77f591b3ff8 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.598171 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3699/7413] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:28:59 2022] DELETE /identity/v3/users/7730cea4a41f440a8388bd0a98cdfaa9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:59.599376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:28:59.601343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:28:59.606459 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3715/7414] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:28:59.696357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbd22d-2d4b-471d-88f0-550830ced3e4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:28:59.705073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:28:59.706433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.706872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.707210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] PATH_INFO: `/v3/projects/06c341e2169a4e97815ea2f6f9ae1baf/users/ac9ee3c66d0447f3aa01d02a3473a98f/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:28:59.740023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c341e2169a4e97815ea2f6f9ae1baf, user_id=ac9ee3c66d0447f3aa01d02a3473a98f, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:28:59.743709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:28:59.773646 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3700/7415] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:28:59 2022] PUT /identity/v3/projects/06c341e2169a4e97815ea2f6f9ae1baf/users/ac9ee3c66d0447f3aa01d02a3473a98f/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:28:59.785929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:28:59.786481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:28:59.786938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.031744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] MFA Rules not processed for user `ac9ee3c66d0447f3aa01d02a3473a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:00.033198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.074828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:00.131063 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3716/7416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:28:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:00.136484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.174373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.176471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.229673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:00.247974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6da2ec-b73b-4afe-b4be-c33e653922b7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.253246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.253968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.254539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.254539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.255485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.257828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.296056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb7b1d-b451-4217-8545-7a739045de26 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.296992 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3701/7417] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:00 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:29:00.298032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.383274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.384402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.384746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.385161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] PATH_INFO: `/v3/projects/b789cf878df042a9b031309018d819c2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.387651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b789cf878df042a9b031309018d819c2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.395189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.419827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c003d91-7ee2-4ea3-83b8-fd55ad1fcc1a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.425233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.425925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.426213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.427102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.427814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.429810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.453562 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3702/7418] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:00 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:00.454950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.456798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.469623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b789cf878df042a9b031309018d819c2', 'request_id': 'req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.470177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ba548-0397-4f0d-bd59-b227b0202bc2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.477615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b789cf878df042a9b031309018d819c2', 'request_id': 'req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.489091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b789cf878df042a9b031309018d819c2', 'request_id': 'req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.501442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] The token cache is being invalidate because project b789cf878df042a9b031309018d819c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:00.501729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.502480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.504527 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3717/7419] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:00 2022] DELETE /identity/v3/projects/b789cf878df042a9b031309018d819c2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:00.505146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.506354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.516045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:00.545415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.546302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.546584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.547541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] PATH_INFO: `/v3/projects/b55b24bd3f4842329c7ad09562be1b7e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.548197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55b24bd3f4842329c7ad09562be1b7e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.550856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.576910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caa1a2-5a5e-4e75-87a2-3a3b7b76314c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.582327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fdf44-07ff-49cf-a9b6-5750525b57b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.583004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdf44-07ff-49cf-a9b6-5750525b57b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.583280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdf44-07ff-49cf-a9b6-5750525b57b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.583551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fdf44-07ff-49cf-a9b6-5750525b57b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.584297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fdf44-07ff-49cf-a9b6-5750525b57b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.586329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fdf44-07ff-49cf-a9b6-5750525b57b2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.600493 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3718/7420] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:00.601808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.602102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.602370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.615323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55b24bd3f4842329c7ad09562be1b7e', 'request_id': 'req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.621101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:00.622312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.623727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55b24bd3f4842329c7ad09562be1b7e', 'request_id': 'req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.635372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55b24bd3f4842329c7ad09562be1b7e', 'request_id': 'req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.644319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:00.649836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] The token cache is being invalidate because project b55b24bd3f4842329c7ad09562be1b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:00.650249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.652369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.655465 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3703/7421] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:00 2022] DELETE /identity/v3/projects/b55b24bd3f4842329c7ad09562be1b7e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:00.658330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.660691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.695297 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3719/7422] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:00.696933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.703072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.717706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390df4d8-3fdc-46a3-8770-96e6eae9d588 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.724088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.725273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.725559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.725912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] PATH_INFO: `/v3/users/783f6bd870cb41199b6cc6c533499000` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.727171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783f6bd870cb41199b6cc6c533499000)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.729184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.736978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3eb0-3367-4561-9c5e-fb7a030b4c9f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.742146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73517df9-1ef1-4b85-ada1-91723b395f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.742832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517df9-1ef1-4b85-ada1-91723b395f12 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.743115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517df9-1ef1-4b85-ada1-91723b395f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.743469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517df9-1ef1-4b85-ada1-91723b395f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.744215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73517df9-1ef1-4b85-ada1-91723b395f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.745860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73517df9-1ef1-4b85-ada1-91723b395f12 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.758073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3704/7423] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:00.759646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14e464-c7fd-4611-92f3-02a012048c74 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.759757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14e464-c7fd-4611-92f3-02a012048c74 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.759994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14e464-c7fd-4611-92f3-02a012048c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.782019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3e14e464-c7fd-4611-92f3-02a012048c74 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:00.783204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e14e464-c7fd-4611-92f3-02a012048c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.791589 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3705/7424] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:00.792375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14e464-c7fd-4611-92f3-02a012048c74 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.795460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783f6bd870cb41199b6cc6c533499000'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.796236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783f6bd870cb41199b6cc6c533499000'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.807373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14e464-c7fd-4611-92f3-02a012048c74 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:00.813012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783f6bd870cb41199b6cc6c533499000'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.813832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783f6bd870cb41199b6cc6c533499000'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.821246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338ff1a-3fc5-46fc-b42c-5caa631ec054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:00.821246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ff1a-3fc5-46fc-b42c-5caa631ec054 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.821246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ff1a-3fc5-46fc-b42c-5caa631ec054 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.821246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338ff1a-3fc5-46fc-b42c-5caa631ec054 admin admin] PATH_INFO: `/v3/projects/a3ab5e3b59764df796a33906fd42ad6f/users/8044d14ea4094c0086b647572be6253d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.823826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783f6bd870cb41199b6cc6c533499000'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:00.838140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338ff1a-3fc5-46fc-b42c-5caa631ec054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ab5e3b59764df796a33906fd42ad6f, user_id=8044d14ea4094c0086b647572be6253d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:00.841067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338ff1a-3fc5-46fc-b42c-5caa631ec054 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:00.845354 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3720/7425] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:00 2022] DELETE /identity/v3/users/783f6bd870cb41199b6cc6c533499000 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:00.845354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:00.845354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.865516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:00.873877 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3706/7426] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:00 2022] PUT /identity/v3/projects/a3ab5e3b59764df796a33906fd42ad6f/users/8044d14ea4094c0086b647572be6253d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:00.886346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:00.886758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:00.887043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:00.922161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] MFA Rules not processed for user `8044d14ea4094c0086b647572be6253d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:00.924247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:00.956806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53648-36d0-4630-b5f2-beddeb9e4b08 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.001155 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3707/7427] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:01.018695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.020405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:01.045653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.046496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.046784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.047059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.047801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:01.048106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.050815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.068301 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3721/7428] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:01.074033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.089470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c2d2f-4b66-4287-9440-f09d03832d41 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.101533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.104497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.104999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.105562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.107374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.110514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.129089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003197a-52ab-4175-a4d3-0a788de143dd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.133346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.134339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.134688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.135111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.137606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:01.144650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:01.154734 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3722/7429] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:01 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:29:01.159791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.233674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.237178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.251448 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3708/7430] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:29:01.323763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6d4d-1437-4809-802d-401161bdb2f4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.339702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.340797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.340982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.341280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.342245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.344651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.358111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.359750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:01.379844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292a44b-be32-4d13-a5dc-79f9084679c2 service glance] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.388026 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3723/7431] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:01 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:01.393423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.396631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.397570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.397848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.398116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] PATH_INFO: `/v3/projects/3ce4a4bad015474fac2489168ad82790` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.399615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce4a4bad015474fac2489168ad82790)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.402746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.424874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:01.466570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce4a4bad015474fac2489168ad82790', 'request_id': 'req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.472257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444c115-656b-4653-aed8-4512c71dd351 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.474080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce4a4bad015474fac2489168ad82790', 'request_id': 'req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.495103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce4a4bad015474fac2489168ad82790', 'request_id': 'req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.512416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] The token cache is being invalidate because project 3ce4a4bad015474fac2489168ad82790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:01.512805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.513548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.516066 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3709/7432] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:01 2022] DELETE /identity/v3/projects/3ce4a4bad015474fac2489168ad82790 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:01.516883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.521012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:01.537819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.538644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.538932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.539214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.541550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:01.612018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ede2c9-7bd8-4d22-be0c-868d5d2cdf10 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.617787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.618613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.618899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.619201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.619939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.621595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.622844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.625202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.633114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3710/7433] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:01.634166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.637304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:01.639780 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3724/7434] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:01.640661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.654653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daeba9-3c56-4e82-9d6d-55566c9c01f7 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.656929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbc651-f398-4625-abdb-59ed36a5db81 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.675879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.677618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.677916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.678632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.678744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.678932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.679209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.679556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] PATH_INFO: `/v3/users/4404fd69a6924bdca2f8aac7adb8c470` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.681276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.681949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4404fd69a6924bdca2f8aac7adb8c470)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.682660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.689717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.704066 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3725/7435] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:01.709455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:01.736222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ebd4-e509-4c72-aa99-cd3548f6dede admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:01.739206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:01.754592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a02242-4cdd-47dc-98fa-48e1eb87040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:01.756901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a02242-4cdd-47dc-98fa-48e1eb87040d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.757216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a02242-4cdd-47dc-98fa-48e1eb87040d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.757503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a02242-4cdd-47dc-98fa-48e1eb87040d admin admin] PATH_INFO: `/v3/projects/4d9ca81e18e5455c8073cde94733f5dd/users/f2b6d2be774a4315a7d3c2c828930603/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.788765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4404fd69a6924bdca2f8aac7adb8c470'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.790136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4404fd69a6924bdca2f8aac7adb8c470'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.806006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a02242-4cdd-47dc-98fa-48e1eb87040d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9ca81e18e5455c8073cde94733f5dd, user_id=f2b6d2be774a4315a7d3c2c828930603, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:01.808927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a02242-4cdd-47dc-98fa-48e1eb87040d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:01.810073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4404fd69a6924bdca2f8aac7adb8c470'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.811416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4404fd69a6924bdca2f8aac7adb8c470'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.823918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4404fd69a6924bdca2f8aac7adb8c470'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:01.841183 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3726/7436] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:01 2022] PUT /identity/v3/projects/4d9ca81e18e5455c8073cde94733f5dd/users/f2b6d2be774a4315a7d3c2c828930603/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:01.847568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:01.852037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:01.852037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:01.874314 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3711/7437] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:01 2022] DELETE /identity/v3/users/4404fd69a6924bdca2f8aac7adb8c470 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:01.912191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] MFA Rules not processed for user `f2b6d2be774a4315a7d3c2c828930603`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:01.913774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.002664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:02.039595 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3727/7438] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:02.055570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:02.057778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.173728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822720fe-07af-4f8a-aea9-091aa6ee27f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:02.181310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:02.182658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.183264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.183754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.197877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:02.200313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:02.212698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:02.214377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.220101 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3712/7439] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:02.293463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c8cb4-116b-465f-8b70-876121da2ea2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:02.299123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:02.299889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.300164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.300454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] PATH_INFO: `/v3/users/ac9ee3c66d0447f3aa01d02a3473a98f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.301730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9ee3c66d0447f3aa01d02a3473a98f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:02.303800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:02.374645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9ee3c66d0447f3aa01d02a3473a98f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.375419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9ee3c66d0447f3aa01d02a3473a98f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.390391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9ee3c66d0447f3aa01d02a3473a98f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.390714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:02.391274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9ee3c66d0447f3aa01d02a3473a98f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.394348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.399803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-58559ec2-70d2-4040-9971-d3a5a17745fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9ee3c66d0447f3aa01d02a3473a98f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.418208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5082580-7b3f-484e-b52f-3fa6d939d77e service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:02.426586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:02.427535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.427810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.428085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] PATH_INFO: `/v3/projects/78bc11513c204016933020ebe1275dc8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.429539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bc11513c204016933020ebe1275dc8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:02.430264 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3728/7440] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:02 2022] DELETE /identity/v3/users/ac9ee3c66d0447f3aa01d02a3473a98f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:02.433933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:02.435043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.435331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.435941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.477521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:02.480781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.524233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bc11513c204016933020ebe1275dc8', 'request_id': 'req-f52b8230-5a5f-4e06-9f44-14b6769b1565'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.536409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bc11513c204016933020ebe1275dc8', 'request_id': 'req-f52b8230-5a5f-4e06-9f44-14b6769b1565'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.546327 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3729/7441] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:02.556057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bc11513c204016933020ebe1275dc8', 'request_id': 'req-f52b8230-5a5f-4e06-9f44-14b6769b1565'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.566303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:02.568656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.582085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] The token cache is being invalidate because project 78bc11513c204016933020ebe1275dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:02.582826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.583125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f52b8230-5a5f-4e06-9f44-14b6769b1565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:02.589498 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3713/7442] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:02 2022] DELETE /identity/v3/projects/78bc11513c204016933020ebe1275dc8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:02.592483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138445b5-12e5-48c1-aa8f-68227d8b0a34 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.592774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138445b5-12e5-48c1-aa8f-68227d8b0a34 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.594187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138445b5-12e5-48c1-aa8f-68227d8b0a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.595995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:02.635526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-138445b5-12e5-48c1-aa8f-68227d8b0a34 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:02.636751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-138445b5-12e5-48c1-aa8f-68227d8b0a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.684496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:02.693426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b719c-4a1f-42cb-a15b-5b7f72295c5d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:02.750859 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3714/7443] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:02.762621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38b94-bc39-4f8d-9a0a-891f5772a44d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.762915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38b94-bc39-4f8d-9a0a-891f5772a44d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.763201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38b94-bc39-4f8d-9a0a-891f5772a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.776567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:02.777630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.778552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.779035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.781373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.799324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:02.801998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:02.815391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dfa38b94-bc39-4f8d-9a0a-891f5772a44d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:02.817788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dfa38b94-bc39-4f8d-9a0a-891f5772a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:02.822481 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3730/7444] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:29:02.852782 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3715/7445] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:02.856922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:02.872229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e30b0-fdf2-440d-8ed7-5d019e592f10 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:02.878756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:02.896429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.897220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.899223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.900920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:02.902373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:02.907003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:02.931614 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3731/7446] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:29:02.932559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa38b94-bc39-4f8d-9a0a-891f5772a44d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:02.946262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa38b94-bc39-4f8d-9a0a-891f5772a44d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:02.952402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:02.953313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:02.953752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:02.954133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:02.955280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:02.982107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.035985 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3716/7447] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:02 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:29:03.040471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.057650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e56b8-01b9-4d7c-986a-78bdd0cca62d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.127505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.128327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.128606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.128879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.129602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.131876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.160353 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3732/7448] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:03 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:03.164810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.189785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd182e5-3ab6-4e97-b25b-1f4567ad21f4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.195458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.196627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.196974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.197669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.198603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.200322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.216041 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3717/7449] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:03.218553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.233426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd60179-7090-4541-94ec-981ed65b93d9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.239806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f256e-8193-4920-962c-77b64c7eeef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.240707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f256e-8193-4920-962c-77b64c7eeef9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.241225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f256e-8193-4920-962c-77b64c7eeef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.241613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f256e-8193-4920-962c-77b64c7eeef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.242418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f256e-8193-4920-962c-77b64c7eeef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.244132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f256e-8193-4920-962c-77b64c7eeef9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.256326 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3733/7450] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:03.260826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.271943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a87be-33e0-42e1-a80a-5db680d07272 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.277461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.278583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.278583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.278906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] PATH_INFO: `/v3/projects/6865d53cbdb64eb7b333fa36daffe0f4/users/46ec3a39c0ce4199aa6099ca8cca6b85/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.295615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6865d53cbdb64eb7b333fa36daffe0f4, user_id=46ec3a39c0ce4199aa6099ca8cca6b85, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.298442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.327790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054563c-dd2c-48a3-8f5b-857b5dc37442 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.328172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054563c-dd2c-48a3-8f5b-857b5dc37442 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.328496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054563c-dd2c-48a3-8f5b-857b5dc37442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.329113 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3718/7451] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:03 2022] PUT /identity/v3/projects/6865d53cbdb64eb7b333fa36daffe0f4/users/46ec3a39c0ce4199aa6099ca8cca6b85/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:03.373513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e054563c-dd2c-48a3-8f5b-857b5dc37442 None None] MFA Rules not processed for user `46ec3a39c0ce4199aa6099ca8cca6b85`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:03.375067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e054563c-dd2c-48a3-8f5b-857b5dc37442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:03.395915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.400762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:03.404399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:03.506322 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3734/7452] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:29:03.508926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054563c-dd2c-48a3-8f5b-857b5dc37442 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.516870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75232f2-bafb-4314-885c-86052d6c6587 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.522989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.524111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.524670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.525333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] PATH_INFO: `/v3/projects/06c341e2169a4e97815ea2f6f9ae1baf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.527329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054563c-dd2c-48a3-8f5b-857b5dc37442 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.527422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c341e2169a4e97815ea2f6f9ae1baf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.530018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.541841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.542869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.543209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.543424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.544352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.547563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.590721 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3735/7453] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:03 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:03.591766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.624408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c341e2169a4e97815ea2f6f9ae1baf', 'request_id': 'req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.636230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c341e2169a4e97815ea2f6f9ae1baf', 'request_id': 'req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.652848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c341e2169a4e97815ea2f6f9ae1baf', 'request_id': 'req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.656215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:03.678992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] The token cache is being invalidate because project 06c341e2169a4e97815ea2f6f9ae1baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:03.683044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.686254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.691124 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3719/7454] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:03 2022] DELETE /identity/v3/projects/06c341e2169a4e97815ea2f6f9ae1baf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:03.695576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.701394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:03.753488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bbf10-1c84-4dda-995e-8c5bb3954fc2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.846474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8602ebd-f1b4-4520-8d41-0da5109c3cdb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.856118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.857799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.859091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.860130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] PATH_INFO: `/v3/users/8044d14ea4094c0086b647572be6253d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.864458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8044d14ea4094c0086b647572be6253d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.867035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.881413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.882410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.882878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.883375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.885710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.890244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.941434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3736/7455] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:03 2022] POST /identity/v3/users => generated 302 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:03.945261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:03.947214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:03.974736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8044d14ea4094c0086b647572be6253d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.975731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8044d14ea4094c0086b647572be6253d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.976907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd552948-1977-4cdc-bb1a-03536dfce409 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:03.983701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:03.984404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:03.984701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:03.984986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:03.985808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:03.987436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:03.992597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8044d14ea4094c0086b647572be6253d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:03.993915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8044d14ea4094c0086b647572be6253d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:04.004409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8044d14ea4094c0086b647572be6253d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:04.020073 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3737/7456] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:29:04.023803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:04.030774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:04.045574 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3720/7457] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:03 2022] DELETE /identity/v3/users/8044d14ea4094c0086b647572be6253d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:04.054133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c09e0-2ed1-4c00-bb70-6cf0bb6d3a18 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:04.116020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:04.205248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:04.207289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:04.207804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:04.208084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] PATH_INFO: `/v3/projects/36b706f6a18e4f0ca8d4a77baaf0045f/users/e2b795cb34d849d1b5eb50d6c7f554ce/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:04.234181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b706f6a18e4f0ca8d4a77baaf0045f, user_id=e2b795cb34d849d1b5eb50d6c7f554ce, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:04.237805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:04.270228 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3738/7458] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:04 2022] PUT /identity/v3/projects/36b706f6a18e4f0ca8d4a77baaf0045f/users/e2b795cb34d849d1b5eb50d6c7f554ce/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:04.275604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:04.287820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751ca3-c8dc-4249-a0cc-5ffa0e47b566 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:04.357904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e44ca-b121-4e25-a329-514a9e446b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:04.359233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e44ca-b121-4e25-a329-514a9e446b8f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:04.359772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e44ca-b121-4e25-a329-514a9e446b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:04.360248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e44ca-b121-4e25-a329-514a9e446b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:04.361424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e44ca-b121-4e25-a329-514a9e446b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:04.363418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e44ca-b121-4e25-a329-514a9e446b8f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:04.376726 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3721/7459] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:04.380681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:04.392918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42126f-c2d4-4bc7-9d37-f49c1c595662 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:04.398722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:04.400269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:04.400793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:04.401318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] PATH_INFO: `/v3/projects/36b706f6a18e4f0ca8d4a77baaf0045f/users/e2b795cb34d849d1b5eb50d6c7f554ce/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:04.404138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b706f6a18e4f0ca8d4a77baaf0045f, user_id=e2b795cb34d849d1b5eb50d6c7f554ce, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:04.407174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:04.421738 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3739/7460] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:04 2022] PUT /identity/v3/projects/36b706f6a18e4f0ca8d4a77baaf0045f/users/e2b795cb34d849d1b5eb50d6c7f554ce/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:04.433832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:04.434781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:04.435841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:04.452671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:04.474475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] MFA Rules not processed for user `e2b795cb34d849d1b5eb50d6c7f554ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:04.476523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:04.566957 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3722/7461] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:04.578822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:04.581462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:04.678425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc9cbb-792e-442a-b783-8558ec161a91 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:04.683397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:04.684868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:04.685200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:04.685620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:04.706216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:04.707805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:04.722434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3740/7462] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:04.793679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:04.795462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:04.817689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901cf1c-56a3-432c-afdc-5a6372152ea9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:04.824547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cca38-9167-44b9-bd67-933befc10219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:04.825526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cca38-9167-44b9-bd67-933befc10219 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:04.826421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cca38-9167-44b9-bd67-933befc10219 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:04.826764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cca38-9167-44b9-bd67-933befc10219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:04.831973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6f7cca38-9167-44b9-bd67-933befc10219 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:04.923168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cca38-9167-44b9-bd67-933befc10219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:04.924995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cca38-9167-44b9-bd67-933befc10219 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:04.938915 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3723/7463] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:05.662931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:05.664482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:05.775087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad773d5-23c7-47b1-8cfc-cc21c3441587 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:05.785026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:05.786079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:05.787103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:05.787591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] PATH_INFO: `/v3/projects/a3ab5e3b59764df796a33906fd42ad6f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:05.789540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ab5e3b59764df796a33906fd42ad6f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:05.794371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:05.919150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:05.946791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ab5e3b59764df796a33906fd42ad6f', 'request_id': 'req-2070367c-d170-49b4-ba95-78bb7e2c8fee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:05.982340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ab5e3b59764df796a33906fd42ad6f', 'request_id': 'req-2070367c-d170-49b4-ba95-78bb7e2c8fee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:06.006369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ab5e3b59764df796a33906fd42ad6f', 'request_id': 'req-2070367c-d170-49b4-ba95-78bb7e2c8fee'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:06.061603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] The token cache is being invalidate because project a3ab5e3b59764df796a33906fd42ad6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:06.065332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:06.066511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2070367c-d170-49b4-ba95-78bb7e2c8fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:06.069213 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3741/7464] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:05 2022] DELETE /identity/v3/projects/a3ab5e3b59764df796a33906fd42ad6f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:06.075373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bfb42-ff68-410b-a121-2d04343a76b1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.076122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bfb42-ff68-410b-a121-2d04343a76b1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.076122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bfb42-ff68-410b-a121-2d04343a76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.122030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b89bfb42-ff68-410b-a121-2d04343a76b1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:06.123300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b89bfb42-ff68-410b-a121-2d04343a76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:06.252302 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3724/7465] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:06.263872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ad7f-1bfc-4b5b-a74c-eecd54690d46 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.264267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ad7f-1bfc-4b5b-a74c-eecd54690d46 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.264618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4ad7f-1bfc-4b5b-a74c-eecd54690d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.311781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7db4ad7f-1bfc-4b5b-a74c-eecd54690d46 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:06.315353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7db4ad7f-1bfc-4b5b-a74c-eecd54690d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:06.341111 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3742/7466] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:06.345360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bfb42-ff68-410b-a121-2d04343a76b1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:06.360422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bfb42-ff68-410b-a121-2d04343a76b1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:06.366972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:06.368526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.368761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.369284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.371831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:06.372170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:06.375166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:06.397024 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3725/7467] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:06.401653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4ad7f-1bfc-4b5b-a74c-eecd54690d46 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:06.414498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4ad7f-1bfc-4b5b-a74c-eecd54690d46 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:06.422655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:06.423417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.423631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.423908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.425081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:06.427757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:06.465760 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3743/7468] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:06 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:06.469959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:06.495149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd141c-86b7-4019-9414-0cd923fdc13d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:06.525184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:06.644898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:06.646023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.646461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.647254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.648366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:06.660666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:06.695729 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3726/7469] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:06 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:06.700651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:06.741821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220dc5-a0e6-42ff-8c68-98204265d778 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:06.748506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:06.753510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.774027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.774791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.776584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:06.800268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:06.820170 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3744/7470] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:06.824340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:06.840108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d50577-10f7-46f4-8562-1c10764a4fbb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:06.855687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d2960-ac64-476f-b090-89e8ab23425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:06.856407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d2960-ac64-476f-b090-89e8ab23425f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.858202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d2960-ac64-476f-b090-89e8ab23425f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.858456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d2960-ac64-476f-b090-89e8ab23425f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.859672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d2960-ac64-476f-b090-89e8ab23425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:06.871362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d2960-ac64-476f-b090-89e8ab23425f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:06.896986 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3727/7471] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:06.900999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:06.916846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc7657-2306-4f0c-81ff-7c38c1484617 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:06.927995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:06.931445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:06.932028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:06.934553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] PATH_INFO: `/v3/projects/cfb700078aaa4bed9aba8f9d50a75e83/users/3a5485bf711e48a5bc38af625f727915/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:06.970345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb700078aaa4bed9aba8f9d50a75e83, user_id=3a5485bf711e48a5bc38af625f727915, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:06.974330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:07.000451 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3745/7472] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:06 2022] PUT /identity/v3/projects/cfb700078aaa4bed9aba8f9d50a75e83/users/3a5485bf711e48a5bc38af625f727915/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:07.013219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bfa8-11d7-4a1a-88d8-58c279695f2d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:07.013817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bfa8-11d7-4a1a-88d8-58c279695f2d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:07.014420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04bfa8-11d7-4a1a-88d8-58c279695f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:07.070742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8b04bfa8-11d7-4a1a-88d8-58c279695f2d None None] MFA Rules not processed for user `3a5485bf711e48a5bc38af625f727915`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:07.072424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b04bfa8-11d7-4a1a-88d8-58c279695f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:07.200722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:07.216428 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3728/7473] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:07.317502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633baf-a375-40ac-82bc-a765571011ae admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:07.329148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:07.329853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:07.330141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:07.330421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:07.331129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:07.333508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:07.405843 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3746/7474] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:07 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:07.407931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04bfa8-11d7-4a1a-88d8-58c279695f2d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:07.428983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04bfa8-11d7-4a1a-88d8-58c279695f2d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:07.601563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:07.602444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:07.607293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:07.607293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:07.612167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:07.614455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:07.686144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3729/7475] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:07 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:07.686941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:07.712820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f17f2-40dd-46ce-afaa-ef1e508cc573 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:07.726524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:07.727151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:07.727520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:07.727801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:07.730277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:07.735825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:07.771905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3747/7476] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:29:07.774155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:07.796005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a346a1-4143-48a7-b966-6b55ad287732 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:07.804347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:07.805703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:07.806226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:07.806859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] PATH_INFO: `/v3/projects/5824013f78c04ae0a724cd73f5bc6e5d/users/027f5a8ae7d74b31b7dd86adba2d898e/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:07.831009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:07.848704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5824013f78c04ae0a724cd73f5bc6e5d, user_id=027f5a8ae7d74b31b7dd86adba2d898e, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:07.852578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:07.890832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3730/7477] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:07 2022] PUT /identity/v3/projects/5824013f78c04ae0a724cd73f5bc6e5d/users/027f5a8ae7d74b31b7dd86adba2d898e/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:07.891568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:07.920378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6455b9e-1c95-4823-aebe-a60037f03426 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:08.050139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:08.123125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3e66-8c68-4f9f-a0fa-7f81c6d1d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:08.123836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3e66-8c68-4f9f-a0fa-7f81c6d1d2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:08.124445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3e66-8c68-4f9f-a0fa-7f81c6d1d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:08.124445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3e66-8c68-4f9f-a0fa-7f81c6d1d2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:08.125185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3e66-8c68-4f9f-a0fa-7f81c6d1d2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:08.126968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3e66-8c68-4f9f-a0fa-7f81c6d1d2f0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:08.138207 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3748/7478] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:29:08.142610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:08.161601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00160098-ffd2-4e90-bd7b-20fe413238ef admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:08.185813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:08.187666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:08.187949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:08.188225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] PATH_INFO: `/v3/projects/5824013f78c04ae0a724cd73f5bc6e5d/users/027f5a8ae7d74b31b7dd86adba2d898e/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:08.199965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5824013f78c04ae0a724cd73f5bc6e5d, user_id=027f5a8ae7d74b31b7dd86adba2d898e, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:08.203116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:08.269876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:08.270169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:08.270647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:08.275097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3731/7479] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:08 2022] PUT /identity/v3/projects/5824013f78c04ae0a724cd73f5bc6e5d/users/027f5a8ae7d74b31b7dd86adba2d898e/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:08.346309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] MFA Rules not processed for user `027f5a8ae7d74b31b7dd86adba2d898e`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:08.348424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:08.625070 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3749/7480] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:29:08.671847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:08.678131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:08.847668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751917c-e132-4476-a311-114f2be73021 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:08.854965 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5333c1d-4512-4c02-9da4-f0cfb006cb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:08.855966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5333c1d-4512-4c02-9da4-f0cfb006cb33 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:08.856355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5333c1d-4512-4c02-9da4-f0cfb006cb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:08.856705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5333c1d-4512-4c02-9da4-f0cfb006cb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:08.873662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5333c1d-4512-4c02-9da4-f0cfb006cb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:08.876423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5333c1d-4512-4c02-9da4-f0cfb006cb33 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:08.892052 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3732/7481] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:09.931061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:09.933141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:10.072471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb072-7d00-495b-a020-83b0f73e5adc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:10.078415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:10.079374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:10.079705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:10.079981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] PATH_INFO: `/v3/users/46ec3a39c0ce4199aa6099ca8cca6b85` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:10.081545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ec3a39c0ce4199aa6099ca8cca6b85)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:10.083607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:10.199369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ec3a39c0ce4199aa6099ca8cca6b85'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.199369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ec3a39c0ce4199aa6099ca8cca6b85'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.220822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:10.223020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ec3a39c0ce4199aa6099ca8cca6b85'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.225816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ec3a39c0ce4199aa6099ca8cca6b85'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.239313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ec3a39c0ce4199aa6099ca8cca6b85'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.259214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3750/7482] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:09 2022] DELETE /identity/v3/users/46ec3a39c0ce4199aa6099ca8cca6b85 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:10.263995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:10.264510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:10.264589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:10.283309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:10.284771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:10.380876 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3733/7483] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:10.390713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:10.392335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:10.456095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae42cf9-cbf8-4129-b458-baca927f161e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:10.459882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:10.460571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:10.460854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:10.461179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:10.471129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:10.472578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:10.482732 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3751/7484] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:10.779739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:10.781527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:10.794848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6ca0-f1b5-4e40-b4f5-869dff01e54a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:10.801150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:10.802065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:10.802348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:10.802822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] PATH_INFO: `/v3/projects/6865d53cbdb64eb7b333fa36daffe0f4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:10.804411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6865d53cbdb64eb7b333fa36daffe0f4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:10.806645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:10.861805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6865d53cbdb64eb7b333fa36daffe0f4', 'request_id': 'req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.868728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6865d53cbdb64eb7b333fa36daffe0f4', 'request_id': 'req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.877434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6865d53cbdb64eb7b333fa36daffe0f4', 'request_id': 'req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.888793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] The token cache is being invalidate because project 6865d53cbdb64eb7b333fa36daffe0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:10.889329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.889997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:10.891684 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3734/7485] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:10 2022] DELETE /identity/v3/projects/6865d53cbdb64eb7b333fa36daffe0f4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:10.895853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:10.906200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc960a6-abe8-4c61-ba73-62779229d6dc service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:10.964765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:10.965693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:10.966077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:10.966235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] PATH_INFO: `/v3/users/e2b795cb34d849d1b5eb50d6c7f554ce` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:10.967820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b795cb34d849d1b5eb50d6c7f554ce)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:10.969583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:11.037254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b795cb34d849d1b5eb50d6c7f554ce'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:11.038027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b795cb34d849d1b5eb50d6c7f554ce'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:11.052155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b795cb34d849d1b5eb50d6c7f554ce'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:11.052978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b795cb34d849d1b5eb50d6c7f554ce'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:11.060699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0c66f123-2107-4a23-993d-16deb42a63e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b795cb34d849d1b5eb50d6c7f554ce'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:11.080360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3752/7486] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:10 2022] DELETE /identity/v3/users/e2b795cb34d849d1b5eb50d6c7f554ce => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:11.991577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:11.993451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:12.003356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:12.018745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9731e-c96d-4dc0-b1e1-a02f997354f1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.108501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.109508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.109815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.110098 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] PATH_INFO: `/v3/projects/36b706f6a18e4f0ca8d4a77baaf0045f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.111357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b706f6a18e4f0ca8d4a77baaf0045f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.113341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.171640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b706f6a18e4f0ca8d4a77baaf0045f', 'request_id': 'req-38343c7e-0816-47df-b6dd-46bce5a0c642'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.181217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b706f6a18e4f0ca8d4a77baaf0045f', 'request_id': 'req-38343c7e-0816-47df-b6dd-46bce5a0c642'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.198983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b706f6a18e4f0ca8d4a77baaf0045f', 'request_id': 'req-38343c7e-0816-47df-b6dd-46bce5a0c642'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.224981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] The token cache is being invalidate because project 36b706f6a18e4f0ca8d4a77baaf0045f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:12.225235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.227801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38343c7e-0816-47df-b6dd-46bce5a0c642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.233931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3735/7487] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:11 2022] DELETE /identity/v3/projects/36b706f6a18e4f0ca8d4a77baaf0045f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:12.235430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9301d-6853-498e-a4f7-1402db48937e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.235883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9301d-6853-498e-a4f7-1402db48937e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.235990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9301d-6853-498e-a4f7-1402db48937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.244137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:12.265781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-32e9301d-6853-498e-a4f7-1402db48937e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:12.268166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32e9301d-6853-498e-a4f7-1402db48937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:12.357411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd0299-003b-4e53-b1a3-52646d48cb3b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.357781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd0299-003b-4e53-b1a3-52646d48cb3b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.358001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd0299-003b-4e53-b1a3-52646d48cb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.370427 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3753/7488] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:12.390365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-37cd0299-003b-4e53-b1a3-52646d48cb3b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:12.391929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-37cd0299-003b-4e53-b1a3-52646d48cb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:12.407608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9301d-6853-498e-a4f7-1402db48937e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:12.421411 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3736/7489] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:12.422042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9301d-6853-498e-a4f7-1402db48937e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.427430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.428121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.428466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.428807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.429833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:12.430204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.432130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.452903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd0299-003b-4e53-b1a3-52646d48cb3b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:12.459857 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3754/7490] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:12.466910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd0299-003b-4e53-b1a3-52646d48cb3b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.473055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.474027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.474422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.474792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.475603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.477969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.527767 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3737/7491] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:12 2022] POST /identity/v3/projects => generated 407 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:12.532097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:12.545076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9143c7-21db-4dc3-a5ad-13130db50563 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.558017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:12.560981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:12.613216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.614672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.614935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.615288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.616051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.618690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.647726 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3755/7492] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:12 2022] POST /identity/v3/users => generated 304 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:12.648660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:12.669520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672bda7-043d-47b1-91e3-5c6e45b4abb0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.684290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.684992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.685299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.685576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.686387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.688560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.712927 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3756/7493] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:12.719281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:12.747387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346401c-7ec9-4ebd-b849-ea71b5f6f2ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.758780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.761318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.761622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.761905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.763561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e230-6fbb-4d11-bf3c-758217ef25e7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.763892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.768109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.780027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.781735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.782114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.785497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] PATH_INFO: `/v3/users/3a5485bf711e48a5bc38af625f727915` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.792906 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3757/7494] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:12.798315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5485bf711e48a5bc38af625f727915)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.798647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:12.805445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.830997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a08ed-7f31-4894-933b-9848ed00715a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:12.832084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:12.856415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468152d7-8432-4b18-b7a5-53b522721452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:12.858161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468152d7-8432-4b18-b7a5-53b522721452 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.858873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468152d7-8432-4b18-b7a5-53b522721452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.859374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468152d7-8432-4b18-b7a5-53b522721452 admin admin] PATH_INFO: `/v3/projects/c0311c9054bd42d59c825ea080ca6213/users/45fbd6ce9c57450196ecfc2e15a29c5b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.920348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468152d7-8432-4b18-b7a5-53b522721452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0311c9054bd42d59c825ea080ca6213, user_id=45fbd6ce9c57450196ecfc2e15a29c5b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:12.925011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468152d7-8432-4b18-b7a5-53b522721452 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:12.935446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5485bf711e48a5bc38af625f727915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.936509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5485bf711e48a5bc38af625f727915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.962112 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3758/7495] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:12 2022] PUT /identity/v3/projects/c0311c9054bd42d59c825ea080ca6213/users/45fbd6ce9c57450196ecfc2e15a29c5b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:12.971822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5485bf711e48a5bc38af625f727915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.973558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5485bf711e48a5bc38af625f727915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:12.980562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:12.985696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:12.985696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:12.990995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-72f52457-23eb-4433-8814-b3035dff30a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5485bf711e48a5bc38af625f727915'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:13.026432 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3738/7496] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:12 2022] DELETE /identity/v3/users/3a5485bf711e48a5bc38af625f727915 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:13.035296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.035577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.037000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.054104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] MFA Rules not processed for user `45fbd6ce9c57450196ecfc2e15a29c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:13.055933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:13.069830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:13.072214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:13.080555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:13.176675 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3759/7497] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:13.181589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.191000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:13.200914 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3739/7498] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:13.219231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6df22-d05a-4970-9884-97113574b1c1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:13.225369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:13.226914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.227485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.227978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.229366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:13.237135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:13.241943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.243619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:13.281453 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3760/7499] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:13 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:13.286454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.355073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa54a21-405f-4a2d-850e-59fff15c38a6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:13.411928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e1118-9c58-4cf4-b6ad-1387421945c3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:13.418806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:13.420620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.421130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.421615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.422528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:13.424886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:13.431385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:13.454370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:13.455609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.456168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.456635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.460583 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3761/7500] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:13 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:13.465436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.478682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:13.478992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1330-767e-4ce9-93be-aceed0c663ed admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:13.480232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:13.487890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:13.488741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.489166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.489657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.490500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:13.492236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:13.504466 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3740/7501] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:29:13.511431 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3762/7502] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:13.513189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.530704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56a78d-1110-43f6-9bd7-3d2699a54735 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:13.558615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:13.560169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.560861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.561669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] PATH_INFO: `/v3/projects/8b91b473a437453aa870ad7f07279b27/users/ca861273e4d742bf9fe16dbfb470b520/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.594749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b91b473a437453aa870ad7f07279b27, user_id=ca861273e4d742bf9fe16dbfb470b520, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:13.598592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:13.632159 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3741/7503] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:13 2022] PUT /identity/v3/projects/8b91b473a437453aa870ad7f07279b27/users/ca861273e4d742bf9fe16dbfb470b520/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:13.637496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.654037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c14a0-b747-444b-b230-2fc3c71d6913 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:13.743051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4abcf2-1a46-4629-80a8-93314f768dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:13.745494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4abcf2-1a46-4629-80a8-93314f768dda admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.746360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4abcf2-1a46-4629-80a8-93314f768dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.747422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4abcf2-1a46-4629-80a8-93314f768dda admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.747650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4abcf2-1a46-4629-80a8-93314f768dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:13.749446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4abcf2-1a46-4629-80a8-93314f768dda admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:13.766125 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3763/7504] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:13.769927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.782405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65fdf-1e92-442f-a2ef-59ce8bfd0421 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:13.787353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:13.788537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.788912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.789333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] PATH_INFO: `/v3/projects/8b91b473a437453aa870ad7f07279b27/users/ca861273e4d742bf9fe16dbfb470b520/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.793120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b91b473a437453aa870ad7f07279b27, user_id=ca861273e4d742bf9fe16dbfb470b520, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:13.794703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:13.815725 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3742/7505] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:13 2022] PUT /identity/v3/projects/8b91b473a437453aa870ad7f07279b27/users/ca861273e4d742bf9fe16dbfb470b520/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:13.828089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2468-b9b0-4060-a7b7-e9c61cf95d77 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:13.828488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2468-b9b0-4060-a7b7-e9c61cf95d77 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:13.828933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2468-b9b0-4060-a7b7-e9c61cf95d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:13.858767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-613d2468-b9b0-4060-a7b7-e9c61cf95d77 None None] MFA Rules not processed for user `ca861273e4d742bf9fe16dbfb470b520`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:13.860020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-613d2468-b9b0-4060-a7b7-e9c61cf95d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:13.864270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:13.970717 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3764/7506] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:13.982967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:13.984837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:14.059084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d2321-2912-492d-81dc-6d371e7584ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:14.064123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:14.065067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:14.065439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:14.065822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:14.085667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:14.092677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:14.111053 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3743/7507] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:14.326847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d2468-b9b0-4060-a7b7-e9c61cf95d77 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:14.358579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:14.360634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:14.360755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d2468-b9b0-4060-a7b7-e9c61cf95d77 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:14.370236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:14.374898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:14.378213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:14.378498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:14.515526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:14.517207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:14.537398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b33f22-37de-4255-a818-ddb35d742a7c service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:14.538875 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3765/7508] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:14.568951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:14.571831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:14.572126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:14.572490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] PATH_INFO: `/v3/projects/cfb700078aaa4bed9aba8f9d50a75e83` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:14.576195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb700078aaa4bed9aba8f9d50a75e83)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:14.582322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:14.738178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb700078aaa4bed9aba8f9d50a75e83', 'request_id': 'req-38f58de6-64ab-4c9e-806f-121b59691626'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:14.749125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:14.770229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb700078aaa4bed9aba8f9d50a75e83', 'request_id': 'req-38f58de6-64ab-4c9e-806f-121b59691626'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:14.801790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb700078aaa4bed9aba8f9d50a75e83', 'request_id': 'req-38f58de6-64ab-4c9e-806f-121b59691626'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:14.824836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] The token cache is being invalidate because project cfb700078aaa4bed9aba8f9d50a75e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:14.825109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:14.827489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:14.833350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:14.833584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3744/7509] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:14 2022] DELETE /identity/v3/projects/cfb700078aaa4bed9aba8f9d50a75e83 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:14.849915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d61c5-959f-4974-b58e-73599da0287c service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:14.976148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:14.977654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:14.978038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:14.978210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] PATH_INFO: `/v3/users/027f5a8ae7d74b31b7dd86adba2d898e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:14.979488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=027f5a8ae7d74b31b7dd86adba2d898e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:14.981485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:15.067780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:15.091118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027f5a8ae7d74b31b7dd86adba2d898e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:15.092060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027f5a8ae7d74b31b7dd86adba2d898e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:15.118312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027f5a8ae7d74b31b7dd86adba2d898e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:15.118934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027f5a8ae7d74b31b7dd86adba2d898e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:15.132104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4eec165e-f9db-4999-910e-deb0b8a2edb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027f5a8ae7d74b31b7dd86adba2d898e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:15.158443 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3766/7510] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:14 2022] DELETE /identity/v3/users/027f5a8ae7d74b31b7dd86adba2d898e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:16.164446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:16.166399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:16.187975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58de6-64ab-4c9e-806f-121b59691626 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:16.294484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:16.295792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.296093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.296430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] PATH_INFO: `/v3/projects/5824013f78c04ae0a724cd73f5bc6e5d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.297956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5824013f78c04ae0a724cd73f5bc6e5d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:16.300737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:16.388755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5824013f78c04ae0a724cd73f5bc6e5d', 'request_id': 'req-934a82ad-461a-433d-b024-7b46804aa39c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:16.397753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5824013f78c04ae0a724cd73f5bc6e5d', 'request_id': 'req-934a82ad-461a-433d-b024-7b46804aa39c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:16.414510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5824013f78c04ae0a724cd73f5bc6e5d', 'request_id': 'req-934a82ad-461a-433d-b024-7b46804aa39c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:16.434089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] The token cache is being invalidate because project 5824013f78c04ae0a724cd73f5bc6e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:16.434463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:16.435397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-934a82ad-461a-433d-b024-7b46804aa39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:16.437441 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3745/7511] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:16 2022] DELETE /identity/v3/projects/5824013f78c04ae0a724cd73f5bc6e5d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:16.442638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61fd2-b11a-46a4-8bab-3eeec87f616b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.443057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61fd2-b11a-46a4-8bab-3eeec87f616b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.443057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61fd2-b11a-46a4-8bab-3eeec87f616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.492391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-24c61fd2-b11a-46a4-8bab-3eeec87f616b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:16.493830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-24c61fd2-b11a-46a4-8bab-3eeec87f616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:16.571346 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3767/7512] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:16.578987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256fe1-e4f5-4167-9856-8862b2511748 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.579273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256fe1-e4f5-4167-9856-8862b2511748 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.579549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256fe1-e4f5-4167-9856-8862b2511748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.608176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fc256fe1-e4f5-4167-9856-8862b2511748 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:16.609678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fc256fe1-e4f5-4167-9856-8862b2511748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:16.628645 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3746/7513] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:16.632301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61fd2-b11a-46a4-8bab-3eeec87f616b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:16.651766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61fd2-b11a-46a4-8bab-3eeec87f616b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:16.657297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:16.658142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.658572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.659010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.660054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:16.660537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:16.662707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:16.681293 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3768/7514] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:16.685653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc256fe1-e4f5-4167-9856-8862b2511748 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:16.697317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc256fe1-e4f5-4167-9856-8862b2511748 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:16.705452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:16.706143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.706424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.706758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.707961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:16.709362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:16.752597 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3747/7515] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:16 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:16.757671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:16.768903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ba5f1-4ba1-4387-962c-9091695971b8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:16.863748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:16.865385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.865385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.865534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.866212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:16.868556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:16.898772 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3769/7516] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:16 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:16.902901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:16.917739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c89a4-c63d-48db-8719-eb8c744f9541 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:16.923981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:16.925005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.925418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.925793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.930658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:16.933526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:16.951181 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3748/7517] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:16.955645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:16.972745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681385e-5031-4901-9f16-4e13a514718f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:16.979862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c85a7-e5eb-4b14-9ae9-4be65f0156b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:16.980615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c85a7-e5eb-4b14-9ae9-4be65f0156b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:16.980970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c85a7-e5eb-4b14-9ae9-4be65f0156b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:16.981371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c85a7-e5eb-4b14-9ae9-4be65f0156b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:16.982117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c85a7-e5eb-4b14-9ae9-4be65f0156b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:16.983859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c85a7-e5eb-4b14-9ae9-4be65f0156b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:16.995626 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3770/7518] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:17.000103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.013706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23836d9-d7b3-4ea5-8f99-1faeb8ba5cb0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:17.020652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:17.021659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.021947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.022226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] PATH_INFO: `/v3/projects/fbc9fa9e59f94c5e9c045580939cca38/users/59ad7bf149a144638661cd60afc80c40/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.041781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc9fa9e59f94c5e9c045580939cca38, user_id=59ad7bf149a144638661cd60afc80c40, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:17.048253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:17.064263 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3749/7519] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:16 2022] PUT /identity/v3/projects/fbc9fa9e59f94c5e9c045580939cca38/users/59ad7bf149a144638661cd60afc80c40/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:17.075787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e007-d28e-49a3-8a5c-c2eb9d8c76ce None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.076107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e007-d28e-49a3-8a5c-c2eb9d8c76ce None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.076391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e007-d28e-49a3-8a5c-c2eb9d8c76ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.103371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1a37e007-d28e-49a3-8a5c-c2eb9d8c76ce None None] MFA Rules not processed for user `59ad7bf149a144638661cd60afc80c40`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:17.104919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a37e007-d28e-49a3-8a5c-c2eb9d8c76ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:17.117060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:17.194910 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3771/7520] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:29:17.200051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.213011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:17.291469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4990-129a-4633-820c-e6da98bac998 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:17.298021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:17.298717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.299005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.299284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.299991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:17.302926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:17.342356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e007-d28e-49a3-8a5c-c2eb9d8c76ce None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.342621 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3750/7521] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:17 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:17.357253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e007-d28e-49a3-8a5c-c2eb9d8c76ce None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:17.448157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:17.448773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.448773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.448992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.449751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:17.452768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:17.487260 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3772/7522] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:17 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:17.491427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.521880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cce1b0-20dc-47b4-b3c3-9f2dd044bef5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:17.527053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:17.528155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.528155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.528380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.529100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:17.531193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:17.544256 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3751/7523] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:17.548378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.560713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bddfa3-3650-4b54-8d3f-2c73793130ce admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:17.566206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:17.567275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.567708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.568162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] PATH_INFO: `/v3/projects/cd681146ccbf4facbcfa434b2edb9c5b/users/78294f43d8c54105b66661a3c657a56b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.587543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd681146ccbf4facbcfa434b2edb9c5b, user_id=78294f43d8c54105b66661a3c657a56b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:17.591259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:17.606984 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3773/7524] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:17 2022] PUT /identity/v3/projects/cd681146ccbf4facbcfa434b2edb9c5b/users/78294f43d8c54105b66661a3c657a56b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:17.611381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.621790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad43e6-b523-44e0-be18-d4859f9a1d5a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:17.688898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7182e-7970-49ac-80f7-98c2385fdbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:17.689637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7182e-7970-49ac-80f7-98c2385fdbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.689974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7182e-7970-49ac-80f7-98c2385fdbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.690305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7182e-7970-49ac-80f7-98c2385fdbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.691734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7182e-7970-49ac-80f7-98c2385fdbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:17.693453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7182e-7970-49ac-80f7-98c2385fdbd7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:17.708515 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3752/7525] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:29:17.711330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.722423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2423-5c64-48a3-a0bd-a594744943e1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:17.727988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:17.729005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.729472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.729752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] PATH_INFO: `/v3/projects/cd681146ccbf4facbcfa434b2edb9c5b/users/78294f43d8c54105b66661a3c657a56b/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.731762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd681146ccbf4facbcfa434b2edb9c5b, user_id=78294f43d8c54105b66661a3c657a56b, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:17.734638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:17.746976 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3774/7526] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:17 2022] PUT /identity/v3/projects/cd681146ccbf4facbcfa434b2edb9c5b/users/78294f43d8c54105b66661a3c657a56b/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:17.757548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:17.757842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:17.758126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:17.793554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] MFA Rules not processed for user `78294f43d8c54105b66661a3c657a56b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:17.794904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:17.901646 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3753/7527] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:17.917234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:17.919311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:18.006628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a3c6-4e6c-423e-a531-cbcafcde4359 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:18.012995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:18.013757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:18.014178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:18.014638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:18.053770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:18.055878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:18.072495 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3775/7528] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:20.011205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:20.012905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:20.018945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:20.147690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d036d-ccba-46af-ab9f-7f938645327e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:20.156371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24948c2-b8f0-4bce-8773-c75d76932567 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:20.158636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24948c2-b8f0-4bce-8773-c75d76932567 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:20.160867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24948c2-b8f0-4bce-8773-c75d76932567 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:20.161648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24948c2-b8f0-4bce-8773-c75d76932567 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:20.165879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c24948c2-b8f0-4bce-8773-c75d76932567 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:20.197152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24948c2-b8f0-4bce-8773-c75d76932567 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:20.197152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24948c2-b8f0-4bce-8773-c75d76932567 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:20.253938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3754/7529] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:21.515118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:21.516734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:21.539815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:21.635048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541173df-7e07-4402-a5ae-65b09000e849 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:21.642555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:21.644107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:21.644407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:21.644729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] PATH_INFO: `/v3/users/45fbd6ce9c57450196ecfc2e15a29c5b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:21.646265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fbd6ce9c57450196ecfc2e15a29c5b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:21.652263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:21.743690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fbd6ce9c57450196ecfc2e15a29c5b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:21.744677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fbd6ce9c57450196ecfc2e15a29c5b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:21.766827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fbd6ce9c57450196ecfc2e15a29c5b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:21.768139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fbd6ce9c57450196ecfc2e15a29c5b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:21.779842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fbd6ce9c57450196ecfc2e15a29c5b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:21.815929 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3776/7530] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:21 2022] DELETE /identity/v3/users/45fbd6ce9c57450196ecfc2e15a29c5b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:21.821063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:21.821063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:21.821700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:21.852879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:21.855250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:21.983790 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3755/7531] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:22.015872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:22.017919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:22.197982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:22.200034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:22.202693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3103f-1e59-4a71-b968-cf770106d1b9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:22.207389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:22.208873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:22.209251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:22.209528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:22.228026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:22.229579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:22.229940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ecaf-9dc9-4480-a38a-3fa605f879a6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:22.243454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:22.244220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:22.244594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:22.244972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:22.246916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:22.260720 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3777/7532] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:22.382895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:22.384496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:22.401708 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3756/7533] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:29:22.840528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:22.842811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:22.862543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011aa60a-7379-4b46-b019-4d0bf9b70e17 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:22.869261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:22.871468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:22.872035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:22.872460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] PATH_INFO: `/v3/users/d372d0f2489b4b0f86ccfc560cd27efd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:22.875787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d372d0f2489b4b0f86ccfc560cd27efd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:22.880049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:22.922840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:22.956259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd372d0f2489b4b0f86ccfc560cd27efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:22.967184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd372d0f2489b4b0f86ccfc560cd27efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:22.991206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd372d0f2489b4b0f86ccfc560cd27efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:22.992109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd372d0f2489b4b0f86ccfc560cd27efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.005648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd372d0f2489b4b0f86ccfc560cd27efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.033489 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3778/7534] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:22 2022] DELETE /identity/v3/users/d372d0f2489b4b0f86ccfc560cd27efd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:23.316084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:23.317498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:23.354507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebb906-28fc-4130-8733-42ba525a7838 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:23.388083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:23.503066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:23.503986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:23.504301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:23.504580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] PATH_INFO: `/v3/projects/c0311c9054bd42d59c825ea080ca6213` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:23.506424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0311c9054bd42d59c825ea080ca6213)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:23.508500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:23.601790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0311c9054bd42d59c825ea080ca6213', 'request_id': 'req-514d2eb9-e4b0-47d5-a441-daab9f7dc432'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.609976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0311c9054bd42d59c825ea080ca6213', 'request_id': 'req-514d2eb9-e4b0-47d5-a441-daab9f7dc432'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.621422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0311c9054bd42d59c825ea080ca6213', 'request_id': 'req-514d2eb9-e4b0-47d5-a441-daab9f7dc432'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.654274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] The token cache is being invalidate because project c0311c9054bd42d59c825ea080ca6213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:23.654687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.655963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.657075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:23.660195 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3757/7535] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:23 2022] DELETE /identity/v3/projects/c0311c9054bd42d59c825ea080ca6213 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:23.661389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:23.662426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:23.669466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:23.682909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b8409-c8c0-4014-9e15-46fb4bb26c95 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:23.800562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:23.801676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:23.801954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:23.802252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] PATH_INFO: `/v3/projects/e9a9696c07e1419b93df7b56eec5fc8a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:23.813676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a9696c07e1419b93df7b56eec5fc8a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:23.817947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d2eb9-e4b0-47d5-a441-daab9f7dc432 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:23.818245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:23.825156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:23.826903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:23.827202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:23.827753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] PATH_INFO: `/v3/users/ca861273e4d742bf9fe16dbfb470b520` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:23.829356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca861273e4d742bf9fe16dbfb470b520)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:23.831905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:23.933682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca861273e4d742bf9fe16dbfb470b520'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.938177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca861273e4d742bf9fe16dbfb470b520'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.969426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a9696c07e1419b93df7b56eec5fc8a', 'request_id': 'req-c651b513-e592-4169-9913-c1b2d0a5e759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.972931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:23.989217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a9696c07e1419b93df7b56eec5fc8a', 'request_id': 'req-c651b513-e592-4169-9913-c1b2d0a5e759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.991532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca861273e4d742bf9fe16dbfb470b520'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:23.992867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca861273e4d742bf9fe16dbfb470b520'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.005737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca861273e4d742bf9fe16dbfb470b520'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.008450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a9696c07e1419b93df7b56eec5fc8a', 'request_id': 'req-c651b513-e592-4169-9913-c1b2d0a5e759'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.044037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] The token cache is being invalidate because project e9a9696c07e1419b93df7b56eec5fc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:24.044335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.047329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.048949 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3758/7536] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:23 2022] DELETE /identity/v3/users/ca861273e4d742bf9fe16dbfb470b520 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:24.058726 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3779/7537] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:23 2022] DELETE /identity/v3/projects/e9a9696c07e1419b93df7b56eec5fc8a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:24.063238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:24.064869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:24.243590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe909c-eaa0-4856-8a98-37f631bdaa1b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:24.258196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:24.259031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:24.259324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:24.259604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] PATH_INFO: `/v3/users/bdd7df768f654bbf8c27cee4e5c027c2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:24.270686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd7df768f654bbf8c27cee4e5c027c2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:24.272797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:24.398955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd7df768f654bbf8c27cee4e5c027c2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.401481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd7df768f654bbf8c27cee4e5c027c2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.420322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd7df768f654bbf8c27cee4e5c027c2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.421157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd7df768f654bbf8c27cee4e5c027c2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.431525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e2f4cbf-a02c-44c6-9a81-cbd906e19645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd7df768f654bbf8c27cee4e5c027c2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.449447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3759/7538] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:24 2022] DELETE /identity/v3/users/bdd7df768f654bbf8c27cee4e5c027c2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:24.732051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:24.733166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:24.781640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:24.820883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651b513-e592-4169-9913-c1b2d0a5e759 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:24.900431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:24.901662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:24.902208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:24.902776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] PATH_INFO: `/v3/users/59ad7bf149a144638661cd60afc80c40` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:24.904329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ad7bf149a144638661cd60afc80c40)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:24.906892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:24.982342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ad7bf149a144638661cd60afc80c40'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:24.985054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ad7bf149a144638661cd60afc80c40'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.006245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ad7bf149a144638661cd60afc80c40'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.007412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ad7bf149a144638661cd60afc80c40'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.018521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ad7bf149a144638661cd60afc80c40'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.053540 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3780/7539] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:24 2022] DELETE /identity/v3/users/59ad7bf149a144638661cd60afc80c40 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:25.059544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.060520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.062195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.080923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.085632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.114457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:25.115872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.197436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10612e-45bc-4f3b-b854-2614d19c99c6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:25.214671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:25.215565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.215853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.216135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] PATH_INFO: `/v3/projects/cca0588184324e06bc1b42b30d4f8599` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.217767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca0588184324e06bc1b42b30d4f8599)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:25.219759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:25.221025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:25.221597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:25.255576 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3760/7540] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:25.255576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.264336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.280797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d7bb-a16e-433c-b0f4-ffe031a235cb None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:25.286873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:25.287831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.288114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.288388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] PATH_INFO: `/v3/projects/8b91b473a437453aa870ad7f07279b27` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.289922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b91b473a437453aa870ad7f07279b27)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:25.292013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:25.334086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca0588184324e06bc1b42b30d4f8599', 'request_id': 'req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.345343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca0588184324e06bc1b42b30d4f8599', 'request_id': 'req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.362974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b91b473a437453aa870ad7f07279b27', 'request_id': 'req-10f1e378-88c8-41f2-a32a-996423d306b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.366241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca0588184324e06bc1b42b30d4f8599', 'request_id': 'req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.373360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b91b473a437453aa870ad7f07279b27', 'request_id': 'req-10f1e378-88c8-41f2-a32a-996423d306b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.381541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] The token cache is being invalidate because project cca0588184324e06bc1b42b30d4f8599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:25.382014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.388016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b91b473a437453aa870ad7f07279b27', 'request_id': 'req-10f1e378-88c8-41f2-a32a-996423d306b2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.388486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.391081 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3781/7541] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:25 2022] DELETE /identity/v3/projects/cca0588184324e06bc1b42b30d4f8599 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:25.391871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.393372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.414559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] The token cache is being invalidate because project 8b91b473a437453aa870ad7f07279b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:25.415246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.415775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-10f1e378-88c8-41f2-a32a-996423d306b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:25.418569 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3761/7542] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:25 2022] DELETE /identity/v3/projects/8b91b473a437453aa870ad7f07279b27 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:25.420021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b979d-05e6-4682-a820-f796560a6d73 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.420429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b979d-05e6-4682-a820-f796560a6d73 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.420802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b979d-05e6-4682-a820-f796560a6d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.452990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8b6b979d-05e6-4682-a820-f796560a6d73 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:25.454374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8b6b979d-05e6-4682-a820-f796560a6d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.517766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddd8ef-29ba-4623-ae48-39ed62bf7860 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:25.601951 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3762/7543] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:25.603732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d852921-9649-4f00-a5ac-f817a79a532f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.607656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d852921-9649-4f00-a5ac-f817a79a532f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.607656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d852921-9649-4f00-a5ac-f817a79a532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.619772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c54db-11d5-4983-b1a2-610008d2736b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:25.628992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c54db-11d5-4983-b1a2-610008d2736b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.629391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c54db-11d5-4983-b1a2-610008d2736b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.629854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c54db-11d5-4983-b1a2-610008d2736b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.632158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-917c54db-11d5-4983-b1a2-610008d2736b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.650010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9d852921-9649-4f00-a5ac-f817a79a532f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:25.651455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9d852921-9649-4f00-a5ac-f817a79a532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.661379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c54db-11d5-4983-b1a2-610008d2736b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:25.662971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c54db-11d5-4983-b1a2-610008d2736b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:25.671141 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3763/7544] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:25.672543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a659-8d38-4580-a757-3c45d2fe9954 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.672972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a659-8d38-4580-a757-3c45d2fe9954 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.674257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a659-8d38-4580-a757-3c45d2fe9954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.689474 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3782/7545] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:25.691388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d329c-77c1-4bab-a47e-c54858ca341d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.692025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d329c-77c1-4bab-a47e-c54858ca341d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.692970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d329c-77c1-4bab-a47e-c54858ca341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.709347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bfb6a659-8d38-4580-a757-3c45d2fe9954 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:25.710737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bfb6a659-8d38-4580-a757-3c45d2fe9954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.715993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9d4d329c-77c1-4bab-a47e-c54858ca341d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:25.717573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9d4d329c-77c1-4bab-a47e-c54858ca341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:25.720709 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3764/7546] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:25.724877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6a659-8d38-4580-a757-3c45d2fe9954 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.727293 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3783/7547] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:25.733305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d329c-77c1-4bab-a47e-c54858ca341d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.741985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6a659-8d38-4580-a757-3c45d2fe9954 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:25.747771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db428-c264-40b0-962f-308373379345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:25.748580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db428-c264-40b0-962f-308373379345 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.749783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db428-c264-40b0-962f-308373379345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.750195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db428-c264-40b0-962f-308373379345 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.751054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db428-c264-40b0-962f-308373379345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:25.753109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db428-c264-40b0-962f-308373379345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:25.755021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db428-c264-40b0-962f-308373379345 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:25.761540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d329c-77c1-4bab-a47e-c54858ca341d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:25.773090 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3765/7548] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:29:25.776410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:25.777138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.777405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db428-c264-40b0-962f-308373379345 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.777523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.780032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.780795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:25.785741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:25.787456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:25.793514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db428-c264-40b0-962f-308373379345 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:25.801414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:25.801928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.802214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.802497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.807263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:25.810690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:25.816387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3784/7549] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:25.821193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.835538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe1919-9a92-4060-8d12-48771ed8cf7e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:25.844323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:25.846541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:25.847491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:25.847949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:25.849128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:25.853163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:25.858746 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3766/7550] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:25.860061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.897634 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3785/7551] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:25.898771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:25.905283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:25.909393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:25.979665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7910c-da40-48e3-81ee-0c64a3efd715 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.029261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abd9a2-45f6-4e44-b4c1-ecdc449793e2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.048759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.050094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.050094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.050094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.051578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.054562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.104860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.106149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.106442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.106724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.107978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.109204 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3786/7552] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:26.109540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.111020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.112676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.135353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a42d54-5678-4c44-b166-debacd378b58 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.140886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.141884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.142218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.142496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] PATH_INFO: `/v3/users/f2b6d2be774a4315a7d3c2c828930603` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.145211 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3767/7553] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:25 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:26.146126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b6d2be774a4315a7d3c2c828930603)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.147945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.148236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.160744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9d40-1e4d-430d-a960-09e6e264ed7a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.171244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.172929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.173566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.173956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.177773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.180322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.194802 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3768/7554] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:26.195697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.213652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5dd8-55af-411a-80b4-596dc2008db5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.219018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b6d2be774a4315a7d3c2c828930603'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.219463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.219888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b6d2be774a4315a7d3c2c828930603'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.220859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.221973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.222319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.223436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.225020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.239589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b6d2be774a4315a7d3c2c828930603'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.240634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b6d2be774a4315a7d3c2c828930603'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.245644 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3769/7555] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:26.245644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.252217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b6d2be774a4315a7d3c2c828930603'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.252971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.273811 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3787/7556] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:26 2022] DELETE /identity/v3/users/f2b6d2be774a4315a7d3c2c828930603 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:26.273811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.273811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.275456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d203d73-a52f-4fe2-842e-46860cafd63c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.371163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dabfe-e684-45ff-a9e7-f14064f4d450 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.376018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619add1-da2f-45d4-b5b8-9093b383e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.376929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619add1-da2f-45d4-b5b8-9093b383e027 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.377315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619add1-da2f-45d4-b5b8-9093b383e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.377653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619add1-da2f-45d4-b5b8-9093b383e027 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.380001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619add1-da2f-45d4-b5b8-9093b383e027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.381902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619add1-da2f-45d4-b5b8-9093b383e027 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.387619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.389744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.390780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.393020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.393912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.397276 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3788/7557] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:26.397276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472aee-b01e-40d7-b9b9-1f5362aa5b62 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.397276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472aee-b01e-40d7-b9b9-1f5362aa5b62 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.397276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472aee-b01e-40d7-b9b9-1f5362aa5b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.398766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.404203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:26.419034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-18472aee-b01e-40d7-b9b9-1f5362aa5b62 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:26.423514 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3770/7558] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:26.424014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-18472aee-b01e-40d7-b9b9-1f5362aa5b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.424105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.435514 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3789/7559] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:26.435514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472aee-b01e-40d7-b9b9-1f5362aa5b62 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.435792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d0a49-a724-4279-95a5-55eb5dce7456 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.443109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.444707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.445166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.445619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] PATH_INFO: `/v3/projects/8062a106f07646b6b12ed75329dd2112/users/9fb43e2d6dfd420ebed13585afaf6e9d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.448972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472aee-b01e-40d7-b9b9-1f5362aa5b62 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.457661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfffe3-3389-4831-b827-ed7de5ad7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.458823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfffe3-3389-4831-b827-ed7de5ad7467 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.459400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfffe3-3389-4831-b827-ed7de5ad7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.459727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfffe3-3389-4831-b827-ed7de5ad7467 admin admin] PATH_INFO: `/v3/projects/0e8d5a4f92ee47e6b45c8559815bd221/users/1cb1193cd856462baebb54b9d0d69c20/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.469679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8062a106f07646b6b12ed75329dd2112, user_id=9fb43e2d6dfd420ebed13585afaf6e9d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.473644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.479191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfffe3-3389-4831-b827-ed7de5ad7467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8d5a4f92ee47e6b45c8559815bd221, user_id=1cb1193cd856462baebb54b9d0d69c20, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.482278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfffe3-3389-4831-b827-ed7de5ad7467 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.494681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3771/7560] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:26 2022] PUT /identity/v3/projects/8062a106f07646b6b12ed75329dd2112/users/9fb43e2d6dfd420ebed13585afaf6e9d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:26.496730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.498915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.504447 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3790/7561] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:26 2022] PUT /identity/v3/projects/0e8d5a4f92ee47e6b45c8559815bd221/users/1cb1193cd856462baebb54b9d0d69c20/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:26.505822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c6ebe-0ace-466d-967f-27dac5e3e5e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.506106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c6ebe-0ace-466d-967f-27dac5e3e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.506376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c6ebe-0ace-466d-967f-27dac5e3e5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.530065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-018c6ebe-0ace-466d-967f-27dac5e3e5e1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:26.531481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-018c6ebe-0ace-466d-967f-27dac5e3e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.533295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:26.611022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e3d5a-2c89-493c-9fb4-09b5d3cf5c59 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.644383 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3791/7562] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:26.645792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.646152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.646418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.666637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.667567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.668017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.668445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.679218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.680889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.684519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] MFA Rules not processed for user `1cb1193cd856462baebb54b9d0d69c20`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:26.685935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.691661 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3772/7563] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:26.692621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.694445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.708034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4bfff-af63-4668-8065-f59aaf058de1 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.712858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.713770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.714053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.714409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] PATH_INFO: `/v3/projects/fbc9fa9e59f94c5e9c045580939cca38` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.715632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc9fa9e59f94c5e9c045580939cca38)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.717946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:26.769898 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3792/7564] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:26.770926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.772274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.776110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc9fa9e59f94c5e9c045580939cca38', 'request_id': 'req-c669a02b-3e83-41f8-a836-8e5232a68eba'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.784023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc9fa9e59f94c5e9c045580939cca38', 'request_id': 'req-c669a02b-3e83-41f8-a836-8e5232a68eba'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.796619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc9fa9e59f94c5e9c045580939cca38', 'request_id': 'req-c669a02b-3e83-41f8-a836-8e5232a68eba'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.797584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311fbb0-3abc-4966-aed5-0e1a1f30d6c5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.810168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] The token cache is being invalidate because project fbc9fa9e59f94c5e9c045580939cca38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:26.810755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.811523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:26.816384 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3773/7565] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:26 2022] DELETE /identity/v3/projects/fbc9fa9e59f94c5e9c045580939cca38 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:26.816384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:26.816384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.871619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.872342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.872628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.872906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.874795 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.895288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669a02b-3e83-41f8-a836-8e5232a68eba admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:26.897223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:26.901198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:26.901873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:26.902181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:26.902420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:26.906309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:26.917989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:26.993430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:26.997489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.009692 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3793/7566] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:27.010566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.012078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.014497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:27.016181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.028745 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3774/7567] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:27.030177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.031863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.048240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990d43-6c63-4e7e-863e-b2232cfd6297 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:27.050223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d74fe9-aad1-4000-82b4-4b0fd8253882 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:27.054416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:27.055507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.055854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.056091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:27.056260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] PATH_INFO: `/v3/users/78294f43d8c54105b66661a3c657a56b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.057490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.058948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=78294f43d8c54105b66661a3c657a56b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:27.059380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.059985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] PATH_INFO: `/v3/projects/4d9ca81e18e5455c8073cde94733f5dd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.063407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9ca81e18e5455c8073cde94733f5dd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:27.065645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.068083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.139307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78294f43d8c54105b66661a3c657a56b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.141013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9ca81e18e5455c8073cde94733f5dd', 'request_id': 'req-9242278e-ee74-4b7c-bf25-700cb2086a49'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.141283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78294f43d8c54105b66661a3c657a56b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.151800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9ca81e18e5455c8073cde94733f5dd', 'request_id': 'req-9242278e-ee74-4b7c-bf25-700cb2086a49'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.163460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78294f43d8c54105b66661a3c657a56b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.164439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78294f43d8c54105b66661a3c657a56b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.167693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9ca81e18e5455c8073cde94733f5dd', 'request_id': 'req-9242278e-ee74-4b7c-bf25-700cb2086a49'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.178553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-676fd406-fb1e-4585-97c5-4c0c4adc26cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78294f43d8c54105b66661a3c657a56b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.189700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] The token cache is being invalidate because project 4d9ca81e18e5455c8073cde94733f5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:27.190893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.191950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.194866 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3775/7568] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:27 2022] DELETE /identity/v3/projects/4d9ca81e18e5455c8073cde94733f5dd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:27.196022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.201086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3794/7569] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:27 2022] DELETE /identity/v3/users/78294f43d8c54105b66661a3c657a56b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:27.201086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6fed-eb18-4472-bdff-170754f7448d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.201086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6fed-eb18-4472-bdff-170754f7448d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.201086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6fed-eb18-4472-bdff-170754f7448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.201980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.247822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8cfa6fed-eb18-4472-bdff-170754f7448d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:27.250731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8cfa6fed-eb18-4472-bdff-170754f7448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.295386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242278e-ee74-4b7c-bf25-700cb2086a49 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:27.363122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:27.441416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:27.441967 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3795/7570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:27.442437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.442784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.443058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] PATH_INFO: `/v3/users/1cb1193cd856462baebb54b9d0d69c20` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.451876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839d21-3154-4c01-a695-49add3fdbc71 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.452220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839d21-3154-4c01-a695-49add3fdbc71 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.453269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839d21-3154-4c01-a695-49add3fdbc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.455812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb1193cd856462baebb54b9d0d69c20)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:27.459682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.496559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-57839d21-3154-4c01-a695-49add3fdbc71 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:27.498262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-57839d21-3154-4c01-a695-49add3fdbc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.511968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3796/7571] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:27.513331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839d21-3154-4c01-a695-49add3fdbc71 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.525831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839d21-3154-4c01-a695-49add3fdbc71 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:27.535808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:27.538478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.539101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.539726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.541918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:27.542456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:27.545021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.596300 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3797/7572] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:27.607255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.608114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb1193cd856462baebb54b9d0d69c20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.609928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb1193cd856462baebb54b9d0d69c20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.643277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e36ffd-e43e-4102-8013-92beac358648 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:27.647078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb1193cd856462baebb54b9d0d69c20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.648847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb1193cd856462baebb54b9d0d69c20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.657196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:27.659020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.659313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.659593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.661615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:27.666975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.669561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dfeb80f2-bbd5-4c0a-9c13-4ddd1e1a6335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb1193cd856462baebb54b9d0d69c20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:27.675688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:27.701687 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3776/7573] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:27 2022] DELETE /identity/v3/users/1cb1193cd856462baebb54b9d0d69c20 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:27.707500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.707500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.707500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.739617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3798/7574] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:27 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:27.744666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.749416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.756452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:27.759995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.853079 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3777/7575] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:27.867453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.869353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.872069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d56b9-be17-49e8-859e-a6e0934e0c76 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:27.882354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:27.883811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.884166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.884474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:27.886086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:27.890174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:27.965356 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3799/7576] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:27 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:27.966316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:27.970420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:27.983500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16707-6eea-4977-81ec-bf0e4dba792a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:27.996895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:27.997630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:27.999015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:27.999298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.001599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767c0a4-cf81-4e02-896a-c2e77f8b4807 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.014650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.015599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.015872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.016136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] PATH_INFO: `/v3/projects/cd681146ccbf4facbcfa434b2edb9c5b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.017910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd681146ccbf4facbcfa434b2edb9c5b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.018343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.020449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.021144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.034063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3778/7577] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:29:28.035244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.047500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:28.059024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88b856-06cc-4b34-b47a-3a56e0ac1512 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.068320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.069299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.069875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.070358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.071273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.073358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.089989 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3779/7578] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:28.091664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.112673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e52e5-4906-45e8-ba76-73cfaedf727a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.146336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd681146ccbf4facbcfa434b2edb9c5b', 'request_id': 'req-b94054d2-0eb8-4d55-aad7-33d7382bf48c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:28.157818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd681146ccbf4facbcfa434b2edb9c5b', 'request_id': 'req-b94054d2-0eb8-4d55-aad7-33d7382bf48c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:28.176326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd681146ccbf4facbcfa434b2edb9c5b', 'request_id': 'req-b94054d2-0eb8-4d55-aad7-33d7382bf48c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:28.197506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] The token cache is being invalidate because project cd681146ccbf4facbcfa434b2edb9c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:28.198167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:28.200083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b94054d2-0eb8-4d55-aad7-33d7382bf48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:28.202682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3800/7579] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:27 2022] DELETE /identity/v3/projects/cd681146ccbf4facbcfa434b2edb9c5b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:28.208548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bc1e0-02bb-41a6-b354-644ba8f36ab7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.209150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bc1e0-02bb-41a6-b354-644ba8f36ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.209437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bc1e0-02bb-41a6-b354-644ba8f36ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.230828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.233247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.233656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.234029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.235019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.237134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.248275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-975bc1e0-02bb-41a6-b354-644ba8f36ab7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:28.258839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-975bc1e0-02bb-41a6-b354-644ba8f36ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:28.264409 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3780/7580] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:28.269149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.274831 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3801/7581] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:28.282300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:28.286221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e76d-6517-4889-a879-8dcf69a0528f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.288487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e76d-6517-4889-a879-8dcf69a0528f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.288807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92e76d-6517-4889-a879-8dcf69a0528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.302910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d97e-6636-4679-abd6-ae7febcec95f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.308757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c79578-3b25-49b9-97dd-1bf3e1ccd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.310473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79578-3b25-49b9-97dd-1bf3e1ccd8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.311142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79578-3b25-49b9-97dd-1bf3e1ccd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.313167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c79578-3b25-49b9-97dd-1bf3e1ccd8f9 admin admin] PATH_INFO: `/v3/projects/ffe0cdf5a28846779f389c77adf4733b/users/f4bfc526f4fb4da3b91247a41c9b0805/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.333945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c79578-3b25-49b9-97dd-1bf3e1ccd8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe0cdf5a28846779f389c77adf4733b, user_id=f4bfc526f4fb4da3b91247a41c9b0805, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.334920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bc92e76d-6517-4889-a879-8dcf69a0528f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:28.336594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bc92e76d-6517-4889-a879-8dcf69a0528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:28.338194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c79578-3b25-49b9-97dd-1bf3e1ccd8f9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.361476 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3802/7582] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:28.362761 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3781/7583] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:28 2022] PUT /identity/v3/projects/ffe0cdf5a28846779f389c77adf4733b/users/f4bfc526f4fb4da3b91247a41c9b0805/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:28.366089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e76d-6517-4889-a879-8dcf69a0528f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.372852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3484-051d-423f-9588-5a4b125ad82d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.373760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3484-051d-423f-9588-5a4b125ad82d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.374306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3484-051d-423f-9588-5a4b125ad82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.391559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92e76d-6517-4889-a879-8dcf69a0528f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.438366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75ef3484-051d-423f-9588-5a4b125ad82d None None] MFA Rules not processed for user `f4bfc526f4fb4da3b91247a41c9b0805`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:28.441502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75ef3484-051d-423f-9588-5a4b125ad82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:28.488359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:28.513109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.514264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.515261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.516062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.517582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:28.518086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.520238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.536487 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3803/7584] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:28.541559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.544585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:28.546224 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3782/7585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:29:28.547231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3484-051d-423f-9588-5a4b125ad82d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.559148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3484-051d-423f-9588-5a4b125ad82d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.565278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.566060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.566703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.567068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.567850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.570123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.612111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3783/7586] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:28 2022] POST /identity/v3/projects => generated 395 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:28.612111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.614633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:28.683473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259c89-cc91-4f27-a44f-26a1a4bc981d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.703077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:28.752407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011a99f-c412-46b3-82b7-a5980cd0271a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:28.761827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.762515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.762797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.763071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.823805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:28.824490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:28.824930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:28.825827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:28.829105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:28.850573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.856521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.880117 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3804/7587] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:28.882055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:28.897818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:28.899602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:28.924460 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3784/7588] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:29.011691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7a99d-59c5-4bcd-aeb6-1586921605a7 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:29.026683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:29.027390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.028155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.028455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.030419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:29.034728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:29.062179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:29.076478 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3805/7589] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:28 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:29.081217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:29.100006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7059cd-bbfb-4727-bf1b-fdd8a70be817 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:29.122866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:29.123573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.123857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.124132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.124873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:29.126533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:29.138781 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3785/7590] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:29:29.142999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:29.162426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bed80-7af5-45c8-892f-d0fa75c01c5a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:29.170199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f564b6-9bb0-42ba-a100-a3f8c51d3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:29.172004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f564b6-9bb0-42ba-a100-a3f8c51d3ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.172814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f564b6-9bb0-42ba-a100-a3f8c51d3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.173846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f564b6-9bb0-42ba-a100-a3f8c51d3ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.174972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f564b6-9bb0-42ba-a100-a3f8c51d3ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:29.177799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f564b6-9bb0-42ba-a100-a3f8c51d3ce6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:29.200579 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3806/7591] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:29.204002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:29.229582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8eef99-bca1-42d9-a38d-6d8aa93bdefd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:29.244976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:29.247155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.247849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.248357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] PATH_INFO: `/v3/projects/7fd4ced3ec764d9aadbe04151569ce80/users/a8451eca2c1d47c8aa50da0de0b87a2a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.287027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd4ced3ec764d9aadbe04151569ce80, user_id=a8451eca2c1d47c8aa50da0de0b87a2a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:29.290870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:29.326272 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3786/7592] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:29 2022] PUT /identity/v3/projects/7fd4ced3ec764d9aadbe04151569ce80/users/a8451eca2c1d47c8aa50da0de0b87a2a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:29.346507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf528-6abe-4639-ba16-648763c012fb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.346507 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf528-6abe-4639-ba16-648763c012fb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.346931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acf528-6abe-4639-ba16-648763c012fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.397124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-14acf528-6abe-4639-ba16-648763c012fb None None] MFA Rules not processed for user `a8451eca2c1d47c8aa50da0de0b87a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:29.398466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14acf528-6abe-4639-ba16-648763c012fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:29.483784 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3807/7593] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:29.497642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:29.499561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:29.608670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c5d1-2b96-4291-ad32-68b124cf82ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:29.619176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf528-6abe-4639-ba16-648763c012fb None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:29.621130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14acf528-6abe-4639-ba16-648763c012fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:29.624073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a15750-1060-48a6-937d-c60696d235a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:29.626791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a15750-1060-48a6-937d-c60696d235a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.627322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a15750-1060-48a6-937d-c60696d235a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.627572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a15750-1060-48a6-937d-c60696d235a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.679299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a15750-1060-48a6-937d-c60696d235a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:29.681861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a15750-1060-48a6-937d-c60696d235a6 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:29.723887 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3787/7594] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:29.800654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acf528-6abe-4639-ba16-648763c012fb None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:29.808157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:29.809247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.809779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.810545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] PATH_INFO: `/v3/projects/0e8d5a4f92ee47e6b45c8559815bd221` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.813254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8d5a4f92ee47e6b45c8559815bd221)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:29.817770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:29.902610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8d5a4f92ee47e6b45c8559815bd221', 'request_id': 'req-45a73872-7371-4c77-823e-ae1f603eb96d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:29.910220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8d5a4f92ee47e6b45c8559815bd221', 'request_id': 'req-45a73872-7371-4c77-823e-ae1f603eb96d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:29.922329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8d5a4f92ee47e6b45c8559815bd221', 'request_id': 'req-45a73872-7371-4c77-823e-ae1f603eb96d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:29.936986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] The token cache is being invalidate because project 0e8d5a4f92ee47e6b45c8559815bd221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:29.937542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:29.938473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-45a73872-7371-4c77-823e-ae1f603eb96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:29.943887 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3808/7595] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:29 2022] DELETE /identity/v3/projects/0e8d5a4f92ee47e6b45c8559815bd221 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:29.945741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05eff-e98e-41ff-8ecc-4854a73a6d20 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:29.946030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05eff-e98e-41ff-8ecc-4854a73a6d20 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:29.946310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f05eff-e98e-41ff-8ecc-4854a73a6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:29.967568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40f05eff-e98e-41ff-8ecc-4854a73a6d20 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:29.969156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40f05eff-e98e-41ff-8ecc-4854a73a6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:30.048271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:30.063747 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3788/7596] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:30.071403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebb4c-640f-43c1-b298-db6230675c9d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.071815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebb4c-640f-43c1-b298-db6230675c9d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.072164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebb4c-640f-43c1-b298-db6230675c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.099600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b96ebb4c-640f-43c1-b298-db6230675c9d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:30.101243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b96ebb4c-640f-43c1-b298-db6230675c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:30.115240 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3809/7597] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:30.116779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05eff-e98e-41ff-8ecc-4854a73a6d20 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:30.128221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f05eff-e98e-41ff-8ecc-4854a73a6d20 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:30.137738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:30.138621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.139093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.139465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.141210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:30.141724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:30.145389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:30.165071 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3789/7598] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:29:30.168145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ebb4c-640f-43c1-b298-db6230675c9d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:30.177978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:30.199170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ebb4c-640f-43c1-b298-db6230675c9d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:30.207676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:30.209154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.209797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.210771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.211091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:30.214513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:30.285408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3810/7599] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:30 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:30.289080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:30.308224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d92b7-d1e9-42fb-adcf-512ce9afc4bd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:30.443402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:30.448045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.449472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.449833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.452279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:30.458321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:30.513659 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3790/7600] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:30 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:29:30.514750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:30.531827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c879f-fc4f-4bc5-a29d-d6dc9ae3c188 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:30.544821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:30.545996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.546480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.546976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.548000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:30.550294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:30.596654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:30.608843 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3811/7601] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:29:30.613257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018484a-c039-4674-8aff-5e0b232a9bcb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:30.623216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9692dcb-9b31-43ac-b552-5c63485cbc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:30.624305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9692dcb-9b31-43ac-b552-5c63485cbc57 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.624690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9692dcb-9b31-43ac-b552-5c63485cbc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.625084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9692dcb-9b31-43ac-b552-5c63485cbc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.625933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9692dcb-9b31-43ac-b552-5c63485cbc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:30.629532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9692dcb-9b31-43ac-b552-5c63485cbc57 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:30.651416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:30.663013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3791/7602] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:30.664320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e98e-9c8e-4661-b966-a9377676175d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:30.669466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:30.670595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.671082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.671477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] PATH_INFO: `/v3/projects/1be2f5441fe54817b84b1ee108b9f6f2/users/bde8bc8327394bcc80cb60633c4215a8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.692977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be2f5441fe54817b84b1ee108b9f6f2, user_id=bde8bc8327394bcc80cb60633c4215a8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:30.695744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:30.718731 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3812/7603] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:30 2022] PUT /identity/v3/projects/1be2f5441fe54817b84b1ee108b9f6f2/users/bde8bc8327394bcc80cb60633c4215a8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:30.731308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb57a1-f79d-4654-982b-68b30b4a6714 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:30.731632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb57a1-f79d-4654-982b-68b30b4a6714 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:30.731918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb57a1-f79d-4654-982b-68b30b4a6714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:30.766978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-83bb57a1-f79d-4654-982b-68b30b4a6714 None None] MFA Rules not processed for user `bde8bc8327394bcc80cb60633c4215a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:30.768288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-83bb57a1-f79d-4654-982b-68b30b4a6714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:30.856052 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3792/7604] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:30.867886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:30.870684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:31.001208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d240-d52f-4100-9b5a-6f30f1c3a4c4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:31.006224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658a356-7280-411d-8902-02e0d6df6c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:31.007419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a356-7280-411d-8902-02e0d6df6c91 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:31.007869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a356-7280-411d-8902-02e0d6df6c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:31.008216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a356-7280-411d-8902-02e0d6df6c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:31.033027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658a356-7280-411d-8902-02e0d6df6c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:31.034640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658a356-7280-411d-8902-02e0d6df6c91 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:31.064581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3813/7605] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:29:34.853704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb57a1-f79d-4654-982b-68b30b4a6714 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:35.034534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:35.071721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb57a1-f79d-4654-982b-68b30b4a6714 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:35.078337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:35.080233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:35.080515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:35.080799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] PATH_INFO: `/v3/users/bde8bc8327394bcc80cb60633c4215a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:35.082431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde8bc8327394bcc80cb60633c4215a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:35.089596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:35.228603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde8bc8327394bcc80cb60633c4215a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:35.229335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde8bc8327394bcc80cb60633c4215a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:35.270342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde8bc8327394bcc80cb60633c4215a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:35.273959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde8bc8327394bcc80cb60633c4215a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:35.298114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde8bc8327394bcc80cb60633c4215a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:35.327477 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3793/7606] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:34 2022] DELETE /identity/v3/users/bde8bc8327394bcc80cb60633c4215a8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:35.333004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:35.333463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:35.333554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:35.366955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:35.368180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:35.471852 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3814/7607] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:35.493814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:35.495368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:35.672597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b192b-bde1-48a7-a454-a5eb1e86e9fc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:35.682347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0c4ce-1c3c-428a-ace7-b379bb07ede2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:35.683396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0c4ce-1c3c-428a-ace7-b379bb07ede2 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:35.684821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0c4ce-1c3c-428a-ace7-b379bb07ede2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:35.685505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0c4ce-1c3c-428a-ace7-b379bb07ede2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:35.703608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0c4ce-1c3c-428a-ace7-b379bb07ede2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:35.705807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0c4ce-1c3c-428a-ace7-b379bb07ede2 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:35.763005 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3794/7608] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:29:37.033914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.035552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:37.060850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf2e8a-9d28-435d-bb6d-2e9c83a3cc34 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.069905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.071071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.071502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.071949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] PATH_INFO: `/v3/projects/1be2f5441fe54817b84b1ee108b9f6f2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.073550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be2f5441fe54817b84b1ee108b9f6f2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.075933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.146960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:37.154052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be2f5441fe54817b84b1ee108b9f6f2', 'request_id': 'req-2d7c8080-643b-4135-ac4a-6bc64b415df0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:37.167115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be2f5441fe54817b84b1ee108b9f6f2', 'request_id': 'req-2d7c8080-643b-4135-ac4a-6bc64b415df0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:37.182539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be2f5441fe54817b84b1ee108b9f6f2', 'request_id': 'req-2d7c8080-643b-4135-ac4a-6bc64b415df0'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:37.196824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] The token cache is being invalidate because project 1be2f5441fe54817b84b1ee108b9f6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:37.197984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:37.199162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2d7c8080-643b-4135-ac4a-6bc64b415df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:37.201902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3815/7609] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:37 2022] DELETE /identity/v3/projects/1be2f5441fe54817b84b1ee108b9f6f2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:37.209668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df79d7-a874-4048-bec8-f09c476b362b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.210116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df79d7-a874-4048-bec8-f09c476b362b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.210116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df79d7-a874-4048-bec8-f09c476b362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.238224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-77df79d7-a874-4048-bec8-f09c476b362b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:37.239803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77df79d7-a874-4048-bec8-f09c476b362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:37.322577 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3795/7610] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:37.330764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d322-5760-4656-a5e3-e951715f0375 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.331131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d322-5760-4656-a5e3-e951715f0375 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.331543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6d322-5760-4656-a5e3-e951715f0375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.360709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-45d6d322-5760-4656-a5e3-e951715f0375 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:37.362598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-45d6d322-5760-4656-a5e3-e951715f0375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:37.386275 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3816/7611] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:37.390339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df79d7-a874-4048-bec8-f09c476b362b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.401552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df79d7-a874-4048-bec8-f09c476b362b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.407416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42af7f-45b7-4f1d-90b2-6f9642411cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.408373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42af7f-45b7-4f1d-90b2-6f9642411cfa admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.408657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42af7f-45b7-4f1d-90b2-6f9642411cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.409267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42af7f-45b7-4f1d-90b2-6f9642411cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.410200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42af7f-45b7-4f1d-90b2-6f9642411cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:37.410706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42af7f-45b7-4f1d-90b2-6f9642411cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.412478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42af7f-45b7-4f1d-90b2-6f9642411cfa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.420518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:37.434025 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3796/7612] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:29:37.440519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6d322-5760-4656-a5e3-e951715f0375 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.454853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6d322-5760-4656-a5e3-e951715f0375 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.461529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.462478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.462815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.463296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.464072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.466178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.508309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.508605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.508886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.523177 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3817/7613] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:37 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:37.524945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.573318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] MFA Rules not processed for user `9fb43e2d6dfd420ebed13585afaf6e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:37.575110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:37.684387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61b33-c9a2-4c44-a415-6c4d48a48a65 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.699275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.700149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.700485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.700771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.701518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.706458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.740713 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3797/7614] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:37.741923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.743782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:37.764366 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3818/7615] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:37 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:37.765989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.776349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f798c-9fc4-4e6e-81e0-ce9e3da8f1cf None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.789012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.789969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9812d9-1dd5-4168-aaaa-62a8bb1a6592 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.791636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.792407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.792784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.794215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.797394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.805759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.806567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.810229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.810742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.811927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.814443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.840020 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3819/7616] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:37.842103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.857604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb18b6-9a65-4011-b3a2-3eeee32198e2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.858591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3798/7617] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:37 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:37.865249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.868976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.869992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.870378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.870792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.871658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.874230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.890757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e458a-995e-49c4-925c-4a8a743617b3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.896878 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3820/7618] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:37.898063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.907838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.908574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.908856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.909175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.909933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.911563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.911924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc08a91-603f-4d53-b2dd-adc444b0469e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.918525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe13d3e-0bc1-44ec-9329-92794437dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:37.931763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe13d3e-0bc1-44ec-9329-92794437dfac admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:37.932291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe13d3e-0bc1-44ec-9329-92794437dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:37.932892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe13d3e-0bc1-44ec-9329-92794437dfac admin admin] PATH_INFO: `/v3/projects/df50a51956d247dcb49a5ca1afed6f32/users/8a70ee3d2307456c8534b279c1f11f4c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:37.944305 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3799/7619] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:37.947489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:37.963019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe13d3e-0bc1-44ec-9329-92794437dfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=df50a51956d247dcb49a5ca1afed6f32, user_id=8a70ee3d2307456c8534b279c1f11f4c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:37.965966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe13d3e-0bc1-44ec-9329-92794437dfac admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:37.978303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3ec8e-6db9-4ab6-bdfe-dd5663fdcdb1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:37.994571 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3821/7620] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:37 2022] PUT /identity/v3/projects/df50a51956d247dcb49a5ca1afed6f32/users/8a70ee3d2307456c8534b279c1f11f4c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:38.005678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:38.006431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:38.006784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:38.068125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] MFA Rules not processed for user `8a70ee3d2307456c8534b279c1f11f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:38.070637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:38.121428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:38.122216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9533d-3c10-4847-84d0-c08437c6e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:38.124634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9533d-3c10-4847-84d0-c08437c6e34a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:38.125250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9533d-3c10-4847-84d0-c08437c6e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:38.125858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9533d-3c10-4847-84d0-c08437c6e34a admin admin] PATH_INFO: `/v3/system/users/338164deb4944d09964795eb2a2bb3be/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:38.144695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9533d-3c10-4847-84d0-c08437c6e34a admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=338164deb4944d09964795eb2a2bb3be, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:38.147816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9533d-3c10-4847-84d0-c08437c6e34a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:38.160007 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3800/7621] 10.222.0.30 () {60 vars in 1377 bytes} [Sat Jun 18 22:29:37 2022] PUT /identity/v3/system/users/338164deb4944d09964795eb2a2bb3be/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:38.170704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a80d6-8937-436d-bbd7-ded801652f40 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:38.171347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a80d6-8937-436d-bbd7-ded801652f40 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:38.172047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a80d6-8937-436d-bbd7-ded801652f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:38.221856 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3822/7622] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:29:38.238785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:38.242006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:38.253597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dc9a80d6-8937-436d-bbd7-ded801652f40 None None] MFA Rules not processed for user `338164deb4944d09964795eb2a2bb3be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:38.257557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dc9a80d6-8937-436d-bbd7-ded801652f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:38.339570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:38.409591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b757afc-aacc-4ae7-a441-60cc72e62fe1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:38.421688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:38.422595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:38.423026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:38.423439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:38.430187 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3801/7623] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:38 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 18 22:29:38.437442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a80d6-8937-436d-bbd7-ded801652f40 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:38.443585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:38.446000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:38.475633 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3823/7624] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:38.783720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a80d6-8937-436d-bbd7-ded801652f40 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:38.878465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338164deb4944d09964795eb2a2bb3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:38.880432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:38.887671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:38.888389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] PATH_INFO: `/v3/services` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:38.889394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:38.891021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:38.910652 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3802/7625] 10.222.0.30 () {58 vars in 1109 bytes} [Sat Jun 18 22:29:38 2022] GET /identity/v3/services => generated 2191 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:38.912203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:39.172580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db2e3-7070-479d-af42-8ed004f363c8 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:39.292276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:39.324374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338164deb4944d09964795eb2a2bb3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:39.325123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:39.326119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:39.326119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] PATH_INFO: `/v3/limits` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:39.326951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:39.327689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jun 18 22:29:39.425498 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jun 18 22:29:39.426448 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:29:39.429273 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3824/7626] 10.222.0.30 () {60 vars in 1125 bytes} [Sat Jun 18 22:29:38 2022] POST /identity/v3/limits => generated 124 bytes in 518 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jun 18 22:29:39.434515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:39.510737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:39.626106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472c80d-f797-4f7b-ba6a-f9a8f08e596d None tempest-ImageQuotaTest-1381520968-system-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:39.728576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338164deb4944d09964795eb2a2bb3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:39.730244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:39.730957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:39.732294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:39.736229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:39.739687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:39.760145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3803/7627] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:29:39 2022] GET /identity/v3/registered_limits => generated 129 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:39.769736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:40.142531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd731d0-6a07-431f-931a-2b37ac8b1ad5 None tempest-ImageQuotaTest-1381520968-system-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:40.219570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338164deb4944d09964795eb2a2bb3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:40.221427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:40.222014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:40.222813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:40.223964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:40.225333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:40.232918 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3825/7628] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:29:39 2022] GET /identity/v3/registered_limits => generated 129 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:29:49.751831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=55 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:50.229494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=77 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:53.061820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:53.080306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4d8d8-4010-4079-a382-2d49f96bf4ba None tempest-ImageQuotaTest-1381520968-system-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:53.103273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:53.104043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:53.104491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:53.104779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] PATH_INFO: `/v3/users/9fb43e2d6dfd420ebed13585afaf6e9d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:53.107425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb43e2d6dfd420ebed13585afaf6e9d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:53.115227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:53.252316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb43e2d6dfd420ebed13585afaf6e9d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:53.253275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb43e2d6dfd420ebed13585afaf6e9d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:53.334518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb43e2d6dfd420ebed13585afaf6e9d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:53.335526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb43e2d6dfd420ebed13585afaf6e9d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:53.356428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb43e2d6dfd420ebed13585afaf6e9d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:53.432787 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3804/7629] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:53 2022] DELETE /identity/v3/users/9fb43e2d6dfd420ebed13585afaf6e9d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:54.042409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:54.044814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:54.304241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0a288-563b-4191-be4b-28b0b3204c90 None tempest-ImageQuotaTest-1381520968-system-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:54.318218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:54.320580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:54.322937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:54.323468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] PATH_INFO: `/v3/projects/8062a106f07646b6b12ed75329dd2112` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:54.325115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8062a106f07646b6b12ed75329dd2112)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:54.331508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:54.446152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8062a106f07646b6b12ed75329dd2112', 'request_id': 'req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.453925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8062a106f07646b6b12ed75329dd2112', 'request_id': 'req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.466233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8062a106f07646b6b12ed75329dd2112', 'request_id': 'req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.499652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] The token cache is being invalidate because project 8062a106f07646b6b12ed75329dd2112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:29:54.500057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.501483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.503579 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3826/7630] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:29:54 2022] DELETE /identity/v3/projects/8062a106f07646b6b12ed75329dd2112 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:54.508546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:54.534163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7afa7-aa83-491e-a1cf-e7b4791a441e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:54.625718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:54.627266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:54.627588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:54.628141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] PATH_INFO: `/v3/users/338164deb4944d09964795eb2a2bb3be` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:54.629666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338164deb4944d09964795eb2a2bb3be)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:54.633952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:54.738549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338164deb4944d09964795eb2a2bb3be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.739679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338164deb4944d09964795eb2a2bb3be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.761596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=79,keystone:DELETE=20,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:54.765172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338164deb4944d09964795eb2a2bb3be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.766175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338164deb4944d09964795eb2a2bb3be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.811391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3b3e226c-70f9-46f1-a6e3-e65cd1dcef39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338164deb4944d09964795eb2a2bb3be'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:54.842496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3805/7631] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:54 2022] DELETE /identity/v3/users/338164deb4944d09964795eb2a2bb3be => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:29:55.470998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:55.472735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:55.492623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea0e8f-6e8f-441a-b0f2-b1a0610b012b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:55.655110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc555e11-c43c-45c6-a082-aaa9d27a7d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:55.656290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc555e11-c43c-45c6-a082-aaa9d27a7d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:55.657245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc555e11-c43c-45c6-a082-aaa9d27a7d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:55.659170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc555e11-c43c-45c6-a082-aaa9d27a7d7d admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:55.673113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc555e11-c43c-45c6-a082-aaa9d27a7d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:55.675334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc555e11-c43c-45c6-a082-aaa9d27a7d7d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application [None req-cc555e11-c43c-45c6-a082-aaa9d27a7d7d admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 18 22:29:55.695230 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jun 18 22:29:55.696466 ncdv-master-1 devstack@keystone.service[91205]: ERROR keystone.server.flask.application Jun 18 22:29:55.704143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede13f-1891-4a5e-b546-0e9ffd94f27d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:55.705125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede13f-1891-4a5e-b546-0e9ffd94f27d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:55.705466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede13f-1891-4a5e-b546-0e9ffd94f27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:55.715938 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3827/7632] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:29:55 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 18 22:29:55.744263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-66ede13f-1891-4a5e-b546-0e9ffd94f27d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:55.746281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-66ede13f-1891-4a5e-b546-0e9ffd94f27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:55.758074 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3806/7633] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:55.768342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebe526-a5a3-453a-a0ea-3fefc1d9913c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:55.768634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebe526-a5a3-453a-a0ea-3fefc1d9913c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:55.768919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebe526-a5a3-453a-a0ea-3fefc1d9913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:55.800081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e5ebe526-a5a3-453a-a0ea-3fefc1d9913c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:55.802848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e5ebe526-a5a3-453a-a0ea-3fefc1d9913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:55.825692 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3828/7634] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:55.827332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede13f-1891-4a5e-b546-0e9ffd94f27d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:55.847931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede13f-1891-4a5e-b546-0e9ffd94f27d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:55.876479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:55.879209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:55.880253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:55.881003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:55.885719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:29:55.887321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:55.898751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:55.935965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebe526-a5a3-453a-a0ea-3fefc1d9913c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:55.951557 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3807/7635] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:29:55.969253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebe526-a5a3-453a-a0ea-3fefc1d9913c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:55.975841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:55.983236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:55.983865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:55.984327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:55.985981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:55.989652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:56.046202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:56.088182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:56.094655 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3829/7636] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:29:55 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:56.104143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4bf8-4354-499f-8e0b-bfc3787108ed admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:56.250014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:56.253653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:56.264801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:56.266074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:56.266869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:56.280105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:56.353695 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3808/7637] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:29:56 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:29:56.355164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:56.377215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53096fdd-055b-4c55-8b7e-1efd6103056f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:56.388588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:56.389477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:56.389653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:56.392696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:56.394664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:56.396454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:56.426391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3830/7638] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:56.430478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:56.443687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08875e96-d362-4dbc-bab9-0bae5f81c72e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:56.457242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5025af-911f-4eba-b450-c9136ddac3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:56.457969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5025af-911f-4eba-b450-c9136ddac3ef admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:56.458246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5025af-911f-4eba-b450-c9136ddac3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:56.458667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5025af-911f-4eba-b450-c9136ddac3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:56.459675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5025af-911f-4eba-b450-c9136ddac3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:56.462107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5025af-911f-4eba-b450-c9136ddac3ef admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:56.490478 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3809/7639] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:29:56.494794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:56.507561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d231ea-60ae-49ba-b833-98a41a43161a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:56.514452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:56.516457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:56.517052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:56.517542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] PATH_INFO: `/v3/projects/2d7a59e0743a480c9af66dea984113c6/users/406628da7a8140fd83200ffc90e71198/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:56.561704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7a59e0743a480c9af66dea984113c6, user_id=406628da7a8140fd83200ffc90e71198, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:56.565545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:56.587358 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3831/7640] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:29:56 2022] PUT /identity/v3/projects/2d7a59e0743a480c9af66dea984113c6/users/406628da7a8140fd83200ffc90e71198/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:56.588950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:56.589273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:56.589558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:56.629683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:56.631137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:56.726387 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3810/7641] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:29:56.758517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:56.761552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:56.872565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4048a26-0b87-4c17-92f1-a37fcc1428fb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:56.878367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99899eb-57c5-43b7-bc52-3ec2b1ba2e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:56.879526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99899eb-57c5-43b7-bc52-3ec2b1ba2e72 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:56.879963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99899eb-57c5-43b7-bc52-3ec2b1ba2e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:56.880389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99899eb-57c5-43b7-bc52-3ec2b1ba2e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:56.901867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99899eb-57c5-43b7-bc52-3ec2b1ba2e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:56.904381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99899eb-57c5-43b7-bc52-3ec2b1ba2e72 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:56.919350 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3832/7642] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:29:57.989777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:57.991259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:58.005433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21efd6-0daf-4b7f-b6ed-1f1828b74289 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:58.027187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:58.028308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:58.028736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:58.029233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] PATH_INFO: `/v3/users/8a70ee3d2307456c8534b279c1f11f4c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:58.036840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a70ee3d2307456c8534b279c1f11f4c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:58.039625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:58.120587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:58.155609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a70ee3d2307456c8534b279c1f11f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:58.157154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a70ee3d2307456c8534b279c1f11f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:58.194840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a70ee3d2307456c8534b279c1f11f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:58.196971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a70ee3d2307456c8534b279c1f11f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:58.219003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a70ee3d2307456c8534b279c1f11f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:29:58.266514 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3811/7643] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:29:57 2022] DELETE /identity/v3/users/8a70ee3d2307456c8534b279c1f11f4c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:29:58.271191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:58.271704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:58.271794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:58.297911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:29:58.299754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:58.404468 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3833/7644] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:29:58.442430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:29:58.444363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:29:58.541515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8837462-7b14-4a5e-b55c-8b47e2e149a5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:29:58.549938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c6426-dcaa-410a-bbd0-4b3dfef734a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:29:58.551331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c6426-dcaa-410a-bbd0-4b3dfef734a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:29:58.551833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c6426-dcaa-410a-bbd0-4b3dfef734a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:29:58.552318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c6426-dcaa-410a-bbd0-4b3dfef734a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:29:58.568053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c6426-dcaa-410a-bbd0-4b3dfef734a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:29:58.570552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c6426-dcaa-410a-bbd0-4b3dfef734a0 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:29:58.586587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3812/7645] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:00.413991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:00.417003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:00.448095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492384d-3565-41f5-a7c8-309087095ff1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:00.462714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:00.463275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:00.463592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:00.464044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] PATH_INFO: `/v3/projects/df50a51956d247dcb49a5ca1afed6f32` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:00.468081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=df50a51956d247dcb49a5ca1afed6f32)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:00.472760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:00.574278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df50a51956d247dcb49a5ca1afed6f32', 'request_id': 'req-740e53f7-1bbe-4c21-b5a4-e461a9257efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:00.592879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df50a51956d247dcb49a5ca1afed6f32', 'request_id': 'req-740e53f7-1bbe-4c21-b5a4-e461a9257efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:00.600594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:00.607695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df50a51956d247dcb49a5ca1afed6f32', 'request_id': 'req-740e53f7-1bbe-4c21-b5a4-e461a9257efd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:00.628966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] The token cache is being invalidate because project df50a51956d247dcb49a5ca1afed6f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:00.629764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:00.631110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-740e53f7-1bbe-4c21-b5a4-e461a9257efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:00.635104 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3834/7646] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:00 2022] DELETE /identity/v3/projects/df50a51956d247dcb49a5ca1afed6f32 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:00.640201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b23a-f98c-4a3c-84b7-309639ea2d39 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:00.641447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b23a-f98c-4a3c-84b7-309639ea2d39 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:00.641937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b23a-f98c-4a3c-84b7-309639ea2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:00.667038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fcc1b23a-f98c-4a3c-84b7-309639ea2d39 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:00.668756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fcc1b23a-f98c-4a3c-84b7-309639ea2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:00.955770 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3813/7647] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:00.963448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afcca6-a0d4-4148-827f-cdff2da9e86b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:00.963769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afcca6-a0d4-4148-827f-cdff2da9e86b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:00.964026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7afcca6-a0d4-4148-827f-cdff2da9e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:00.986297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a7afcca6-a0d4-4148-827f-cdff2da9e86b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:00.987748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a7afcca6-a0d4-4148-827f-cdff2da9e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:01.002117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b23a-f98c-4a3c-84b7-309639ea2d39 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:01.007562 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3835/7648] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:01.014044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b23a-f98c-4a3c-84b7-309639ea2d39 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:01.019884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:01.020935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.021235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.021565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.025493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:01.025493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:01.025493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:01.055430 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3814/7649] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:01.061813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afcca6-a0d4-4148-827f-cdff2da9e86b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:01.073579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7afcca6-a0d4-4148-827f-cdff2da9e86b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:01.087352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:01.087981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.088268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.088552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.089358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:01.093501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:01.159276 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3836/7650] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:01 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:01.160109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:01.174625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d481-07ab-4d09-b756-e1795a6ec08b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:01.231173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:01.262732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:01.263431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.263717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.264172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.264897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:01.266990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:01.301793 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3815/7651] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:01 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:30:01.306045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:01.322628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80042927-b962-48d5-9b6d-8c7828ad4eca admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:01.333898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:01.336352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.337794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.337936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.338624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:01.342768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:01.361945 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3837/7652] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:01.368389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:01.396158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fd055-cb31-456f-8bf0-0c9d70aed04c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:01.404614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa531-e6ce-4597-ba70-d8623d735a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:01.406459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa531-e6ce-4597-ba70-d8623d735a25 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.409511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa531-e6ce-4597-ba70-d8623d735a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.410482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa531-e6ce-4597-ba70-d8623d735a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.414253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa531-e6ce-4597-ba70-d8623d735a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:01.422476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa531-e6ce-4597-ba70-d8623d735a25 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:01.447240 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3816/7653] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:01.452695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:01.468632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4498-990a-4ac9-8626-2ab37f976177 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:01.476980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:01.479229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.479989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.480580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] PATH_INFO: `/v3/projects/0ec1edee2a79449ba938310fa3810695/users/8df56507fb7e4c6eb012fbea8bb5a660/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.517932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec1edee2a79449ba938310fa3810695, user_id=8df56507fb7e4c6eb012fbea8bb5a660, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:01.520813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:01.547576 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3838/7654] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:01 2022] PUT /identity/v3/projects/0ec1edee2a79449ba938310fa3810695/users/8df56507fb7e4c6eb012fbea8bb5a660/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:01.558084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.558650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.559085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.593997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] MFA Rules not processed for user `8df56507fb7e4c6eb012fbea8bb5a660`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:01.596814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:01.741333 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3817/7655] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:01.754726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:01.757385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:01.875276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c25c-1168-4eb6-9872-c295034c4276 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:01.889111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:01.890003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:01.890298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:01.890629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:01.922436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:01.925413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:01.959506 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3839/7656] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:30:02.006766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:02.008717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:02.110650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:02.112805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:02.261583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26514f-f460-46bf-bdcd-9d8bda4d8ad5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:02.270602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4df34-5b51-44a5-9422-2a400db9d10a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:02.272633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4df34-5b51-44a5-9422-2a400db9d10a service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:02.272927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4df34-5b51-44a5-9422-2a400db9d10a service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:02.274424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4df34-5b51-44a5-9422-2a400db9d10a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:02.280491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-35e4df34-5b51-44a5-9422-2a400db9d10a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:02.320442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4df34-5b51-44a5-9422-2a400db9d10a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:02.322970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4df34-5b51-44a5-9422-2a400db9d10a service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:02.326967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e894aec-8f87-4809-9f9e-63ac198ec011 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:02.341891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:02.345740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:02.345740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:02.346198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] PATH_INFO: `/v3/users/a8451eca2c1d47c8aa50da0de0b87a2a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:02.347623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8451eca2c1d47c8aa50da0de0b87a2a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:02.350854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:02.356762 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3818/7657] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:02.428785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:02.466372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8451eca2c1d47c8aa50da0de0b87a2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:02.467823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8451eca2c1d47c8aa50da0de0b87a2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:02.487197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8451eca2c1d47c8aa50da0de0b87a2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:02.488234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8451eca2c1d47c8aa50da0de0b87a2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:02.513477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8451eca2c1d47c8aa50da0de0b87a2a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:02.536886 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3840/7658] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:02 2022] DELETE /identity/v3/users/a8451eca2c1d47c8aa50da0de0b87a2a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:02.539065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:02.539595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:02.540052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:02.573564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:02.580434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:02.646007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:02.745358 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3819/7659] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:02.755217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:02.757021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:02.839689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8338-a554-49f6-aabb-1d25dbfcd187 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:02.844047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b90f2-7d65-4204-88aa-27b1d907c589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:02.844825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b90f2-7d65-4204-88aa-27b1d907c589 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:02.845297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b90f2-7d65-4204-88aa-27b1d907c589 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:02.845581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b90f2-7d65-4204-88aa-27b1d907c589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:02.866382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b90f2-7d65-4204-88aa-27b1d907c589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:02.868208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b90f2-7d65-4204-88aa-27b1d907c589 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:02.907093 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3841/7660] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:03.257143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:03.259664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:03.293949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9957a6-6fd4-47ac-905d-b6f8f8b69667 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:03.309114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:03.309438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:03.309703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:03.309977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] PATH_INFO: `/v3/projects/7fd4ced3ec764d9aadbe04151569ce80` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:03.311583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd4ced3ec764d9aadbe04151569ce80)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:03.313837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:03.390239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd4ced3ec764d9aadbe04151569ce80', 'request_id': 'req-bf833473-cf89-4346-bea7-fa587e73ddaf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:03.428161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd4ced3ec764d9aadbe04151569ce80', 'request_id': 'req-bf833473-cf89-4346-bea7-fa587e73ddaf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:03.448839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd4ced3ec764d9aadbe04151569ce80', 'request_id': 'req-bf833473-cf89-4346-bea7-fa587e73ddaf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:03.469496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] The token cache is being invalidate because project 7fd4ced3ec764d9aadbe04151569ce80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:03.470442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:03.471118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bf833473-cf89-4346-bea7-fa587e73ddaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:03.472950 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3820/7661] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:03 2022] DELETE /identity/v3/projects/7fd4ced3ec764d9aadbe04151569ce80 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:03.477808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8803-580a-4aa9-8279-e38c0547bf0d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:03.478734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8803-580a-4aa9-8279-e38c0547bf0d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:03.479158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8803-580a-4aa9-8279-e38c0547bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:03.536774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ead8803-580a-4aa9-8279-e38c0547bf0d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:03.543927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ead8803-580a-4aa9-8279-e38c0547bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:03.705544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2e71-9ea4-4b09-be38-e4e83a4f10de None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:03.706179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3842/7662] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:03.706506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2e71-9ea4-4b09-be38-e4e83a4f10de None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:03.706830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2e71-9ea4-4b09-be38-e4e83a4f10de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:03.778468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1e4d2e71-9ea4-4b09-be38-e4e83a4f10de None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:03.780683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1e4d2e71-9ea4-4b09-be38-e4e83a4f10de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:03.822411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8803-580a-4aa9-8279-e38c0547bf0d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:03.822985 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3821/7663] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:03.833417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8803-580a-4aa9-8279-e38c0547bf0d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:03.839215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:03.839923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:03.840207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:03.840493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:03.841304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:03.841618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:03.843320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:03.870150 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3843/7664] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:03.871426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2e71-9ea4-4b09-be38-e4e83a4f10de None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:03.882276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2e71-9ea4-4b09-be38-e4e83a4f10de None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:03.888673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:03.890488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:03.891129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:03.891568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:03.892531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:03.894848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:03.949084 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3822/7665] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:03 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:03.953908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:03.971415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691969eb-2f08-4163-b4f7-ff107c817120 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:04.017591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:04.064841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:04.065940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:04.066214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:04.066775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:04.067510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:04.071601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:04.119017 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3844/7666] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:03 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:04.122651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:04.135269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea01a86-366c-4bac-93a1-f0d6dfa965ef admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:04.141611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:04.142417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:04.142743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:04.143083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:04.143990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:04.145684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:04.163970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:04.171056 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3823/7667] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:04.181564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf8848-c16a-4cb4-a433-f59fa56692cd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:04.189182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d4db7-4db4-47c3-b021-fdf01543cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:04.190681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4db7-4db4-47c3-b021-fdf01543cde1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:04.191223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4db7-4db4-47c3-b021-fdf01543cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:04.193113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4db7-4db4-47c3-b021-fdf01543cde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:04.198057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d4db7-4db4-47c3-b021-fdf01543cde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:04.206253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d4db7-4db4-47c3-b021-fdf01543cde1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:04.231758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:04.241841 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3845/7668] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:04.257226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f0f04-bf54-407a-abca-f5960a2f31b6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:04.266309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:04.269369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:04.269930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:04.270421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] PATH_INFO: `/v3/projects/b3f543739f504616b82fa637892386a8/users/c769010bd68c4de78e9d491bee7b64fa/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:04.293454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f543739f504616b82fa637892386a8, user_id=c769010bd68c4de78e9d491bee7b64fa, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:04.299764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:04.333072 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3824/7669] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:04 2022] PUT /identity/v3/projects/b3f543739f504616b82fa637892386a8/users/c769010bd68c4de78e9d491bee7b64fa/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:04.337351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be43a-0b83-4166-a5c3-abca930a2686 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:04.338330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be43a-0b83-4166-a5c3-abca930a2686 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:04.338831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05be43a-0b83-4166-a5c3-abca930a2686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:04.424513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c05be43a-0b83-4166-a5c3-abca930a2686 None None] MFA Rules not processed for user `c769010bd68c4de78e9d491bee7b64fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:04.425821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c05be43a-0b83-4166-a5c3-abca930a2686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:04.705407 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3846/7670] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:04.731848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:04.733872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:04.978367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59037908-448f-4ac4-a8d9-776fd3ae0d32 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:04.991840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a134d31-75f6-4ea1-a18b-c0ffdfc847a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:04.992716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a134d31-75f6-4ea1-a18b-c0ffdfc847a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:04.993007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a134d31-75f6-4ea1-a18b-c0ffdfc847a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:04.993306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a134d31-75f6-4ea1-a18b-c0ffdfc847a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:05.016659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a134d31-75f6-4ea1-a18b-c0ffdfc847a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:05.039153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a134d31-75f6-4ea1-a18b-c0ffdfc847a0 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:05.080590 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3825/7671] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:07.606675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be43a-0b83-4166-a5c3-abca930a2686 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:07.699451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05be43a-0b83-4166-a5c3-abca930a2686 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:07.716384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:07.717608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:07.718424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:07.718878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] PATH_INFO: `/v3/users/c769010bd68c4de78e9d491bee7b64fa` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:07.720753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c769010bd68c4de78e9d491bee7b64fa)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:07.723508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:07.865771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:07.882580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c769010bd68c4de78e9d491bee7b64fa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:07.883378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c769010bd68c4de78e9d491bee7b64fa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:07.932674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c769010bd68c4de78e9d491bee7b64fa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:07.937302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c769010bd68c4de78e9d491bee7b64fa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:07.952662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c769010bd68c4de78e9d491bee7b64fa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:07.989172 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3847/7672] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:07 2022] DELETE /identity/v3/users/c769010bd68c4de78e9d491bee7b64fa => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:07.991030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:07.991504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:07.991585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:08.008597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:08.063427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:08.064684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:08.310554 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3826/7673] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:08.353167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:08.362695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:08.732239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998036d0-8bfb-4947-aa8d-c8b07edfdaff admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:08.765854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb156d-e323-43fc-999e-1c83ac183656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:08.766836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb156d-e323-43fc-999e-1c83ac183656 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:08.767305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb156d-e323-43fc-999e-1c83ac183656 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:08.767735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb156d-e323-43fc-999e-1c83ac183656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:08.800234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb156d-e323-43fc-999e-1c83ac183656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:08.802143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb156d-e323-43fc-999e-1c83ac183656 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:08.822284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3848/7674] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:10.286183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:10.287894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:10.333621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721afc6-0c15-42c8-bf40-4c99bf0d2e69 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:10.339092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:10.340265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:10.340725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:10.341181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] PATH_INFO: `/v3/projects/b3f543739f504616b82fa637892386a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:10.342844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f543739f504616b82fa637892386a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:10.355501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:10.508153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f543739f504616b82fa637892386a8', 'request_id': 'req-27d7b468-9a19-4ee9-9adf-95ce59781fdb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:10.538925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f543739f504616b82fa637892386a8', 'request_id': 'req-27d7b468-9a19-4ee9-9adf-95ce59781fdb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:10.565885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f543739f504616b82fa637892386a8', 'request_id': 'req-27d7b468-9a19-4ee9-9adf-95ce59781fdb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:10.596163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] The token cache is being invalidate because project b3f543739f504616b82fa637892386a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:10.598446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:10.600984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-27d7b468-9a19-4ee9-9adf-95ce59781fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:10.614878 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3827/7675] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:10 2022] DELETE /identity/v3/projects/b3f543739f504616b82fa637892386a8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:10.621419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826933b-4040-4f04-83f5-4528700ecfe3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:10.622058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826933b-4040-4f04-83f5-4528700ecfe3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:10.622058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826933b-4040-4f04-83f5-4528700ecfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:10.662548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a826933b-4040-4f04-83f5-4528700ecfe3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:10.669077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a826933b-4040-4f04-83f5-4528700ecfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:10.801579 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3849/7676] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:10.809843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09adbb-55d3-4e02-a924-38bcd93e342f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:10.810132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09adbb-55d3-4e02-a924-38bcd93e342f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:10.810402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09adbb-55d3-4e02-a924-38bcd93e342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:10.861304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9e09adbb-55d3-4e02-a924-38bcd93e342f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:10.862591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9e09adbb-55d3-4e02-a924-38bcd93e342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:10.882758 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3828/7677] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:10.887368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826933b-4040-4f04-83f5-4528700ecfe3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:10.898704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826933b-4040-4f04-83f5-4528700ecfe3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:10.903944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:10.904849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:10.905339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:10.905789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:10.907269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:10.907752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:10.909611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:10.929181 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3850/7678] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:10.934359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09adbb-55d3-4e02-a924-38bcd93e342f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:10.946985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09adbb-55d3-4e02-a924-38bcd93e342f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:10.952635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:10.953533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:10.953961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:10.954407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:10.955936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:10.959463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:11.049552 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3829/7679] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:10 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:11.051731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:11.066774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e9e63-c3d3-4033-bbb4-7ca82843b6e4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:11.153368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:11.167437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:11.168584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:11.169367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:11.171496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:11.172910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:11.175398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:11.213163 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3851/7680] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:11 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:11.217406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:11.238316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27dc9-fb6a-49d7-abf9-87ed5d325f2a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:11.259211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:11.260366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:11.260755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:11.261171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:11.262164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:11.267109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:11.291600 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3830/7681] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:11.295969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:11.309983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e26df8-aebf-4c2b-a5ca-994934ff1c61 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:11.323910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1cbd0-a3fc-46b0-a7bb-0c7cc7962a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:11.323910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cbd0-a3fc-46b0-a7bb-0c7cc7962a2e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:11.323910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cbd0-a3fc-46b0-a7bb-0c7cc7962a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:11.323910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1cbd0-a3fc-46b0-a7bb-0c7cc7962a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:11.326035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1cbd0-a3fc-46b0-a7bb-0c7cc7962a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:11.330245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1cbd0-a3fc-46b0-a7bb-0c7cc7962a2e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:11.360970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3852/7682] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:30:11.366441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:11.380219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ddfc4-600d-4f96-a759-c4c08b54f026 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:11.393337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:11.394430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:11.394959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:11.395339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] PATH_INFO: `/v3/projects/303930b7f1714dca90f279bd8ca8bcc0/users/51e496a1e9c94d1e8d16742ceb0db00c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:11.433115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=303930b7f1714dca90f279bd8ca8bcc0, user_id=51e496a1e9c94d1e8d16742ceb0db00c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:11.436756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:11.461490 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3831/7683] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:11 2022] PUT /identity/v3/projects/303930b7f1714dca90f279bd8ca8bcc0/users/51e496a1e9c94d1e8d16742ceb0db00c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:11.472347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9128f-60be-492c-bda2-1cce026b51be None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:11.473064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9128f-60be-492c-bda2-1cce026b51be None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:11.473441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9128f-60be-492c-bda2-1cce026b51be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:11.517997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-79d9128f-60be-492c-bda2-1cce026b51be None None] MFA Rules not processed for user `51e496a1e9c94d1e8d16742ceb0db00c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:11.519712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-79d9128f-60be-492c-bda2-1cce026b51be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:11.612136 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3853/7684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:11.636456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:11.638271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:11.721721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:11.850305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9ffbe-ce40-44ba-863a-8163e6e612cc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:11.859063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:11.859911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:11.860303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:11.861364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:11.885128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:11.889712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:11.919747 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3832/7685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:13.165948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa27b7-6680-4dc5-86d4-418c009f9cc6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:13.166402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa27b7-6680-4dc5-86d4-418c009f9cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:13.166402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa27b7-6680-4dc5-86d4-418c009f9cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:13.231437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d3aa27b7-6680-4dc5-86d4-418c009f9cc6 None None] MFA Rules not processed for user `406628da7a8140fd83200ffc90e71198`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:13.232669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d3aa27b7-6680-4dc5-86d4-418c009f9cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:13.403711 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3854/7686] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:13.407270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:13.412519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:13.843335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418f088-2336-4bc7-a62d-350260e74657 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:13.855813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:13.859010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:13.860894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:13.862327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:13.863335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:13.872724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:13.957639 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3833/7687] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:13 2022] POST /identity/v3/projects => generated 379 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:13.981560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa27b7-6680-4dc5-86d4-418c009f9cc6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:14.042601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa27b7-6680-4dc5-86d4-418c009f9cc6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:14.170797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:14.222901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:14.225819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:14.226294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:14.227037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:14.228345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:14.231263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:14.309248 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3855/7688] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:13 2022] POST /identity/v3/users => generated 296 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:14.309676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:14.346005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b54a-3da0-4a4a-96a4-eda74ec07b73 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:14.372704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:14.376302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:14.376599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:14.376883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:14.382782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:14.397816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:14.559653 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3834/7689] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:30:14.561772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:14.620881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f0e0b-cfc2-4260-987a-fbe2ef5bd715 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:14.652403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:14.658294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:14.660999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:14.664929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] PATH_INFO: `/v3/projects/207a41c91fb6453b9eed9e5780111f76/users/0a7a7d74c1784ff99dbfb3b4abe152b2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:14.805549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207a41c91fb6453b9eed9e5780111f76, user_id=0a7a7d74c1784ff99dbfb3b4abe152b2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:14.821896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:14.875369 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3856/7690] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:14 2022] PUT /identity/v3/projects/207a41c91fb6453b9eed9e5780111f76/users/0a7a7d74c1784ff99dbfb3b4abe152b2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:14.879620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:14.929014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc345c-475e-4d1d-85be-3301fbfc0695 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:15.109417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:15.110130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:15.110412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:15.110719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:15.111648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:15.113315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:15.131694 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3835/7691] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:15.133024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:15.151708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5a98e-94a3-45d8-b119-664cd4773b83 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:15.159024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e397-6a60-4f1e-9b13-887aa1412902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:15.159954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e397-6a60-4f1e-9b13-887aa1412902 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:15.160381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e397-6a60-4f1e-9b13-887aa1412902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:15.160537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e397-6a60-4f1e-9b13-887aa1412902 admin admin] PATH_INFO: `/v3/projects/207a41c91fb6453b9eed9e5780111f76/users/0a7a7d74c1784ff99dbfb3b4abe152b2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:15.167455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959e397-6a60-4f1e-9b13-887aa1412902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207a41c91fb6453b9eed9e5780111f76, user_id=0a7a7d74c1784ff99dbfb3b4abe152b2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:15.172048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959e397-6a60-4f1e-9b13-887aa1412902 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:15.203212 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3857/7692] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:15 2022] PUT /identity/v3/projects/207a41c91fb6453b9eed9e5780111f76/users/0a7a7d74c1784ff99dbfb3b4abe152b2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:17.062488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:17.064305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:17.087039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f8397-519f-49ff-b795-5cfa58461edf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:17.139236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:17.194296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:17.195686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:17.197078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:17.197078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] PATH_INFO: `/v3/users/8df56507fb7e4c6eb012fbea8bb5a660` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:17.198850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df56507fb7e4c6eb012fbea8bb5a660)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:17.201605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:17.309886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df56507fb7e4c6eb012fbea8bb5a660'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:17.311466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df56507fb7e4c6eb012fbea8bb5a660'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:17.336701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df56507fb7e4c6eb012fbea8bb5a660'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:17.337868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df56507fb7e4c6eb012fbea8bb5a660'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:17.352677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df56507fb7e4c6eb012fbea8bb5a660'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:17.383126 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3836/7693] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:17 2022] DELETE /identity/v3/users/8df56507fb7e4c6eb012fbea8bb5a660 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:17.388170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:17.389091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:17.390840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:17.439092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:17.441024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:17.556523 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3858/7694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:17.580549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:17.584274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:17.720972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddf53a-9d56-4e71-bb87-2feb7d0ad586 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:17.728706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf426a-3cdd-462b-838d-1eaa77fbc231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:17.729800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf426a-3cdd-462b-838d-1eaa77fbc231 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:17.730156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf426a-3cdd-462b-838d-1eaa77fbc231 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:17.730585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf426a-3cdd-462b-838d-1eaa77fbc231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:17.745217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf426a-3cdd-462b-838d-1eaa77fbc231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:17.746940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf426a-3cdd-462b-838d-1eaa77fbc231 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:17.759455 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3837/7695] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:30:18.297116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:18.298780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:18.315527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e90d4-a754-4444-a73a-a0a9e1f34ec9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:18.331104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:18.332827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:18.333682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:18.334261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] PATH_INFO: `/v3/projects/0ec1edee2a79449ba938310fa3810695` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:18.337376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec1edee2a79449ba938310fa3810695)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:18.346210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:18.495400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec1edee2a79449ba938310fa3810695', 'request_id': 'req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:18.519913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec1edee2a79449ba938310fa3810695', 'request_id': 'req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:18.546324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec1edee2a79449ba938310fa3810695', 'request_id': 'req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:18.571264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] The token cache is being invalidate because project 0ec1edee2a79449ba938310fa3810695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:18.571551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:18.574553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6b8aebef-a54f-4ff7-9e98-7e49ca25b25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:18.588832 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3859/7696] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:18 2022] DELETE /identity/v3/projects/0ec1edee2a79449ba938310fa3810695 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:18.594092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0a46-9238-4f1e-bc6c-fd0a3e029a82 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:18.594618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0a46-9238-4f1e-bc6c-fd0a3e029a82 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:18.594618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0a46-9238-4f1e-bc6c-fd0a3e029a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:18.635125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-65ac0a46-9238-4f1e-bc6c-fd0a3e029a82 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:18.639444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65ac0a46-9238-4f1e-bc6c-fd0a3e029a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:18.794554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:18.846021 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3838/7697] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:18.955393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434743b-7765-4251-b473-e1d8ec7fb46c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:18.956014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434743b-7765-4251-b473-e1d8ec7fb46c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:18.956545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434743b-7765-4251-b473-e1d8ec7fb46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:18.998380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7434743b-7765-4251-b473-e1d8ec7fb46c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:19.000573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7434743b-7765-4251-b473-e1d8ec7fb46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:19.025071 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3860/7698] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:19.029564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0a46-9238-4f1e-bc6c-fd0a3e029a82 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:19.054103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0a46-9238-4f1e-bc6c-fd0a3e029a82 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:19.068490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:19.069470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:19.069845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:19.070214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:19.071389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:19.077308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:19.079227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:19.109024 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3839/7699] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:19.113485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434743b-7765-4251-b473-e1d8ec7fb46c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:19.127765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434743b-7765-4251-b473-e1d8ec7fb46c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:19.142590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:19.143516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:19.144074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:19.144572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:19.145494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:19.147697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:19.200630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:19.211936 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3861/7700] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:19 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:19.214899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:19.254784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04b8e3-0ee0-48e5-8a6c-0d3d50c8bdbf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:19.399870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:19.401398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:19.401398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:19.401398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:19.402185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:19.404221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:19.463861 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3840/7701] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:19 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:19.468982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:19.500456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63da1-bc2d-49f5-8e79-5294a742083b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:19.508566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:19.513779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:19.514077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:19.514361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:19.515157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:19.521211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:19.549317 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3862/7702] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:19.549729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:19.584099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341258d8-cdac-4792-b349-ae1ebf1c6146 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:19.598106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168913b-c6da-4e5c-94ca-701dd2cd2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:19.598802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168913b-c6da-4e5c-94ca-701dd2cd2fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:19.599645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168913b-c6da-4e5c-94ca-701dd2cd2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:19.599645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168913b-c6da-4e5c-94ca-701dd2cd2fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:19.600130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168913b-c6da-4e5c-94ca-701dd2cd2fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:19.601806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168913b-c6da-4e5c-94ca-701dd2cd2fd7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:19.628467 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3841/7703] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:30:19.633952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:19.677932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84a9a2-0a7b-4224-85df-6bbbdd5add56 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:19.694844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:19.706841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:19.708961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:19.709623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] PATH_INFO: `/v3/projects/d5e959db1a264037960eb2a3d7ef1582/users/28f81713c9b0454eb5dd6d3784a73925/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:19.753129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e959db1a264037960eb2a3d7ef1582, user_id=28f81713c9b0454eb5dd6d3784a73925, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:19.760735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:19.806511 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3863/7704] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:19 2022] PUT /identity/v3/projects/d5e959db1a264037960eb2a3d7ef1582/users/28f81713c9b0454eb5dd6d3784a73925/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:19.817342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862c6c-8fe4-446a-8884-9043c5ef050e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:19.817628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862c6c-8fe4-446a-8884-9043c5ef050e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:19.818046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862c6c-8fe4-446a-8884-9043c5ef050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:19.875353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fb862c6c-8fe4-446a-8884-9043c5ef050e None None] MFA Rules not processed for user `28f81713c9b0454eb5dd6d3784a73925`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:19.878778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fb862c6c-8fe4-446a-8884-9043c5ef050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:20.069566 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3842/7705] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:20.077434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:20.101876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:20.229573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86edd-ed2c-4d9e-bc3c-6b6995624952 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:20.231160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86edd-ed2c-4d9e-bc3c-6b6995624952 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:20.231434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86edd-ed2c-4d9e-bc3c-6b6995624952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:20.288348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8aa86edd-ed2c-4d9e-bc3c-6b6995624952 None None] MFA Rules not processed for user `3f6133e6ab7745118bc629dd126189e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:20.290862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8aa86edd-ed2c-4d9e-bc3c-6b6995624952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:20.328491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a49b3-df6d-4a52-af3c-f158a6ec99e2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:20.345881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:20.346605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:20.346888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:20.347162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:20.378118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:20.380117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:20.418737 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3864/7706] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:20.500914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:20.549226 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3843/7707] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:30.394773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:30.542678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:32.150222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:32.153654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:32.395386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108681d-df05-4083-90cd-f0eef6a1f4c2 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:32.401858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:32.403737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:32.404365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:32.405806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] PATH_INFO: `/v3/users/51e496a1e9c94d1e8d16742ceb0db00c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:32.407453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e496a1e9c94d1e8d16742ceb0db00c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:32.409745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:32.527281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e496a1e9c94d1e8d16742ceb0db00c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:32.528494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e496a1e9c94d1e8d16742ceb0db00c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:32.554221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e496a1e9c94d1e8d16742ceb0db00c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:32.556116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e496a1e9c94d1e8d16742ceb0db00c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:32.580161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e496a1e9c94d1e8d16742ceb0db00c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:32.615269 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3865/7708] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:32 2022] DELETE /identity/v3/users/51e496a1e9c94d1e8d16742ceb0db00c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:32.617585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:32.618401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:32.618730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:32.664694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:32.667363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:32.885236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3844/7709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:32.960682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:32.964454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:33.186058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af95ff-1c2d-442a-930b-d92cfe3ea1d9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:33.198876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a88f5-8c61-41ec-972b-20bf805e8451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:33.200068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a88f5-8c61-41ec-972b-20bf805e8451 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:33.200464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a88f5-8c61-41ec-972b-20bf805e8451 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:33.207179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a88f5-8c61-41ec-972b-20bf805e8451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:33.233008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a88f5-8c61-41ec-972b-20bf805e8451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:33.237809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a88f5-8c61-41ec-972b-20bf805e8451 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:33.275718 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3866/7710] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:34.434397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:34.439073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:34.481576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3448bd-f82d-473a-982e-34b6a0838ca4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:34.500563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:34.502208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:34.502491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:34.506840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] PATH_INFO: `/v3/projects/303930b7f1714dca90f279bd8ca8bcc0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:34.513882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=303930b7f1714dca90f279bd8ca8bcc0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:34.515926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:34.790988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '303930b7f1714dca90f279bd8ca8bcc0', 'request_id': 'req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:34.815924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '303930b7f1714dca90f279bd8ca8bcc0', 'request_id': 'req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:34.838816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '303930b7f1714dca90f279bd8ca8bcc0', 'request_id': 'req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:34.874509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] The token cache is being invalidate because project 303930b7f1714dca90f279bd8ca8bcc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:34.881290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:34.882930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e7db84c6-7cb9-4c52-af9e-18851f1c9fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:34.897807 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3845/7711] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:34 2022] DELETE /identity/v3/projects/303930b7f1714dca90f279bd8ca8bcc0 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:34.903224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e665-42b9-4445-8e02-3bf9f2414b3f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:34.905197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e665-42b9-4445-8e02-3bf9f2414b3f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:34.906919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e665-42b9-4445-8e02-3bf9f2414b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:34.949864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:34.949864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:34.950287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:35.022278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-32b5e665-42b9-4445-8e02-3bf9f2414b3f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:35.042325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32b5e665-42b9-4445-8e02-3bf9f2414b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:35.122038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] MFA Rules not processed for user `0a7a7d74c1784ff99dbfb3b4abe152b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:35.123265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:35.141445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:35.351730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3867/7712] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:35.365601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763b330-13d0-479b-b44c-7f31cd17720d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:35.366279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763b330-13d0-479b-b44c-7f31cd17720d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:35.366589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763b330-13d0-479b-b44c-7f31cd17720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:35.413451 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3846/7713] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:35.424376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:35.427582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:35.452133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6763b330-13d0-479b-b44c-7f31cd17720d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:35.463514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6763b330-13d0-479b-b44c-7f31cd17720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:35.487052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:35.503749 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3868/7714] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:35.509496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763b330-13d0-479b-b44c-7f31cd17720d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:35.535324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763b330-13d0-479b-b44c-7f31cd17720d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:35.563944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:35.564688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:35.565023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:35.565257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:35.566137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:35.566455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:35.577439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:35.622058 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3869/7715] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:35.627280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:35.660501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd20cb-d2c3-4df8-8509-076b725c5b7b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:35.678556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eee9e-1e84-4cc5-9750-4bc090335569 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:35.703397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:35.704358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:35.707081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:35.707444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:35.718033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:35.720406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:35.721888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:35.723314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:35.723314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:35.723650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:35.732105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:35.924774 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3870/7716] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:35 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:35.926700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:35.988219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:35.989787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:36.096285 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3847/7717] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:36.238751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213954-f01f-489a-b237-24df5a063731 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:36.266434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:36.267158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:36.267454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:36.267714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:36.268783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:36.273301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:36.357065 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3871/7718] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:35 2022] POST /identity/v3/users => generated 287 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:36.361582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:36.395655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeeb30-eae0-40f8-95a1-2372364d9430 service glance] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:36.410291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:36.411492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:36.411942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:36.412270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:36.413552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:36.418561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:36.437348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:36.438726 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3848/7719] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:36.458338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252ceae-f125-4d32-9641-e2e5f9be6f83 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:36.464496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449238f2-a670-4ed7-a9d4-11355e8713ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:36.465748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449238f2-a670-4ed7-a9d4-11355e8713ff admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:36.466032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449238f2-a670-4ed7-a9d4-11355e8713ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:36.466312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449238f2-a670-4ed7-a9d4-11355e8713ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:36.467070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449238f2-a670-4ed7-a9d4-11355e8713ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:36.469941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449238f2-a670-4ed7-a9d4-11355e8713ff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:36.485970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3872/7720] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:30:36.491289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:36.507078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b770-d85c-4328-9a7c-9ad4c4ef4a8a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:36.529604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:36.530532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:36.531026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:36.533239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] PATH_INFO: `/v3/projects/970aa1119d3d49808e7bfd0c7f750bc4/users/79abdc1adf9245d08bd622f988a6a792/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:36.604055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=970aa1119d3d49808e7bfd0c7f750bc4, user_id=79abdc1adf9245d08bd622f988a6a792, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:36.617741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:36.700259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51278-68fa-4c75-a8fd-f9d80d761d36 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:36.700999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51278-68fa-4c75-a8fd-f9d80d761d36 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:36.703468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51278-68fa-4c75-a8fd-f9d80d761d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:36.710827 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3849/7721] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:36 2022] PUT /identity/v3/projects/970aa1119d3d49808e7bfd0c7f750bc4/users/79abdc1adf9245d08bd622f988a6a792/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:30:36.858078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2fd51278-68fa-4c75-a8fd-f9d80d761d36 None None] MFA Rules not processed for user `79abdc1adf9245d08bd622f988a6a792`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:36.859802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2fd51278-68fa-4c75-a8fd-f9d80d761d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:37.017751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:37.085224 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3873/7722] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:37.090356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:37.479983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56accb44-c4a0-492e-9e5a-574e7ea71aed admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:37.486563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:37.497055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:37.499150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:37.500346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:37.501739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:37.505121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:37.578202 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3850/7723] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:37 2022] POST /identity/v3/projects => generated 371 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:30:37.581782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd51278-68fa-4c75-a8fd-f9d80d761d36 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:37.608282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd51278-68fa-4c75-a8fd-f9d80d761d36 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:37.859761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:37.861297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:37.861793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:37.862331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:37.863324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:37.868495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:37.924911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3874/7724] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:37 2022] POST /identity/v3/users => generated 292 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:37.929571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:37.970228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7534c86-af45-48c6-8c44-2bc80b7779e2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:37.984582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:37.986224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:37.989294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:37.989810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:37.990746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:37.998727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:38.035298 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3851/7725] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:30:38.037493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:38.056241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453700b4-5727-46a9-b9ca-f7e489faee96 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:38.073934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:38.075631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:38.075869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:38.076152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] PATH_INFO: `/v3/projects/31cd30814b434f3eab06f2271532d759/users/45cf7e77f7d7477bb710a45121151af1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:38.134905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cd30814b434f3eab06f2271532d759, user_id=45cf7e77f7d7477bb710a45121151af1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:38.137896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:38.194831 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3875/7726] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:38 2022] PUT /identity/v3/projects/31cd30814b434f3eab06f2271532d759/users/45cf7e77f7d7477bb710a45121151af1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:38.198034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:38.204580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:38.214453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d4e10-1d2f-4795-8f62-2d44d49e415d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:38.374366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38320c-9f0f-4309-82c7-ddecc0788452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:38.374366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38320c-9f0f-4309-82c7-ddecc0788452 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:38.374366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38320c-9f0f-4309-82c7-ddecc0788452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:38.376491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38320c-9f0f-4309-82c7-ddecc0788452 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:38.377378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38320c-9f0f-4309-82c7-ddecc0788452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:38.379083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38320c-9f0f-4309-82c7-ddecc0788452 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:38.409514 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3852/7727] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:38.412049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:38.425128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c985e-26d8-46fa-aaaf-291f1b9b80ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:38.439325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:38.440258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:38.440536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:38.441476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] PATH_INFO: `/v3/projects/31cd30814b434f3eab06f2271532d759/users/45cf7e77f7d7477bb710a45121151af1/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:38.445594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cd30814b434f3eab06f2271532d759, user_id=45cf7e77f7d7477bb710a45121151af1, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:38.449545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:38.472660 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3876/7728] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:38 2022] PUT /identity/v3/projects/31cd30814b434f3eab06f2271532d759/users/45cf7e77f7d7477bb710a45121151af1/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:38.483589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830293b-3b8e-4cf6-b5a2-c6ff77b9e754 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:38.484878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830293b-3b8e-4cf6-b5a2-c6ff77b9e754 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:38.485262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830293b-3b8e-4cf6-b5a2-c6ff77b9e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:38.570463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6830293b-3b8e-4cf6-b5a2-c6ff77b9e754 None None] MFA Rules not processed for user `45cf7e77f7d7477bb710a45121151af1`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:38.582241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6830293b-3b8e-4cf6-b5a2-c6ff77b9e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:38.840114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3853/7729] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:38.860000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:38.874187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:39.107041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6cbd-57d5-4be3-982c-0b1216b8bfd1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:39.129226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ae6c-5bc5-477a-b03b-b83a3f43c55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:39.133626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ae6c-5bc5-477a-b03b-b83a3f43c55a service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:39.134141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ae6c-5bc5-477a-b03b-b83a3f43c55a service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:39.136932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ae6c-5bc5-477a-b03b-b83a3f43c55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:39.176910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ae6c-5bc5-477a-b03b-b83a3f43c55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:39.180548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ae6c-5bc5-477a-b03b-b83a3f43c55a service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:39.224922 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3877/7730] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:30:40.281394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830293b-3b8e-4cf6-b5a2-c6ff77b9e754 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:40.483243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830293b-3b8e-4cf6-b5a2-c6ff77b9e754 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:40.505322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:40.506779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:40.507595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:40.508284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] PATH_INFO: `/v3/users/79abdc1adf9245d08bd622f988a6a792` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:40.509959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=79abdc1adf9245d08bd622f988a6a792)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:40.512989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:40.599333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:40.652652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79abdc1adf9245d08bd622f988a6a792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:40.654140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79abdc1adf9245d08bd622f988a6a792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:40.739324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79abdc1adf9245d08bd622f988a6a792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:40.742516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79abdc1adf9245d08bd622f988a6a792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:40.805675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79abdc1adf9245d08bd622f988a6a792'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:40.899302 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3854/7731] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:40 2022] DELETE /identity/v3/users/79abdc1adf9245d08bd622f988a6a792 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:40.904836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ad212-c653-41aa-89da-39304a300781 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:40.905356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ad212-c653-41aa-89da-39304a300781 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:40.905478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ad212-c653-41aa-89da-39304a300781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:40.942666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-010ad212-c653-41aa-89da-39304a300781 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:40.944230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-010ad212-c653-41aa-89da-39304a300781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:41.084137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:41.128549 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3878/7732] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:41.581943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:41.588777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:41.975415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02452303-da52-4bc9-bdac-3e6e3161bcdb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:41.990543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788fa88-d6d1-483b-bad8-7f999539cc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:41.991503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788fa88-d6d1-483b-bad8-7f999539cc10 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:41.995789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788fa88-d6d1-483b-bad8-7f999539cc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:41.996251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788fa88-d6d1-483b-bad8-7f999539cc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:42.033447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788fa88-d6d1-483b-bad8-7f999539cc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:42.037922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788fa88-d6d1-483b-bad8-7f999539cc10 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:42.078326 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3855/7733] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:43.968785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ad212-c653-41aa-89da-39304a300781 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:43.971068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-010ad212-c653-41aa-89da-39304a300781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:43.994472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512bca5-d155-4529-a74f-b7572d2e6e01 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:43.995353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512bca5-d155-4529-a74f-b7572d2e6e01 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:43.995805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512bca5-d155-4529-a74f-b7572d2e6e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:44.002533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ad212-c653-41aa-89da-39304a300781 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:44.018709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:44.019935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:44.020599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:44.021121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] PATH_INFO: `/v3/projects/970aa1119d3d49808e7bfd0c7f750bc4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:44.029701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=970aa1119d3d49808e7bfd0c7f750bc4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:44.036935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:44.050913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1512bca5-d155-4529-a74f-b7572d2e6e01 None None] MFA Rules not processed for user `406628da7a8140fd83200ffc90e71198`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:44.058223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1512bca5-d155-4529-a74f-b7572d2e6e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:44.207625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970aa1119d3d49808e7bfd0c7f750bc4', 'request_id': 'req-ef461edd-123e-4fd8-b23b-d7852d351957'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.224365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970aa1119d3d49808e7bfd0c7f750bc4', 'request_id': 'req-ef461edd-123e-4fd8-b23b-d7852d351957'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.241608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970aa1119d3d49808e7bfd0c7f750bc4', 'request_id': 'req-ef461edd-123e-4fd8-b23b-d7852d351957'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.264901 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3856/7734] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:44.266720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] The token cache is being invalidate because project 970aa1119d3d49808e7bfd0c7f750bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:44.266922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.267628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.275819 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3879/7735] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:43 2022] DELETE /identity/v3/projects/970aa1119d3d49808e7bfd0c7f750bc4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:44.277392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512bca5-d155-4529-a74f-b7572d2e6e01 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:44.291876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512bca5-d155-4529-a74f-b7572d2e6e01 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:44.381305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:44.427946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:44.428917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:44.429519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:44.430211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] PATH_INFO: `/v3/users/45cf7e77f7d7477bb710a45121151af1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:44.431887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cf7e77f7d7477bb710a45121151af1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:44.434458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:44.506265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cf7e77f7d7477bb710a45121151af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.507248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cf7e77f7d7477bb710a45121151af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.523105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cf7e77f7d7477bb710a45121151af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.523846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cf7e77f7d7477bb710a45121151af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.533691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cf7e77f7d7477bb710a45121151af1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:44.555094 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3857/7736] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:44 2022] DELETE /identity/v3/users/45cf7e77f7d7477bb710a45121151af1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:44.954237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:44.956062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:45.066921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461edd-123e-4fd8-b23b-d7852d351957 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:45.142380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf2ffb-e446-4b07-ae50-123c2e6960f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:45.143421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2ffb-e446-4b07-ae50-123c2e6960f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:45.144043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2ffb-e446-4b07-ae50-123c2e6960f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:45.144675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2ffb-e446-4b07-ae50-123c2e6960f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:45.147131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ebaf2ffb-e446-4b07-ae50-123c2e6960f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:45.163928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf2ffb-e446-4b07-ae50-123c2e6960f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:45.166472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf2ffb-e446-4b07-ae50-123c2e6960f2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:45.182013 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3880/7737] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:30:45.510222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:45.512672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:45.698031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00349f08-fc36-48b5-97ad-ed814e5b8d9a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:45.714794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:45.717281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:45.717824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:45.718280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] PATH_INFO: `/v3/projects/31cd30814b434f3eab06f2271532d759` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:45.720022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cd30814b434f3eab06f2271532d759)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:45.725302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:45.841394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cd30814b434f3eab06f2271532d759', 'request_id': 'req-582f892d-8429-4a59-b282-e77c6730ed64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:45.851491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cd30814b434f3eab06f2271532d759', 'request_id': 'req-582f892d-8429-4a59-b282-e77c6730ed64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:45.870076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cd30814b434f3eab06f2271532d759', 'request_id': 'req-582f892d-8429-4a59-b282-e77c6730ed64'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:45.883001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:45.888210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] The token cache is being invalidate because project 31cd30814b434f3eab06f2271532d759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:45.888588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:45.894559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-582f892d-8429-4a59-b282-e77c6730ed64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:45.901833 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3858/7738] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:45 2022] DELETE /identity/v3/projects/31cd30814b434f3eab06f2271532d759 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:45.904473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09883-d946-45f6-9a88-fd0385b96b71 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:45.904969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09883-d946-45f6-9a88-fd0385b96b71 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:45.905431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09883-d946-45f6-9a88-fd0385b96b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:45.926037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2af09883-d946-45f6-9a88-fd0385b96b71 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:45.927580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2af09883-d946-45f6-9a88-fd0385b96b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:45.956357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:46.049643 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3881/7739] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:46.140212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2004b2-9cdc-4ad9-9161-a496d7ba2dad None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:46.140503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2004b2-9cdc-4ad9-9161-a496d7ba2dad None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:46.140940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2004b2-9cdc-4ad9-9161-a496d7ba2dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:46.214191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fb2004b2-9cdc-4ad9-9161-a496d7ba2dad None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:46.215468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fb2004b2-9cdc-4ad9-9161-a496d7ba2dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:46.238387 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3859/7740] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:46.243489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09883-d946-45f6-9a88-fd0385b96b71 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:46.264367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09883-d946-45f6-9a88-fd0385b96b71 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:46.279701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:46.280890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:46.280890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:46.281106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:46.281994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:46.282647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:46.284010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:46.338198 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3882/7741] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:46.342841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2004b2-9cdc-4ad9-9161-a496d7ba2dad None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:46.381170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2004b2-9cdc-4ad9-9161-a496d7ba2dad None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:46.391998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:46.392931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:46.393267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:46.393545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:46.394369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:46.396997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:46.511550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3860/7742] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:46 2022] POST /identity/v3/projects => generated 389 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:46.516000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:46.537221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23477ac-2b94-46b2-87c8-4658e7ac0163 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:46.796987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:46.798708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:46.799800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:46.800798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:46.803146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:46.807683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:46.851904 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3883/7743] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:46 2022] POST /identity/v3/users => generated 295 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:30:46.854407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:46.877060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401949bc-bcdd-46b3-843c-b688f5501b03 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:46.896870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:46.900208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:46.900645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:46.901070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:46.902028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:46.921448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:46.947909 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3861/7744] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:46.950150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:46.971790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122fc48-831b-4c5e-950b-8d4d2d557e82 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:46.983048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110e81a-32dd-450d-a658-4aa8156d3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:46.983774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e81a-32dd-450d-a658-4aa8156d3f1e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:46.985724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e81a-32dd-450d-a658-4aa8156d3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:46.987201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110e81a-32dd-450d-a658-4aa8156d3f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:46.988199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e81a-32dd-450d-a658-4aa8156d3f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:46.997158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110e81a-32dd-450d-a658-4aa8156d3f1e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:47.024263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3884/7745] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:47.028559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:47.039650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd25e3b-504b-4609-880d-947692557d90 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:47.046528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:47.048750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:47.049255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:47.049719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] PATH_INFO: `/v3/projects/a69de3a82bd441149004b062658a4f7b/users/6cc37c85fa754da396bb93e36eb0b2e9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:47.075951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69de3a82bd441149004b062658a4f7b, user_id=6cc37c85fa754da396bb93e36eb0b2e9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:47.078988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:47.115728 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3862/7746] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:47 2022] PUT /identity/v3/projects/a69de3a82bd441149004b062658a4f7b/users/6cc37c85fa754da396bb93e36eb0b2e9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:30:47.116946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c1f7-e8c9-49f2-a246-5d4053a474cc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:47.117319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c1f7-e8c9-49f2-a246-5d4053a474cc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:47.117673 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c1f7-e8c9-49f2-a246-5d4053a474cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:47.169873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3595c1f7-e8c9-49f2-a246-5d4053a474cc None None] MFA Rules not processed for user `6cc37c85fa754da396bb93e36eb0b2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:47.171100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3595c1f7-e8c9-49f2-a246-5d4053a474cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:47.332919 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3885/7747] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:47.334531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:47.449128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f10815-d74e-4a1d-a46e-b031b0828190 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:47.473382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:47.474199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:47.474556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:47.474926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:47.475752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:47.478136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:47.541713 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3863/7748] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:47 2022] POST /identity/v3/projects => generated 389 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:47.543147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c1f7-e8c9-49f2-a246-5d4053a474cc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:47.566755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c1f7-e8c9-49f2-a246-5d4053a474cc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:47.640055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:47.785910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:47.786880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:47.789696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:47.791212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:47.791990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:47.794727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:47.844835 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3886/7749] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:47 2022] POST /identity/v3/users => generated 301 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:47.846593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:47.872855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6082d8-c935-472f-b871-665d36a2693c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:47.886467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:47.887667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:47.891292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:47.891852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:47.892839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:47.897335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:47.929087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3864/7750] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:47.931732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:47.957258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a345-e201-4829-a13a-5899414c3b1b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:47.971505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:47.972447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:47.972942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:47.975632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] PATH_INFO: `/v3/projects/dbcb36ff603f437bafacc7f2c035a9a0/users/b68523366c134386b65c4628b3b4ce20/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:48.010011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcb36ff603f437bafacc7f2c035a9a0, user_id=b68523366c134386b65c4628b3b4ce20, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:48.012778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:48.046635 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3887/7751] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:47 2022] PUT /identity/v3/projects/dbcb36ff603f437bafacc7f2c035a9a0/users/b68523366c134386b65c4628b3b4ce20/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:48.048194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:48.081817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65fa3-43ad-4fdf-8016-5c189085eac9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:48.246560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e764a7-14b3-468d-aa76-b661c2ca769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:48.247618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e764a7-14b3-468d-aa76-b661c2ca769c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:48.248086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e764a7-14b3-468d-aa76-b661c2ca769c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:48.248696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e764a7-14b3-468d-aa76-b661c2ca769c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:48.249814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e764a7-14b3-468d-aa76-b661c2ca769c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:48.252590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e764a7-14b3-468d-aa76-b661c2ca769c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:48.278757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:48.285324 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3865/7752] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:48.294208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8893e0-e9df-40aa-a3e7-35e209dc1935 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:48.302757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:48.304472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:48.304984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:48.305540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] PATH_INFO: `/v3/projects/dbcb36ff603f437bafacc7f2c035a9a0/users/b68523366c134386b65c4628b3b4ce20/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:48.308051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcb36ff603f437bafacc7f2c035a9a0, user_id=b68523366c134386b65c4628b3b4ce20, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:48.311787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:48.346294 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3888/7753] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:48 2022] PUT /identity/v3/projects/dbcb36ff603f437bafacc7f2c035a9a0/users/b68523366c134386b65c4628b3b4ce20/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:48.357608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ad01-aeb4-4fbc-a2ca-dfe9c7068198 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:48.357901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ad01-aeb4-4fbc-a2ca-dfe9c7068198 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:48.358181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410ad01-aeb4-4fbc-a2ca-dfe9c7068198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:48.389380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:48.440979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f410ad01-aeb4-4fbc-a2ca-dfe9c7068198 None None] MFA Rules not processed for user `b68523366c134386b65c4628b3b4ce20`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:48.443249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f410ad01-aeb4-4fbc-a2ca-dfe9c7068198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:48.668613 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3866/7754] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:48.680274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:48.682058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:48.825540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91cf6d-e1d0-4e2c-bc6b-a992c96e6d44 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:48.833391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dafbaf-7420-48ce-bd3b-31557f77efa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:48.835835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dafbaf-7420-48ce-bd3b-31557f77efa5 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:48.836200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dafbaf-7420-48ce-bd3b-31557f77efa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:48.836465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dafbaf-7420-48ce-bd3b-31557f77efa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:48.862465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dafbaf-7420-48ce-bd3b-31557f77efa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:48.864317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dafbaf-7420-48ce-bd3b-31557f77efa5 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:48.884770 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3889/7755] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:49.114889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ad01-aeb4-4fbc-a2ca-dfe9c7068198 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:49.260256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410ad01-aeb4-4fbc-a2ca-dfe9c7068198 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:49.277288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:49.279326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:49.280587 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:49.281549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] PATH_INFO: `/v3/users/6cc37c85fa754da396bb93e36eb0b2e9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:49.284798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc37c85fa754da396bb93e36eb0b2e9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:49.290304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:49.420862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc37c85fa754da396bb93e36eb0b2e9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:49.422050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc37c85fa754da396bb93e36eb0b2e9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:49.478368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc37c85fa754da396bb93e36eb0b2e9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:49.479533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc37c85fa754da396bb93e36eb0b2e9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:49.494001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc37c85fa754da396bb93e36eb0b2e9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:49.530564 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3867/7756] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:49 2022] DELETE /identity/v3/users/6cc37c85fa754da396bb93e36eb0b2e9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:49.535241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:49.535727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:49.535849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:49.570243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:49.571472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:49.744944 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3890/7757] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:49.842888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:49.844799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:49.873024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:49.977184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834588c8-f405-4c78-b067-5e4f9fe8546f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:49.982641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:49.983720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:49.984151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:49.984936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:49.999692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:50.001935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:50.018376 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3868/7758] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:30:50.500483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:50.502904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:50.518490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78838c-071e-4a8b-968f-c222940fa6c5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:50.524986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:50.526946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:50.527376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:50.527509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] PATH_INFO: `/v3/users/28f81713c9b0454eb5dd6d3784a73925` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:50.529686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f81713c9b0454eb5dd6d3784a73925)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:50.533879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:50.546729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:50.548925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:50.549928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:50.620307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f81713c9b0454eb5dd6d3784a73925'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:50.621779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f81713c9b0454eb5dd6d3784a73925'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:50.642512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f81713c9b0454eb5dd6d3784a73925'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:50.643791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f81713c9b0454eb5dd6d3784a73925'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:50.655623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7b420-1f08-46a0-baf3-84ee6f811b88 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:50.658189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2ca52c2a-849c-4d2c-8eb3-81047663eda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f81713c9b0454eb5dd6d3784a73925'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:50.664945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:50.666837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:50.667228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:50.667646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:50.670227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:50.679585 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3891/7759] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:50 2022] DELETE /identity/v3/users/28f81713c9b0454eb5dd6d3784a73925 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:50.685273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:50.685783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:50.688912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:50.692630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:50.694448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:50.715994 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3869/7760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:50.720458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:50.721982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:50.858468 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3892/7761] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:50.950771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:50.952521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:50.983391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f80ee-78a3-43a5-8c67-9426914f791f service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:51.118807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:51.122567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:51.122931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:51.123276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:51.155586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:51.157863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:51.172523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3870/7762] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:53.016757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:53.018151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:53.074979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b3564-b050-4a4f-a48b-3a875c3f657c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:53.089077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:53.090255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:53.094285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:53.094849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] PATH_INFO: `/v3/projects/a69de3a82bd441149004b062658a4f7b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:53.096489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69de3a82bd441149004b062658a4f7b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:53.100495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:53.252806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69de3a82bd441149004b062658a4f7b', 'request_id': 'req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.261650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69de3a82bd441149004b062658a4f7b', 'request_id': 'req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.278189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69de3a82bd441149004b062658a4f7b', 'request_id': 'req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.307838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] The token cache is being invalidate because project a69de3a82bd441149004b062658a4f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:53.308378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.309273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.311987 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3893/7763] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:53 2022] DELETE /identity/v3/projects/a69de3a82bd441149004b062658a4f7b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:53.315922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:53.327480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620cef5-6790-4f65-a9f6-eedd7cd4d795 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:53.423842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:53.445634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:53.446712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:53.447101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:53.448022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] PATH_INFO: `/v3/users/b68523366c134386b65c4628b3b4ce20` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:53.448853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68523366c134386b65c4628b3b4ce20)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:53.450968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:53.535564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68523366c134386b65c4628b3b4ce20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.538346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68523366c134386b65c4628b3b4ce20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.575352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68523366c134386b65c4628b3b4ce20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.576779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68523366c134386b65c4628b3b4ce20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.589867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0260f075-4dd8-471b-86a1-8bb31d85adcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68523366c134386b65c4628b3b4ce20'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:53.623952 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3871/7764] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:53 2022] DELETE /identity/v3/users/b68523366c134386b65c4628b3b4ce20 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:53.788087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:53.790717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:53.813300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572a5e1-5f2a-45c7-a1dc-9ac7e287c491 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:53.839108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:53.986758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:53.989984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:53.991417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:53.992572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] PATH_INFO: `/v3/projects/d5e959db1a264037960eb2a3d7ef1582` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:53.996664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e959db1a264037960eb2a3d7ef1582)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:53.998873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:54.128704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e959db1a264037960eb2a3d7ef1582', 'request_id': 'req-a128fe6e-f6ef-4fdf-a505-adc3030b9419'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:54.136358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e959db1a264037960eb2a3d7ef1582', 'request_id': 'req-a128fe6e-f6ef-4fdf-a505-adc3030b9419'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:54.148379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e959db1a264037960eb2a3d7ef1582', 'request_id': 'req-a128fe6e-f6ef-4fdf-a505-adc3030b9419'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:54.164338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] The token cache is being invalidate because project d5e959db1a264037960eb2a3d7ef1582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:54.164922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:54.166856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a128fe6e-f6ef-4fdf-a505-adc3030b9419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:54.169359 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3894/7765] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:53 2022] DELETE /identity/v3/projects/d5e959db1a264037960eb2a3d7ef1582 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:54.174860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6ebd-e7d3-47db-ace9-78a1cee5056a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:54.176004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6ebd-e7d3-47db-ace9-78a1cee5056a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:54.176508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6ebd-e7d3-47db-ace9-78a1cee5056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:54.245921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-320c6ebd-e7d3-47db-ace9-78a1cee5056a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:54.250346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-320c6ebd-e7d3-47db-ace9-78a1cee5056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:54.377290 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3872/7766] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:54.381405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff504c-c03d-40ba-bd4e-6d86e166c12d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:54.382225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff504c-c03d-40ba-bd4e-6d86e166c12d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:54.382225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff504c-c03d-40ba-bd4e-6d86e166c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:54.418681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c9ff504c-c03d-40ba-bd4e-6d86e166c12d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:54.420810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c9ff504c-c03d-40ba-bd4e-6d86e166c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:54.458314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3895/7767] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:54.462916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6ebd-e7d3-47db-ace9-78a1cee5056a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:54.489496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6ebd-e7d3-47db-ace9-78a1cee5056a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:54.507373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:54.508593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:54.508593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:54.509064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:54.509929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:54.511687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:54.519134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:54.560943 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3873/7768] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:54.565363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff504c-c03d-40ba-bd4e-6d86e166c12d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:54.578941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff504c-c03d-40ba-bd4e-6d86e166c12d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:54.594178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:54.597127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:54.597709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:54.598101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:54.599860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:54.611283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:54.711103 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3896/7769] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:54 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:30:54.715263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:54.734702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250974c-0cd4-408c-8e30-582bd28b3a77 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:54.901841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:54.918266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:54.919554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:54.920014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:54.920457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:54.922446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:54.924676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:54.975613 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3874/7770] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:54 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:54.979812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:54.991976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17316cd2-0bbe-430a-82a2-69ad8def91e3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:55.007833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:55.009396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:55.009854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:55.010299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:55.011364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:55.015799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:55.045178 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3897/7771] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:55.048986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:55.061356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0787a2-7c0e-4c68-b74f-9da0180c3e52 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:55.066922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860077c-c20a-4acd-ac68-292951e1136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:55.073921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860077c-c20a-4acd-ac68-292951e1136f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:55.074308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860077c-c20a-4acd-ac68-292951e1136f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:55.074683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860077c-c20a-4acd-ac68-292951e1136f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:55.075596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860077c-c20a-4acd-ac68-292951e1136f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:55.077670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860077c-c20a-4acd-ac68-292951e1136f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:55.116308 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3875/7772] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:30:55.120429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:55.147712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f145a6-cf80-4fc6-b775-2a5daf52b4ea admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:55.155233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:55.156860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:55.157312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:55.157704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] PATH_INFO: `/v3/projects/d65dfa8232fa458fb3c49822a1f4ede1/users/61121749f1aa4a2285c8f270abb74fdf/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:55.192824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65dfa8232fa458fb3c49822a1f4ede1, user_id=61121749f1aa4a2285c8f270abb74fdf, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:55.196330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:55.224187 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3898/7773] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:55 2022] PUT /identity/v3/projects/d65dfa8232fa458fb3c49822a1f4ede1/users/61121749f1aa4a2285c8f270abb74fdf/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:55.230374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:55.230751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:55.230950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:55.260452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:55.262347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:55.333488 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3876/7774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:55.362671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:55.364593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:55.419664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:55.450952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe14258-0f58-475d-8c06-1b833483c23e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:55.455912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627fc76-59c4-45d8-9f69-c3db0fe3c87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:55.456597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627fc76-59c4-45d8-9f69-c3db0fe3c87f service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:55.456955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627fc76-59c4-45d8-9f69-c3db0fe3c87f service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:55.457341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627fc76-59c4-45d8-9f69-c3db0fe3c87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:55.474616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627fc76-59c4-45d8-9f69-c3db0fe3c87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:55.475717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627fc76-59c4-45d8-9f69-c3db0fe3c87f service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:55.487663 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3899/7775] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:55.635428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:55.637015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:55.660724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca3990-d714-4d4e-bf95-db831df2751e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:55.671138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:55.672275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:55.672629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:55.672972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] PATH_INFO: `/v3/projects/dbcb36ff603f437bafacc7f2c035a9a0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:55.677547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcb36ff603f437bafacc7f2c035a9a0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:55.679801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:55.780624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcb36ff603f437bafacc7f2c035a9a0', 'request_id': 'req-1d96f046-6436-4c51-82bc-eea7f4d693af'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:55.790946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcb36ff603f437bafacc7f2c035a9a0', 'request_id': 'req-1d96f046-6436-4c51-82bc-eea7f4d693af'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:55.806377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcb36ff603f437bafacc7f2c035a9a0', 'request_id': 'req-1d96f046-6436-4c51-82bc-eea7f4d693af'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:55.857416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] The token cache is being invalidate because project dbcb36ff603f437bafacc7f2c035a9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:55.857816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:55.862336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1d96f046-6436-4c51-82bc-eea7f4d693af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:55.867616 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3877/7776] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:55 2022] DELETE /identity/v3/projects/dbcb36ff603f437bafacc7f2c035a9a0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:55.869252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e058a-6771-42f4-bd67-931312437ba4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:55.869665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e058a-6771-42f4-bd67-931312437ba4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:55.869784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e058a-6771-42f4-bd67-931312437ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:55.903915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f84e058a-6771-42f4-bd67-931312437ba4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:55.905269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f84e058a-6771-42f4-bd67-931312437ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:56.035752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0919a2-ac73-4674-930b-1903fbe09eac None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.036046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0919a2-ac73-4674-930b-1903fbe09eac None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.036828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0919a2-ac73-4674-930b-1903fbe09eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.039607 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3900/7777] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:56.062156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2d0919a2-ac73-4674-930b-1903fbe09eac None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:56.063388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2d0919a2-ac73-4674-930b-1903fbe09eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:56.075735 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3878/7778] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:56.077419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e058a-6771-42f4-bd67-931312437ba4 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.093061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e058a-6771-42f4-bd67-931312437ba4 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:56.104365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:56.105574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.105944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.106225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.107124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:56.107433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:56.110496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:56.134876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0919a2-ac73-4674-930b-1903fbe09eac None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.144906 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3901/7779] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:30:56.157982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0919a2-ac73-4674-930b-1903fbe09eac None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:56.175713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:56.176582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.176938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.177474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.178412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:56.180669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:56.223741 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3879/7780] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:56 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:56.231347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.244924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f3bd7-256e-4952-8113-7e71f96f7eef admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:56.325860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:56.326967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.327448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.327739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.328443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:56.330424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:56.361530 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3902/7781] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:56 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:56.363360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.376537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4f42e-a7eb-4867-ac72-982f24aeb3e0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:56.384861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:56.386164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.386454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.387542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.388011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:56.390955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:56.407453 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3880/7782] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:56.409410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.426905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949f9ec-0a47-4ff7-b93e-496520095eeb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:56.435109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd5d6-2097-4bbd-8c57-76583697df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:56.436122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd5d6-2097-4bbd-8c57-76583697df17 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.436753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd5d6-2097-4bbd-8c57-76583697df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.437635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd5d6-2097-4bbd-8c57-76583697df17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.439619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd5d6-2097-4bbd-8c57-76583697df17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:56.442695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd5d6-2097-4bbd-8c57-76583697df17 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:56.454026 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3903/7783] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:56.458301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.471879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2872738-0946-45bc-b75d-a60da157e460 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:56.477393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:56.478374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.478883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.479177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] PATH_INFO: `/v3/projects/c29c1f8c82714c84861bdc73a75348da/users/0dd8db30c736405e80ccc09e59d46f01/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.489880 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:56.500904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c1f8c82714c84861bdc73a75348da, user_id=0dd8db30c736405e80ccc09e59d46f01, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:56.504208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:56.520530 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3881/7784] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:56 2022] PUT /identity/v3/projects/c29c1f8c82714c84861bdc73a75348da/users/0dd8db30c736405e80ccc09e59d46f01/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:30:56.531160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f88b5-bcda-43cc-9752-6772e91074e2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.531560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f88b5-bcda-43cc-9752-6772e91074e2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.531935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f88b5-bcda-43cc-9752-6772e91074e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.560597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-277f88b5-bcda-43cc-9752-6772e91074e2 None None] MFA Rules not processed for user `0dd8db30c736405e80ccc09e59d46f01`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:56.561849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-277f88b5-bcda-43cc-9752-6772e91074e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:56.605542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:56.654351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.655593 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3904/7785] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:56.796891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1534-7db6-42a5-92f9-d3577ec95f34 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:56.804909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:56.805572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:56.805991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:56.806277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:56.807068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:56.809436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:56.868058 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3882/7786] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:56 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:56.872716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f88b5-bcda-43cc-9752-6772e91074e2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:56.890502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f88b5-bcda-43cc-9752-6772e91074e2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:57.000207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:57.001106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.001484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.001824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.002633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:57.006506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:57.053776 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3905/7787] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:56 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:57.057907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:57.075176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645e7e6-1fc9-46c5-82d2-2c56de3d0616 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:57.086349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:57.087199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.087481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.087757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.088979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:57.091629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:57.109960 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3883/7788] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:30:57.111362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:57.125641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb353c-9485-4fac-95d9-d4ce11b03264 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:57.132873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:57.134178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.134520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.134860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] PATH_INFO: `/v3/projects/b50a722be4b347c4aa087b2fc79f1d74/users/fe335153fe734bb197ce0df461a55fbf/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.157235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50a722be4b347c4aa087b2fc79f1d74, user_id=fe335153fe734bb197ce0df461a55fbf, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:57.160377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:57.182465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3906/7789] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:57 2022] PUT /identity/v3/projects/b50a722be4b347c4aa087b2fc79f1d74/users/fe335153fe734bb197ce0df461a55fbf/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:57.183788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:57.196147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c807ca2-de38-40a6-84b8-acddaa1c2d34 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:57.282594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8680e-ee55-4826-af24-0de38b7d5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:57.284543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8680e-ee55-4826-af24-0de38b7d5ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.285515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8680e-ee55-4826-af24-0de38b7d5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.285985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8680e-ee55-4826-af24-0de38b7d5ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.287110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8680e-ee55-4826-af24-0de38b7d5ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:57.291824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8680e-ee55-4826-af24-0de38b7d5ba6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:57.311945 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3884/7790] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:30:57.316605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:57.329174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa508f-034b-4b40-9f15-0b0187b1cb59 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:57.336004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:57.337149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.337719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.338246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] PATH_INFO: `/v3/projects/b50a722be4b347c4aa087b2fc79f1d74/users/fe335153fe734bb197ce0df461a55fbf/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.340854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50a722be4b347c4aa087b2fc79f1d74, user_id=fe335153fe734bb197ce0df461a55fbf, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:57.343865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:57.358302 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3907/7791] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:30:57 2022] PUT /identity/v3/projects/b50a722be4b347c4aa087b2fc79f1d74/users/fe335153fe734bb197ce0df461a55fbf/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:57.371128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b30483-be8b-4d68-bf68-8feac3157b78 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.371463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b30483-be8b-4d68-bf68-8feac3157b78 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.371809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b30483-be8b-4d68-bf68-8feac3157b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.413685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-00b30483-be8b-4d68-bf68-8feac3157b78 None None] MFA Rules not processed for user `fe335153fe734bb197ce0df461a55fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:57.413685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-00b30483-be8b-4d68-bf68-8feac3157b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:57.481583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:57.552094 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3885/7792] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:57.566440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:57.568153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:57.637051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8867911-ef4a-4c20-91cc-5122039a35b4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:57.641986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb65a2-6d08-41e7-8daa-faf30f4a4eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:57.642908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb65a2-6d08-41e7-8daa-faf30f4a4eed service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.643409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb65a2-6d08-41e7-8daa-faf30f4a4eed service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.643862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb65a2-6d08-41e7-8daa-faf30f4a4eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.657237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb65a2-6d08-41e7-8daa-faf30f4a4eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:57.659023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb65a2-6d08-41e7-8daa-faf30f4a4eed service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:57.676638 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3908/7793] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:30:57.848849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b30483-be8b-4d68-bf68-8feac3157b78 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:57.862617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b30483-be8b-4d68-bf68-8feac3157b78 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:57.867667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:57.868786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:57.869327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:57.869779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:57.971388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:57.973151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:57.987591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3886/7794] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:58.147836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:58.148127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:58.148402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:58.222066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] MFA Rules not processed for user `61121749f1aa4a2285c8f270abb74fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:58.225477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:58.245345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:58.246812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:58.259893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:58.351971 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3909/7795] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:58.363246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:58.364773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:58.389923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3a4f-fb76-40ef-b778-98f8c2a2a30c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:58.400678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2937b6-d450-41e5-897a-096e57bdb32d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:58.403223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2937b6-d450-41e5-897a-096e57bdb32d service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:58.403546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2937b6-d450-41e5-897a-096e57bdb32d service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:58.404132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2937b6-d450-41e5-897a-096e57bdb32d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:58.416450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d510-e5a8-4866-b6b6-1c0697055134 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:58.422886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2937b6-d450-41e5-897a-096e57bdb32d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:58.426605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2937b6-d450-41e5-897a-096e57bdb32d service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:58.431975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:58.433023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:58.433592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:58.433865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] PATH_INFO: `/v3/users/b7ccf136672e4af793c6eec34952c860` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:58.436063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ccf136672e4af793c6eec34952c860)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:58.439743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:58.449663 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3910/7796] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:30:58.515779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ccf136672e4af793c6eec34952c860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:58.517494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ccf136672e4af793c6eec34952c860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:58.539115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ccf136672e4af793c6eec34952c860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:58.539888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ccf136672e4af793c6eec34952c860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:58.552123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ccf136672e4af793c6eec34952c860'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:58.581097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:58.603508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:58.603847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:58.604200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:58.612209 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3887/7797] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:30:58 2022] DELETE /identity/v3/users/b7ccf136672e4af793c6eec34952c860 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:58.630814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:58.631075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:58.728546 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3911/7798] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:58.742109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:58.743655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:58.873469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4699-ebc2-407b-aabd-0715450de7ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:58.894656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77409796-91f9-48ab-add2-c014eac2550d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:58.895349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409796-91f9-48ab-add2-c014eac2550d service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:58.895628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409796-91f9-48ab-add2-c014eac2550d service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:58.895901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409796-91f9-48ab-add2-c014eac2550d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:58.916623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77409796-91f9-48ab-add2-c014eac2550d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:58.918436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77409796-91f9-48ab-add2-c014eac2550d service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:58.939266 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3888/7799] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:30:59.191834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:59.193732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:59.239177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0046c4-e7a2-4dd9-9878-f5b5952e0dbf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:59.255054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:59.255971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:59.256253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:59.256541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] PATH_INFO: `/v3/projects/dc34a77b076a477d8af43328f522e209` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:59.257888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc34a77b076a477d8af43328f522e209)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:59.261639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:59.348607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc34a77b076a477d8af43328f522e209', 'request_id': 'req-e6f993e4-c30c-45ff-bdfa-286ee0297146'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:59.357855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc34a77b076a477d8af43328f522e209', 'request_id': 'req-e6f993e4-c30c-45ff-bdfa-286ee0297146'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:59.375378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc34a77b076a477d8af43328f522e209', 'request_id': 'req-e6f993e4-c30c-45ff-bdfa-286ee0297146'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:59.401375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] The token cache is being invalidate because project dc34a77b076a477d8af43328f522e209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:30:59.401674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:59.402649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e6f993e4-c30c-45ff-bdfa-286ee0297146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:30:59.409176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3912/7800] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:30:59 2022] DELETE /identity/v3/projects/dc34a77b076a477d8af43328f522e209 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:30:59.411142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181423f3-60fd-4900-8c14-29ea84a85b18 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:59.411689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181423f3-60fd-4900-8c14-29ea84a85b18 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:59.413576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181423f3-60fd-4900-8c14-29ea84a85b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:59.449832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-181423f3-60fd-4900-8c14-29ea84a85b18 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:59.451131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-181423f3-60fd-4900-8c14-29ea84a85b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:59.565108 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3889/7801] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:30:59.574156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46d894-e044-458c-af07-7d399624ac91 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:59.574690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46d894-e044-458c-af07-7d399624ac91 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:59.575378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46d894-e044-458c-af07-7d399624ac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:59.615996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8c46d894-e044-458c-af07-7d399624ac91 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:30:59.617299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c46d894-e044-458c-af07-7d399624ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:30:59.630037 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3913/7802] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:30:59.634600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181423f3-60fd-4900-8c14-29ea84a85b18 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:59.647859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181423f3-60fd-4900-8c14-29ea84a85b18 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:59.667427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:59.667427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:59.667427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:59.667427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:59.667907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:30:59.667907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:59.667907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:59.696097 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3890/7803] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:30:59.701936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46d894-e044-458c-af07-7d399624ac91 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:59.717284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46d894-e044-458c-af07-7d399624ac91 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:59.732304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:59.734198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:59.734485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:59.735516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:59.736570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:59.742061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:59.798414 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3914/7804] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:30:59 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:59.800418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:59.816490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8f14d-a402-41bb-9016-43b64bd654fb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:59.899452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:59.900927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:59.901439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:59.901867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:59.902791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:59.905274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:30:59.940398 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3891/7805] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:30:59 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:30:59.941209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:30:59.961343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:59.971171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b4a73-819a-4f5e-85f6-39c23788abf1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:30:59.986122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:30:59.987108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:30:59.987560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:30:59.987897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:30:59.989020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:30:59.990285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:00.013282 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3915/7806] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:00.018888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:00.034966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1e35-5b3a-4e41-a130-c1e9c50352f4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:00.047743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ae6c7-5f60-4a3d-8b9d-5a17411f560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:00.048476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae6c7-5f60-4a3d-8b9d-5a17411f560b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:00.048747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae6c7-5f60-4a3d-8b9d-5a17411f560b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:00.049026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae6c7-5f60-4a3d-8b9d-5a17411f560b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:00.051336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ae6c7-5f60-4a3d-8b9d-5a17411f560b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:00.052968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ae6c7-5f60-4a3d-8b9d-5a17411f560b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:00.076013 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3892/7807] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:00.077224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:00.096139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6c1b4-10a0-4fa0-bac6-9831c0c8121f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:00.101879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:00.103101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:00.103402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:00.103804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] PATH_INFO: `/v3/projects/ef56c695f4c44f59b35d520a04440d95/users/b631acf191a34cd2b07040358ab488af/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:00.127433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef56c695f4c44f59b35d520a04440d95, user_id=b631acf191a34cd2b07040358ab488af, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:00.131064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:00.156255 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3916/7808] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:00 2022] PUT /identity/v3/projects/ef56c695f4c44f59b35d520a04440d95/users/b631acf191a34cd2b07040358ab488af/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:00.168146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:00.168524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:00.168873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:00.209799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:00.229480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] MFA Rules not processed for user `b631acf191a34cd2b07040358ab488af`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:00.237980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:00.344699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3893/7809] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:00.355573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:00.358006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:00.477841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718182cc-8c91-4f57-8622-780910941035 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:00.484308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2917e6-bcdf-4711-b846-b67f2b7b5557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:00.485239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2917e6-bcdf-4711-b846-b67f2b7b5557 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:00.485522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2917e6-bcdf-4711-b846-b67f2b7b5557 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:00.485800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2917e6-bcdf-4711-b846-b67f2b7b5557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:00.501207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2917e6-bcdf-4711-b846-b67f2b7b5557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:00.506713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2917e6-bcdf-4711-b846-b67f2b7b5557 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:00.522844 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3917/7810] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:04.199982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:04.202300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:04.341506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43ef6d-9ff4-4d24-866c-e2948e40d495 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:04.349637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:04.350791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:04.351474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:04.351858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] PATH_INFO: `/v3/users/0dd8db30c736405e80ccc09e59d46f01` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:04.353536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd8db30c736405e80ccc09e59d46f01)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:04.356381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:04.452344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd8db30c736405e80ccc09e59d46f01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:04.454116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd8db30c736405e80ccc09e59d46f01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:04.489218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd8db30c736405e80ccc09e59d46f01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:04.493661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd8db30c736405e80ccc09e59d46f01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:04.508937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd8db30c736405e80ccc09e59d46f01'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:04.537655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:04.538579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:04.538886 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3894/7811] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:04 2022] DELETE /identity/v3/users/0dd8db30c736405e80ccc09e59d46f01 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:04.539225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:04.578388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:04.579911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:04.681364 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3918/7812] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:31:04.815544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:04.823226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:04.882613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:05.058855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917572f-f654-48ce-adc5-c6494b3e1bc7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:05.085549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:05.085549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:05.086171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:05.086422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:05.120635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:05.131468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:05.177015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3895/7813] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:06.648207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:06.649708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:06.667523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1280228-511b-4cf0-a34b-9f8c24b72e4f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:06.682269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:06.683142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:06.683602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:06.684028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] PATH_INFO: `/v3/projects/c29c1f8c82714c84861bdc73a75348da` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:06.686686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29c1f8c82714c84861bdc73a75348da)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:06.688883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:06.946801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29c1f8c82714c84861bdc73a75348da', 'request_id': 'req-04bba247-2f44-4cba-aede-22f9b9a8f829'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:06.968672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29c1f8c82714c84861bdc73a75348da', 'request_id': 'req-04bba247-2f44-4cba-aede-22f9b9a8f829'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:06.998454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29c1f8c82714c84861bdc73a75348da', 'request_id': 'req-04bba247-2f44-4cba-aede-22f9b9a8f829'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.006214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:07.031788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] The token cache is being invalidate because project c29c1f8c82714c84861bdc73a75348da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:07.032578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.034648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.047753 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3919/7814] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:06 2022] DELETE /identity/v3/projects/c29c1f8c82714c84861bdc73a75348da => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:07.048004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:07.067805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490589-8367-4295-8f72-b8075ce00f40 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:07.291604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:07.299139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:07.307765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:07.308243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] PATH_INFO: `/v3/users/fe335153fe734bb197ce0df461a55fbf` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:07.310133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe335153fe734bb197ce0df461a55fbf)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:07.312304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:07.469261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe335153fe734bb197ce0df461a55fbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.470045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe335153fe734bb197ce0df461a55fbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.514288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe335153fe734bb197ce0df461a55fbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.515050 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe335153fe734bb197ce0df461a55fbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.531385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-df393711-79fb-4839-99c9-9d184aef7757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe335153fe734bb197ce0df461a55fbf'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:07.566509 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3896/7815] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:07 2022] DELETE /identity/v3/users/fe335153fe734bb197ce0df461a55fbf => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:08.549875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:08.553331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:08.588611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bba247-2f44-4cba-aede-22f9b9a8f829 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:08.745286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:08.746653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:08.747190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:08.747716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] PATH_INFO: `/v3/projects/b50a722be4b347c4aa087b2fc79f1d74` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:08.749601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50a722be4b347c4aa087b2fc79f1d74)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:08.753474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:08.875548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50a722be4b347c4aa087b2fc79f1d74', 'request_id': 'req-8a611512-9a4a-4498-b545-a9592c879cfa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:08.891276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50a722be4b347c4aa087b2fc79f1d74', 'request_id': 'req-8a611512-9a4a-4498-b545-a9592c879cfa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:08.907146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50a722be4b347c4aa087b2fc79f1d74', 'request_id': 'req-8a611512-9a4a-4498-b545-a9592c879cfa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:08.930556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] The token cache is being invalidate because project b50a722be4b347c4aa087b2fc79f1d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:08.932275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:08.936505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8a611512-9a4a-4498-b545-a9592c879cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:08.939846 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3920/7816] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:08 2022] DELETE /identity/v3/projects/b50a722be4b347c4aa087b2fc79f1d74 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:08.945203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500c72-cb71-48bd-bbd5-1770d03c6819 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:08.945763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500c72-cb71-48bd-bbd5-1770d03c6819 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:08.945763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7500c72-cb71-48bd-bbd5-1770d03c6819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:08.993814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d7500c72-cb71-48bd-bbd5-1770d03c6819 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:08.994577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d7500c72-cb71-48bd-bbd5-1770d03c6819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:09.078904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:09.146789 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3897/7817] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:09.157584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee116-a054-4b91-9566-c79b27121b5a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:09.157951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee116-a054-4b91-9566-c79b27121b5a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:09.158176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee116-a054-4b91-9566-c79b27121b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:09.203953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ffdee116-a054-4b91-9566-c79b27121b5a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:09.206562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffdee116-a054-4b91-9566-c79b27121b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:09.243098 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3921/7818] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:09.247428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7500c72-cb71-48bd-bbd5-1770d03c6819 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:09.257831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7500c72-cb71-48bd-bbd5-1770d03c6819 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:09.277411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:09.278123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:09.278397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:09.278670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:09.279428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:31:09.279723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:09.281561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:09.309649 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3898/7819] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:31:09.313980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee116-a054-4b91-9566-c79b27121b5a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:09.333225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee116-a054-4b91-9566-c79b27121b5a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:09.338704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:09.339106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:09.339389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:09.339663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:09.340366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:09.342354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:09.398620 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3922/7820] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:09 2022] POST /identity/v3/projects => generated 359 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:09.403977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:09.420661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4235ef9-5476-4c59-be7a-79f1524cb8d9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:09.691835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:09.691835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:09.692136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:09.692419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:09.694343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:09.695323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:09.763535 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3899/7821] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:09 2022] POST /identity/v3/users => generated 280 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:09.765266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:09.776927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b6c4-c65c-4138-8f4e-4b212f250dd1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:09.856467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:09.865234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:09.865939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:09.866621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:09.867676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:09.877821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:09.919954 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3923/7822] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:09.921394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:09.943209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ae4e-e1de-4257-a4ad-f4cd6985282c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:09.969110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b5008-9777-4036-9542-05a4838b8659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:09.974189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5008-9777-4036-9542-05a4838b8659 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:09.975013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5008-9777-4036-9542-05a4838b8659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:09.975459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5008-9777-4036-9542-05a4838b8659 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:09.976509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b5008-9777-4036-9542-05a4838b8659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:09.979422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b5008-9777-4036-9542-05a4838b8659 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:10.006959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:10.021868 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3900/7823] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:10.024486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5e775-15d4-48ea-af73-52a42aa90de1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:10.046345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:10.047689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:10.048079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:10.048618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] PATH_INFO: `/v3/projects/5e217ce7e20a40b0b9c8b65c70a49cfd/users/7479979bf16e400082f69eb0b606f14b/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:10.107506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e217ce7e20a40b0b9c8b65c70a49cfd, user_id=7479979bf16e400082f69eb0b606f14b, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:10.110680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:10.155266 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3924/7824] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:10 2022] PUT /identity/v3/projects/5e217ce7e20a40b0b9c8b65c70a49cfd/users/7479979bf16e400082f69eb0b606f14b/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:31:10.170138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6603b-6eab-4cc2-9291-66b4e6579a3e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:10.170421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6603b-6eab-4cc2-9291-66b4e6579a3e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:10.170872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6603b-6eab-4cc2-9291-66b4e6579a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:10.276012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e7b6603b-6eab-4cc2-9291-66b4e6579a3e None None] MFA Rules not processed for user `7479979bf16e400082f69eb0b606f14b`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:10.282025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e7b6603b-6eab-4cc2-9291-66b4e6579a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:10.542230 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3901/7825] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:10 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:10.585474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:10.587475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:10.676087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:10.777711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6531c2-1c84-4d82-bd19-e67e2f3a8482 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:10.800966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2bd42-656f-432f-8daf-bc65e94ccf4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:10.800966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2bd42-656f-432f-8daf-bc65e94ccf4b service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:10.800966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2bd42-656f-432f-8daf-bc65e94ccf4b service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:10.800966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2bd42-656f-432f-8daf-bc65e94ccf4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:10.819202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2bd42-656f-432f-8daf-bc65e94ccf4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:10.820841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2bd42-656f-432f-8daf-bc65e94ccf4b service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:10.847790 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3925/7826] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:10 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:10.869123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6603b-6eab-4cc2-9291-66b4e6579a3e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:10.964080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:11.018078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6603b-6eab-4cc2-9291-66b4e6579a3e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:11.035145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:11.036430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:11.036962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:11.037504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] PATH_INFO: `/v3/users/7479979bf16e400082f69eb0b606f14b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:11.042218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7479979bf16e400082f69eb0b606f14b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:11.044604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:11.162095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7479979bf16e400082f69eb0b606f14b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:11.162929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7479979bf16e400082f69eb0b606f14b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:11.192404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7479979bf16e400082f69eb0b606f14b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:11.193275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7479979bf16e400082f69eb0b606f14b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:11.209021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7479979bf16e400082f69eb0b606f14b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:11.255445 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3902/7827] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:10 2022] DELETE /identity/v3/users/7479979bf16e400082f69eb0b606f14b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:11.260364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:11.261007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:11.261575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:11.361305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:11.383657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:11.665534 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3926/7828] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:11.821632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:11.825004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:12.157239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79a24-0550-4ba6-b9f2-ceff886f7af1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:12.190121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e706a-aec3-4f7b-a4b0-3b6b55d3880e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:12.191037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e706a-aec3-4f7b-a4b0-3b6b55d3880e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:12.191336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e706a-aec3-4f7b-a4b0-3b6b55d3880e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:12.191626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e706a-aec3-4f7b-a4b0-3b6b55d3880e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:12.255581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e706a-aec3-4f7b-a4b0-3b6b55d3880e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:12.257123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e706a-aec3-4f7b-a4b0-3b6b55d3880e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:12.303291 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3903/7829] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:13.669008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:13.672474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:13.746740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ee569-01dc-463d-8c3e-641cc41e52c8 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:13.753586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:13.754504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:13.754788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:13.755063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] PATH_INFO: `/v3/projects/5e217ce7e20a40b0b9c8b65c70a49cfd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:13.758953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e217ce7e20a40b0b9c8b65c70a49cfd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:13.762448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:13.899159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e217ce7e20a40b0b9c8b65c70a49cfd', 'request_id': 'req-46c892c5-757f-4a43-8529-da1bca5fa6ff'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:13.917828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e217ce7e20a40b0b9c8b65c70a49cfd', 'request_id': 'req-46c892c5-757f-4a43-8529-da1bca5fa6ff'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:13.949873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e217ce7e20a40b0b9c8b65c70a49cfd', 'request_id': 'req-46c892c5-757f-4a43-8529-da1bca5fa6ff'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:13.958433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:13.970717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] The token cache is being invalidate because project 5e217ce7e20a40b0b9c8b65c70a49cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:13.973180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:13.977165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-46c892c5-757f-4a43-8529-da1bca5fa6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:13.980209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3927/7830] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:13 2022] DELETE /identity/v3/projects/5e217ce7e20a40b0b9c8b65c70a49cfd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:31:13.985153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db39db-e63f-46f9-93db-37803d001110 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:13.986148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db39db-e63f-46f9-93db-37803d001110 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:13.986670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db39db-e63f-46f9-93db-37803d001110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:14.102627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75db39db-e63f-46f9-93db-37803d001110 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:14.111297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75db39db-e63f-46f9-93db-37803d001110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:14.188255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:14.337996 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3904/7831] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:14.347086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858594-3618-4927-8a14-66043e34af1d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:14.347373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858594-3618-4927-8a14-66043e34af1d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:14.347650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17858594-3618-4927-8a14-66043e34af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:14.390061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-17858594-3618-4927-8a14-66043e34af1d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:14.391380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-17858594-3618-4927-8a14-66043e34af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:14.409399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3928/7832] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:31:14.415291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db39db-e63f-46f9-93db-37803d001110 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:14.432052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db39db-e63f-46f9-93db-37803d001110 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:14.444040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:14.444749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:14.445237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:14.446184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:14.447109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:31:14.447572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:14.451483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:14.484432 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3905/7833] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:31:14.485504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858594-3618-4927-8a14-66043e34af1d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:14.507343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17858594-3618-4927-8a14-66043e34af1d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:14.527432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:14.532153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:14.532369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:14.532845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:14.533754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:14.542294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:14.645991 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3929/7834] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:14 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:14.651171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:14.667719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892da475-21ed-472a-b6e1-c6d19654b454 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:14.850162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:14.850752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:14.851043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:14.851346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:14.852035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:14.854053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:14.909364 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3906/7835] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:14 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:31:14.913832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:14.932372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f97e-ea4f-4342-9a1f-7260c0debddf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:14.967924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:14.969245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:14.969722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:14.970278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:14.973019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:14.975846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:15.010015 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3930/7836] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:15.014604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:15.060020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9eb97-614b-49c6-9c09-95350dea4409 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:15.068658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbcb9-34d8-4d00-9a91-c58a23608a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:15.069878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbcb9-34d8-4d00-9a91-c58a23608a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:15.071186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbcb9-34d8-4d00-9a91-c58a23608a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:15.072063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbcb9-34d8-4d00-9a91-c58a23608a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:15.073446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbcb9-34d8-4d00-9a91-c58a23608a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:15.077451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbcb9-34d8-4d00-9a91-c58a23608a60 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:15.094847 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3907/7837] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:31:15.101599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:15.132794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9557d-7d0d-482d-9f3b-facd7806559a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:15.141770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:15.142932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:15.143318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:15.143653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] PATH_INFO: `/v3/projects/f45dc8c8953c47e0b50cbacc9fcac9a2/users/e0c6b9900e5d4990949858b319446ad7/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:15.180288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45dc8c8953c47e0b50cbacc9fcac9a2, user_id=e0c6b9900e5d4990949858b319446ad7, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:15.185586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:15.219501 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3931/7838] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:15 2022] PUT /identity/v3/projects/f45dc8c8953c47e0b50cbacc9fcac9a2/users/e0c6b9900e5d4990949858b319446ad7/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:15.232663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb2e81-5d44-4a70-a29d-a2250eb15160 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:15.233070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb2e81-5d44-4a70-a29d-a2250eb15160 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:15.233468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb2e81-5d44-4a70-a29d-a2250eb15160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:15.290472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2adb2e81-5d44-4a70-a29d-a2250eb15160 None None] MFA Rules not processed for user `e0c6b9900e5d4990949858b319446ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:15.292505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2adb2e81-5d44-4a70-a29d-a2250eb15160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:15.450508 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3908/7839] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:15.454921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:15.552009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c404c9-8726-44d4-ab72-6ad49e22f901 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:15.592778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:15.604657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:15.607763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:15.608411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:15.610365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:15.625455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:15.686676 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3932/7840] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:15 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:15.687689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb2e81-5d44-4a70-a29d-a2250eb15160 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:15.706978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb2e81-5d44-4a70-a29d-a2250eb15160 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:15.727872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:15.811852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:15.812897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:15.813071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:15.813431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:15.814236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:15.823727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:15.878792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:15.880019 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3909/7841] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:15 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:15.901765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8ba21-48c6-46b3-b831-83335e76105c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:15.923634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:15.924443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:15.924746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:15.925024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:15.925928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:15.933327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:15.977429 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3933/7842] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:15.981000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:15.996765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cfb00-a100-46f6-8144-1b938ada7127 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:16.031338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16e818-e042-440c-adc6-7c5c43a1d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:16.032018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e818-e042-440c-adc6-7c5c43a1d42c admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:16.032318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e818-e042-440c-adc6-7c5c43a1d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:16.032521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e818-e042-440c-adc6-7c5c43a1d42c admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:16.034765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16e818-e042-440c-adc6-7c5c43a1d42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:16.036826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16e818-e042-440c-adc6-7c5c43a1d42c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:16.066129 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3910/7843] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:31:16.070205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:16.087822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53712-1532-4d02-a53a-f343033ade08 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:16.094401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:16.100572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:16.101433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:16.103816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] PATH_INFO: `/v3/projects/c89d896ecf6d460a8943e39399577327/users/099bc97413694854bd6238fe23de9ae2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:16.174008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89d896ecf6d460a8943e39399577327, user_id=099bc97413694854bd6238fe23de9ae2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:16.177012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:16.237822 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3934/7844] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:16 2022] PUT /identity/v3/projects/c89d896ecf6d460a8943e39399577327/users/099bc97413694854bd6238fe23de9ae2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:16.251204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1445-f76a-4274-8458-5bd706a58da8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:16.251869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1445-f76a-4274-8458-5bd706a58da8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:16.252267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1445-f76a-4274-8458-5bd706a58da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:16.342560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5afd1445-f76a-4274-8458-5bd706a58da8 None None] MFA Rules not processed for user `099bc97413694854bd6238fe23de9ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:16.343730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5afd1445-f76a-4274-8458-5bd706a58da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:16.508083 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3911/7845] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:31:16.512796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:16.625467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:16.651213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5f3fb-7532-4d99-92c4-a7c8d04c29ce admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:16.659529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:16.660383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:16.660774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:16.661344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:16.662664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:16.665713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:16.703717 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3935/7846] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:16 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:16.708347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd1445-f76a-4274-8458-5bd706a58da8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:16.725191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd1445-f76a-4274-8458-5bd706a58da8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:16.831563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:16.832921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:16.833718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:16.834185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:16.835229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:16.839759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:16.883219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:16.891397 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3912/7847] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:16 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:16.898440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02577ef2-8d97-420b-9b6f-5cf02ea036ee admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:16.907579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:16.908712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:16.909382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:16.910733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:16.912574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:16.915295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:16.939194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:16.941220 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3936/7848] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:16.952668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee8a60-89cd-4cab-8c7f-32ecb2bcfb2f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:16.959975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:16.961187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:16.961773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:16.961983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] PATH_INFO: `/v3/projects/5ca860f62b7942059e2e742046f05a04/users/e76db4f096e849a596a1bddc3887883c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:17.012887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:17.040004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca860f62b7942059e2e742046f05a04, user_id=e76db4f096e849a596a1bddc3887883c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:17.043807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:17.066317 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3913/7849] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:16 2022] PUT /identity/v3/projects/5ca860f62b7942059e2e742046f05a04/users/e76db4f096e849a596a1bddc3887883c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:17.070324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:17.085266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cda62-224a-4a69-af18-502d8c298dcd admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:17.200735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c28028-bc90-4ffb-b219-018ed9768aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:17.202913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c28028-bc90-4ffb-b219-018ed9768aab admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:17.204771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c28028-bc90-4ffb-b219-018ed9768aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:17.204771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c28028-bc90-4ffb-b219-018ed9768aab admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:17.220439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c28028-bc90-4ffb-b219-018ed9768aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:17.228012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c28028-bc90-4ffb-b219-018ed9768aab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:17.250559 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3937/7850] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:17.253614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:17.273564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adff27-659b-4feb-a0bf-d585b1fd8e2a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:17.300964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:17.323790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:17.324175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:17.324565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] PATH_INFO: `/v3/projects/5ca860f62b7942059e2e742046f05a04/users/e76db4f096e849a596a1bddc3887883c/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:17.338444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca860f62b7942059e2e742046f05a04, user_id=e76db4f096e849a596a1bddc3887883c, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:17.341368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:17.394085 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3914/7851] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:17 2022] PUT /identity/v3/projects/5ca860f62b7942059e2e742046f05a04/users/e76db4f096e849a596a1bddc3887883c/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:31:17.401220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:17.401220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:17.401220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:17.453397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] MFA Rules not processed for user `e76db4f096e849a596a1bddc3887883c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:17.454781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:17.592586 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3938/7852] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:17.609887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:17.612133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:17.857629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854549c1-7500-4c56-8157-23b8ce39bcb8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:17.863548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:17.873173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:17.873173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:17.873173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:18.020064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:18.022322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:18.057194 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3915/7853] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:20.056024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:20.058009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:20.100020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20625681-1e20-4272-bfb0-8e9679e33738 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:20.108105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880216c-9a77-43c8-a755-55ae2fec41d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:20.109016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880216c-9a77-43c8-a755-55ae2fec41d2 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:20.109334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880216c-9a77-43c8-a755-55ae2fec41d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:20.109640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880216c-9a77-43c8-a755-55ae2fec41d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:20.169523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:20.220122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880216c-9a77-43c8-a755-55ae2fec41d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:20.222071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880216c-9a77-43c8-a755-55ae2fec41d2 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:20.249635 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3939/7854] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:20.985341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:21.005791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c692-a35d-4c3b-8e32-6aa37c20ae99 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:21.010134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:21.010810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:21.011093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:21.011556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:21.021607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:21.023333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:21.045161 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3916/7855] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:21.172328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcc806-e2b7-4d1e-a7b3-7f4c4443ec53 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:21.172805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcc806-e2b7-4d1e-a7b3-7f4c4443ec53 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:21.172934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcc806-e2b7-4d1e-a7b3-7f4c4443ec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:21.198572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b9fcc806-e2b7-4d1e-a7b3-7f4c4443ec53 None None] MFA Rules not processed for user `61121749f1aa4a2285c8f270abb74fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:21.199814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b9fcc806-e2b7-4d1e-a7b3-7f4c4443ec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:21.313000 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3940/7856] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:21.381371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:21.383480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:21.507481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ca4d-3a7f-49bb-b12d-7a06eb0857da service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:21.512193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:21.513286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:21.513792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:21.517021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:21.525222 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:21.568496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:21.673606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:21.674186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:21.674719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:21.712445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] MFA Rules not processed for user `406628da7a8140fd83200ffc90e71198`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:21.714696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:21.755680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:21.758231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:21.794576 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3917/7857] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:21.827063 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3941/7858] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:21.877660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:21.904860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f1746-ab7a-4c1c-ae03-58ada51610a3 service glance] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:21.911021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:21.911531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:21.911883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:21.912250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:21.914395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:21.934381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:21.936186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:21.952638 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3918/7859] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:23.528038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:23.530460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:23.571499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc4e5-e73d-4a90-9302-26093ac25b32 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:23.586579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defac64e-f8b3-4f8b-8517-5e09658a0dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:23.587272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac64e-f8b3-4f8b-8517-5e09658a0dac service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:23.587534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac64e-f8b3-4f8b-8517-5e09658a0dac service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:23.588561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac64e-f8b3-4f8b-8517-5e09658a0dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:23.590668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-defac64e-f8b3-4f8b-8517-5e09658a0dac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:23.683391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defac64e-f8b3-4f8b-8517-5e09658a0dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:23.688083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defac64e-f8b3-4f8b-8517-5e09658a0dac service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:23.704933 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3942/7860] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:26.099046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:26.239618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d11bf-a99b-4f91-94d3-6e7d1d82b7e8 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:26.245650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:26.247383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:26.247955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:26.249656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] PATH_INFO: `/v3/users/e0c6b9900e5d4990949858b319446ad7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:26.251638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c6b9900e5d4990949858b319446ad7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:26.254204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:26.371691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c6b9900e5d4990949858b319446ad7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:26.372785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c6b9900e5d4990949858b319446ad7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:26.405732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c6b9900e5d4990949858b319446ad7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:26.407668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c6b9900e5d4990949858b319446ad7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:26.438849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c6b9900e5d4990949858b319446ad7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:26.460705 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3919/7861] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:26 2022] DELETE /identity/v3/users/e0c6b9900e5d4990949858b319446ad7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:26.465625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:26.466132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:26.466372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:26.499182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:26.500866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:26.520935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:26.622508 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3943/7862] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:26.647329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:26.649667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:26.678439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:26.826279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f33e17-367e-4872-955c-e3ac729f94e0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:26.837779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:26.838299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:26.838598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:26.838891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:26.867769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:26.869441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:26.893678 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3920/7863] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:27.784460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:27.786648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:27.809745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d79fb8-c79f-4575-925f-a8b82fbd3436 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:27.826514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:27.827815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:27.828603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:27.829095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] PATH_INFO: `/v3/projects/f45dc8c8953c47e0b50cbacc9fcac9a2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:27.831695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45dc8c8953c47e0b50cbacc9fcac9a2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:27.834787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:27.954392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45dc8c8953c47e0b50cbacc9fcac9a2', 'request_id': 'req-d122d6de-dd52-40b5-bb68-19aacd618b12'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:27.963996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45dc8c8953c47e0b50cbacc9fcac9a2', 'request_id': 'req-d122d6de-dd52-40b5-bb68-19aacd618b12'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:27.975974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45dc8c8953c47e0b50cbacc9fcac9a2', 'request_id': 'req-d122d6de-dd52-40b5-bb68-19aacd618b12'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:27.996055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] The token cache is being invalidate because project f45dc8c8953c47e0b50cbacc9fcac9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:27.999823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:28.000835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:28.003247 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3944/7864] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:27 2022] DELETE /identity/v3/projects/f45dc8c8953c47e0b50cbacc9fcac9a2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:28.008362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:28.028238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabfc7c-8f1e-410a-8e22-97e7a60cc7f4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:28.175380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:28.176505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:28.176834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:28.177194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] PATH_INFO: `/v3/users/099bc97413694854bd6238fe23de9ae2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:28.178976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099bc97413694854bd6238fe23de9ae2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:28.186169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:28.307782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099bc97413694854bd6238fe23de9ae2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:28.309155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099bc97413694854bd6238fe23de9ae2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:28.325685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099bc97413694854bd6238fe23de9ae2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:28.326518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099bc97413694854bd6238fe23de9ae2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:28.349981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099bc97413694854bd6238fe23de9ae2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:28.388894 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3921/7865] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:28 2022] DELETE /identity/v3/users/099bc97413694854bd6238fe23de9ae2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:29.505676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:29.507715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:29.575775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d6de-dd52-40b5-bb68-19aacd618b12 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:29.679817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:29.681272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:29.681880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:29.682393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] PATH_INFO: `/v3/projects/c89d896ecf6d460a8943e39399577327` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:29.684515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89d896ecf6d460a8943e39399577327)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:29.690552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:29.763341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:29.768989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89d896ecf6d460a8943e39399577327', 'request_id': 'req-081fabf2-23c9-49a8-a75e-04d7808a9c03'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:29.778555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89d896ecf6d460a8943e39399577327', 'request_id': 'req-081fabf2-23c9-49a8-a75e-04d7808a9c03'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:29.791077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89d896ecf6d460a8943e39399577327', 'request_id': 'req-081fabf2-23c9-49a8-a75e-04d7808a9c03'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:29.819758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] The token cache is being invalidate because project c89d896ecf6d460a8943e39399577327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:29.820394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:29.821133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:29.826382 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3945/7866] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:29 2022] DELETE /identity/v3/projects/c89d896ecf6d460a8943e39399577327 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:29.827428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:29.828911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:29.857449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5ead-a1a2-429d-8f28-2023735df6f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:29.915824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:29.974918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:29.975833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:29.976111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:29.976388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] PATH_INFO: `/v3/users/e76db4f096e849a596a1bddc3887883c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:29.977925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76db4f096e849a596a1bddc3887883c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:29.979783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:30.088894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76db4f096e849a596a1bddc3887883c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:30.089720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76db4f096e849a596a1bddc3887883c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:30.109487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76db4f096e849a596a1bddc3887883c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:30.111434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76db4f096e849a596a1bddc3887883c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:30.123980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-61f87bbb-1010-4c36-9c75-1b7988d87366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76db4f096e849a596a1bddc3887883c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:30.162188 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3922/7867] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:29 2022] DELETE /identity/v3/users/e76db4f096e849a596a1bddc3887883c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:31.464335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:31.465889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:31.480863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fabf2-23c9-49a8-a75e-04d7808a9c03 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:31.548471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:31.550024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:31.550499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:31.550946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] PATH_INFO: `/v3/projects/5ca860f62b7942059e2e742046f05a04` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:31.552392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca860f62b7942059e2e742046f05a04)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:31.554849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:31.621105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca860f62b7942059e2e742046f05a04', 'request_id': 'req-6c75d67a-28c2-4afa-855c-1f5728e4dd11'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.630004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca860f62b7942059e2e742046f05a04', 'request_id': 'req-6c75d67a-28c2-4afa-855c-1f5728e4dd11'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.642739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca860f62b7942059e2e742046f05a04', 'request_id': 'req-6c75d67a-28c2-4afa-855c-1f5728e4dd11'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.662390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] The token cache is being invalidate because project 5ca860f62b7942059e2e742046f05a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:31.662761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.663737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.669130 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3946/7868] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:31 2022] DELETE /identity/v3/projects/5ca860f62b7942059e2e742046f05a04 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:31.670925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502327fd-48a5-49ef-969a-6b21b7c42e85 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:31.671375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502327fd-48a5-49ef-969a-6b21b7c42e85 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:31.671487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502327fd-48a5-49ef-969a-6b21b7c42e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:31.679413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:31.682110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:31.709097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-502327fd-48a5-49ef-969a-6b21b7c42e85 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:31.711506 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-502327fd-48a5-49ef-969a-6b21b7c42e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:31.782917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d67a-28c2-4afa-855c-1f5728e4dd11 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:31.795547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:31.795547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:31.795547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:31.795547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] PATH_INFO: `/v3/users/b631acf191a34cd2b07040358ab488af` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:31.795885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b631acf191a34cd2b07040358ab488af)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:31.796580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:31.799408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:31.801184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3923/7869] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:31.809653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354bc2-c8b3-40c3-95aa-9b00424d298f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:31.810568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354bc2-c8b3-40c3-95aa-9b00424d298f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:31.810568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354bc2-c8b3-40c3-95aa-9b00424d298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:31.838823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d5354bc2-c8b3-40c3-95aa-9b00424d298f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:31.841474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d5354bc2-c8b3-40c3-95aa-9b00424d298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:31.855242 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3924/7870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:31.856409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354bc2-c8b3-40c3-95aa-9b00424d298f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:31.867856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354bc2-c8b3-40c3-95aa-9b00424d298f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:31.868119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b631acf191a34cd2b07040358ab488af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.868973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b631acf191a34cd2b07040358ab488af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.873702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:31.875461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:31.876139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:31.876457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:31.877419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:31:31.877728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:31.879809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:31.889574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b631acf191a34cd2b07040358ab488af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.891264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b631acf191a34cd2b07040358ab488af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.904624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03f0bf57-4fee-49e7-b810-53cc03788734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b631acf191a34cd2b07040358ab488af'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:31.909087 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3925/7871] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:31:31.917858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:31.923447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:31.936528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3947/7872] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:31 2022] DELETE /identity/v3/users/b631acf191a34cd2b07040358ab488af => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:31.938887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:31.939186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:31.939606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:31.950123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9688a-e1a5-4729-ab6e-ba54e1c17cca admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:31.962502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:31.963278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:31.964777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:32.036651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:32.047424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.047715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.049647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.050421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:32.059063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:32.061341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3948/7873] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:32.073077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:32.075345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:32.104586 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3926/7874] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:31 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:32.123494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:32.160968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd4c09-a098-40a5-ab18-81475023baaa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:32.223432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:32.250468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:32.251288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.251572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.251873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.262400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0b7d4-a2e6-45e2-b91a-576294b69523 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:32.263535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:32.265211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:32.269172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:32.270326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.270709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.271104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.272153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:32.275461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:32.278911 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3949/7875] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:32.320846 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3927/7876] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:32 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:32.321892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:32.338907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351bcf-bf72-4a51-b42a-ca9792cb0633 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:32.348579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:32.349297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.349583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.349862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.350597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:32.352226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:32.367350 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3950/7877] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:31:32.369523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:32.381990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283b3d-b9e4-48f2-9e08-4fa2bc0be17d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:32.388066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bfbcf-f863-460e-bee0-69f8d402434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:32.389085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bfbcf-f863-460e-bee0-69f8d402434d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.389612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bfbcf-f863-460e-bee0-69f8d402434d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.390218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bfbcf-f863-460e-bee0-69f8d402434d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.391174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bfbcf-f863-460e-bee0-69f8d402434d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:32.393309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bfbcf-f863-460e-bee0-69f8d402434d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:32.409089 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3928/7878] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:32.409897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:32.430030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc228c-0b5c-46a1-b48d-ea23388fd512 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:32.442605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:32.444115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.444115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.444316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] PATH_INFO: `/v3/projects/f7b4d0121cf24c619d4ad0f5af414dd8/users/a4b5f6d69d1e4804923d47dd4d71d443/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.462718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b4d0121cf24c619d4ad0f5af414dd8, user_id=a4b5f6d69d1e4804923d47dd4d71d443, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:32.465897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:32.489373 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3951/7879] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:32 2022] PUT /identity/v3/projects/f7b4d0121cf24c619d4ad0f5af414dd8/users/a4b5f6d69d1e4804923d47dd4d71d443/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:32.506637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.506637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.506637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.567462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] MFA Rules not processed for user `a4b5f6d69d1e4804923d47dd4d71d443`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:32.568936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:32.743924 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3929/7880] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:32.758775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:32.760579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:32.784007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:32.786290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:32.822238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:32.923351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b5d9c-65cc-4060-846b-fd903a81396f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:32.934272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecaf48-5061-4e89-8347-cdb2c4e1e743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:32.934949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecaf48-5061-4e89-8347-cdb2c4e1e743 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:32.935251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecaf48-5061-4e89-8347-cdb2c4e1e743 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:32.935514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecaf48-5061-4e89-8347-cdb2c4e1e743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:32.954430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecaf48-5061-4e89-8347-cdb2c4e1e743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:32.955993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecaf48-5061-4e89-8347-cdb2c4e1e743 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:32.974871 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3952/7881] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:33.066891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189722d-a83c-47f3-87f8-aefbf636cf60 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:33.076664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:33.077723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.078092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.079903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] PATH_INFO: `/v3/projects/ef56c695f4c44f59b35d520a04440d95` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.080976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef56c695f4c44f59b35d520a04440d95)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:33.083125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:33.210409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef56c695f4c44f59b35d520a04440d95', 'request_id': 'req-5917ded7-76aa-4a75-9857-6146a3611545'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:33.222960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef56c695f4c44f59b35d520a04440d95', 'request_id': 'req-5917ded7-76aa-4a75-9857-6146a3611545'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:33.241467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef56c695f4c44f59b35d520a04440d95', 'request_id': 'req-5917ded7-76aa-4a75-9857-6146a3611545'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:33.276759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] The token cache is being invalidate because project ef56c695f4c44f59b35d520a04440d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:33.277342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:33.278265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5917ded7-76aa-4a75-9857-6146a3611545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:33.280128 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3930/7882] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:32 2022] DELETE /identity/v3/projects/ef56c695f4c44f59b35d520a04440d95 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:33.285311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78039aae-bb27-4897-acb8-07ffb72d0f02 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.285604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78039aae-bb27-4897-acb8-07ffb72d0f02 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.285907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78039aae-bb27-4897-acb8-07ffb72d0f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.329016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-78039aae-bb27-4897-acb8-07ffb72d0f02 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:33.330432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-78039aae-bb27-4897-acb8-07ffb72d0f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:33.411348 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3953/7883] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:33.419015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825c064-6ff9-4deb-98fe-dfd9f820f48b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.419701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825c064-6ff9-4deb-98fe-dfd9f820f48b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.420247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825c064-6ff9-4deb-98fe-dfd9f820f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.489781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e825c064-6ff9-4deb-98fe-dfd9f820f48b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:33.491845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e825c064-6ff9-4deb-98fe-dfd9f820f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:33.508482 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3931/7884] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:33.509358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78039aae-bb27-4897-acb8-07ffb72d0f02 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:33.523638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78039aae-bb27-4897-acb8-07ffb72d0f02 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:33.536146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:33.536847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.537150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.537447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.538173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:31:33.538475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:33.540435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:33.563902 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3954/7885] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:31:33.568138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825c064-6ff9-4deb-98fe-dfd9f820f48b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:33.579346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825c064-6ff9-4deb-98fe-dfd9f820f48b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:33.585837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:33.586638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.586958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.587257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.587960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:33.589913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:33.631354 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3932/7886] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:33.631517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:33.642789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af846d1e-a62e-4c04-9cfe-bf81f3c23d8e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:33.683948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:33.713277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:33.713975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.714255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.714701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.715429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:33.718285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:33.750254 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3955/7887] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:33 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:31:33.751603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:33.766762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fd66-9683-4624-a9a1-6927fe580278 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:33.774381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:33.775437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.775767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.776049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.776846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:33.778745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:33.807754 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3933/7888] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:33.811936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:33.862797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6892c05-61cd-4a95-b97b-177a9216c0c5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:33.869088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3b421-9ad4-4ad7-b92d-892d7f5b3437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:33.869772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3b421-9ad4-4ad7-b92d-892d7f5b3437 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.870052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3b421-9ad4-4ad7-b92d-892d7f5b3437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.870325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3b421-9ad4-4ad7-b92d-892d7f5b3437 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.871060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3b421-9ad4-4ad7-b92d-892d7f5b3437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:33.876705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3b421-9ad4-4ad7-b92d-892d7f5b3437 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:33.907619 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3956/7889] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:33.912431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:33.935102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bdef6-9686-49b7-8f85-e018dae01f3b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:33.944398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:33.945974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:33.946705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:33.947187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] PATH_INFO: `/v3/projects/7620b17486a841cf8b83c2a42f60c92d/users/ea1bb1fe8c154fb1b582e4b249812682/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:33.997241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7620b17486a841cf8b83c2a42f60c92d, user_id=ea1bb1fe8c154fb1b582e4b249812682, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:34.001077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:34.027077 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3934/7890] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:33 2022] PUT /identity/v3/projects/7620b17486a841cf8b83c2a42f60c92d/users/ea1bb1fe8c154fb1b582e4b249812682/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:34.037423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2e12-fcb4-4b59-8cd0-5edcbfd3387a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:34.037716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2e12-fcb4-4b59-8cd0-5edcbfd3387a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:34.038032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2e12-fcb4-4b59-8cd0-5edcbfd3387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:34.072608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5b3f2e12-fcb4-4b59-8cd0-5edcbfd3387a None None] MFA Rules not processed for user `ea1bb1fe8c154fb1b582e4b249812682`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:34.074059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5b3f2e12-fcb4-4b59-8cd0-5edcbfd3387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:34.160868 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3957/7891] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:34.172157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:34.174405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:34.232169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:34.259882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99851ab-20da-4dc7-bad8-542eadfeace3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:34.263561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aa29e-fb3e-44d4-9671-7a28c55892ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:34.264254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aa29e-fb3e-44d4-9671-7a28c55892ef service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:34.264537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aa29e-fb3e-44d4-9671-7a28c55892ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:34.264814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aa29e-fb3e-44d4-9671-7a28c55892ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:34.274683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aa29e-fb3e-44d4-9671-7a28c55892ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:34.277267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aa29e-fb3e-44d4-9671-7a28c55892ef service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:34.286997 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3935/7892] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:31:34.301287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f2e12-fcb4-4b59-8cd0-5edcbfd3387a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:34.385340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f2e12-fcb4-4b59-8cd0-5edcbfd3387a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:34.390722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:34.391671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:34.391958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:34.392227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] PATH_INFO: `/v3/users/ea1bb1fe8c154fb1b582e4b249812682` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:34.393804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1bb1fe8c154fb1b582e4b249812682)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:34.396305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:34.467767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:34.470999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1bb1fe8c154fb1b582e4b249812682'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:34.472194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1bb1fe8c154fb1b582e4b249812682'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:34.492728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1bb1fe8c154fb1b582e4b249812682'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:34.493533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1bb1fe8c154fb1b582e4b249812682'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:34.501127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-96b87b66-8626-4324-a102-9ca6fad0fb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1bb1fe8c154fb1b582e4b249812682'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:34.523103 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3958/7893] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:34 2022] DELETE /identity/v3/users/ea1bb1fe8c154fb1b582e4b249812682 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:34.523980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:34.524391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:34.524694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:34.567327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:34.569898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:34.605504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:34.605775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:34.606891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:34.635068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] MFA Rules not processed for user `a4b5f6d69d1e4804923d47dd4d71d443`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:34.636472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:34.706656 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3936/7894] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:34.717383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:34.722306 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3959/7895] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:34.722461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:34.850175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed73fb-b9b2-4217-834a-cb44203ee813 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:34.853918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5734c-d1d5-455e-a583-227131adb4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:34.854597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5734c-d1d5-455e-a583-227131adb4ca service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:34.854879 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5734c-d1d5-455e-a583-227131adb4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:34.855276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5734c-d1d5-455e-a583-227131adb4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:34.866657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5734c-d1d5-455e-a583-227131adb4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:34.868467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5734c-d1d5-455e-a583-227131adb4ca service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:34.880289 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3937/7896] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:31:35.459488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:35.461697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:35.500265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c831-eb2a-484a-86b2-4f1414205a83 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:35.507812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:35.507812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:35.507997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:35.510500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] PATH_INFO: `/v3/projects/7620b17486a841cf8b83c2a42f60c92d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:35.511758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7620b17486a841cf8b83c2a42f60c92d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:35.519190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:35.627023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7620b17486a841cf8b83c2a42f60c92d', 'request_id': 'req-6c16a70b-1fc1-49e0-98b5-472275e1afe6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:35.638637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7620b17486a841cf8b83c2a42f60c92d', 'request_id': 'req-6c16a70b-1fc1-49e0-98b5-472275e1afe6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:35.652622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7620b17486a841cf8b83c2a42f60c92d', 'request_id': 'req-6c16a70b-1fc1-49e0-98b5-472275e1afe6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:35.676220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] The token cache is being invalidate because project 7620b17486a841cf8b83c2a42f60c92d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:35.676456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:35.677399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6c16a70b-1fc1-49e0-98b5-472275e1afe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:35.681363 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3960/7897] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:35 2022] DELETE /identity/v3/projects/7620b17486a841cf8b83c2a42f60c92d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:35.685406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5d8d1-b1eb-4460-bf26-309f182865f1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:35.685675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5d8d1-b1eb-4460-bf26-309f182865f1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:35.686112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5d8d1-b1eb-4460-bf26-309f182865f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:35.709429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bfe5d8d1-b1eb-4460-bf26-309f182865f1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:35.710806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bfe5d8d1-b1eb-4460-bf26-309f182865f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:35.793309 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3938/7898] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:31:35.802367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d046-701c-4fc5-ab55-e55fad1274bd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:35.803056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d046-701c-4fc5-ab55-e55fad1274bd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:35.803620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d046-701c-4fc5-ab55-e55fad1274bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:35.848593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1452d046-701c-4fc5-ab55-e55fad1274bd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:35.849934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1452d046-701c-4fc5-ab55-e55fad1274bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:35.876583 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3961/7899] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:35.881455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5d8d1-b1eb-4460-bf26-309f182865f1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:35.903162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5d8d1-b1eb-4460-bf26-309f182865f1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:35.924431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:35.925165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:35.925451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:35.925725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:35.926747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:31:35.940055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:35.945389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:35.979371 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3939/7900] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:31:35.980638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452d046-701c-4fc5-ab55-e55fad1274bd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:35.996844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452d046-701c-4fc5-ab55-e55fad1274bd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:36.019546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:36.020321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.020675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.021402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.021834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:36.030141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:36.097983 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3962/7901] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:35 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:36.101931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:36.116328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c7cd5-3e70-4a43-b101-3af467ff4777 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:36.120792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:36.216683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:36.217564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.217946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.218322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.219191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:36.221875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:36.266369 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3940/7902] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:36 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:31:36.270511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:36.287972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f28b2d-f8e9-4cda-9a12-51275a036970 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:36.298693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:36.299973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.300379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.300736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.302109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:36.304132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:36.320159 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3963/7903] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:36.325497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:36.344714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d79a1-1862-44c8-94b2-6211dbb4a250 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:36.353345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b4ef1-1f54-4265-bf19-32d151bae735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:36.354178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4ef1-1f54-4265-bf19-32d151bae735 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.354579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4ef1-1f54-4265-bf19-32d151bae735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.354931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b4ef1-1f54-4265-bf19-32d151bae735 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.355786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b4ef1-1f54-4265-bf19-32d151bae735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:36.357529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b4ef1-1f54-4265-bf19-32d151bae735 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:36.370162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3941/7904] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:36.374745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:36.398334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111073d-d1cb-48f7-8dfe-e52151a6eddf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:36.406052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:36.407339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.407848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.408388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] PATH_INFO: `/v3/projects/05d853df78e440f794c8e860dcbf430e/users/9ad39fddfa204739a21bd1fb30359b33/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.418273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:36.430125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d853df78e440f794c8e860dcbf430e, user_id=9ad39fddfa204739a21bd1fb30359b33, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:36.433193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:36.463304 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3964/7905] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:36 2022] PUT /identity/v3/projects/05d853df78e440f794c8e860dcbf430e/users/9ad39fddfa204739a21bd1fb30359b33/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:36.475610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6015-c8fa-45a6-97dc-7659123d4675 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.475915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6015-c8fa-45a6-97dc-7659123d4675 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.476190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6015-c8fa-45a6-97dc-7659123d4675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.527019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9a8f6015-c8fa-45a6-97dc-7659123d4675 None None] MFA Rules not processed for user `9ad39fddfa204739a21bd1fb30359b33`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:36.528257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a8f6015-c8fa-45a6-97dc-7659123d4675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:36.655180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3942/7906] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:36.676886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:36.678750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:36.786724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3d8f6-42f0-4867-928b-3ccf99a636f3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:36.791655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c2aa-03f8-4426-b43d-c2f30d5e32bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:36.792430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c2aa-03f8-4426-b43d-c2f30d5e32bd service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.792714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c2aa-03f8-4426-b43d-c2f30d5e32bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.792996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c2aa-03f8-4426-b43d-c2f30d5e32bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.807659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c2aa-03f8-4426-b43d-c2f30d5e32bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:36.809707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c2aa-03f8-4426-b43d-c2f30d5e32bd service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:36.822619 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3965/7907] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:36.840086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f6015-c8fa-45a6-97dc-7659123d4675 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:36.982334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f6015-c8fa-45a6-97dc-7659123d4675 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:36.989613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:36.990771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:36.991194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:36.991861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] PATH_INFO: `/v3/users/9ad39fddfa204739a21bd1fb30359b33` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:36.993674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad39fddfa204739a21bd1fb30359b33)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:37.003963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:37.030891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:37.103021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad39fddfa204739a21bd1fb30359b33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:37.104296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad39fddfa204739a21bd1fb30359b33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:37.123124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad39fddfa204739a21bd1fb30359b33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:37.124383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad39fddfa204739a21bd1fb30359b33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:37.136589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad39fddfa204739a21bd1fb30359b33'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:37.166536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3943/7908] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:36 2022] DELETE /identity/v3/users/9ad39fddfa204739a21bd1fb30359b33 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:37.171533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:37.172230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:37.172828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:37.203848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:37.206620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:37.307449 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3966/7909] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:37.359022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:37.361615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:37.463430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd394bc2-0e3e-400d-83fd-7836a5af60ec admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:37.469632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8af8a-1b85-4d1c-8be4-bbe7420fc6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:37.470535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8af8a-1b85-4d1c-8be4-bbe7420fc6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:37.470922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8af8a-1b85-4d1c-8be4-bbe7420fc6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:37.471724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8af8a-1b85-4d1c-8be4-bbe7420fc6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:37.494715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8af8a-1b85-4d1c-8be4-bbe7420fc6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:37.498863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8af8a-1b85-4d1c-8be4-bbe7420fc6f5 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:37.531536 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3944/7910] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:38.248607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:38.251431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:38.270118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02a618-9a9b-47bc-a646-49eebcf1de87 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:38.290732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:38.291976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:38.292635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:38.292635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] PATH_INFO: `/v3/projects/05d853df78e440f794c8e860dcbf430e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:38.294774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d853df78e440f794c8e860dcbf430e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:38.296872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:38.394321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d853df78e440f794c8e860dcbf430e', 'request_id': 'req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:38.406017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d853df78e440f794c8e860dcbf430e', 'request_id': 'req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:38.413233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d853df78e440f794c8e860dcbf430e', 'request_id': 'req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:38.436476 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] The token cache is being invalidate because project 05d853df78e440f794c8e860dcbf430e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:38.436784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:38.437499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1d82e7a6-a76e-4322-9b1f-5c9fa4e00391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:38.441069 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3967/7911] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:38 2022] DELETE /identity/v3/projects/05d853df78e440f794c8e860dcbf430e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:38.445372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f4285-87bc-4edb-a15a-910dd6be5ca2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:38.445870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f4285-87bc-4edb-a15a-910dd6be5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:38.446047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f4285-87bc-4edb-a15a-910dd6be5ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:38.494175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ce5f4285-87bc-4edb-a15a-910dd6be5ca2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:38.495437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ce5f4285-87bc-4edb-a15a-910dd6be5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:38.640133 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3945/7912] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:38.648551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df0613-4f85-4600-93d7-38dbb4a15162 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:38.648844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df0613-4f85-4600-93d7-38dbb4a15162 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:38.649697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df0613-4f85-4600-93d7-38dbb4a15162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:38.669149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f7df0613-4f85-4600-93d7-38dbb4a15162 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:38.670423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f7df0613-4f85-4600-93d7-38dbb4a15162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:38.679021 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3968/7913] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:38.683884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f4285-87bc-4edb-a15a-910dd6be5ca2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:38.695751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f4285-87bc-4edb-a15a-910dd6be5ca2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:38.700710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:38.701451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:38.701730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:38.702005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:38.702757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:31:38.703063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:38.704713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:38.720485 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3946/7914] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:31:38.722126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df0613-4f85-4600-93d7-38dbb4a15162 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:38.732097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df0613-4f85-4600-93d7-38dbb4a15162 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:38.737324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:38.738089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:38.738447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:38.738723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:38.739421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:38.741435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:38.745885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:38.779417 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3969/7915] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:38 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:38.783807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:38.797158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1a13f-68a2-4b49-b48c-43ac71e77035 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:38.830544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:38.880630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:38.881568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:38.881857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:38.882316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:38.882980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:38.884976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:38.923680 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3947/7916] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:38 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:38.927949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:38.945153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f8143-5c05-4bc3-9386-99a9b59d1e6a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:38.951192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:38.952539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:38.952827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:38.953142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:38.953894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:38.955740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:38.971578 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3970/7917] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:38.975394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:38.992782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823c97-d538-4ad8-86e5-49b7a92f8b4b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:39.010312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558a0fd-818e-4bd8-9b0d-ec98179064f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:39.011027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558a0fd-818e-4bd8-9b0d-ec98179064f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:39.011312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558a0fd-818e-4bd8-9b0d-ec98179064f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:39.011597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558a0fd-818e-4bd8-9b0d-ec98179064f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:39.012347 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558a0fd-818e-4bd8-9b0d-ec98179064f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:39.014017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558a0fd-818e-4bd8-9b0d-ec98179064f9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:39.036867 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3948/7918] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:39.041313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:39.063080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acb71b-7d70-41c0-8df5-30bf928d3e7b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:39.068604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:39.069636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:39.070003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:39.070204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] PATH_INFO: `/v3/projects/e5bd20bbb431448aa4931e893ded5458/users/fc83c95051c94fa6bd48314e6a1360fc/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:39.128622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bd20bbb431448aa4931e893ded5458, user_id=fc83c95051c94fa6bd48314e6a1360fc, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:39.131317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:39.188721 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3971/7919] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:39 2022] PUT /identity/v3/projects/e5bd20bbb431448aa4931e893ded5458/users/fc83c95051c94fa6bd48314e6a1360fc/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:39.192951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b856-c237-4735-9243-132506725045 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:39.193303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b856-c237-4735-9243-132506725045 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:39.193575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b856-c237-4735-9243-132506725045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:39.265690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-48f5b856-c237-4735-9243-132506725045 None None] MFA Rules not processed for user `fc83c95051c94fa6bd48314e6a1360fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:39.267388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48f5b856-c237-4735-9243-132506725045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:39.409789 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3949/7920] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:39.414456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:39.521348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c36e1-086a-4ac8-85f7-2d633d09b62f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:39.527885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:39.528694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:39.529211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:39.529943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:39.531880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:39.535179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:39.605176 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3972/7921] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:39 2022] POST /identity/v3/projects => generated 403 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:39.607538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b856-c237-4735-9243-132506725045 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:39.629419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b856-c237-4735-9243-132506725045 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:39.759782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:39.760841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:39.761359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:39.761656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:39.762871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:39.764535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:39.818806 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3950/7922] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:39 2022] POST /identity/v3/users => generated 308 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:31:39.823176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:39.836541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704850a5-9a23-4e38-a276-6764409665f1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:39.843900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:39.844595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:39.845160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:39.845616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:39.846278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:39.847964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:39.861193 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3973/7923] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:39.866233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:39.881431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b7c7-7168-40bc-be54-5b49ac21589c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:39.887853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:39.889980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:39.890661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:39.891198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] PATH_INFO: `/v3/projects/5caa7ef012774ef9bc989aad88d14c75/users/4c79d86caacf4ca1b1644d6d82b867d7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:39.916959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5caa7ef012774ef9bc989aad88d14c75, user_id=4c79d86caacf4ca1b1644d6d82b867d7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:39.920305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:39.935494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:39.943328 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3951/7924] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:39 2022] PUT /identity/v3/projects/5caa7ef012774ef9bc989aad88d14c75/users/4c79d86caacf4ca1b1644d6d82b867d7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:39.948291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:39.966460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a70ab-2a88-4307-adb6-cb00edf44976 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:40.053306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ffa03-0e68-4b25-9b57-263592ef7698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:40.054017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ffa03-0e68-4b25-9b57-263592ef7698 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:40.054304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ffa03-0e68-4b25-9b57-263592ef7698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:40.054587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ffa03-0e68-4b25-9b57-263592ef7698 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:40.055332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ffa03-0e68-4b25-9b57-263592ef7698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:40.057261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ffa03-0e68-4b25-9b57-263592ef7698 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:40.081555 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3974/7925] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:40.085985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:40.098382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29339ab3-6389-4106-b073-90b9aa908d3b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:40.103661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:40.104892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:40.104892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:40.105211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] PATH_INFO: `/v3/projects/5caa7ef012774ef9bc989aad88d14c75/users/4c79d86caacf4ca1b1644d6d82b867d7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:40.107378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5caa7ef012774ef9bc989aad88d14c75, user_id=4c79d86caacf4ca1b1644d6d82b867d7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:40.110865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:40.132202 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3952/7926] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:40 2022] PUT /identity/v3/projects/5caa7ef012774ef9bc989aad88d14c75/users/4c79d86caacf4ca1b1644d6d82b867d7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:40.134797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e9e69-4746-4dec-8810-e82060ba6afd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:40.135326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e9e69-4746-4dec-8810-e82060ba6afd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:40.135747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e9e69-4746-4dec-8810-e82060ba6afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:40.170668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d62e9e69-4746-4dec-8810-e82060ba6afd None None] MFA Rules not processed for user `4c79d86caacf4ca1b1644d6d82b867d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:40.172096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d62e9e69-4746-4dec-8810-e82060ba6afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:40.184562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:40.342298 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3975/7927] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:31:40.367595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:40.371783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:40.522182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533aa1c-a4f8-4e15-9d09-20f48ccc5069 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:40.532260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f06ec-5c08-4944-9a9b-e3d866b44449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:40.533225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f06ec-5c08-4944-9a9b-e3d866b44449 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:40.533617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f06ec-5c08-4944-9a9b-e3d866b44449 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:40.534000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f06ec-5c08-4944-9a9b-e3d866b44449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:40.548947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f06ec-5c08-4944-9a9b-e3d866b44449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:40.550745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f06ec-5c08-4944-9a9b-e3d866b44449 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:40.579457 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3953/7928] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:40.792668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e9e69-4746-4dec-8810-e82060ba6afd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:40.946537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e9e69-4746-4dec-8810-e82060ba6afd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:40.960086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:40.962514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:40.963187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:40.963774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] PATH_INFO: `/v3/users/fc83c95051c94fa6bd48314e6a1360fc` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:40.965353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc83c95051c94fa6bd48314e6a1360fc)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:40.969871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:41.090954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc83c95051c94fa6bd48314e6a1360fc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:41.092367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc83c95051c94fa6bd48314e6a1360fc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:41.110532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc83c95051c94fa6bd48314e6a1360fc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:41.111750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc83c95051c94fa6bd48314e6a1360fc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:41.134124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc83c95051c94fa6bd48314e6a1360fc'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:41.177387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3976/7929] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:40 2022] DELETE /identity/v3/users/fc83c95051c94fa6bd48314e6a1360fc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:41.182033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:41.182492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:41.182863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:41.241381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:41.242634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:41.363396 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3954/7930] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:41.386177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:41.388096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:41.449025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:41.509123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29994f-4f4a-436a-a183-93ba26b1c5a8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:41.513950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:41.514814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:41.515106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:41.515446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:41.528055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:41.529609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:41.541376 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3977/7931] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:42.410454 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:42.412007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:42.430909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae7b3c-6b85-4e2e-a41e-68f6f148e393 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:42.438352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:42.439327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:42.439617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:42.439897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] PATH_INFO: `/v3/projects/e5bd20bbb431448aa4931e893ded5458` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:42.441223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bd20bbb431448aa4931e893ded5458)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:42.443544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:42.532888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bd20bbb431448aa4931e893ded5458', 'request_id': 'req-d05ee479-b869-4b0c-8086-54b37c076ed2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.542738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bd20bbb431448aa4931e893ded5458', 'request_id': 'req-d05ee479-b869-4b0c-8086-54b37c076ed2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.556916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bd20bbb431448aa4931e893ded5458', 'request_id': 'req-d05ee479-b869-4b0c-8086-54b37c076ed2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.581817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] The token cache is being invalidate because project e5bd20bbb431448aa4931e893ded5458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:42.582971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.583129 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.588880 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3955/7932] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:42 2022] DELETE /identity/v3/projects/e5bd20bbb431448aa4931e893ded5458 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:42.590215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:42.612487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a9a8-bf8c-4435-936e-e0ec00b792e2 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:42.722513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:42.723801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:42.724278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:42.724744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] PATH_INFO: `/v3/users/4c79d86caacf4ca1b1644d6d82b867d7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:42.726373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c79d86caacf4ca1b1644d6d82b867d7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:42.728784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:42.805538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c79d86caacf4ca1b1644d6d82b867d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.806327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c79d86caacf4ca1b1644d6d82b867d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.822783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c79d86caacf4ca1b1644d6d82b867d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.824227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c79d86caacf4ca1b1644d6d82b867d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.833879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0bc92934-d839-44ad-bca4-f92ec9445508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c79d86caacf4ca1b1644d6d82b867d7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:42.862402 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3978/7933] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:42 2022] DELETE /identity/v3/users/4c79d86caacf4ca1b1644d6d82b867d7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:31:43.770289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:43.773934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:43.813113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ee479-b869-4b0c-8086-54b37c076ed2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:43.824570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:43.917814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:43.918817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:43.919165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:43.919520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] PATH_INFO: `/v3/projects/5caa7ef012774ef9bc989aad88d14c75` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:43.920994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5caa7ef012774ef9bc989aad88d14c75)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:43.923249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:44.013313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5caa7ef012774ef9bc989aad88d14c75', 'request_id': 'req-0f469967-1f4d-460f-8ada-a61185df9200'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:44.030564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5caa7ef012774ef9bc989aad88d14c75', 'request_id': 'req-0f469967-1f4d-460f-8ada-a61185df9200'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:44.040723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5caa7ef012774ef9bc989aad88d14c75', 'request_id': 'req-0f469967-1f4d-460f-8ada-a61185df9200'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:44.064116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] The token cache is being invalidate because project 5caa7ef012774ef9bc989aad88d14c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:31:44.064417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:44.065377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-0f469967-1f4d-460f-8ada-a61185df9200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:44.067162 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3956/7934] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:31:43 2022] DELETE /identity/v3/projects/5caa7ef012774ef9bc989aad88d14c75 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:44.074786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6055e1f-fa40-4d8d-a5b4-d82e34179860 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:44.075374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6055e1f-fa40-4d8d-a5b4-d82e34179860 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:44.075374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6055e1f-fa40-4d8d-a5b4-d82e34179860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:44.114617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a6055e1f-fa40-4d8d-a5b4-d82e34179860 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:44.129887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a6055e1f-fa40-4d8d-a5b4-d82e34179860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:44.276084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:44.327775 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3979/7935] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:44.336090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee486423-fa82-428a-91f4-2df659ec7a42 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:44.336389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee486423-fa82-428a-91f4-2df659ec7a42 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:44.336676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee486423-fa82-428a-91f4-2df659ec7a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:44.377027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ee486423-fa82-428a-91f4-2df659ec7a42 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:44.380861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ee486423-fa82-428a-91f4-2df659ec7a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:44.418122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6055e1f-fa40-4d8d-a5b4-d82e34179860 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:44.425907 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3957/7936] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:44.435929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6055e1f-fa40-4d8d-a5b4-d82e34179860 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:44.449992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:44.450763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:44.451236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:44.451441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:44.463678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:31:44.464748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:44.470862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:44.515050 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3980/7937] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:31:44.516099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee486423-fa82-428a-91f4-2df659ec7a42 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:44.527662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee486423-fa82-428a-91f4-2df659ec7a42 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:44.536667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:44.537566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:44.538115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:44.538398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:44.539932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:44.542907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:44.619063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3958/7938] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:44 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:44.625894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:44.648142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162e17e-9b2e-411c-a6cc-c8600d1b836e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:44.834312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:44.835219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:44.840045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:44.841603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:44.841603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:44.859363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:44.947614 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3981/7939] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:44 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:44.951398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:44.970187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480142c5-8697-4938-9858-8f89d9e88ca5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:44.985882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:44.986398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:44.986679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:44.986948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:44.987746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:44.991119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:45.047285 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3959/7940] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:45.052252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:45.067469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368c54-3eaa-43a9-85da-eb5cd1f30753 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:45.080884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419cce2-acb5-4397-be05-d59e8fcced60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:45.081675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419cce2-acb5-4397-be05-d59e8fcced60 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:45.082091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419cce2-acb5-4397-be05-d59e8fcced60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:45.082376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419cce2-acb5-4397-be05-d59e8fcced60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:45.083132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419cce2-acb5-4397-be05-d59e8fcced60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:45.084773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419cce2-acb5-4397-be05-d59e8fcced60 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:45.119923 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3982/7941] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:31:45.121529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:45.135472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb143-4573-495d-933a-2d4065b0a1cc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:45.145077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:45.148279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:45.148578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:45.148857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] PATH_INFO: `/v3/projects/6e8a6af1730648f59aad868ff855fe5b/users/9ad1cbaef41944979c96491cd297e4f0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:45.172578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8a6af1730648f59aad868ff855fe5b, user_id=9ad1cbaef41944979c96491cd297e4f0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:45.178040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:45.237098 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3960/7942] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:45 2022] PUT /identity/v3/projects/6e8a6af1730648f59aad868ff855fe5b/users/9ad1cbaef41944979c96491cd297e4f0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:45.249519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038186ca-5cc7-4824-8929-7c65b0e324e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:45.250959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038186ca-5cc7-4824-8929-7c65b0e324e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:45.250959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038186ca-5cc7-4824-8929-7c65b0e324e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:45.312071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-038186ca-5cc7-4824-8929-7c65b0e324e1 None None] MFA Rules not processed for user `9ad1cbaef41944979c96491cd297e4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:45.315058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-038186ca-5cc7-4824-8929-7c65b0e324e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:45.400097 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3983/7943] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:45.404942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:45.492975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:45.542482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524735cb-e3a7-44c1-9e9e-5be6be272b98 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:45.552764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:45.553923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:45.554438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:45.554929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:45.555959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:45.558611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:45.614454 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3961/7944] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:31:45 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:45.616876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038186ca-5cc7-4824-8929-7c65b0e324e1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:45.631284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038186ca-5cc7-4824-8929-7c65b0e324e1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:45.738954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:45.775810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:45.776508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:45.776825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:45.777131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:45.778225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:45.780919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:45.813116 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3984/7945] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:31:45 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:31:45.816681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:45.837338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da2473-f22f-45e8-bd01-d6d50769de58 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:45.843929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:45.844361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:45.844625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:45.845225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:45.846074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:45.847796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:45.864992 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3962/7946] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:45.869208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:45.883937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd30e47-4877-4bf1-9011-0fd343db74ec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:45.890903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:45.891961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:45.892250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:45.892534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] PATH_INFO: `/v3/projects/721a38c341d3437287ba104682e72bf1/users/8c72e93b305b4b479f53250d44ab0048/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:45.919798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] RBAC: Authorizing `identity:create_grant(project_id=721a38c341d3437287ba104682e72bf1, user_id=8c72e93b305b4b479f53250d44ab0048, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:45.922666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:45.945720 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3985/7947] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:45 2022] PUT /identity/v3/projects/721a38c341d3437287ba104682e72bf1/users/8c72e93b305b4b479f53250d44ab0048/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:45.949759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:45.962421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c684b-7df5-4332-819c-57aa670afcfd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:46.072679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d528c7f-df3e-43e8-a325-8ed9fccfeacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:46.073570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528c7f-df3e-43e8-a325-8ed9fccfeacd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:46.073928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528c7f-df3e-43e8-a325-8ed9fccfeacd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:46.074429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528c7f-df3e-43e8-a325-8ed9fccfeacd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:46.075663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d528c7f-df3e-43e8-a325-8ed9fccfeacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:46.077792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d528c7f-df3e-43e8-a325-8ed9fccfeacd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:46.109987 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3963/7948] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:31:46.111525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:46.134417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf964a-4c24-48fa-b941-2515f862540d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:46.151383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:46.152324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:46.152582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:46.152862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] PATH_INFO: `/v3/projects/721a38c341d3437287ba104682e72bf1/users/8c72e93b305b4b479f53250d44ab0048/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:46.160791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=721a38c341d3437287ba104682e72bf1, user_id=8c72e93b305b4b479f53250d44ab0048, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:46.163918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:46.203380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:46.203681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:46.203967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:46.206651 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3986/7949] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:31:46 2022] PUT /identity/v3/projects/721a38c341d3437287ba104682e72bf1/users/8c72e93b305b4b479f53250d44ab0048/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:46.244219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] MFA Rules not processed for user `8c72e93b305b4b479f53250d44ab0048`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:46.245522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:46.379832 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3964/7950] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:46.388218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:46.391594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:46.489468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86667c-ff67-442e-84e8-84083928b61a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:46.494112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75adec4-bde7-4086-8bc4-55a2a194ac02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:46.494955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75adec4-bde7-4086-8bc4-55a2a194ac02 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:46.495468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75adec4-bde7-4086-8bc4-55a2a194ac02 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:46.495650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75adec4-bde7-4086-8bc4-55a2a194ac02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:46.508751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75adec4-bde7-4086-8bc4-55a2a194ac02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:46.510554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75adec4-bde7-4086-8bc4-55a2a194ac02 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:46.522029 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3987/7951] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:46.670829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:46.673790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:46.703066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf1dd8-70c7-48a1-bf70-d17cab66fb91 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:46.707696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:46.708505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:46.708973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:46.709398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:46.769967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:46.823594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:46.825830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:46.839894 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3965/7952] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:47.722170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760e7b-cb37-4c37-b130-b184faa69877 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:47.723836 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760e7b-cb37-4c37-b130-b184faa69877 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:47.724340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760e7b-cb37-4c37-b130-b184faa69877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:47.785352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2e760e7b-cb37-4c37-b130-b184faa69877 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:47.786964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2e760e7b-cb37-4c37-b130-b184faa69877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:47.919763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3988/7953] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:31:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:48.000795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:48.002926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:48.129868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d9406-fb8a-4839-88c9-e9069168f61e service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:48.136635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:48.137404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:48.137760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:48.138113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:48.150195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:48.151983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:48.179160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3966/7954] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:31:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:48.838385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed21a-7871-4803-bfad-876a88f565dd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:48.840505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed21a-7871-4803-bfad-876a88f565dd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:48.841685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ed21a-7871-4803-bfad-876a88f565dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:48.873354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-711ed21a-7871-4803-bfad-876a88f565dd None None] MFA Rules not processed for user `406628da7a8140fd83200ffc90e71198`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:48.875898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-711ed21a-7871-4803-bfad-876a88f565dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:48.933081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:48.973151 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3989/7955] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:53.634476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:53.639951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:53.813006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849bcbc-46ac-4fd4-8975-4d02334b9e2f service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:53.819045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:53.820081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:53.820709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:53.821484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:53.825201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:53.965749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:53.968060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:53.984423 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3967/7956] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:57.160517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed21a-7871-4803-bfad-876a88f565dd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:57.179375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ed21a-7871-4803-bfad-876a88f565dd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:57.191873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5d110-8610-43e5-b670-42ac8e46c2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:57.192632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d110-8610-43e5-b670-42ac8e46c2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:57.192946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d110-8610-43e5-b670-42ac8e46c2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:57.207425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d110-8610-43e5-b670-42ac8e46c2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:57.221809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-deb5d110-8610-43e5-b670-42ac8e46c2d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:57.266769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5d110-8610-43e5-b670-42ac8e46c2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:57.275695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5d110-8610-43e5-b670-42ac8e46c2d0 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:57.310940 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3990/7957] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:31:58.417526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:58.428900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d0b63-70c0-4d33-b32f-1bbad978c7c2 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:58.462093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:58.463915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:58.464391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:58.464876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] PATH_INFO: `/v3/users/9ad1cbaef41944979c96491cd297e4f0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:58.469386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad1cbaef41944979c96491cd297e4f0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:58.474207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:58.483771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:58.565866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad1cbaef41944979c96491cd297e4f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:58.566823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad1cbaef41944979c96491cd297e4f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:58.604885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad1cbaef41944979c96491cd297e4f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:58.605765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad1cbaef41944979c96491cd297e4f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:58.618742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad1cbaef41944979c96491cd297e4f0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:31:58.642738 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3968/7958] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:31:58 2022] DELETE /identity/v3/users/9ad1cbaef41944979c96491cd297e4f0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:31:58.648509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b66a5-8045-47ee-a417-73364841f227 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:58.649557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b66a5-8045-47ee-a417-73364841f227 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:58.650094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b66a5-8045-47ee-a417-73364841f227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:58.686439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-498b66a5-8045-47ee-a417-73364841f227 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:31:58.688272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-498b66a5-8045-47ee-a417-73364841f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:58.799357 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3991/7959] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:31:58.836544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:31:58.840069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:31:59.011161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8f122-f072-4f3f-b3cb-afb05ad684d0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:31:59.041305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:31:59.043399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:31:59.043846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:31:59.045524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:31:59.080561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:31:59.084651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:31:59.140255 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3969/7960] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:00.026548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b66a5-8045-47ee-a417-73364841f227 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:00.028597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-498b66a5-8045-47ee-a417-73364841f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:00.048910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b66a5-8045-47ee-a417-73364841f227 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:00.065557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:00.066454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:00.068742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:00.069255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] PATH_INFO: `/v3/projects/6e8a6af1730648f59aad868ff855fe5b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:00.082972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8a6af1730648f59aad868ff855fe5b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:00.112133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:00.260765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8a6af1730648f59aad868ff855fe5b', 'request_id': 'req-85d8a518-d510-4c91-ab94-4382b22919f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.273224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8a6af1730648f59aad868ff855fe5b', 'request_id': 'req-85d8a518-d510-4c91-ab94-4382b22919f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.295511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8a6af1730648f59aad868ff855fe5b', 'request_id': 'req-85d8a518-d510-4c91-ab94-4382b22919f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.314631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] The token cache is being invalidate because project 6e8a6af1730648f59aad868ff855fe5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:00.314631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.315596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.321099 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3992/7961] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:00 2022] DELETE /identity/v3/projects/6e8a6af1730648f59aad868ff855fe5b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:00.322832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:00.336907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e31a7a-0b2d-44c4-9a70-24cbc440e181 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:00.434006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:00.436239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:00.436599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:00.437109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] PATH_INFO: `/v3/users/8c72e93b305b4b479f53250d44ab0048` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:00.439143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c72e93b305b4b479f53250d44ab0048)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:00.441414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:00.488735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:00.532800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c72e93b305b4b479f53250d44ab0048'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.533730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c72e93b305b4b479f53250d44ab0048'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.574443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c72e93b305b4b479f53250d44ab0048'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.575207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c72e93b305b4b479f53250d44ab0048'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.585113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-c8478d24-6c0c-4201-bdf7-6658cd6ccede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c72e93b305b4b479f53250d44ab0048'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:00.608660 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3970/7962] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:00 2022] DELETE /identity/v3/users/8c72e93b305b4b479f53250d44ab0048 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:01.316552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:01.321410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:01.364569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8a518-d510-4c91-ab94-4382b22919f6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:01.499842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:01.509068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:01.510463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:01.510904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:01.511382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] PATH_INFO: `/v3/projects/721a38c341d3437287ba104682e72bf1` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:01.514963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=721a38c341d3437287ba104682e72bf1)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:01.521116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:01.614856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721a38c341d3437287ba104682e72bf1', 'request_id': 'req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:01.626693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721a38c341d3437287ba104682e72bf1', 'request_id': 'req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:01.643747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721a38c341d3437287ba104682e72bf1', 'request_id': 'req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:01.669717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] The token cache is being invalidate because project 721a38c341d3437287ba104682e72bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:01.670375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:01.672127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d972437d-74f6-4ebd-8d9c-b4fdb82355f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:01.680458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c71f6-88d3-48c6-861f-d3ea0e495b56 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:01.681551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c71f6-88d3-48c6-861f-d3ea0e495b56 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:01.682073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c71f6-88d3-48c6-861f-d3ea0e495b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:01.683465 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3993/7963] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:01 2022] DELETE /identity/v3/projects/721a38c341d3437287ba104682e72bf1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:01.724018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d82c71f6-88d3-48c6-861f-d3ea0e495b56 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:01.725409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d82c71f6-88d3-48c6-861f-d3ea0e495b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:01.863244 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3971/7964] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:01.874144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18f5a9-a587-4428-b5d2-2eccfc4fcc09 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:01.874871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18f5a9-a587-4428-b5d2-2eccfc4fcc09 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:01.875375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18f5a9-a587-4428-b5d2-2eccfc4fcc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:01.909103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-eb18f5a9-a587-4428-b5d2-2eccfc4fcc09 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:01.912266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eb18f5a9-a587-4428-b5d2-2eccfc4fcc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:01.925917 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3994/7965] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:01.930197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c71f6-88d3-48c6-861f-d3ea0e495b56 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:01.954824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c71f6-88d3-48c6-861f-d3ea0e495b56 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:01.954824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:01.955161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:01.955450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:01.955739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:01.956652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:01.956995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:01.958738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:01.972998 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3972/7966] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:01.978097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18f5a9-a587-4428-b5d2-2eccfc4fcc09 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:02.024422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18f5a9-a587-4428-b5d2-2eccfc4fcc09 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:02.063026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:02.064381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.064841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.065348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.066359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:02.068491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:02.123791 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3995/7967] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:01 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:02.128888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:02.147486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153861fb-3828-423e-b9e3-4da8828cecc5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:02.268365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:02.269359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.273976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.274349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.275103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:02.277386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:02.301966 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3973/7968] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:02 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:02.306415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:02.318149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a59ffb-3ad4-4387-a4dd-a07b2dd6df80 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:02.325173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:02.326237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.326516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.326940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.327868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:02.329822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:02.350185 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3996/7969] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:02.354072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:02.376763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46ed5-19ce-4c16-979a-8cc431de12a9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:02.381794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48537c-e445-4900-b440-7fb04ff40fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:02.382633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48537c-e445-4900-b440-7fb04ff40fdd admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.383045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48537c-e445-4900-b440-7fb04ff40fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.383361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48537c-e445-4900-b440-7fb04ff40fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.384217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48537c-e445-4900-b440-7fb04ff40fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:02.388062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48537c-e445-4900-b440-7fb04ff40fdd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:02.406389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3974/7970] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:02.412873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:02.440086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694e655-8b9f-4a2c-b049-961f113c7ea9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:02.447851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:02.448786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.449813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.449987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] PATH_INFO: `/v3/projects/5fc4f664405a4ca5b78debfcae6a6223/users/0f9f293ce1d644489dbc17e1b46db5a8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.482180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc4f664405a4ca5b78debfcae6a6223, user_id=0f9f293ce1d644489dbc17e1b46db5a8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:02.485568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:02.510144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3997/7971] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:02 2022] PUT /identity/v3/projects/5fc4f664405a4ca5b78debfcae6a6223/users/0f9f293ce1d644489dbc17e1b46db5a8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:02.523397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8803-e279-4a16-a4a1-34a22cb42c44 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.524518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8803-e279-4a16-a4a1-34a22cb42c44 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.525293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8803-e279-4a16-a4a1-34a22cb42c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.566682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:02.577839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-37bf8803-e279-4a16-a4a1-34a22cb42c44 None None] MFA Rules not processed for user `0f9f293ce1d644489dbc17e1b46db5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:02.580076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-37bf8803-e279-4a16-a4a1-34a22cb42c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:02.681130 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3975/7972] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:02.686269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:02.793886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552def7-df68-40d5-8290-68b557000597 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:02.799568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:02.800248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.800534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.800806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.801534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:02.803464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:02.835029 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3998/7973] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:02 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:02.839521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8803-e279-4a16-a4a1-34a22cb42c44 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:02.853166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8803-e279-4a16-a4a1-34a22cb42c44 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:02.969673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:02.970945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:02.971477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:02.971985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:02.973131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:02.977328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.012801 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3976/7974] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:02 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:03.016978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:03.075610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abceb86-af67-4e55-ade3-fc5c626a5443 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:03.083628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:03.084464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.084900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.085313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.086739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:03.090363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.094647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:03.129381 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 3999/7975] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:03.133618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:03.150184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebdeea-941e-426c-8054-fdc6a64cc647 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:03.150983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:03.152579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:03.171246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:03.172711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.173193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.173642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] PATH_INFO: `/v3/projects/0d128a4fb3ae4977bc425c4dabbfa906/users/05a6b928f35b402aaf0940a990686997/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.176378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfee7f-919d-47b8-ac80-4687b470e130 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:03.189853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:03.190837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.191123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.191403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] PATH_INFO: `/v3/users/3f6133e6ab7745118bc629dd126189e8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.193334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6133e6ab7745118bc629dd126189e8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:03.195738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.214301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d128a4fb3ae4977bc425c4dabbfa906, user_id=05a6b928f35b402aaf0940a990686997, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:03.226170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.252788 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3977/7976] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:03 2022] PUT /identity/v3/projects/0d128a4fb3ae4977bc425c4dabbfa906/users/05a6b928f35b402aaf0940a990686997/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:03.257053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:03.289785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6133e6ab7745118bc629dd126189e8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:03.291438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6133e6ab7745118bc629dd126189e8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:03.320874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6133e6ab7745118bc629dd126189e8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:03.322643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6133e6ab7745118bc629dd126189e8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:03.335848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6133e6ab7745118bc629dd126189e8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:03.364692 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4000/7977] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:03 2022] DELETE /identity/v3/users/3f6133e6ab7745118bc629dd126189e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:03.388763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77822d-db2b-4faf-ae84-8d4dd27a90bb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:03.402199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:03.472565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4f29e-f9a6-465f-985d-75890abee167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:03.473796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f29e-f9a6-465f-985d-75890abee167 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.474220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f29e-f9a6-465f-985d-75890abee167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.474790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4f29e-f9a6-465f-985d-75890abee167 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.475858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f29e-f9a6-465f-985d-75890abee167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:03.477784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4f29e-f9a6-465f-985d-75890abee167 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.496567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3978/7978] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:03.498066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:03.499780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:03.517311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca228f2-f8a8-4694-8568-9838c246c5b2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:03.524613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:03.526032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.526422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.526770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] PATH_INFO: `/v3/projects/0d128a4fb3ae4977bc425c4dabbfa906/users/05a6b928f35b402aaf0940a990686997/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.530361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d128a4fb3ae4977bc425c4dabbfa906, user_id=05a6b928f35b402aaf0940a990686997, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:03.534085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.561068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4001/7979] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:03 2022] PUT /identity/v3/projects/0d128a4fb3ae4977bc425c4dabbfa906/users/05a6b928f35b402aaf0940a990686997/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:03.568847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.568847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.568847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.621794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] MFA Rules not processed for user `05a6b928f35b402aaf0940a990686997`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:03.624008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:03.736829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:03.739111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:03.748488 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3979/7980] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:03.763047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:03.764996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:03.901154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ebc07-fd04-4ab3-811e-c7b2cf1a0c04 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:03.912531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:03.913666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.913951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.914246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] PATH_INFO: `/v3/projects/76301551c4574f299511a993dc871890` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.916043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=76301551c4574f299511a993dc871890)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:03.918172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb591aa1-c73c-45af-b02d-bb6a2ae154f4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:03.918304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.922853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453fdd-84f3-44cd-8aff-57204d48b8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:03.923811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453fdd-84f3-44cd-8aff-57204d48b8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:03.924103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453fdd-84f3-44cd-8aff-57204d48b8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:03.924382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453fdd-84f3-44cd-8aff-57204d48b8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:03.940080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453fdd-84f3-44cd-8aff-57204d48b8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:03.942583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453fdd-84f3-44cd-8aff-57204d48b8b9 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:03.958585 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3980/7981] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:03.995699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76301551c4574f299511a993dc871890', 'request_id': 'req-744a2820-1d20-4832-be74-16dd7f7c3abb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:04.002653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76301551c4574f299511a993dc871890', 'request_id': 'req-744a2820-1d20-4832-be74-16dd7f7c3abb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:04.008386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:04.025923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76301551c4574f299511a993dc871890', 'request_id': 'req-744a2820-1d20-4832-be74-16dd7f7c3abb'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:04.049394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] The token cache is being invalidate because project 76301551c4574f299511a993dc871890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:04.049510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:04.050379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:04.052180 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4002/7982] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:03 2022] DELETE /identity/v3/projects/76301551c4574f299511a993dc871890 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:04.059823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ea2b4-1551-4078-aeb4-53dc9864fe73 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.060237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ea2b4-1551-4078-aeb4-53dc9864fe73 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.060792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ea2b4-1551-4078-aeb4-53dc9864fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.061345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:04.063005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:04.109017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-116ea2b4-1551-4078-aeb4-53dc9864fe73 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:04.111581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-116ea2b4-1551-4078-aeb4-53dc9864fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:04.168846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2820-1d20-4832-be74-16dd7f7c3abb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:04.171088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:04.176454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:04.177932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.177932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.178123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.181900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:04.232386 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3981/7983] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:04.237574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15937263-14f2-4a66-a369-73615edb2360 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.237987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15937263-14f2-4a66-a369-73615edb2360 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.238385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15937263-14f2-4a66-a369-73615edb2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.289855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-15937263-14f2-4a66-a369-73615edb2360 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:04.294670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15937263-14f2-4a66-a369-73615edb2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:04.312863 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3982/7984] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:04.318442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15937263-14f2-4a66-a369-73615edb2360 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:04.328279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:04.331046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:04.346167 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4003/7985] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:04.353325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15937263-14f2-4a66-a369-73615edb2360 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:04.367532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:04.369556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.370956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.371608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.373100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:04.374614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:04.380851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:04.427884 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3983/7986] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:04.437050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:04.504689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a76a-d777-4927-9672-064adb8044df service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:04.520026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:04.521057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.523532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.524005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.525017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:04.531085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:04.587535 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4004/7987] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:04 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:04.592904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:04.614327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95956dee-7515-46fa-8b1f-eed15e7d1d65 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:04.751095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:04.751968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.752255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.752537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.753764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:04.756579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:04.788775 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3984/7988] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:04 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:04.793011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:04.810196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d329a1-e34e-46db-b709-97ab338e118c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:04.822362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:04.823071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.825009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.825387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.826353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:04.835621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:04.852588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4005/7989] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:04.854211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:04.866715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4516c7-685e-4772-9f13-92d4a01e4721 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:04.872538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0f85f-e65d-4f61-bdb9-aeb28f199e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:04.873253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f85f-e65d-4f61-bdb9-aeb28f199e05 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.873537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f85f-e65d-4f61-bdb9-aeb28f199e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.873822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0f85f-e65d-4f61-bdb9-aeb28f199e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.874751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f85f-e65d-4f61-bdb9-aeb28f199e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:04.876662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0f85f-e65d-4f61-bdb9-aeb28f199e05 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:04.905363 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3985/7990] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:04.907512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:04.920642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6a1f-73c4-4cb5-ae71-323e0dfa2dc9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:04.926203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:04.927226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.927562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.927898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] PATH_INFO: `/v3/projects/f16c225722ff454c8c6cf8d418409139/users/d67187b72bad46cba3f3c12db0b3bf38/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:04.945415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16c225722ff454c8c6cf8d418409139, user_id=d67187b72bad46cba3f3c12db0b3bf38, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:04.948357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:04.977215 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4006/7991] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:04 2022] PUT /identity/v3/projects/f16c225722ff454c8c6cf8d418409139/users/d67187b72bad46cba3f3c12db0b3bf38/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:04.983639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4023110-3637-466b-96ac-4c016d4115b7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:04.984310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4023110-3637-466b-96ac-4c016d4115b7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:04.984856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4023110-3637-466b-96ac-4c016d4115b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:05.036090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c4023110-3637-466b-96ac-4c016d4115b7 None None] MFA Rules not processed for user `d67187b72bad46cba3f3c12db0b3bf38`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:05.037597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4023110-3637-466b-96ac-4c016d4115b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:05.137491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3986/7992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:05.142259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:05.201947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:05.244316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e458b-741e-4ea7-a7d2-3095eba670ad admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:05.256084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:05.256787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:05.257103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:05.257387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:05.258107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:05.264475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:05.313583 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4007/7993] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:05 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:05.317975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4023110-3637-466b-96ac-4c016d4115b7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:05.339673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4023110-3637-466b-96ac-4c016d4115b7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:05.403221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:05.459302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:05.460360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:05.460920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:05.461541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:05.462510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:05.465802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:05.530597 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3987/7994] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:05 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:05.534780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:05.549376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b693ec-ca6a-4452-939b-183bd5b48f05 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:05.568332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:05.569513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:05.570080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:05.570727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:05.572384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:05.574700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:05.591348 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4008/7995] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:05.596002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:05.617479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431683-c50c-455d-9b29-55501b321b54 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:05.630291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:05.631554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:05.631971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:05.632260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] PATH_INFO: `/v3/projects/1ba7c0d9e361426e8859698d542e6b91/users/21effccbd0c140e6aaad3d97d0540382/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:05.663075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba7c0d9e361426e8859698d542e6b91, user_id=21effccbd0c140e6aaad3d97d0540382, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:05.665974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:05.692225 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3988/7996] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:05 2022] PUT /identity/v3/projects/1ba7c0d9e361426e8859698d542e6b91/users/21effccbd0c140e6aaad3d97d0540382/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:05.696576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:05.718756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591faa99-c159-40b5-ac97-f95cbce8a404 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:05.889629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab394a7d-cc83-40aa-a692-bac5a9464208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:05.891417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394a7d-cc83-40aa-a692-bac5a9464208 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:05.891417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394a7d-cc83-40aa-a692-bac5a9464208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:05.892019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394a7d-cc83-40aa-a692-bac5a9464208 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:05.892747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab394a7d-cc83-40aa-a692-bac5a9464208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:05.895772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab394a7d-cc83-40aa-a692-bac5a9464208 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:05.911219 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4009/7997] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:05.915596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:05.935755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a555f7c-f56a-42b3-b17f-07f050ca265e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:05.940842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:05.941796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:05.942075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:05.942508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] PATH_INFO: `/v3/projects/1ba7c0d9e361426e8859698d542e6b91/users/21effccbd0c140e6aaad3d97d0540382/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:05.944482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba7c0d9e361426e8859698d542e6b91, user_id=21effccbd0c140e6aaad3d97d0540382, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:05.947434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:05.960467 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3989/7998] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:05 2022] PUT /identity/v3/projects/1ba7c0d9e361426e8859698d542e6b91/users/21effccbd0c140e6aaad3d97d0540382/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:05.971802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d0e1f-147d-45fa-9350-6c5cd826d072 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:05.972006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d0e1f-147d-45fa-9350-6c5cd826d072 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:05.972383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d0e1f-147d-45fa-9350-6c5cd826d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.023153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d73d0e1f-147d-45fa-9350-6c5cd826d072 None None] MFA Rules not processed for user `21effccbd0c140e6aaad3d97d0540382`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:06.025065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d73d0e1f-147d-45fa-9350-6c5cd826d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:06.198306 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4010/7999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:06.204844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:06.253730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2c0e-db7b-499c-8d9e-8971e1a66886 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:06.278268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:06.279101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:06.279393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:06.280600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.281583 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:06.283923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:06.333677 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3990/8000] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:06 2022] POST /identity/v3/projects => generated 333 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:06.333914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d0e1f-147d-45fa-9350-6c5cd826d072 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:06.352734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d0e1f-147d-45fa-9350-6c5cd826d072 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:06.412043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:06.450050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:06.451366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:06.451366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:06.451657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.452449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:06.454629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:06.503807 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4011/8001] 10.222.0.30 () {60 vars in 1151 bytes} [Sat Jun 18 22:32:06 2022] POST /identity/v3/projects => generated 332 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:06.506483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:06.528788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49127126-edac-493e-a8f9-94edb8ce87b6 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:06.654127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:06.654777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:06.655056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:06.655401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.656972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:06.659975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:06.724610 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3991/8002] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:06 2022] POST /identity/v3/projects => generated 357 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:06.733529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:06.750177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b713a5e-c48c-478e-b8f1-24b0d92dcf91 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:06.825304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:06.825988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:06.826271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:06.826547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.827356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:06.830362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:06.850713 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4012/8003] 10.222.0.30 () {58 vars in 1130 bytes} [Sat Jun 18 22:32:06 2022] GET /identity/v3/projects => generated 6794 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:06.855953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:06.867962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313cfda-3e6c-4a04-92f9-87c8eb2a39e3 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:06.873594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:06.874313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:06.874611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:06.874881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.875988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:06.876293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:06.879289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:06.911339 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3992/8004] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:32:06 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:32:06.913803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:06.925896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240414f-901b-4140-b887-28a5a620c846 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:06.930778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:06.931449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:06.931744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:06.932020 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.933185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Adding query filter params (parent_id=2826d3edab4948e69e5bb659c8a4db6d) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:06.933496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:06.935506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:06.955284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4013/8005] 10.222.0.30 () {58 vars in 1215 bytes} [Sat Jun 18 22:32:06 2022] GET /identity/v3/projects?parent_id=2826d3edab4948e69e5bb659c8a4db6d => generated 497 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:06.960522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:06.971568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d53c1-b39f-4bbc-8220-9956b870e5f9 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:06.976300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:06.977323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:06.977609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:06.977891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects/18304f22d6b2410f8fe7d4538b182a81` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:06.979461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18304f22d6b2410f8fe7d4538b182a81)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:06.981430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:06.999937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:07.036590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18304f22d6b2410f8fe7d4538b182a81', 'request_id': 'req-30ce6753-d14c-422e-8655-b4393a6a2641'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.043765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18304f22d6b2410f8fe7d4538b182a81', 'request_id': 'req-30ce6753-d14c-422e-8655-b4393a6a2641'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.054262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18304f22d6b2410f8fe7d4538b182a81', 'request_id': 'req-30ce6753-d14c-422e-8655-b4393a6a2641'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.067313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] The token cache is being invalidate because project 18304f22d6b2410f8fe7d4538b182a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:07.067608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.068381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.070205 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3993/8006] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:06 2022] DELETE /identity/v3/projects/18304f22d6b2410f8fe7d4538b182a81 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:07.074486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:07.076451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:07.092699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d02950-2e4b-45f4-bafa-0997079a8273 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:07.154446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:07.155454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:07.155706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:07.155980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects/2826d3edab4948e69e5bb659c8a4db6d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:07.157311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2826d3edab4948e69e5bb659c8a4db6d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:07.159420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:07.218883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2826d3edab4948e69e5bb659c8a4db6d', 'request_id': 'req-9533ff0d-03bf-483d-ba4e-702c871f2424'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.220330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:07.227810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2826d3edab4948e69e5bb659c8a4db6d', 'request_id': 'req-9533ff0d-03bf-483d-ba4e-702c871f2424'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.238033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2826d3edab4948e69e5bb659c8a4db6d', 'request_id': 'req-9533ff0d-03bf-483d-ba4e-702c871f2424'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.250374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] The token cache is being invalidate because project 2826d3edab4948e69e5bb659c8a4db6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:07.250755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.251608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.256929 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4014/8007] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:07 2022] DELETE /identity/v3/projects/2826d3edab4948e69e5bb659c8a4db6d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:07.258258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:07.281180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce6753-d14c-422e-8655-b4393a6a2641 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:07.356836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21effccbd0c140e6aaad3d97d0540382', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba7c0d9e361426e8859698d542e6b91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:07.357820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:07.358301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:07.358585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] PATH_INFO: `/v3/projects/a559dd1999fb4e918176112198e8315b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:07.359927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a559dd1999fb4e918176112198e8315b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:07.363009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:07.433595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a559dd1999fb4e918176112198e8315b', 'request_id': 'req-f71bf097-e230-4a5e-8e7c-8602e67da5f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.447375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a559dd1999fb4e918176112198e8315b', 'request_id': 'req-f71bf097-e230-4a5e-8e7c-8602e67da5f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.462932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a559dd1999fb4e918176112198e8315b', 'request_id': 'req-f71bf097-e230-4a5e-8e7c-8602e67da5f2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.479349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] The token cache is being invalidate because project a559dd1999fb4e918176112198e8315b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:07.479646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.480713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.483393 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3994/8008] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:07 2022] DELETE /identity/v3/projects/a559dd1999fb4e918176112198e8315b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:07.489627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:07.490840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:07.697988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533ff0d-03bf-483d-ba4e-702c871f2424 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:07.806035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:07.807481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:07.808495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:07.808809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] PATH_INFO: `/v3/users/d67187b72bad46cba3f3c12db0b3bf38` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:07.811301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67187b72bad46cba3f3c12db0b3bf38)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:07.815947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:07.885594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:07.889268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:07.914796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71bf097-e230-4a5e-8e7c-8602e67da5f2 tempest-ListProjectsTestJSON-982552373 tempest-ListProjectsTestJSON-982552373-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:07.932552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:07.933994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:07.934315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:07.934626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] PATH_INFO: `/v3/users/0f9f293ce1d644489dbc17e1b46db5a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:07.936654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9f293ce1d644489dbc17e1b46db5a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:07.941009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67187b72bad46cba3f3c12db0b3bf38'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.941290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:07.941829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67187b72bad46cba3f3c12db0b3bf38'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.964738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67187b72bad46cba3f3c12db0b3bf38'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.965636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67187b72bad46cba3f3c12db0b3bf38'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:07.980138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d7197905-4787-4a67-8196-29d4dd4bc76c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67187b72bad46cba3f3c12db0b3bf38'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:08.003221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:08.005635 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4015/8009] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:07 2022] DELETE /identity/v3/users/d67187b72bad46cba3f3c12db0b3bf38 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:08.012494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:08.012816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:08.013095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:08.040029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:08.049172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9f293ce1d644489dbc17e1b46db5a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:08.053601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9f293ce1d644489dbc17e1b46db5a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:08.071395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:08.072882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:08.073892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9f293ce1d644489dbc17e1b46db5a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:08.075783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9f293ce1d644489dbc17e1b46db5a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:08.095059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-761e00c2-bfc5-429b-9f0a-ce7bb2aab442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9f293ce1d644489dbc17e1b46db5a8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:08.121561 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3995/8010] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:07 2022] DELETE /identity/v3/users/0f9f293ce1d644489dbc17e1b46db5a8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:08.128322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6901-15d5-4de2-a157-14b7b918bd87 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:08.128816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6901-15d5-4de2-a157-14b7b918bd87 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:08.129271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6901-15d5-4de2-a157-14b7b918bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:08.150099 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4016/8011] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:08.162814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:08.167589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:08.177554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75fc6901-15d5-4de2-a157-14b7b918bd87 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:08.179319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75fc6901-15d5-4de2-a157-14b7b918bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:08.293781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80a8e3-043f-43ee-b26f-2f4215064649 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:08.304352 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3996/8012] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:08.326642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc6901-15d5-4de2-a157-14b7b918bd87 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:08.399482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:08.400170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:08.400450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:08.400736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:08.404874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc6901-15d5-4de2-a157-14b7b918bd87 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:08.409502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:08.410560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:08.410845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:08.411395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:08.414823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:08.416573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:08.422495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:08.424209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:08.436983 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3997/8013] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:08.442995 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4017/8014] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:09.069546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:09.071254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:09.097384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4ff3a-9620-4077-9e5c-56e3942a932b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:09.110658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:09.111991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:09.112507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:09.112999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] PATH_INFO: `/v3/projects/f16c225722ff454c8c6cf8d418409139` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:09.115123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16c225722ff454c8c6cf8d418409139)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:09.117549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:09.209946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:09.219834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:09.222414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:09.237672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16c225722ff454c8c6cf8d418409139', 'request_id': 'req-fbae6920-2d3c-4867-af6d-40687a69b73f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.251811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16c225722ff454c8c6cf8d418409139', 'request_id': 'req-fbae6920-2d3c-4867-af6d-40687a69b73f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.266368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc444eb-4d50-4279-bdb4-b6b8f84e4264 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:09.268600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16c225722ff454c8c6cf8d418409139', 'request_id': 'req-fbae6920-2d3c-4867-af6d-40687a69b73f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.286492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] The token cache is being invalidate because project f16c225722ff454c8c6cf8d418409139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:09.287044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.287887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.290703 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3998/8015] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:09 2022] DELETE /identity/v3/projects/f16c225722ff454c8c6cf8d418409139 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:09.296206 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:09.298713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:09.385230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:09.386391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:09.387134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:09.387774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] PATH_INFO: `/v3/projects/5fc4f664405a4ca5b78debfcae6a6223` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:09.389764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc4f664405a4ca5b78debfcae6a6223)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:09.394274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:09.398572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:09.402529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae6920-2d3c-4867-af6d-40687a69b73f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:09.413971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:09.415078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:09.415358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:09.415773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] PATH_INFO: `/v3/users/21effccbd0c140e6aaad3d97d0540382` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:09.417256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21effccbd0c140e6aaad3d97d0540382)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:09.419478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:09.487671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc4f664405a4ca5b78debfcae6a6223', 'request_id': 'req-8f2a9740-27a9-4159-8680-ad2afabb2534'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.492831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21effccbd0c140e6aaad3d97d0540382'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.493963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21effccbd0c140e6aaad3d97d0540382'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.495243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc4f664405a4ca5b78debfcae6a6223', 'request_id': 'req-8f2a9740-27a9-4159-8680-ad2afabb2534'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.507985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc4f664405a4ca5b78debfcae6a6223', 'request_id': 'req-8f2a9740-27a9-4159-8680-ad2afabb2534'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.517918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21effccbd0c140e6aaad3d97d0540382'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.519415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21effccbd0c140e6aaad3d97d0540382'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.528335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] The token cache is being invalidate because project 5fc4f664405a4ca5b78debfcae6a6223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:09.528771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.529890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.532589 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4018/8016] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:09 2022] DELETE /identity/v3/projects/5fc4f664405a4ca5b78debfcae6a6223 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:09.533721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21effccbd0c140e6aaad3d97d0540382'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.537627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:09.539659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:09.559313 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 3999/8017] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:09 2022] DELETE /identity/v3/users/21effccbd0c140e6aaad3d97d0540382 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:09.700737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a9740-27a9-4159-8680-ad2afabb2534 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:09.775724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:09.776002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:09.776412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:09.776748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] PATH_INFO: `/v3/users/05a6b928f35b402aaf0940a990686997` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:09.779125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a6b928f35b402aaf0940a990686997)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:09.781626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:09.901293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:09.925314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a6b928f35b402aaf0940a990686997'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.927975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a6b928f35b402aaf0940a990686997'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.970082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a6b928f35b402aaf0940a990686997'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.975484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a6b928f35b402aaf0940a990686997'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:09.993010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a6b928f35b402aaf0940a990686997'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:10.018888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4019/8018] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:09 2022] DELETE /identity/v3/users/05a6b928f35b402aaf0940a990686997 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:10.511862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:10.515270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:10.571197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42fb5a-dac3-46bd-a3a8-b5a35b166db5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:10.668924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:10.671193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:10.675033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:10.695873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:10.703043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:10.704362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:10.707255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] PATH_INFO: `/v3/projects/1ba7c0d9e361426e8859698d542e6b91` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:10.715943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba7c0d9e361426e8859698d542e6b91)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:10.719472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:10.810058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba7c0d9e361426e8859698d542e6b91', 'request_id': 'req-d0d82545-f4ba-4499-8444-ba853a955384'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:10.819235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba7c0d9e361426e8859698d542e6b91', 'request_id': 'req-d0d82545-f4ba-4499-8444-ba853a955384'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:10.832067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba7c0d9e361426e8859698d542e6b91', 'request_id': 'req-d0d82545-f4ba-4499-8444-ba853a955384'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:10.850531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] The token cache is being invalidate because project 1ba7c0d9e361426e8859698d542e6b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:10.850945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:10.853182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d0d82545-f4ba-4499-8444-ba853a955384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:10.856058 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4000/8019] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:10 2022] DELETE /identity/v3/projects/1ba7c0d9e361426e8859698d542e6b91 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:10.862260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41616383-3d0c-4cea-8469-348a69ef1b0d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:10.864613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c2f4a-9533-4226-95f1-b115abdd1b77 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:10.865099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c2f4a-9533-4226-95f1-b115abdd1b77 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:10.865588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c2f4a-9533-4226-95f1-b115abdd1b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:10.895638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fe0c2f4a-9533-4226-95f1-b115abdd1b77 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:10.897180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fe0c2f4a-9533-4226-95f1-b115abdd1b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:10.986550 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4001/8020] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:10.996772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b9c89-47cb-42bc-9908-d613bfe5bbca None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:10.997087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b9c89-47cb-42bc-9908-d613bfe5bbca None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:10.997374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b9c89-47cb-42bc-9908-d613bfe5bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.014696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.016082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.017960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.018786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] PATH_INFO: `/v3/projects/0d128a4fb3ae4977bc425c4dabbfa906` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.020295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-710b9c89-47cb-42bc-9908-d613bfe5bbca None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:11.021796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-710b9c89-47cb-42bc-9908-d613bfe5bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:11.029198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d128a4fb3ae4977bc425c4dabbfa906)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.030912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.050279 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4002/8021] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:11.052316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b9c89-47cb-42bc-9908-d613bfe5bbca None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.064838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b9c89-47cb-42bc-9908-d613bfe5bbca None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.076565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.077310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.077873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.078064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.079489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:11.079923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.084163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.128351 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4003/8022] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:11.130669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.165170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d128a4fb3ae4977bc425c4dabbfa906', 'request_id': 'req-f84fb66e-f67b-4e59-a48f-4abd0340ce81'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:11.169060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559a6f0-d77a-412b-843a-bee91aeef4d6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.186195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d128a4fb3ae4977bc425c4dabbfa906', 'request_id': 'req-f84fb66e-f67b-4e59-a48f-4abd0340ce81'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:11.210788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d128a4fb3ae4977bc425c4dabbfa906', 'request_id': 'req-f84fb66e-f67b-4e59-a48f-4abd0340ce81'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:11.225974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:11.243665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] The token cache is being invalidate because project 0d128a4fb3ae4977bc425c4dabbfa906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:11.244624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:11.246469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f84fb66e-f67b-4e59-a48f-4abd0340ce81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:11.260698 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4020/8023] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:10 2022] DELETE /identity/v3/projects/0d128a4fb3ae4977bc425c4dabbfa906 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:11.263603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.263975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.264173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.306427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:11.308337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:11.360755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.361500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.362497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.362813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.363525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.365878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.394833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:11.472178 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4004/8024] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:11 2022] POST /identity/v3/projects => generated 367 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:11.477363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.481125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:11.521769 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4021/8025] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:11.522779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.524380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:11.553967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e766a1-bc1b-46fb-ac7b-55de6b759014 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.644678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7ab1-33eb-427b-ad9d-abe4a685931d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.657894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.659124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.659413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.659746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.663161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f677422-79e7-462e-8be7-0b6efb27a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.663857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f677422-79e7-462e-8be7-0b6efb27a7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.664142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f677422-79e7-462e-8be7-0b6efb27a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.664614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f677422-79e7-462e-8be7-0b6efb27a7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.665504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f677422-79e7-462e-8be7-0b6efb27a7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.668325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f677422-79e7-462e-8be7-0b6efb27a7a6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.672592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:11.691318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.693122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.707214 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4022/8026] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:11 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:11.709155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15bd4-3530-4a83-bca0-5f041e7bc443 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.709773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15bd4-3530-4a83-bca0-5f041e7bc443 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.710270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa15bd4-3530-4a83-bca0-5f041e7bc443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.714715 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4005/8027] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:11.715593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.740499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-afa15bd4-3530-4a83-bca0-5f041e7bc443 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:11.741726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea072e4-d96d-4378-9f0a-59c9107c7813 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.743049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-afa15bd4-3530-4a83-bca0-5f041e7bc443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:11.749350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.750259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.750793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.751167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.752232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.754487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.756306 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4023/8028] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:11.764349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa15bd4-3530-4a83-bca0-5f041e7bc443 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.768160 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4006/8029] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:11.773213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.780884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa15bd4-3530-4a83-bca0-5f041e7bc443 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.795461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.806754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.807515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.809261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.809880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:11.810262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.812133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.830610 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4024/8030] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:11.832405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.843174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6472e6-97aa-44bc-9aad-4382ba4c6894 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.858398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1019eb-d490-434e-b24b-9800014ce953 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.860571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.861453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.862178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.862584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.863512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.866277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.879374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.880559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.881089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.882606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.883442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.884863 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4007/8031] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:11.886893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.890905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.913926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e859-7559-4586-b4d3-26a14cddd8e9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:11.920257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402c568-e521-40be-81fa-107280cdc141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:11.921349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402c568-e521-40be-81fa-107280cdc141 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:11.921624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402c568-e521-40be-81fa-107280cdc141 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:11.922062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402c568-e521-40be-81fa-107280cdc141 admin admin] PATH_INFO: `/v3/projects/878b2a1c368242a7ad1813ba39917016/users/ff66ecf62a2c43a693c7ae8bbab85f4c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:11.951385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402c568-e521-40be-81fa-107280cdc141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878b2a1c368242a7ad1813ba39917016, user_id=ff66ecf62a2c43a693c7ae8bbab85f4c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:11.954480 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4025/8032] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:11 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:11.958168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:11.961613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402c568-e521-40be-81fa-107280cdc141 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:11.999347 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4008/8033] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:11 2022] PUT /identity/v3/projects/878b2a1c368242a7ad1813ba39917016/users/ff66ecf62a2c43a693c7ae8bbab85f4c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:12.011984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6f9d-8b01-4410-a926-fd2797f50af5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.012276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6f9d-8b01-4410-a926-fd2797f50af5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.012616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6f9d-8b01-4410-a926-fd2797f50af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.117721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cb1d6f9d-8b01-4410-a926-fd2797f50af5 None None] MFA Rules not processed for user `ff66ecf62a2c43a693c7ae8bbab85f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:12.119151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cb1d6f9d-8b01-4410-a926-fd2797f50af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:12.135731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:12.172486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aca970-09d8-46be-9ebe-6ac82487e7b2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.322022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.323051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.323530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.324029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.325174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:12.327584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:12.330679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:12.348046 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4009/8034] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:12.356753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d6f9d-8b01-4410-a926-fd2797f50af5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:12.376218 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4026/8035] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:11 2022] POST /identity/v3/users => generated 287 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:12.376473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d6f9d-8b01-4410-a926-fd2797f50af5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.380062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.381007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.381501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.381909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.382807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:12.386341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:12.397288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:12.417065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88465e73-4bdc-47a5-a662-595d34359f39 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.430747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.431518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.431834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.431935 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4010/8036] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:12 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:12.433766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.434546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:12.438017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:12.442315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:12.474980 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4027/8037] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:12.475915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:12.507915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68982793-7cf2-43c5-a87a-f505fdd56672 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.609827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e0910-5601-4ce7-b8f9-7089dbfd17e3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.624195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.625195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.625507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.625850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.628225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:12.631278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:12.664621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.666916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.672103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.672547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.673509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:12.678993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:12.681850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4011/8038] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:12 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:12.686875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:12.709116 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4028/8039] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:12.713190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:12.722045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627af23-a8f6-4760-908f-6af5a8a8ab7e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.727882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed3c03-9adc-4130-8d04-4e223c44bbec admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.733744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.733917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431c18a-5787-4c5f-8c0b-07df42968f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.736149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.736292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431c18a-5787-4c5f-8c0b-07df42968f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.736493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431c18a-5787-4c5f-8c0b-07df42968f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.736778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431c18a-5787-4c5f-8c0b-07df42968f23 admin admin] PATH_INFO: `/v3/projects/3a5b3f2dd8f24dc6a8c76e83a8b49feb/users/9b990ed2963d46c9919b5b4fc1867c5a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.736917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.737226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.738254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:12.740422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:12.760101 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4012/8040] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:12.761894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:12.762258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431c18a-5787-4c5f-8c0b-07df42968f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5b3f2dd8f24dc6a8c76e83a8b49feb, user_id=9b990ed2963d46c9919b5b4fc1867c5a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:12.766586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431c18a-5787-4c5f-8c0b-07df42968f23 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:12.781592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7678e1-2d81-47ec-8adb-94c5454c0ddb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:12.796399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4029/8041] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:12 2022] PUT /identity/v3/projects/3a5b3f2dd8f24dc6a8c76e83a8b49feb/users/9b990ed2963d46c9919b5b4fc1867c5a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:12.816259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.817012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.817792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:12.892111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] MFA Rules not processed for user `9b990ed2963d46c9919b5b4fc1867c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:12.896663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:12.980449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:12.980989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:12.984026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:12.984443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:12.984795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] PATH_INFO: `/v3/projects/580a1714a55b40a3a67a6d008d3529ce/users/384f61457a6c42029f60a249f7f35290/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.037640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=580a1714a55b40a3a67a6d008d3529ce, user_id=384f61457a6c42029f60a249f7f35290, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:13.043036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:13.079145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4013/8042] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:12 2022] PUT /identity/v3/projects/580a1714a55b40a3a67a6d008d3529ce/users/384f61457a6c42029f60a249f7f35290/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:13.083724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:13.092566 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4030/8043] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:13.108640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:13.112421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:13.207906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:13.214014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d13b14-a655-4df6-a079-ebfb822e3740 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:13.269008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea8f16-2b23-4482-9b29-7877cc7d2d6a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:13.299705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:13.300687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.301808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.302315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.304705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:13.307161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:13.337093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4014/8044] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:13.339464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:13.350006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:13.350822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.354257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.354637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.358062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605796ae-b480-4022-9acb-a425f9b3556b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:13.363406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cd669-7929-4367-8a01-43eee77235e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:13.364480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd669-7929-4367-8a01-43eee77235e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.364901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd669-7929-4367-8a01-43eee77235e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.365309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cd669-7929-4367-8a01-43eee77235e3 admin admin] PATH_INFO: `/v3/projects/580a1714a55b40a3a67a6d008d3529ce/users/384f61457a6c42029f60a249f7f35290/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.367757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd669-7929-4367-8a01-43eee77235e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580a1714a55b40a3a67a6d008d3529ce, user_id=384f61457a6c42029f60a249f7f35290, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:13.370650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cd669-7929-4367-8a01-43eee77235e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:13.383358 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4015/8045] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:13 2022] PUT /identity/v3/projects/580a1714a55b40a3a67a6d008d3529ce/users/384f61457a6c42029f60a249f7f35290/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:13.393845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988cdbb-0bda-4413-991f-49861714ee21 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.394267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988cdbb-0bda-4413-991f-49861714ee21 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.394656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988cdbb-0bda-4413-991f-49861714ee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.437139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0988cdbb-0bda-4413-991f-49861714ee21 None None] MFA Rules not processed for user `384f61457a6c42029f60a249f7f35290`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:13.438721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0988cdbb-0bda-4413-991f-49861714ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:13.457710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:13.459860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:13.491331 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4031/8046] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:13.516062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:13.533080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f1c1-b37d-427f-af1f-447bd858dd99 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:13.574710 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4016/8047] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:13.578659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988cdbb-0bda-4413-991f-49861714ee21 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:13.593894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988cdbb-0bda-4413-991f-49861714ee21 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:13.603986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:13.605006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.605728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.605728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.606450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:13.608556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:13.608710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:13.651691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:13.652697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.652952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.653352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] PATH_INFO: `/v3/users/9b990ed2963d46c9919b5b4fc1867c5a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.654666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b990ed2963d46c9919b5b4fc1867c5a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:13.656804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:13.680567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4017/8048] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:13 2022] POST /identity/v3/projects => generated 359 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:13.686456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:13.815354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b990ed2963d46c9919b5b4fc1867c5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:13.816038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b990ed2963d46c9919b5b4fc1867c5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:13.841649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b990ed2963d46c9919b5b4fc1867c5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:13.852811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b990ed2963d46c9919b5b4fc1867c5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:13.855531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdecba-68a2-41e9-8098-876f6e79033a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:13.862565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:13.863535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.864360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.864946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.866160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:13.868726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:13.871968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-9330062a-4b52-4da6-bc9b-5f44ef491ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b990ed2963d46c9919b5b4fc1867c5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:13.910638 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4032/8049] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:13 2022] DELETE /identity/v3/users/9b990ed2963d46c9919b5b4fc1867c5a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:13.915820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:13.916297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:13.916743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:13.924216 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4018/8050] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:13 2022] POST /identity/v3/users => generated 371 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:13.928910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:13.934084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:13.948057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:13.949708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:13.969872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc0b2-8f91-4d5c-badc-f87477c965aa tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:13.996057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:14.056314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4033/8051] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:14.068884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:14.072443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:14.140139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:14.142113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:14.142391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:14.142677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/70cd5994e26c4b6ca7c271103b0778ed` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:14.166765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:get_user(user_id=70cd5994e26c4b6ca7c271103b0778ed)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:14.170229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:14.173534 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4019/8052] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:32:13 2022] GET /identity/v3/users/70cd5994e26c4b6ca7c271103b0778ed => generated 371 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:14.177161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:14.211331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69703074-9367-474d-9672-2461a7de2d98 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:14.221479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:14.223152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:14.223475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:14.223897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/70cd5994e26c4b6ca7c271103b0778ed` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:14.225845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_user(user_id=70cd5994e26c4b6ca7c271103b0778ed)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:14.228977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:14.254428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cbd74-d4f1-4c59-b2f5-24d3838dd959 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:14.277390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:14.280798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:14.281907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:14.282230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:14.305561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:14.311835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cd5994e26c4b6ca7c271103b0778ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.312679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:14.313421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cd5994e26c4b6ca7c271103b0778ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.348813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cd5994e26c4b6ca7c271103b0778ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.350145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cd5994e26c4b6ca7c271103b0778ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.363476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cd5994e26c4b6ca7c271103b0778ed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.366135 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4034/8053] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:14.395386 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4020/8054] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:14 2022] DELETE /identity/v3/users/70cd5994e26c4b6ca7c271103b0778ed => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:14.399813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:14.409955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:14.420257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d942d-aeab-45ee-a928-aee205e4b2cb service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:14.559403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:14.561163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:14.561477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:14.562963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/354c56e02f734c559c5d2e8917f6dc58` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:14.565855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=354c56e02f734c559c5d2e8917f6dc58)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:14.568113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:14.664043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354c56e02f734c559c5d2e8917f6dc58', 'request_id': 'req-b8b190e9-33df-43be-b4e1-b5229d66c60e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.678492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354c56e02f734c559c5d2e8917f6dc58', 'request_id': 'req-b8b190e9-33df-43be-b4e1-b5229d66c60e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.693758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354c56e02f734c559c5d2e8917f6dc58', 'request_id': 'req-b8b190e9-33df-43be-b4e1-b5229d66c60e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.722834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] The token cache is being invalidate because project 354c56e02f734c559c5d2e8917f6dc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:14.723681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.726283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:14.726939 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4035/8055] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:14 2022] DELETE /identity/v3/projects/354c56e02f734c559c5d2e8917f6dc58 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:14.731856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:14.733385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:14.752309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eae74d-b815-4701-8eda-d7709f9560eb tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:14.851362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:14.852216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:14.852575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:14.852993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:14.854928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:14.857298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:14.928642 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4021/8056] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:14 2022] POST /identity/v3/projects => generated 358 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:14.934695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:14.936447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:14.957775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b190e9-33df-43be-b4e1-b5229d66c60e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.011373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.013796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:15.050075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:15.157212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.158435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.158930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.160046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.162622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.169493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.197542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1443b-3fe6-4336-8e52-9fd51702367f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.220979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.222096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.222626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.222963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] PATH_INFO: `/v3/projects/3a5b3f2dd8f24dc6a8c76e83a8b49feb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.224364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5b3f2dd8f24dc6a8c76e83a8b49feb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.226898 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4036/8057] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:14 2022] POST /identity/v3/users => generated 414 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:15.227345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.228390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.267387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf304e7b-41ab-4fff-b704-ac7a0ba6c7b2 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.274447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.275983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.276483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.277002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.278447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.285005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.315927 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4037/8058] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:32:15 2022] POST /identity/v3/roles => generated 238 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:15.318207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.331910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5b3f2dd8f24dc6a8c76e83a8b49feb', 'request_id': 'req-b9ba905e-7093-44df-ab19-0aae062535e3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:15.335056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c316-888b-4d0c-a5c1-edae054e3de4 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.341736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5b3f2dd8f24dc6a8c76e83a8b49feb', 'request_id': 'req-b9ba905e-7093-44df-ab19-0aae062535e3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:15.351361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:15.359798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5b3f2dd8f24dc6a8c76e83a8b49feb', 'request_id': 'req-b9ba905e-7093-44df-ab19-0aae062535e3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:15.379631 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] The token cache is being invalidate because project 3a5b3f2dd8f24dc6a8c76e83a8b49feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:15.380161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:15.381086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b9ba905e-7093-44df-ab19-0aae062535e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:15.383998 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4022/8059] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:15 2022] DELETE /identity/v3/projects/3a5b3f2dd8f24dc6a8c76e83a8b49feb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:15.398388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4c488-00ac-4aa9-8422-4f3fa9967938 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.398827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4c488-00ac-4aa9-8422-4f3fa9967938 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.399120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4c488-00ac-4aa9-8422-4f3fa9967938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.436846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-bbf4c488-00ac-4aa9-8422-4f3fa9967938 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:15.438394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bbf4c488-00ac-4aa9-8422-4f3fa9967938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:15.443631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.444744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.445163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.445451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/2953bae249964d01bd455421bff62142` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.492534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:get_user(user_id=2953bae249964d01bd455421bff62142)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.496236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.501089 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4038/8060] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:32:15 2022] GET /identity/v3/users/2953bae249964d01bd455421bff62142 => generated 414 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:15.503577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.507756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:15.528294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aef42d-5129-4670-9007-3443dc605120 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.540513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.542516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.542953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.543247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.546153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:get_role(role_id=b2fabcbe5c394b0fb27e4b8639fe2b6b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.547514 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:32:15.547514 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:32:15.547514 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:32:15.549013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.551173 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4039/8062] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:32:15 2022] GET /identity/v3/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b => generated 238 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:15.554618 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4023/8062] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:15.555769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.566067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871f19-9012-4c22-99c8-1755d86eddb1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.566986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871f19-9012-4c22-99c8-1755d86eddb1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.567495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871f19-9012-4c22-99c8-1755d86eddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.570028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c2b94-e762-4c81-8b58-044f6ec09062 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.576538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.577301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.577573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.577858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.578656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.580577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.606679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-61871f19-9012-4c22-99c8-1755d86eddb1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:15.609393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-61871f19-9012-4c22-99c8-1755d86eddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:15.634899 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4024/8063] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:15.635110 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4040/8064] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:15 2022] POST /identity/v3/projects => generated 359 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:15.635201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871f19-9012-4c22-99c8-1755d86eddb1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.636688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.655620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871f19-9012-4c22-99c8-1755d86eddb1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.702242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:15.717307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c0bea-1952-44d0-a043-90f79752781d tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.724591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.725522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.725903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.726232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.727467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:15.727467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.729588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.748503 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4041/8065] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:32:15.748712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.749483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.749796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.750891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.751272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/df116e36cab04b25b8aa5e167bf919a3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.752739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:get_project(project_id=df116e36cab04b25b8aa5e167bf919a3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.756080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.760979 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4025/8066] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:32:15 2022] GET /identity/v3/projects/df116e36cab04b25b8aa5e167bf919a3 => generated 359 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:15.761210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084417b1-b70d-4e9b-9968-5949299f20fb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.762942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.766249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.766958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.767212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.767494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.768207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.770525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.775190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5b377-bcbd-4a51-8de1-74a0a739cc89 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.780643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.781829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.782073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.782910 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/df116e36cab04b25b8aa5e167bf919a3/users/2953bae249964d01bd455421bff62142/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.785588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df116e36cab04b25b8aa5e167bf919a3, user_id=2953bae249964d01bd455421bff62142, role_id=b2fabcbe5c394b0fb27e4b8639fe2b6b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.788423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:15.801814 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4042/8067] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:15 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:15.806691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.817308 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4026/8068] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:15 2022] PUT /identity/v3/projects/df116e36cab04b25b8aa5e167bf919a3/users/2953bae249964d01bd455421bff62142/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:15.818533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:15.881140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:15.920319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572d190-c65e-4ed0-8b18-ec4f2375ff8f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.925440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07159c4-fe65-4b91-aaef-a381e0becea4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:15.933664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:15.934809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:15.935709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:15.936299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:15.967771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:15.967771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.056786 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4043/8069] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:15 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:16.061320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.072995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.074268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.074826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.075089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.075977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.078056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.085497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3afd5c-4400-4260-adeb-8c1b82bfe443 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.096788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.098647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.099891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.100349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.101309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.103303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.122028 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4044/8070] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:16 2022] GET /identity/v3/roles => generated 1649 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:16.132159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.140854 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4027/8071] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:15 2022] POST /identity/v3/projects => generated 360 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:16.142608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.149410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f40e8e-d15f-4f9d-a2a8-ed4a40c3df50 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.223514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:16.248156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.249105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.249853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.250131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.250951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.252880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.255896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e0fd1-7f7e-4c32-a133-c6294634ec03 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.263243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.264634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.264919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.265225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/bd34b2e95a9f4a8dba559b768f1c80a4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.267203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd34b2e95a9f4a8dba559b768f1c80a4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.270469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.278070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4028/8072] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:32:16 2022] GET /identity/v3/projects/bd34b2e95a9f4a8dba559b768f1c80a4 => generated 360 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:32:16.279349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.297067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723c21a-0eac-4512-9adc-2d4eb9dedebd tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.299925 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4045/8073] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:16 2022] GET /identity/v3/roles => generated 1649 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:16.300975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.303911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.305094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.305677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.306160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/bd34b2e95a9f4a8dba559b768f1c80a4/users/2953bae249964d01bd455421bff62142/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.309731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd34b2e95a9f4a8dba559b768f1c80a4, user_id=2953bae249964d01bd455421bff62142, role_id=b2fabcbe5c394b0fb27e4b8639fe2b6b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.313461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.314130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e40b3-0318-4841-8d93-a2a85dea3819 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.320838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd30577-b185-4a5d-bcc5-c200d96fc5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.322578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30577-b185-4a5d-bcc5-c200d96fc5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.322945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30577-b185-4a5d-bcc5-c200d96fc5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.323303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd30577-b185-4a5d-bcc5-c200d96fc5b8 admin admin] PATH_INFO: `/v3/projects/1bf51848ad1c43ae997974ba2925ab4e/users/f228d958acdb4d769a59f019e4d41d6c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.339133 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4029/8074] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:16 2022] PUT /identity/v3/projects/bd34b2e95a9f4a8dba559b768f1c80a4/users/2953bae249964d01bd455421bff62142/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:16.343089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.354538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30577-b185-4a5d-bcc5-c200d96fc5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf51848ad1c43ae997974ba2925ab4e, user_id=f228d958acdb4d769a59f019e4d41d6c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.357848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd30577-b185-4a5d-bcc5-c200d96fc5b8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.376262 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4046/8075] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:16 2022] PUT /identity/v3/projects/1bf51848ad1c43ae997974ba2925ab4e/users/f228d958acdb4d769a59f019e4d41d6c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:16.381664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.382015 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.382299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.406764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:16.408951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:16.421981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1843-df6d-40ed-a902-13932d85b22e tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.545408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4047/8076] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:16.557075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.561170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:16.586184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.586184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.586184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.586525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/2953bae249964d01bd455421bff62142/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.586525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=2953bae249964d01bd455421bff62142)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.586525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.632774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:16.657093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4030/8077] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:32:16 2022] GET /identity/v3/users/2953bae249964d01bd455421bff62142/projects => generated 843 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:16.660779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:16.673709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c9769-dda5-4430-9239-ff6335782a1e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.680112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.681017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.681343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.681651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.702579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244d83e-3c26-430a-a972-f7b5ac988621 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:16.722119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.723204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:16.724975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.729797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:16.729797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:16.729797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/bd34b2e95a9f4a8dba559b768f1c80a4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:16.732207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd34b2e95a9f4a8dba559b768f1c80a4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:16.741797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:16.769185 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4048/8078] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:16.911930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd34b2e95a9f4a8dba559b768f1c80a4', 'request_id': 'req-a341bda9-fe94-4046-b1a9-071e0d50e323'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:16.917324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:16.928384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd34b2e95a9f4a8dba559b768f1c80a4', 'request_id': 'req-a341bda9-fe94-4046-b1a9-071e0d50e323'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:16.956843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd34b2e95a9f4a8dba559b768f1c80a4', 'request_id': 'req-a341bda9-fe94-4046-b1a9-071e0d50e323'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:16.981585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] The token cache is being invalidate because project bd34b2e95a9f4a8dba559b768f1c80a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:16.981727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:16.983169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:16.989027 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4031/8079] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:16 2022] DELETE /identity/v3/projects/bd34b2e95a9f4a8dba559b768f1c80a4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:16.990837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:17.009249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2bb58-2c53-4367-9cf1-8d474652fd23 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:17.119371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:17.120331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:17.121340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:17.121709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/df116e36cab04b25b8aa5e167bf919a3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:17.123666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df116e36cab04b25b8aa5e167bf919a3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:17.127210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:17.271598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df116e36cab04b25b8aa5e167bf919a3', 'request_id': 'req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:17.309520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df116e36cab04b25b8aa5e167bf919a3', 'request_id': 'req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:17.332188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df116e36cab04b25b8aa5e167bf919a3', 'request_id': 'req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:17.359792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] The token cache is being invalidate because project df116e36cab04b25b8aa5e167bf919a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:17.360099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:17.360908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:17.362784 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4049/8080] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:16 2022] DELETE /identity/v3/projects/df116e36cab04b25b8aa5e167bf919a3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:17.367962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:17.369811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:17.389931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341bda9-fe94-4046-b1a9-071e0d50e323 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:17.494717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:17.494948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:17.495044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:17.495514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:17.497119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b2fabcbe5c394b0fb27e4b8639fe2b6b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:17.502204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:17.615291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invalidating the token cache because role b2fabcbe5c394b0fb27e4b8639fe2b6b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:17.615870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:17.616864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:17.619308 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4032/8081] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:17 2022] DELETE /identity/v3/roles/b2fabcbe5c394b0fb27e4b8639fe2b6b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:17.629822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:17.632150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:17.670974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e39a3-2d3c-4e7a-97a2-74aa1fe5f46c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:17.871416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:17.882417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:17.883616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:17.884870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/2953bae249964d01bd455421bff62142` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:17.889244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2953bae249964d01bd455421bff62142)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:17.897146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:17.944869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:18.069307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2953bae249964d01bd455421bff62142'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.072161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2953bae249964d01bd455421bff62142'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.118891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2953bae249964d01bd455421bff62142'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.125521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2953bae249964d01bd455421bff62142'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.152340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2953bae249964d01bd455421bff62142'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.189190 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4050/8082] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:17 2022] DELETE /identity/v3/users/2953bae249964d01bd455421bff62142 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:18.194545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:18.196365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:18.211006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b946b6-f2d4-488e-845c-dddd170cb015 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:18.290482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:18.291312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:18.291594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:18.291871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/1737860160af4d7bbabffcaadf0a8ad3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:18.294537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1737860160af4d7bbabffcaadf0a8ad3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:18.298144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:18.444692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:18.447964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1737860160af4d7bbabffcaadf0a8ad3', 'request_id': 'req-00e905de-2d3d-4704-be2d-c88325177bf6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.478918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1737860160af4d7bbabffcaadf0a8ad3', 'request_id': 'req-00e905de-2d3d-4704-be2d-c88325177bf6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.501242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1737860160af4d7bbabffcaadf0a8ad3', 'request_id': 'req-00e905de-2d3d-4704-be2d-c88325177bf6'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.555977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] The token cache is being invalidate because project 1737860160af4d7bbabffcaadf0a8ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:18.556430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.558753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-00e905de-2d3d-4704-be2d-c88325177bf6 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.564863 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4033/8083] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:18 2022] DELETE /identity/v3/projects/1737860160af4d7bbabffcaadf0a8ad3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:18.570386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:18.573132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:18.605178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821b88d-a049-4f66-bcd6-55feb37a5020 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:18.731384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:18.732400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:18.732738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:18.733045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:18.734655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:update_user(user_id=ff66ecf62a2c43a693c7ae8bbab85f4c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:18.736068 ncdv-master-1 devstack@keystone.service[91205]: WARNING py.warnings [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:32:18.736068 ncdv-master-1 devstack@keystone.service[91205]: warnings.warn(msg) Jun 18 22:32:18.736068 ncdv-master-1 devstack@keystone.service[91205]: Jun 18 22:32:18.737502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:18.838636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.856698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invalidating the token cache because user ff66ecf62a2c43a693c7ae8bbab85f4c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:18.857002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.857654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:18.859891 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4051/8084] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Jun 18 22:32:18 2022] PATCH /identity/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c => generated 297 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:18.866340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcac0f-5824-4cd5-a76f-01e2fb24c00c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:18.866772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcac0f-5824-4cd5-a76f-01e2fb24c00c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:18.867254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcac0f-5824-4cd5-a76f-01e2fb24c00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:18.980684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-41dcac0f-5824-4cd5-a76f-01e2fb24c00c None None] MFA Rules not processed for user `ff66ecf62a2c43a693c7ae8bbab85f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:18.987747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-41dcac0f-5824-4cd5-a76f-01e2fb24c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:18.998736 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4034/8085] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:18 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:32:19.004536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:19.006296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:19.031051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace3aa3-f213-4530-aa7d-daf72bb5183a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:19.038374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:19.040090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:19.040422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:19.040750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:19.043168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:update_user(user_id=ff66ecf62a2c43a693c7ae8bbab85f4c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:19.045463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:19.201856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.225273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invalidating the token cache because user ff66ecf62a2c43a693c7ae8bbab85f4c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:19.225723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.227954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-034a74d4-2af6-4cb2-84ae-9fb19c27665f tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.230760 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4052/8086] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Jun 18 22:32:19 2022] PATCH /identity/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:19.235812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcac0f-5824-4cd5-a76f-01e2fb24c00c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:19.267588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcac0f-5824-4cd5-a76f-01e2fb24c00c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:19.286318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:19.289300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:19.289521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:19.293284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:19.332873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:update_user(user_id=ff66ecf62a2c43a693c7ae8bbab85f4c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:19.341840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:19.438296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.452031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invalidating the token cache because user ff66ecf62a2c43a693c7ae8bbab85f4c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:19.452570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.453523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.456530 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4035/8087] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Jun 18 22:32:19 2022] PATCH /identity/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:19.460877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc927-c882-4b96-85b4-494319559d12 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:19.461364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc927-c882-4b96-85b4-494319559d12 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:19.461495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc927-c882-4b96-85b4-494319559d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:19.559609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8a4fc927-c882-4b96-85b4-494319559d12 None None] MFA Rules not processed for user `ff66ecf62a2c43a693c7ae8bbab85f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:19.565540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8a4fc927-c882-4b96-85b4-494319559d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:19.577900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:19.578384 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4053/8088] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:19 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:32:19.588652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:19.628288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7ac36-fade-4eba-b597-a867652f6c8c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:19.660709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:19.664847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:19.673923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:19.674791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:19.679108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:update_user(user_id=ff66ecf62a2c43a693c7ae8bbab85f4c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:19.685170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:19.774325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.815070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invalidating the token cache because user ff66ecf62a2c43a693c7ae8bbab85f4c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:19.815824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.817845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:19.825852 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4036/8089] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Jun 18 22:32:19 2022] PATCH /identity/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:19.829303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc927-c882-4b96-85b4-494319559d12 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:19.851057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc927-c882-4b96-85b4-494319559d12 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:19.869544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffedc3-7219-4da4-9e77-a65f3c948306 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:19.870429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffedc3-7219-4da4-9e77-a65f3c948306 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:19.871491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffedc3-7219-4da4-9e77-a65f3c948306 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:19.871812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffedc3-7219-4da4-9e77-a65f3c948306 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:19.872615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffedc3-7219-4da4-9e77-a65f3c948306 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:19.877747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffedc3-7219-4da4-9e77-a65f3c948306 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:19.977479 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4054/8090] 10.222.0.30 () {60 vars in 1142 bytes} [Sat Jun 18 22:32:19 2022] POST /identity/v3/users => generated 265 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:19.987082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:19.989070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:20.027559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd525-8bab-4cbb-b22e-d8c40ba6f64c tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:20.041602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78a062-5fb4-47d5-821e-e262a32fe1ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:20.049737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a062-5fb4-47d5-821e-e262a32fe1ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:20.050274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a062-5fb4-47d5-821e-e262a32fe1ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:20.050838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78a062-5fb4-47d5-821e-e262a32fe1ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/63fb0d3393ae4e1dbbe8dcda533c1470/password` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:20.214603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da78a062-5fb4-47d5-821e-e262a32fe1ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '63fb0d3393ae4e1dbbe8dcda533c1470'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:20.239269 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4037/8091] 10.222.0.30 () {60 vars in 1268 bytes} [Sat Jun 18 22:32:19 2022] POST /identity/v3/users/63fb0d3393ae4e1dbbe8dcda533c1470/password => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:21.246321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42af63-c35d-46ec-8def-96310de49931 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:21.247006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42af63-c35d-46ec-8def-96310de49931 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:21.247320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42af63-c35d-46ec-8def-96310de49931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:21.254247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=79,keystone:DELETE=11,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:21.292437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-bd42af63-c35d-46ec-8def-96310de49931 None None] MFA Rules not processed for user `63fb0d3393ae4e1dbbe8dcda533c1470`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:21.297127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bd42af63-c35d-46ec-8def-96310de49931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:21.311755 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4055/8092] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:21 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 18 22:32:21.313572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78a062-5fb4-47d5-821e-e262a32fe1ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:21.330490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78a062-5fb4-47d5-821e-e262a32fe1ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:21.347042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:21.347944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:21.348078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:21.348272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:21.366762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:21.369136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:21.389497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42af63-c35d-46ec-8def-96310de49931 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:21.392297 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4038/8093] 10.222.0.30 () {56 vars in 1262 bytes} [Sat Jun 18 22:32:21 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 18 22:32:21.410310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42af63-c35d-46ec-8def-96310de49931 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:21.421975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:21.422976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:21.423331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:21.423612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/63fb0d3393ae4e1dbbe8dcda533c1470` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:21.427700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_user(user_id=63fb0d3393ae4e1dbbe8dcda533c1470)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:21.437378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:21.512585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fb0d3393ae4e1dbbe8dcda533c1470'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:21.514671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fb0d3393ae4e1dbbe8dcda533c1470'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:21.546386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fb0d3393ae4e1dbbe8dcda533c1470'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:21.547336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fb0d3393ae4e1dbbe8dcda533c1470'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:21.565173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fb0d3393ae4e1dbbe8dcda533c1470'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:21.594282 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4056/8094] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:21 2022] DELETE /identity/v3/users/63fb0d3393ae4e1dbbe8dcda533c1470 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:21.599644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:21.617684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4f16-a4a0-427b-8a63-b35daf004982 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:21.699596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=82,keystone:INSERT=7,keystone:DELETE=8,keystone:UPDATE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:21.776964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:21.778416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:21.778714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:21.779081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:21.779872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:21.782923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:21.840567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4039/8095] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:21 2022] POST /identity/v3/users => generated 364 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:21.840938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:21.845492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:21.888133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59913695-2267-4a48-9949-af38999616ca tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:21.900482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:21.901811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:21.904363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:21.904655 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:21.905616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:21.915016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:22.016453 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4057/8096] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:21 2022] POST /identity/v3/projects => generated 360 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:22.020962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:22.072176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72ad9b-2314-4f89-8c2f-ff2e7f72d184 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:22.201296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:22.203166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:22.203740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:22.203932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/5e9b857f3f8543929c7b83807c541858` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:22.237137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:update_user(user_id=5e9b857f3f8543929c7b83807c541858)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:22.239805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:22.298934 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4040/8097] 10.222.0.30 () {60 vars in 1243 bytes} [Sat Jun 18 22:32:22 2022] PATCH /identity/v3/users/5e9b857f3f8543929c7b83807c541858 => generated 522 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:22.302904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:22.326319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a751dbd-a97b-4f6b-a120-ac58c5e9fc61 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:22.336143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:22.337535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:22.338450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:22.339005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/5e9b857f3f8543929c7b83807c541858` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:22.374228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:get_user(user_id=5e9b857f3f8543929c7b83807c541858)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:22.379898 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:22.386471 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4058/8098] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:32:22 2022] GET /identity/v3/users/5e9b857f3f8543929c7b83807c541858 => generated 389 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:22.388595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:22.402669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567815e-176a-451e-8149-92edc157d693 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:22.411857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:22.413570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:22.413895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:22.414145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/projects/10107b2f934641c9a7ff9815d57c367e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:22.416694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10107b2f934641c9a7ff9815d57c367e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:22.418959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:22.511553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10107b2f934641c9a7ff9815d57c367e', 'request_id': 'req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.520553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10107b2f934641c9a7ff9815d57c367e', 'request_id': 'req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.535266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10107b2f934641c9a7ff9815d57c367e', 'request_id': 'req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.557097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] The token cache is being invalidate because project 10107b2f934641c9a7ff9815d57c367e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:22.557825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.559278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.562956 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4041/8099] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:22 2022] DELETE /identity/v3/projects/10107b2f934641c9a7ff9815d57c367e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:22.567226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:22.569631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:22.590475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60320dd1-834e-48a2-b567-4697b0bf2010 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:22.713845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '384f61457a6c42029f60a249f7f35290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '580a1714a55b40a3a67a6d008d3529ce', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:22.714972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:22.715131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:22.715420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] PATH_INFO: `/v3/users/5e9b857f3f8543929c7b83807c541858` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:22.716686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5e9b857f3f8543929c7b83807c541858)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:22.719186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:22.776917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:22.797481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9b857f3f8543929c7b83807c541858'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.798312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9b857f3f8543929c7b83807c541858'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.812780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9b857f3f8543929c7b83807c541858'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.814118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9b857f3f8543929c7b83807c541858'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.821615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-760bd83d-6a64-4131-b086-664e7e3aea8a tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9b857f3f8543929c7b83807c541858'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:22.841179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4059/8100] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:22 2022] DELETE /identity/v3/users/5e9b857f3f8543929c7b83807c541858 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:22.842480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:22.844728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:22.880040 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:22.966244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947cb6b-d5d3-4fa9-8e9f-39b77ef69cf8 tempest-UsersV3TestJSON-1186751376 tempest-UsersV3TestJSON-1186751376-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:23.100210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:23.101229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:23.101819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:23.101956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] PATH_INFO: `/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:23.125366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff66ecf62a2c43a693c7ae8bbab85f4c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:23.128658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:23.263797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:23.266394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:23.315054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:23.317331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:23.341862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff66ecf62a2c43a693c7ae8bbab85f4c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:23.389348 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4042/8101] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:22 2022] DELETE /identity/v3/users/ff66ecf62a2c43a693c7ae8bbab85f4c => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:23.394220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:23.395039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:23.395511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:23.421699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:23.423759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:23.550121 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4060/8102] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:23.568606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:23.570482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:23.675674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:23.725315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d3396-a645-4035-9eb3-ce78ab5ca6e8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:23.745177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:23.746103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:23.746341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:23.746695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:23.775143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:23.776774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:23.804965 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4043/8103] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:24.923154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:24.924801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:24.947093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f1dfd-ddf7-42dc-a84a-8ea9addcf1c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:24.978231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:24.983132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:24.984365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:24.985236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] PATH_INFO: `/v3/projects/878b2a1c368242a7ad1813ba39917016` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:24.990616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=878b2a1c368242a7ad1813ba39917016)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:24.995238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:25.149878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878b2a1c368242a7ad1813ba39917016', 'request_id': 'req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.166034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878b2a1c368242a7ad1813ba39917016', 'request_id': 'req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.186171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878b2a1c368242a7ad1813ba39917016', 'request_id': 'req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.223029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] The token cache is being invalidate because project 878b2a1c368242a7ad1813ba39917016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:25.223610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.224707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a63295b-9c02-4ce6-898d-1c6fdfc28c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.230083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4061/8104] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:24 2022] DELETE /identity/v3/projects/878b2a1c368242a7ad1813ba39917016 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:25.231014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:25.246411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c798ac-ee1f-4c53-bcdc-51167c30eac6 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:25.421395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:25.422995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:25.423561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:25.424032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] PATH_INFO: `/v3/users/384f61457a6c42029f60a249f7f35290` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:25.425610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] RBAC: Authorizing `identity:delete_user(user_id=384f61457a6c42029f60a249f7f35290)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:25.437241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:25.565729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384f61457a6c42029f60a249f7f35290'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.566718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384f61457a6c42029f60a249f7f35290'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.613471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384f61457a6c42029f60a249f7f35290'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.614370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384f61457a6c42029f60a249f7f35290'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.634153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384f61457a6c42029f60a249f7f35290'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:25.665917 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4044/8105] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:25 2022] DELETE /identity/v3/users/384f61457a6c42029f60a249f7f35290 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:25.975998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617c01a-c29f-426f-b7d0-2af4ca416d4f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:25.976874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617c01a-c29f-426f-b7d0-2af4ca416d4f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:25.977354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617c01a-c29f-426f-b7d0-2af4ca416d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:26.042402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2617c01a-c29f-426f-b7d0-2af4ca416d4f None None] MFA Rules not processed for user `f228d958acdb4d769a59f019e4d41d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:26.044654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2617c01a-c29f-426f-b7d0-2af4ca416d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:26.085807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:26.210528 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4062/8106] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:26.217288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:26.219169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:26.380134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7f7be-e2c0-42ec-b3ac-d0aa48e7361d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:26.395220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:26.395601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:26.396057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:26.396472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:26.397346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:26.399630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:26.408325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:26.517855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617c01a-c29f-426f-b7d0-2af4ca416d4f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:26.530759 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4045/8107] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:26.532891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:26.539268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:26.549501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617c01a-c29f-426f-b7d0-2af4ca416d4f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:26.821868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:26.822597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:26.826317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:26.827496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:26.831398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912fcd3-5878-4909-97e1-efad68e27fc5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:26.834373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:26.836832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:26.867681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:26.869106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:26.869477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:26.869844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] PATH_INFO: `/v3/projects/580a1714a55b40a3a67a6d008d3529ce` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:26.873128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=580a1714a55b40a3a67a6d008d3529ce)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:26.876642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:26.908527 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4063/8108] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:26 2022] POST /identity/v3/users => generated 293 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:26.912730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:26.930491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d7230-6505-45d4-9b90-da7f61c31d17 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:26.945633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:26.969645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:26.970367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:26.972104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:26.974393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:26.990267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:27.010847 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4064/8109] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:27.015196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:27.044707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580a1714a55b40a3a67a6d008d3529ce', 'request_id': 'req-4e530af5-deff-445c-86a1-fa404388d034'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:27.060653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386ef2-2091-402e-be17-884a6af484cf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:27.068211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580a1714a55b40a3a67a6d008d3529ce', 'request_id': 'req-4e530af5-deff-445c-86a1-fa404388d034'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:27.115284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580a1714a55b40a3a67a6d008d3529ce', 'request_id': 'req-4e530af5-deff-445c-86a1-fa404388d034'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:27.166397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] The token cache is being invalidate because project 580a1714a55b40a3a67a6d008d3529ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:27.166658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:27.169432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4e530af5-deff-445c-86a1-fa404388d034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:27.177839 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4046/8110] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:26 2022] DELETE /identity/v3/projects/580a1714a55b40a3a67a6d008d3529ce => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:27.180276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a74929-eca1-498d-a97c-7a234fa340b4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:27.180527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a74929-eca1-498d-a97c-7a234fa340b4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:27.180796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a74929-eca1-498d-a97c-7a234fa340b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:27.282417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f7a74929-eca1-498d-a97c-7a234fa340b4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:27.284713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f7a74929-eca1-498d-a97c-7a234fa340b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:27.308410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:27.312813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:27.313198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:27.313410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] PATH_INFO: `/v3/projects/445a0d0d5cc146cea23c952253106bd7/users/29193876d78148f8ba44ce9d40f691c0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:27.371386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445a0d0d5cc146cea23c952253106bd7, user_id=29193876d78148f8ba44ce9d40f691c0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:27.374810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:27.453355 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4065/8111] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:27 2022] PUT /identity/v3/projects/445a0d0d5cc146cea23c952253106bd7/users/29193876d78148f8ba44ce9d40f691c0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:27.458506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:27.467697 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4047/8112] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:27.472278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:27.595430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be340-44fd-41aa-91c9-e8dc7dd730b6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:27.595744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be340-44fd-41aa-91c9-e8dc7dd730b6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:27.596053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1be340-44fd-41aa-91c9-e8dc7dd730b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:27.613216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:27.628374 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ee1be340-44fd-41aa-91c9-e8dc7dd730b6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:27.632154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ee1be340-44fd-41aa-91c9-e8dc7dd730b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:27.736403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:27.800501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a60f22-75e0-4799-b19c-06470e7d9610 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:27.813319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:27.814569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:27.815283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:27.817374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:27.818442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:27.820365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:27.855972 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4066/8113] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:27.857889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:27.922097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55f8bb-5185-42d8-b1a2-85617bcb20e9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:27.928270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:27.929618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:27.930121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:27.930608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] PATH_INFO: `/v3/projects/445a0d0d5cc146cea23c952253106bd7/users/29193876d78148f8ba44ce9d40f691c0/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:27.933479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] RBAC: Authorizing `identity:create_grant(project_id=445a0d0d5cc146cea23c952253106bd7, user_id=29193876d78148f8ba44ce9d40f691c0, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:27.936792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4048/8114] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:27.937702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:27.938275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1be340-44fd-41aa-91c9-e8dc7dd730b6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:27.978013 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4067/8115] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:27 2022] PUT /identity/v3/projects/445a0d0d5cc146cea23c952253106bd7/users/29193876d78148f8ba44ce9d40f691c0/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:27.999117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1be340-44fd-41aa-91c9-e8dc7dd730b6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:28.240972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:28.241926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:28.242329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:28.242711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:28.243693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:28.244150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:28.250560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:28.287340 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4049/8116] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:28.292604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:28.313819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4dbb-8394-4bad-ab19-07319a37183d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:28.328012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:28.329178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:28.329807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:28.330294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:28.338294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:28.340421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:28.478291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:28.479730 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4068/8117] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:28 2022] POST /identity/v3/projects => generated 399 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:28.517120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b62c1-6ab1-46f5-870c-02ebe438151e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:28.730266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:28.731103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:28.735197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:28.735539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:28.736307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:28.740679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:28.815242 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4050/8118] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:28 2022] POST /identity/v3/users => generated 306 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:28.819803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:28.843562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf07f42-6351-4fc2-9311-81a3e44ae89f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:28.853641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:28.854661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:28.855048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:28.855471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:28.856727 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:28.859371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:28.934118 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4069/8119] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:28.935298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:28.957136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ca610-5973-45f9-b36d-bc0e2552f0b9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:28.968258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:28.971844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:28.972137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:28.972437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] PATH_INFO: `/v3/projects/b05b06c03a3d4e6dbaa999f8f161ed4c/users/d60686a155d84e0fa2b45fe2fd4e20ec/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:28.997325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05b06c03a3d4e6dbaa999f8f161ed4c, user_id=d60686a155d84e0fa2b45fe2fd4e20ec, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:29.001908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:29.057095 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4051/8120] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:28 2022] PUT /identity/v3/projects/b05b06c03a3d4e6dbaa999f8f161ed4c/users/d60686a155d84e0fa2b45fe2fd4e20ec/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:29.061668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:29.170958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70a24-9f22-42c1-818a-607841140caa admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:29.437231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ed4c8-afd6-4056-b9e9-73d94b45ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:29.438635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed4c8-afd6-4056-b9e9-73d94b45ac31 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:29.440276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed4c8-afd6-4056-b9e9-73d94b45ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:29.440632 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ed4c8-afd6-4056-b9e9-73d94b45ac31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:29.441775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ed4c8-afd6-4056-b9e9-73d94b45ac31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:29.443661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ed4c8-afd6-4056-b9e9-73d94b45ac31 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:29.497814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:29.498381 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4070/8121] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:29.514142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7dd10-c751-4245-83ef-bcc325123450 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:29.534137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:29.535216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:29.540235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:29.540733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] PATH_INFO: `/v3/projects/b05b06c03a3d4e6dbaa999f8f161ed4c/users/d60686a155d84e0fa2b45fe2fd4e20ec/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:29.555405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05b06c03a3d4e6dbaa999f8f161ed4c, user_id=d60686a155d84e0fa2b45fe2fd4e20ec, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:29.563064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:29.626019 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4052/8122] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:29 2022] PUT /identity/v3/projects/b05b06c03a3d4e6dbaa999f8f161ed4c/users/d60686a155d84e0fa2b45fe2fd4e20ec/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:29.630142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22806b11-7d89-44dd-966f-255feac08e77 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:29.630629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22806b11-7d89-44dd-966f-255feac08e77 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:29.631040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22806b11-7d89-44dd-966f-255feac08e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:29.718784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-22806b11-7d89-44dd-966f-255feac08e77 None None] MFA Rules not processed for user `d60686a155d84e0fa2b45fe2fd4e20ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:29.720698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22806b11-7d89-44dd-966f-255feac08e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:29.893200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:29.912640 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4071/8123] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:29.914510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:29.928877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:30.200712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c01dc7-34e9-4b23-ae66-f9f524e0ca76 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:30.266099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:30.266621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:30.270375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:30.270692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:30.271604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:30.287014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:30.441349 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4053/8124] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:29 2022] POST /identity/v3/projects => generated 399 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:30.445608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22806b11-7d89-44dd-966f-255feac08e77 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:30.460850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22806b11-7d89-44dd-966f-255feac08e77 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:30.606032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:30.612265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:30.617589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:30.617936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:30.619058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:30.628541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:30.710156 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4072/8125] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:30 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:30.711928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:30.756505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee4ed7-b916-4410-a8d3-c1eda828e20c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:30.780960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:30.783186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:30.792211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:30.793916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:30.795532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:30.797626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:30.818913 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4054/8126] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:30.823330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:30.853857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3290c-ebcc-4660-ad6c-831b02623cb6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:30.876017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092950-301d-43aa-bc75-6f4bfee38cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:30.877987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092950-301d-43aa-bc75-6f4bfee38cbc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:30.878314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092950-301d-43aa-bc75-6f4bfee38cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:30.878596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092950-301d-43aa-bc75-6f4bfee38cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:30.879464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092950-301d-43aa-bc75-6f4bfee38cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:30.881542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092950-301d-43aa-bc75-6f4bfee38cbc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:30.906139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4073/8127] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:30.910371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:30.932789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d87b7-127c-4cf2-bb82-42a69cc74a50 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:30.939541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:30.941175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:30.941640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:30.942287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] PATH_INFO: `/v3/projects/2c75e42e9d1045c0943e10aaaf78e993/users/06b646311053406b901d79df708679fd/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:30.975680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c75e42e9d1045c0943e10aaaf78e993, user_id=06b646311053406b901d79df708679fd, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:30.983047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:31.016894 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4055/8128] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:30 2022] PUT /identity/v3/projects/2c75e42e9d1045c0943e10aaaf78e993/users/06b646311053406b901d79df708679fd/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:31.028007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4746c4-bbfc-4432-9336-b5998138d80f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:31.028572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4746c4-bbfc-4432-9336-b5998138d80f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:31.029026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4746c4-bbfc-4432-9336-b5998138d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:31.114083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3a4746c4-bbfc-4432-9336-b5998138d80f None None] MFA Rules not processed for user `06b646311053406b901d79df708679fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:31.119120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3a4746c4-bbfc-4432-9336-b5998138d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:31.404496 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4074/8129] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:31.421950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:31.430478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:31.629666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4a1a-ee12-4322-95a2-7f66d9f01729 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:31.635173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8b9df-755b-413b-b5f5-7bc20b1cca44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:31.637385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b9df-755b-413b-b5f5-7bc20b1cca44 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:31.637982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b9df-755b-413b-b5f5-7bc20b1cca44 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:31.639620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8b9df-755b-413b-b5f5-7bc20b1cca44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:31.743845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8b9df-755b-413b-b5f5-7bc20b1cca44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:31.745551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8b9df-755b-413b-b5f5-7bc20b1cca44 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:31.760035 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4056/8130] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:32.426275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4746c4-bbfc-4432-9336-b5998138d80f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:32.593174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4746c4-bbfc-4432-9336-b5998138d80f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:32.625895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:32.627090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:32.627943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:32.628478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] PATH_INFO: `/v3/users/d60686a155d84e0fa2b45fe2fd4e20ec` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:32.630269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60686a155d84e0fa2b45fe2fd4e20ec)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:32.634105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:32.645566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:32.741802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60686a155d84e0fa2b45fe2fd4e20ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:32.743778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60686a155d84e0fa2b45fe2fd4e20ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:32.777565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60686a155d84e0fa2b45fe2fd4e20ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:32.780886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60686a155d84e0fa2b45fe2fd4e20ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:32.799456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60686a155d84e0fa2b45fe2fd4e20ec'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:32.837677 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4075/8131] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:32 2022] DELETE /identity/v3/users/d60686a155d84e0fa2b45fe2fd4e20ec => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:32.844912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:32.845782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:32.845782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:32.856320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:32.919477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:32.921157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:33.110875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4057/8132] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:33.180174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:33.181900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:33.411014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dc3df-5ca8-4a06-abbf-ee7a365ff74e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:33.417732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:33.418487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:33.418735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:33.419089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:33.457959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:33.459576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:33.489332 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4076/8133] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:33.709447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:33.711308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:33.795633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:33.798480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:33.840757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11c7a-6410-43c6-9d65-e1d91263f53a service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:33.886082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:33.888221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:33.889936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:33.890491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] PATH_INFO: `/v3/users/f4bfc526f4fb4da3b91247a41c9b0805` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:33.898085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4bfc526f4fb4da3b91247a41c9b0805)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:33.904251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:34.019178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7f8bb-9584-4c67-9c4e-4d1a459d13b6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:34.034162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d7cbb-4080-4dac-9a5c-8b20833e47c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:34.035489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7cbb-4080-4dac-9a5c-8b20833e47c2 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:34.036107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7cbb-4080-4dac-9a5c-8b20833e47c2 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:34.036696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d7cbb-4080-4dac-9a5c-8b20833e47c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:34.041586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5f4d7cbb-4080-4dac-9a5c-8b20833e47c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:34.048996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4bfc526f4fb4da3b91247a41c9b0805'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:34.050129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4bfc526f4fb4da3b91247a41c9b0805'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:34.068873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d7cbb-4080-4dac-9a5c-8b20833e47c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:34.070904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d7cbb-4080-4dac-9a5c-8b20833e47c2 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:34.104879 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4058/8134] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:34.117319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4bfc526f4fb4da3b91247a41c9b0805'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:34.121412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4bfc526f4fb4da3b91247a41c9b0805'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:34.139749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4bfc526f4fb4da3b91247a41c9b0805'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:34.159940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:34.175709 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4077/8135] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:33 2022] DELETE /identity/v3/users/f4bfc526f4fb4da3b91247a41c9b0805 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:34.180380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:34.181190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:34.181897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:34.230211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:34.234766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:34.384725 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4059/8136] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:34.395475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:34.398579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:34.553604 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dec39f-6271-4d4d-8456-98101facf562 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:34.560949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:34.561857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:34.562280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:34.562844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:34.580508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:34.582181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:34.597224 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4078/8137] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:34.854635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:34.856802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:34.882100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc16c3-e1e6-4769-ac4b-41980c044cbd None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:34.891611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:34.893224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:34.894011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:34.894461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] PATH_INFO: `/v3/projects/b05b06c03a3d4e6dbaa999f8f161ed4c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:34.898912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05b06c03a3d4e6dbaa999f8f161ed4c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:34.902917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:34.933671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:34.996482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05b06c03a3d4e6dbaa999f8f161ed4c', 'request_id': 'req-570f0060-bee7-4aa3-b412-51c84c4c8f7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.010210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05b06c03a3d4e6dbaa999f8f161ed4c', 'request_id': 'req-570f0060-bee7-4aa3-b412-51c84c4c8f7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.042025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:35.043839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:35.053730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05b06c03a3d4e6dbaa999f8f161ed4c', 'request_id': 'req-570f0060-bee7-4aa3-b412-51c84c4c8f7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.074725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625474-24ff-4a5f-ba3b-6698c386f195 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:35.082055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] The token cache is being invalidate because project b05b06c03a3d4e6dbaa999f8f161ed4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:35.082342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.083474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.086389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4060/8138] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:34 2022] DELETE /identity/v3/projects/b05b06c03a3d4e6dbaa999f8f161ed4c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:35.091002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:35.092870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:35.201009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:35.202388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:35.202902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:35.203195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] PATH_INFO: `/v3/projects/ffe0cdf5a28846779f389c77adf4733b` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:35.205181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe0cdf5a28846779f389c77adf4733b)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:35.209045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:35.256693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f0060-bee7-4aa3-b412-51c84c4c8f7c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:35.286387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:35.287318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:35.287632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:35.287872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] PATH_INFO: `/v3/users/06b646311053406b901d79df708679fd` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:35.290837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b646311053406b901d79df708679fd)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:35.292829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:35.328875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe0cdf5a28846779f389c77adf4733b', 'request_id': 'req-ed523298-b4b9-4655-9316-fd9172308d8e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.348322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe0cdf5a28846779f389c77adf4733b', 'request_id': 'req-ed523298-b4b9-4655-9316-fd9172308d8e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.364853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe0cdf5a28846779f389c77adf4733b', 'request_id': 'req-ed523298-b4b9-4655-9316-fd9172308d8e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.404211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] The token cache is being invalidate because project ffe0cdf5a28846779f389c77adf4733b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:35.404621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.406190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ed523298-b4b9-4655-9316-fd9172308d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.412942 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4079/8139] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:35 2022] DELETE /identity/v3/projects/ffe0cdf5a28846779f389c77adf4733b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:35.417247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa335-a782-4d78-b52c-0a53d0872484 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:35.419880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa335-a782-4d78-b52c-0a53d0872484 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:35.420586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aa335-a782-4d78-b52c-0a53d0872484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:35.461490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-256aa335-a782-4d78-b52c-0a53d0872484 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:35.464566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b646311053406b901d79df708679fd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.464963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-256aa335-a782-4d78-b52c-0a53d0872484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:35.465418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b646311053406b901d79df708679fd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.497041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b646311053406b901d79df708679fd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.498097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b646311053406b901d79df708679fd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.514260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-378dd1cb-2afe-4642-9708-80c07ddb1e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b646311053406b901d79df708679fd'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:35.520694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:35.542423 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4061/8140] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:35 2022] DELETE /identity/v3/users/06b646311053406b901d79df708679fd => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:35.601086 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4080/8141] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:35.605406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8dbe-ef4a-4809-81fb-fc7264ce959a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:35.605945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8dbe-ef4a-4809-81fb-fc7264ce959a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:35.607717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8dbe-ef4a-4809-81fb-fc7264ce959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:35.645383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-790c8dbe-ef4a-4809-81fb-fc7264ce959a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:35.646356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-790c8dbe-ef4a-4809-81fb-fc7264ce959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:35.681443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:35.767220 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4062/8142] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:35.770775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa335-a782-4d78-b52c-0a53d0872484 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:35.793210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aa335-a782-4d78-b52c-0a53d0872484 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:35.801756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:35.803150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:35.803775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:35.808919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:35.810506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:35.810862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:35.813281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:35.844502 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4081/8143] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:35.849901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c8dbe-ef4a-4809-81fb-fc7264ce959a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:35.866444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c8dbe-ef4a-4809-81fb-fc7264ce959a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:35.874150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:35.876348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:35.876841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:35.877306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:35.878255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:35.880668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:35.919238 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4063/8144] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:35 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:35.923676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:35.936136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36eae-d404-43a7-a61a-e6f78daf3f89 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:36.056137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:36.056137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.056137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.056137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.058242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:36.061915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:36.117112 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4082/8145] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:35 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:36.117703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:36.136625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d8485-472a-4ee5-b661-40db2a5e425c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:36.148409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:36.150121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.150948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.152668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.153756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:36.159068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:36.185595 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4064/8146] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:36.190248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:36.205579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41708362-12c1-4bdd-95be-11b2513ae928 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:36.219432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:36.220143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.220457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.221142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.221800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:36.249457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:36.270661 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4083/8147] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:36.274867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:36.292904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261b93c-0853-4677-9668-5a17476121fb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:36.298846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a05597-58ac-47cd-afa8-73e86db88bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:36.300320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05597-58ac-47cd-afa8-73e86db88bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.300821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05597-58ac-47cd-afa8-73e86db88bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.301360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a05597-58ac-47cd-afa8-73e86db88bb3 admin admin] PATH_INFO: `/v3/projects/de9c71d878f8496e97912e937eca59fa/users/3c0345b0db6141beac7093ece22fdfd0/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.323999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a05597-58ac-47cd-afa8-73e86db88bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9c71d878f8496e97912e937eca59fa, user_id=3c0345b0db6141beac7093ece22fdfd0, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:36.330750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a05597-58ac-47cd-afa8-73e86db88bb3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:36.363735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:36.366533 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4065/8148] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:36 2022] PUT /identity/v3/projects/de9c71d878f8496e97912e937eca59fa/users/3c0345b0db6141beac7093ece22fdfd0/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:36.376099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:36.379513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.379797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.380073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.406845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca67ce8-b66a-4326-bfee-e4ca537fe185 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:36.422670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] MFA Rules not processed for user `3c0345b0db6141beac7093ece22fdfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:36.424071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:36.518254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:36.520459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.525918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.527236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] PATH_INFO: `/v3/projects/2c75e42e9d1045c0943e10aaaf78e993` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.529867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c75e42e9d1045c0943e10aaaf78e993)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:36.533475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:36.544171 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4066/8149] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:36.552465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:36.554107 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:36.623679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:36.657135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c75e42e9d1045c0943e10aaaf78e993', 'request_id': 'req-38871212-3196-446d-9700-ebcd649483aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:36.673168 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c75e42e9d1045c0943e10aaaf78e993', 'request_id': 'req-38871212-3196-446d-9700-ebcd649483aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:36.694140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c75e42e9d1045c0943e10aaaf78e993', 'request_id': 'req-38871212-3196-446d-9700-ebcd649483aa'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:36.710790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] The token cache is being invalidate because project 2c75e42e9d1045c0943e10aaaf78e993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:36.711232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:36.715024 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-38871212-3196-446d-9700-ebcd649483aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:36.716680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006c88b-5428-42ba-9a92-7ec7e09934d8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:36.717470 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4084/8150] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:36 2022] DELETE /identity/v3/projects/2c75e42e9d1045c0943e10aaaf78e993 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:36.727338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952eaf-7ca3-45f4-b12f-ed045e7626ea None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.728265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952eaf-7ca3-45f4-b12f-ed045e7626ea None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.728754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952eaf-7ca3-45f4-b12f-ed045e7626ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.748536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:36.760929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2b952eaf-7ca3-45f4-b12f-ed045e7626ea None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:36.762770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b952eaf-7ca3-45f4-b12f-ed045e7626ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:36.815123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:36.815799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.816715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.817214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.824330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:36.921797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:36.923842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:36.924251 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4085/8151] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:36.932660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1d776-2d49-461a-bb31-a7448e12bd00 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:36.933148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1d776-2d49-461a-bb31-a7448e12bd00 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:36.938779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1d776-2d49-461a-bb31-a7448e12bd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:36.939873 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4067/8152] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:36.985591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e6a1d776-2d49-461a-bb31-a7448e12bd00 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:36.987365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e6a1d776-2d49-461a-bb31-a7448e12bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:37.009756 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4086/8153] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:37.010317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:37.032053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c13948-f8f9-4624-a0a1-c2df92fd8d74 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:37.051394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:37.058678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.059752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.059752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.074922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:37.075226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:37.080665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:37.112554 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4068/8154] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:37.117290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1d776-2d49-461a-bb31-a7448e12bd00 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:37.131438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1d776-2d49-461a-bb31-a7448e12bd00 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:37.154109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:37.157660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.159245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.160774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.162400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:37.166918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:37.236143 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4087/8155] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:37 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:37.236584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:37.255141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62292f4-412c-43da-b6f6-c8a5e728dbeb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:37.361355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:37.362172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.362520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.362862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.363687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:37.365740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:37.407595 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4069/8156] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:37 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:37.412474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:37.453725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b3ba9-eac3-4655-8626-b9d3f42bd35a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:37.477059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:37.484099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.484434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.486484 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.491517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:37.503019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:37.541132 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4088/8157] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:37.541379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:37.559385 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91b042-344e-4e66-b74a-8a9e6b63083f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:37.574391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:37.575487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.575770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.576099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] PATH_INFO: `/v3/projects/986baf13621e4395831f4d4ea74b0153/users/285dbd88fbc741a1a4b934473bccf1b7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.600405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] RBAC: Authorizing `identity:create_grant(project_id=986baf13621e4395831f4d4ea74b0153, user_id=285dbd88fbc741a1a4b934473bccf1b7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:37.604016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:37.631271 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4070/8158] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:37 2022] PUT /identity/v3/projects/986baf13621e4395831f4d4ea74b0153/users/285dbd88fbc741a1a4b934473bccf1b7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:37.632856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:37.648986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9e61-7a9b-49a0-919b-f8a9cce2cdf2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:37.804965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc80c6b-88b8-4a88-a621-d006ac3cf77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:37.806389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc80c6b-88b8-4a88-a621-d006ac3cf77b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.807454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc80c6b-88b8-4a88-a621-d006ac3cf77b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.807750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc80c6b-88b8-4a88-a621-d006ac3cf77b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.808504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc80c6b-88b8-4a88-a621-d006ac3cf77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:37.814800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc80c6b-88b8-4a88-a621-d006ac3cf77b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:37.847066 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4089/8159] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:37.848543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:37.863934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea46d3-9f76-4604-a6ee-36c23493442d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:37.879352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:37.880643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.881439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.881917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] PATH_INFO: `/v3/projects/986baf13621e4395831f4d4ea74b0153/users/285dbd88fbc741a1a4b934473bccf1b7/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.888942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986baf13621e4395831f4d4ea74b0153, user_id=285dbd88fbc741a1a4b934473bccf1b7, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:37.892173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:37.925239 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4071/8160] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:37 2022] PUT /identity/v3/projects/986baf13621e4395831f4d4ea74b0153/users/285dbd88fbc741a1a4b934473bccf1b7/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:37.934859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0176e3-4610-49eb-8ff6-d9869ebdd877 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:37.935396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0176e3-4610-49eb-8ff6-d9869ebdd877 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:37.936366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0176e3-4610-49eb-8ff6-d9869ebdd877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:37.988797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-db0176e3-4610-49eb-8ff6-d9869ebdd877 None None] MFA Rules not processed for user `285dbd88fbc741a1a4b934473bccf1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:37.990191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-db0176e3-4610-49eb-8ff6-d9869ebdd877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:38.013886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:38.101211 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4090/8161] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:38.106578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:38.130517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:38.228235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01ac43-2e09-4c35-926a-af2f1c978106 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:38.235991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:38.236707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:38.237526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:38.237526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:38.238268 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:38.240630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:38.292904 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4072/8162] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:38.297141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0176e3-4610-49eb-8ff6-d9869ebdd877 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:38.311351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0176e3-4610-49eb-8ff6-d9869ebdd877 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:38.480236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:38.482738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:38.483106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:38.483332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:38.484402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:38.486530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:38.539998 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4091/8163] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:38 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:38.544161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:38.562299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fbde1-7f29-4cca-bf3a-17ea615e39fb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:38.576339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:38.577754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:38.577754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:38.577754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:38.582452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:38.583863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:38.610996 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4073/8164] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:38.614880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:38.626884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a076451-105a-4454-b7a4-779f3c2c846f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:38.641603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cc6a3-756b-495f-a5af-06b69fbe5d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:38.642295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc6a3-756b-495f-a5af-06b69fbe5d73 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:38.642553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc6a3-756b-495f-a5af-06b69fbe5d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:38.642813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc6a3-756b-495f-a5af-06b69fbe5d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:38.643499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cc6a3-756b-495f-a5af-06b69fbe5d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:38.645243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cc6a3-756b-495f-a5af-06b69fbe5d73 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:38.674523 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4092/8165] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:38.676577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:38.693849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2380e-c81c-4bb0-a86e-eeaf4cfd7442 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:38.707097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024171c8-af50-4b9e-b23a-a931d51d4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:38.708899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024171c8-af50-4b9e-b23a-a931d51d4990 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:38.710906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024171c8-af50-4b9e-b23a-a931d51d4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:38.711460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024171c8-af50-4b9e-b23a-a931d51d4990 admin admin] PATH_INFO: `/v3/projects/d3b72df2646e4c4e95cc6b114872e7a0/users/9a33dd9d270948de985bcd43beb86c09/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:38.742260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:38.742769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:38.742893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:38.753999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024171c8-af50-4b9e-b23a-a931d51d4990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b72df2646e4c4e95cc6b114872e7a0, user_id=9a33dd9d270948de985bcd43beb86c09, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:38.757616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024171c8-af50-4b9e-b23a-a931d51d4990 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:38.808813 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4074/8166] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:38 2022] PUT /identity/v3/projects/d3b72df2646e4c4e95cc6b114872e7a0/users/9a33dd9d270948de985bcd43beb86c09/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:38.811512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:38.811650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] MFA Rules not processed for user `29193876d78148f8ba44ce9d40f691c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:38.811747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:38.811905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:38.817119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:38.861181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] MFA Rules not processed for user `9a33dd9d270948de985bcd43beb86c09`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:38.862486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:38.938637 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4093/8167] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:38.946458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:38.948680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:38.968062 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4075/8168] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:38.971485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:38.984985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:38.987109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:39.099196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095f0a2-8f0c-4f2b-b062-4080e2b23c28 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:39.107571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:39.108350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:39.108725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:39.109007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:39.112716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:39.125137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:39.143127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e73f1-2fd0-40e4-b079-69ae6b5c1827 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:39.178493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed7343-e6c5-4fe3-91af-29a2de916fd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:39.179815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed7343-e6c5-4fe3-91af-29a2de916fd6 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:39.182854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed7343-e6c5-4fe3-91af-29a2de916fd6 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:39.183229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed7343-e6c5-4fe3-91af-29a2de916fd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:39.237276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:39.239053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:39.251976 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4094/8169] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:39.342214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed7343-e6c5-4fe3-91af-29a2de916fd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:39.345246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed7343-e6c5-4fe3-91af-29a2de916fd6 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:39.365780 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4076/8170] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:39.857101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:40.046885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871740b8-2bc2-4420-97a9-d4e2acab8561 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:40.052759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:40.053846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:40.054127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:40.054499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] PATH_INFO: `/v3/users/285dbd88fbc741a1a4b934473bccf1b7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:40.056696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=285dbd88fbc741a1a4b934473bccf1b7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:40.059992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:40.144715 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285dbd88fbc741a1a4b934473bccf1b7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:40.146177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285dbd88fbc741a1a4b934473bccf1b7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:40.153948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:40.170541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285dbd88fbc741a1a4b934473bccf1b7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:40.171979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285dbd88fbc741a1a4b934473bccf1b7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:40.198701 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285dbd88fbc741a1a4b934473bccf1b7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:40.273373 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4095/8171] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:39 2022] DELETE /identity/v3/users/285dbd88fbc741a1a4b934473bccf1b7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:40.282252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e5378-4208-4f3a-a066-939f9c32aaf3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:40.283340 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e5378-4208-4f3a-a066-939f9c32aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:40.283723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e5378-4208-4f3a-a066-939f9c32aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:40.309168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4c9e5378-4208-4f3a-a066-939f9c32aaf3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:40.310709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c9e5378-4208-4f3a-a066-939f9c32aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:40.402869 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4077/8172] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:40.423808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:40.428089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:40.546496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6478df-80be-4324-82aa-515f5ecbcfce admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:40.552300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:40.553754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:40.554224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:40.554656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:40.570408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:40.572474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:40.586128 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4096/8173] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:41.202452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:41.202743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:41.203534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:41.241432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] MFA Rules not processed for user `f228d958acdb4d769a59f019e4d41d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:41.243502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:41.341096 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4078/8174] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:41.366831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:41.369162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:41.385416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e175c3-33e7-4660-91b8-b71292b2a5fd service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:41.394895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:41.396324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:41.396922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:41.397716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] PATH_INFO: `/v3/users/a4b5f6d69d1e4804923d47dd4d71d443` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:41.400629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b5f6d69d1e4804923d47dd4d71d443)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:41.406373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:41.462308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:41.468675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:41.498231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68e451-bbe9-4da0-a1ee-f363e5e1bfd1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:41.512277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b5f6d69d1e4804923d47dd4d71d443'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.514877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:41.516189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:41.516892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:41.517132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b5f6d69d1e4804923d47dd4d71d443'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.518323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] PATH_INFO: `/v3/projects/986baf13621e4395831f4d4ea74b0153` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:41.520534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986baf13621e4395831f4d4ea74b0153)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:41.525718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:41.555137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b5f6d69d1e4804923d47dd4d71d443'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.557222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b5f6d69d1e4804923d47dd4d71d443'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.573928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8f7cf43e-78e4-4e6f-aa29-d7d0fe3b22f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b5f6d69d1e4804923d47dd4d71d443'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.611239 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4097/8175] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:41 2022] DELETE /identity/v3/users/a4b5f6d69d1e4804923d47dd4d71d443 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:41.631853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:41.632367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:41.632575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:41.666219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:41.685713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986baf13621e4395831f4d4ea74b0153', 'request_id': 'req-71817ac7-f92b-4d20-937c-cbba2f469968'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.699356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986baf13621e4395831f4d4ea74b0153', 'request_id': 'req-71817ac7-f92b-4d20-937c-cbba2f469968'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.702589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:41.706188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:41.719390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986baf13621e4395831f4d4ea74b0153', 'request_id': 'req-71817ac7-f92b-4d20-937c-cbba2f469968'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.741935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] The token cache is being invalidate because project 986baf13621e4395831f4d4ea74b0153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:41.742627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.743766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.746456 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4079/8176] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:41 2022] DELETE /identity/v3/projects/986baf13621e4395831f4d4ea74b0153 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:41.750386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:41.752383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:41.823608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:41.852038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71817ac7-f92b-4d20-937c-cbba2f469968 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:41.858755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:41.859920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:41.860331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:41.860612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] PATH_INFO: `/v3/users/9a33dd9d270948de985bcd43beb86c09` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:41.862225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a33dd9d270948de985bcd43beb86c09)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:41.866012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:41.873385 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4098/8177] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:41.880800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:41.883883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:41.972178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a33dd9d270948de985bcd43beb86c09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:41.974651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a33dd9d270948de985bcd43beb86c09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:42.011979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a33dd9d270948de985bcd43beb86c09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:42.013547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a33dd9d270948de985bcd43beb86c09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:42.040330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a33dd9d270948de985bcd43beb86c09'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:42.069882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ac77a-6949-4493-9f1b-2f2d07082286 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:42.072204 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4080/8178] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:41 2022] DELETE /identity/v3/users/9a33dd9d270948de985bcd43beb86c09 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:42.193165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:42.193901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:42.194142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:42.194425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:42.199312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:42.365945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:42.368561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:42.399471 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4099/8179] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:42.604085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:42.607082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:42.650294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfecca-ff77-4ef1-b642-3f3a85f1bc92 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:42.657180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:42.658137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:42.658265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:42.658627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:42.664829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:42.693294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:42.695550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:42.755109 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4081/8180] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:43.052797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:43.055365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:43.079652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83a603-11dc-4934-9a21-47e737fcc70d service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:43.092478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:43.094806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:43.095152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:43.096364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.097454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.098221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] PATH_INFO: `/v3/projects/d3b72df2646e4c4e95cc6b114872e7a0` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.101006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b72df2646e4c4e95cc6b114872e7a0)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:43.105893 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:43.146383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fa2c9-5fc7-4809-ae47-6bc35fd2fc4f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:43.167033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:43.167950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.170805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.175279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] PATH_INFO: `/v3/projects/f7b4d0121cf24c619d4ad0f5af414dd8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.181380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b4d0121cf24c619d4ad0f5af414dd8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:43.190434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:43.250139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:43.258566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b72df2646e4c4e95cc6b114872e7a0', 'request_id': 'req-63ea358c-6808-4c83-b6b1-320958c4ab56'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.276341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b72df2646e4c4e95cc6b114872e7a0', 'request_id': 'req-63ea358c-6808-4c83-b6b1-320958c4ab56'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.292265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b72df2646e4c4e95cc6b114872e7a0', 'request_id': 'req-63ea358c-6808-4c83-b6b1-320958c4ab56'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.322481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:43.328389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] The token cache is being invalidate because project d3b72df2646e4c4e95cc6b114872e7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:43.330299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.333466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-63ea358c-6808-4c83-b6b1-320958c4ab56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.339118 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4100/8181] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:43 2022] DELETE /identity/v3/projects/d3b72df2646e4c4e95cc6b114872e7a0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:43.345235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc0986-c078-4d80-b0aa-b1a0d20abbbd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.345647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc0986-c078-4d80-b0aa-b1a0d20abbbd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.346023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc0986-c078-4d80-b0aa-b1a0d20abbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.378380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'request_id': 'req-f0acce5e-93d3-48da-b1d1-3309df7a505f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.400860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'request_id': 'req-f0acce5e-93d3-48da-b1d1-3309df7a505f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.401496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ffc0986-c078-4d80-b0aa-b1a0d20abbbd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:43.403977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ffc0986-c078-4d80-b0aa-b1a0d20abbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:43.430630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'request_id': 'req-f0acce5e-93d3-48da-b1d1-3309df7a505f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.468388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] The token cache is being invalidate because project f7b4d0121cf24c619d4ad0f5af414dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:43.468709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.470262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0acce5e-93d3-48da-b1d1-3309df7a505f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:43.476334 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4082/8182] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:43 2022] DELETE /identity/v3/projects/f7b4d0121cf24c619d4ad0f5af414dd8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:43.482869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d0272-50fa-495a-9055-cd8676483d92 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.483533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d0272-50fa-495a-9055-cd8676483d92 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.484453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d0272-50fa-495a-9055-cd8676483d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.509573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-754d0272-50fa-495a-9055-cd8676483d92 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:43.511125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-754d0272-50fa-495a-9055-cd8676483d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:43.565517 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4101/8183] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:43.573827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ff37-515c-4e46-8e42-a3aeb20d0133 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.575107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ff37-515c-4e46-8e42-a3aeb20d0133 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.575107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ff37-515c-4e46-8e42-a3aeb20d0133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.615687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b213ff37-515c-4e46-8e42-a3aeb20d0133 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:43.617253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b213ff37-515c-4e46-8e42-a3aeb20d0133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:43.649862 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4102/8184] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:43.651407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ff37-515c-4e46-8e42-a3aeb20d0133 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:43.665109 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4083/8185] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:43.666285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ff37-515c-4e46-8e42-a3aeb20d0133 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:43.676328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:43.677124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.677414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.677717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.678101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fd81-6c26-4f37-a98f-7889149bf564 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.678453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:43.678786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:43.680324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fd81-6c26-4f37-a98f-7889149bf564 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.680456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:43.682226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fd81-6c26-4f37-a98f-7889149bf564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.706488 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4103/8186] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:32:43.714167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:43.724044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1c61fd81-6c26-4f37-a98f-7889149bf564 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:43.725531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1c61fd81-6c26-4f37-a98f-7889149bf564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:43.766918 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4084/8187] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:43.770935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fd81-6c26-4f37-a98f-7889149bf564 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:43.771477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d27e2-ac90-4746-95cd-7d4656cfe702 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:43.792421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:43.794800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.795104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.795433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.796155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:43.797114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fd81-6c26-4f37-a98f-7889149bf564 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:43.805505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:43.808274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:43.809193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:43.809654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:43.810087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:43.811238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:43.811706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:43.814846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:43.848027 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4085/8188] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:43.852909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:43.875345 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4104/8189] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:43 2022] POST /identity/v3/projects => generated 407 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:43.877760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:43.887072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36767ebe-04aa-4922-affb-f6508c20bf81 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.028811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.029970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.030786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.032263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.043970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.046845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.063004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1356a-6731-487b-97c6-b024f3d3e98b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.090035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.090933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.091361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.091757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.092895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.097575 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.137754 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4086/8190] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:43 2022] POST /identity/v3/projects => generated 377 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:44.142840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.155005 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4105/8191] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:43 2022] POST /identity/v3/users => generated 304 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:44.158713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.179197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e0c4-e43e-46b1-8b20-da5fcf7517e9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.206793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:44.235986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:44.332112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe90fd-b385-42d0-b05e-bc41d783bb7c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.345562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.346313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.347627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.348358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.349064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.349776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.350510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.350690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.351532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.353635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.356078 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.358043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.386684 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4106/8192] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:44.387859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.392369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:44.403136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4087/8193] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:44 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:44.404325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.418821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728acea-de1f-47bf-bea4-b43bc16a631a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.428604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.429961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.430441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.431217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.432749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.435435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.457699 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4088/8194] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:44.458736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.474911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca06066-317a-438c-b117-3852bf4d690e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.481865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.483064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.483435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.484375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.485235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.487280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.503797 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4089/8195] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:44.504715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.509884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedfd5d-555f-4d53-926c-52707c1f1506 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.517721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdbf2b-c6f0-4160-81b8-e656b00dbb8a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.518677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.519560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.520048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.520480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.522728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:44.529578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092247e6-37a3-461c-aeb9-79bf7327e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.531964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092247e6-37a3-461c-aeb9-79bf7327e6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.543914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.546189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.551403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092247e6-37a3-461c-aeb9-79bf7327e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.551835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092247e6-37a3-461c-aeb9-79bf7327e6d6 admin admin] PATH_INFO: `/v3/projects/e4380f4a345b4cffb731c106bec8241a/users/2b8e738d654f4d73888ff1aa24c4566d/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.569545 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4107/8196] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:44.570403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.581978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70438160-61da-4399-b8f4-60654dbfe8f8 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.589764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.591025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.591306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.591584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.592504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.594994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.609886 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4108/8197] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:44.614339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:44.626169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bce577-cf67-4f73-8628-57ccb906821f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:44.632712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092247e6-37a3-461c-aeb9-79bf7327e6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4380f4a345b4cffb731c106bec8241a, user_id=2b8e738d654f4d73888ff1aa24c4566d, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.637300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092247e6-37a3-461c-aeb9-79bf7327e6d6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.638314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ef3b-add5-4d86-97f5-05d1a6d7317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:44.639764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ef3b-add5-4d86-97f5-05d1a6d7317a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.640004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ef3b-add5-4d86-97f5-05d1a6d7317a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.640864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ef3b-add5-4d86-97f5-05d1a6d7317a admin admin] PATH_INFO: `/v3/projects/c5ee789f989a4382bac7b1a5ed79d4d3/users/fb7707ec6a664b328adfa6efc791f6e4/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.669381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ef3b-add5-4d86-97f5-05d1a6d7317a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ee789f989a4382bac7b1a5ed79d4d3, user_id=fb7707ec6a664b328adfa6efc791f6e4, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:44.671375 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4090/8198] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:44 2022] PUT /identity/v3/projects/e4380f4a345b4cffb731c106bec8241a/users/2b8e738d654f4d73888ff1aa24c4566d/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:44.682889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ef3b-add5-4d86-97f5-05d1a6d7317a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:44.695193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6dd4-e6bc-414b-aa45-d4b5abc87276 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.697621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6dd4-e6bc-414b-aa45-d4b5abc87276 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.698042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6dd4-e6bc-414b-aa45-d4b5abc87276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.718736 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4109/8199] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:44 2022] PUT /identity/v3/projects/c5ee789f989a4382bac7b1a5ed79d4d3/users/fb7707ec6a664b328adfa6efc791f6e4/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:44.729894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:44.731652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:44.732170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:44.799446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-299b6dd4-e6bc-414b-aa45-d4b5abc87276 None None] MFA Rules not processed for user `2b8e738d654f4d73888ff1aa24c4566d`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:44.803161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-299b6dd4-e6bc-414b-aa45-d4b5abc87276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:44.810243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] MFA Rules not processed for user `fb7707ec6a664b328adfa6efc791f6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:44.811798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:44.947864 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4091/8200] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:44.952998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6dd4-e6bc-414b-aa45-d4b5abc87276 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:45.003558 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4110/8201] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:45.016601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:45.018123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:45.029554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:45.050311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:45.076085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6dd4-e6bc-414b-aa45-d4b5abc87276 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:45.085519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:45.090373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.092394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.092783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.093992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:45.100303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:45.182655 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4092/8202] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:44 2022] POST /identity/v3/projects => generated 407 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:45.186274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:45.204046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b70a-4962-45b2-b8f6-b14e6fdc22ca None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:45.287186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb5ef1-37b3-44c0-ace0-7f29aa6f8c5b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:45.294572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:45.296494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.298715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.298907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.300728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:45.309185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:45.339847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:45.340918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.341514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.342012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.377164 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4093/8203] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:45 2022] POST /identity/v3/users => generated 310 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:32:45.381363 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:45.401734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248c990-8de1-470a-a181-b6291fde37c6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:45.407870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:45.408918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.409272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.409552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.410295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:45.411912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:45.453632 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4094/8204] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:45.457876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:45.476433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eef92-61b2-420e-96eb-e7a2c7b310f1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:45.495683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:45.496608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.496889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.497193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] PATH_INFO: `/v3/projects/2b9c5bada5824b56964f281823f2cfae/users/37c6058dd6d24ef6aacec58f2575b064/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.522263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:45.530180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:45.543029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9c5bada5824b56964f281823f2cfae, user_id=37c6058dd6d24ef6aacec58f2575b064, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:45.546305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:45.560693 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4111/8205] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:45.586546 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4095/8206] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:45 2022] PUT /identity/v3/projects/2b9c5bada5824b56964f281823f2cfae/users/37c6058dd6d24ef6aacec58f2575b064/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:45.590510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:45.610470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321916bd-6a1a-41db-8393-c4ab72eb8238 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:45.774287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbf02-dd65-4716-af6e-e2b2f606d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:45.775782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbf02-dd65-4716-af6e-e2b2f606d736 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.776897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbf02-dd65-4716-af6e-e2b2f606d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.777365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbf02-dd65-4716-af6e-e2b2f606d736 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.782089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbf02-dd65-4716-af6e-e2b2f606d736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:45.782089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbf02-dd65-4716-af6e-e2b2f606d736 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:45.812881 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4112/8207] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:45.816691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:45.831670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fc353-0960-44af-8bdf-53735b95c873 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:45.838125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:45.839132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.839412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.839684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] PATH_INFO: `/v3/projects/2b9c5bada5824b56964f281823f2cfae/users/37c6058dd6d24ef6aacec58f2575b064/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.841974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9c5bada5824b56964f281823f2cfae, user_id=37c6058dd6d24ef6aacec58f2575b064, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:45.844896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:45.860233 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4096/8208] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:45 2022] PUT /identity/v3/projects/2b9c5bada5824b56964f281823f2cfae/users/37c6058dd6d24ef6aacec58f2575b064/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:45.872758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:45.872924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:45.873267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:45.911023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:45.929104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] MFA Rules not processed for user `37c6058dd6d24ef6aacec58f2575b064`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:45.930336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:46.068098 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4113/8209] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:45 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:46.082496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:46.086572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:46.220391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24553385-0a44-4490-bb5a-fa7d754b1cca admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:46.237833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:46.238540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:46.238823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:46.239103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:46.276058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:46.304978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:46.306645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:46.317849 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4097/8210] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:47.157192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:47.159792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:47.355432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a660a-8d1b-4752-94d9-88cb441d25f9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:47.361904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76bfc3-a9bc-4fd8-af8b-2a018b60d45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:47.362997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76bfc3-a9bc-4fd8-af8b-2a018b60d45c service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:47.363699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76bfc3-a9bc-4fd8-af8b-2a018b60d45c service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:47.364177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76bfc3-a9bc-4fd8-af8b-2a018b60d45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:47.375439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76bfc3-a9bc-4fd8-af8b-2a018b60d45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:47.377784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76bfc3-a9bc-4fd8-af8b-2a018b60d45c service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:47.393969 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4114/8211] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:47.750531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:47.753328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:47.877161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff6f92-b363-4253-a153-075dc5f03d2a service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:47.883581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:47.884860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:47.885527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:47.885957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] PATH_INFO: `/v3/users/3c0345b0db6141beac7093ece22fdfd0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:47.887617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0345b0db6141beac7093ece22fdfd0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:47.891043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:48.010218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0345b0db6141beac7093ece22fdfd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.011273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0345b0db6141beac7093ece22fdfd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.031661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0345b0db6141beac7093ece22fdfd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.033295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0345b0db6141beac7093ece22fdfd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.055275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0345b0db6141beac7093ece22fdfd0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.080016 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4098/8212] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:47 2022] DELETE /identity/v3/users/3c0345b0db6141beac7093ece22fdfd0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:48.084883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:48.085260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:48.085494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:48.126664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:48.141436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:48.256589 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4115/8213] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:48.274975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:48.277584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:48.390055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23267055-489d-498d-a294-3c6997499f81 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:48.395161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5922c18-3b49-4c52-9d22-e3b0f0be85c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:48.395948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5922c18-3b49-4c52-9d22-e3b0f0be85c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:48.396376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5922c18-3b49-4c52-9d22-e3b0f0be85c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:48.396757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5922c18-3b49-4c52-9d22-e3b0f0be85c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:48.407768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:48.412688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5922c18-3b49-4c52-9d22-e3b0f0be85c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:48.415784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5922c18-3b49-4c52-9d22-e3b0f0be85c2 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:48.443799 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4099/8214] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:48.726523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:48.730119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:48.762161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03c6b-a495-4d4b-83de-83d0779399c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:48.780142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:48.781705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:48.782350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:48.782849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] PATH_INFO: `/v3/projects/de9c71d878f8496e97912e937eca59fa` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:48.785021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9c71d878f8496e97912e937eca59fa)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:48.789287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:48.833687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:48.926638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9c71d878f8496e97912e937eca59fa', 'request_id': 'req-64d78b09-60cf-4312-b55a-7b36317c5853'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.936010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9c71d878f8496e97912e937eca59fa', 'request_id': 'req-64d78b09-60cf-4312-b55a-7b36317c5853'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.960092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9c71d878f8496e97912e937eca59fa', 'request_id': 'req-64d78b09-60cf-4312-b55a-7b36317c5853'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.977657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] The token cache is being invalidate because project de9c71d878f8496e97912e937eca59fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:48.977657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.978762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-64d78b09-60cf-4312-b55a-7b36317c5853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:48.981407 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4116/8215] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:48 2022] DELETE /identity/v3/projects/de9c71d878f8496e97912e937eca59fa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:48.986299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7cb27-1608-48ed-863a-9fbacaffb146 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:48.986857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7cb27-1608-48ed-863a-9fbacaffb146 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:48.986951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7cb27-1608-48ed-863a-9fbacaffb146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.030305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c7d7cb27-1608-48ed-863a-9fbacaffb146 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:49.032858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c7d7cb27-1608-48ed-863a-9fbacaffb146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:49.164828 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4100/8216] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:49.174231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c204d29-fd4c-41ff-bb07-5500fb4fcd4b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.174443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c204d29-fd4c-41ff-bb07-5500fb4fcd4b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.174724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c204d29-fd4c-41ff-bb07-5500fb4fcd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.200645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0c204d29-fd4c-41ff-bb07-5500fb4fcd4b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:49.201987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0c204d29-fd4c-41ff-bb07-5500fb4fcd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:49.213784 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4117/8217] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:49.218099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7cb27-1608-48ed-863a-9fbacaffb146 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:49.232067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7cb27-1608-48ed-863a-9fbacaffb146 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:49.237675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:49.238298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.238580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.238857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.240046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:49.240359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:49.242100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:49.257580 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4101/8218] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:32:49.262323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c204d29-fd4c-41ff-bb07-5500fb4fcd4b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:49.283923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c204d29-fd4c-41ff-bb07-5500fb4fcd4b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:49.292834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:49.293702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.294213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.294625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.296217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:49.299905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:49.340231 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4118/8219] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:49 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:49.344501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:49.359622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a0518-ff3a-4ce6-bc1f-145db7fae688 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:49.444018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:49.444878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.445273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.445643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.446690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:49.448745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:49.519681 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4102/8220] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:49 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:49.524137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:49.549343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043a425-c78c-4af2-847a-bb453f1ce48f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:49.570937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:49.571645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.571928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.572207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.572952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:49.574641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:49.603581 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4119/8221] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:49.613763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:49.643139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1bfff-4af2-4139-a6f4-4624c4075788 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:49.656990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00dd40-13c0-4fd3-a4b1-9e12a6b44fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:49.657584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00dd40-13c0-4fd3-a4b1-9e12a6b44fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.657862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00dd40-13c0-4fd3-a4b1-9e12a6b44fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.658853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00dd40-13c0-4fd3-a4b1-9e12a6b44fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.659594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00dd40-13c0-4fd3-a4b1-9e12a6b44fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:49.661429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00dd40-13c0-4fd3-a4b1-9e12a6b44fb8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:49.676322 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4103/8222] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:49.680843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:49.707499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40d950-e551-4967-85e6-45a25e8bda67 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:49.715577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:49.716563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.716926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.717278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] PATH_INFO: `/v3/projects/af80217fc26f457cbd0e3713dcee4739/users/08014ddde12a4fc088c34738c29b8c81/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.740118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af80217fc26f457cbd0e3713dcee4739, user_id=08014ddde12a4fc088c34738c29b8c81, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:49.744649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:49.776808 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4120/8223] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:49 2022] PUT /identity/v3/projects/af80217fc26f457cbd0e3713dcee4739/users/08014ddde12a4fc088c34738c29b8c81/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:49.788228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819e0c-5ad8-4267-9e30-8e2608d5e920 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:49.788523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819e0c-5ad8-4267-9e30-8e2608d5e920 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:49.788799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819e0c-5ad8-4267-9e30-8e2608d5e920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:49.854471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d7819e0c-5ad8-4267-9e30-8e2608d5e920 None None] MFA Rules not processed for user `08014ddde12a4fc088c34738c29b8c81`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:49.856029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d7819e0c-5ad8-4267-9e30-8e2608d5e920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:49.987643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:50.012809 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4104/8224] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:50.033982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:50.036720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:50.118688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38691c-dd7a-4316-83c4-7ba5c072117a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:50.122885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:50.123784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:50.124091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:50.124369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:50.136252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:50.138023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:50.149005 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4121/8225] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:50.792064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:50.792792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:50.792792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:50.814007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:50.815342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:50.873483 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4105/8226] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:32:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:32:50.939878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:50.942402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:51.015193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:51.060123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce3153-bfbc-40d6-8e5c-371cce6def85 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:51.069824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:51.071928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:51.072309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:51.074553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:51.090230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:51.092333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:51.104012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4122/8227] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:32:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:32:54.686827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:54.688295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:54.888111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b958430-c5e4-46cd-9554-023e1265f216 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:54.906817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6512db5-6802-466d-8eb3-ba37390f54dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:54.909854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6512db5-6802-466d-8eb3-ba37390f54dc service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:54.912869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6512db5-6802-466d-8eb3-ba37390f54dc service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:54.914650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6512db5-6802-466d-8eb3-ba37390f54dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:54.925320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a6512db5-6802-466d-8eb3-ba37390f54dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:54.954690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6512db5-6802-466d-8eb3-ba37390f54dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:54.980912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6512db5-6802-466d-8eb3-ba37390f54dc service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:55.068859 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4106/8228] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:55.344865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:55.346422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:55.453702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c57f-4461-4625-8b13-c2e7fde7c484 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:55.475881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:55.477258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:55.477848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:55.478274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] PATH_INFO: `/v3/users/fb7707ec6a664b328adfa6efc791f6e4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:55.489539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7707ec6a664b328adfa6efc791f6e4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:55.492172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:55.611337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7707ec6a664b328adfa6efc791f6e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:55.611754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7707ec6a664b328adfa6efc791f6e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:55.638301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7707ec6a664b328adfa6efc791f6e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:55.639274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7707ec6a664b328adfa6efc791f6e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:55.659699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7707ec6a664b328adfa6efc791f6e4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:55.683139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4123/8229] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:55 2022] DELETE /identity/v3/users/fb7707ec6a664b328adfa6efc791f6e4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:55.688099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:55.688567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:55.688672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:55.725945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:55.727634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:55.860436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4107/8230] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:55.870050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:55.872133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:55.951029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0f21-07c3-473a-9ef0-df7072a34752 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:55.955360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9eefa-c6a6-4a80-b9fa-413dcc41daa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:55.956881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9eefa-c6a6-4a80-b9fa-413dcc41daa7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:55.956881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9eefa-c6a6-4a80-b9fa-413dcc41daa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:55.956881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9eefa-c6a6-4a80-b9fa-413dcc41daa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:55.964438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:55.970203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9eefa-c6a6-4a80-b9fa-413dcc41daa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:55.972704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9eefa-c6a6-4a80-b9fa-413dcc41daa7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:55.985165 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4124/8231] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:32:56.545726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:56.548802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:56.593024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece840-1818-4f17-a393-bc714e14fa3c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:56.603911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:56.605088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:56.605550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:56.606041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] PATH_INFO: `/v3/projects/c5ee789f989a4382bac7b1a5ed79d4d3` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:56.608593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ee789f989a4382bac7b1a5ed79d4d3)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:56.610764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:56.638306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:56.678493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ee789f989a4382bac7b1a5ed79d4d3', 'request_id': 'req-35da34a4-ebee-4aeb-b48d-4de60f9f3559'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:56.687755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ee789f989a4382bac7b1a5ed79d4d3', 'request_id': 'req-35da34a4-ebee-4aeb-b48d-4de60f9f3559'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:56.698517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ee789f989a4382bac7b1a5ed79d4d3', 'request_id': 'req-35da34a4-ebee-4aeb-b48d-4de60f9f3559'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:56.741508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] The token cache is being invalidate because project c5ee789f989a4382bac7b1a5ed79d4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:56.741934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:56.742750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-35da34a4-ebee-4aeb-b48d-4de60f9f3559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:56.745892 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4108/8232] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:56 2022] DELETE /identity/v3/projects/c5ee789f989a4382bac7b1a5ed79d4d3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:56.751111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543adc63-9657-4908-848f-8871e91447f6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:56.751652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543adc63-9657-4908-848f-8871e91447f6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:56.751889 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543adc63-9657-4908-848f-8871e91447f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:56.777386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-543adc63-9657-4908-848f-8871e91447f6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:56.779598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-543adc63-9657-4908-848f-8871e91447f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:56.866031 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4125/8233] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:56.874239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12d01-9886-496d-b919-3e74e18e0fd2 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:56.874907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12d01-9886-496d-b919-3e74e18e0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:56.875757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12d01-9886-496d-b919-3e74e18e0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:56.900478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5da12d01-9886-496d-b919-3e74e18e0fd2 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:56.902775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5da12d01-9886-496d-b919-3e74e18e0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:56.918236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4109/8234] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:56.921773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543adc63-9657-4908-848f-8871e91447f6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:56.939500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543adc63-9657-4908-848f-8871e91447f6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:56.947904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:56.949231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:56.949559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:56.949850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:56.950780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:32:56.951260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:56.953695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:56.971868 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4126/8235] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:32:56.976576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da12d01-9886-496d-b919-3e74e18e0fd2 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:56.988827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da12d01-9886-496d-b919-3e74e18e0fd2 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:56.994512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:56.995473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:56.996047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:56.996465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:56.997361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:57.000339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:57.069676 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4110/8236] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:32:56 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:57.074361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:57.090562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b51035-2cef-4ffe-b6ba-cfe2cc79cf48 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:57.187280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:57.188429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:57.188708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:57.188985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:57.189796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:57.191816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:57.214127 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4127/8237] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:32:57 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:32:57.219254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:57.234382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27a1f-d7ff-4fa1-befe-920500b2f9db admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:57.239730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:57.240700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:57.241581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:57.241920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:57.242907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:57.244855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:57.256327 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4111/8238] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:32:57.260997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:57.272580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47cabd-49ed-44f0-85a0-4ab71d4f5d51 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:57.278948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0043f-dfe4-4a51-9a80-545200d5101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:57.280225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0043f-dfe4-4a51-9a80-545200d5101f admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:57.280225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0043f-dfe4-4a51-9a80-545200d5101f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:57.280571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0043f-dfe4-4a51-9a80-545200d5101f admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:57.281579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0043f-dfe4-4a51-9a80-545200d5101f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:57.284535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0043f-dfe4-4a51-9a80-545200d5101f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:57.295635 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4128/8239] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:32:57.299298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:57.314286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b963c16-0bef-4614-9385-522d0feb2716 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:57.319719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:57.320837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:57.321231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:57.321626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] PATH_INFO: `/v3/projects/bc95151a35ea4e35b567edf469eb4b42/users/be11c009c2d647d59e5ab06ad9a79a77/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:57.339573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc95151a35ea4e35b567edf469eb4b42, user_id=be11c009c2d647d59e5ab06ad9a79a77, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:57.344448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:57.366851 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4112/8240] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:32:57 2022] PUT /identity/v3/projects/bc95151a35ea4e35b567edf469eb4b42/users/be11c009c2d647d59e5ab06ad9a79a77/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:32:57.373098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930bbaa-9e0c-495e-bcfc-4049e2cdd290 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:57.373505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930bbaa-9e0c-495e-bcfc-4049e2cdd290 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:57.374213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930bbaa-9e0c-495e-bcfc-4049e2cdd290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:57.404696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c930bbaa-9e0c-495e-bcfc-4049e2cdd290 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:57.407321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c930bbaa-9e0c-495e-bcfc-4049e2cdd290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:57.482217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:57.493795 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4129/8241] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:57.503443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:57.505537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:57.566288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c137c-b0a9-4125-8e58-81285ab92932 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:57.571679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:57.572361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:57.572648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:57.572926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:57.584072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:57.585779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:57.597706 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4113/8242] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:57.759761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10729b76-394f-4d1d-a46a-0cdfe3d88bb4 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:57.760952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10729b76-394f-4d1d-a46a-0cdfe3d88bb4 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:57.761294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10729b76-394f-4d1d-a46a-0cdfe3d88bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:57.780360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-10729b76-394f-4d1d-a46a-0cdfe3d88bb4 None None] MFA Rules not processed for user `406628da7a8140fd83200ffc90e71198`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:57.781671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-10729b76-394f-4d1d-a46a-0cdfe3d88bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:57.844567 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4130/8243] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:58.116550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:58.118055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:58.135958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6db166-c92d-408e-9cf2-68dcec3ed2b4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:58.142847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:58.143858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:58.144259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:58.144645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] PATH_INFO: `/v3/users/2b8e738d654f4d73888ff1aa24c4566d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:58.146822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8e738d654f4d73888ff1aa24c4566d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:58.149127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:58.205468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:58.214613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8e738d654f4d73888ff1aa24c4566d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:58.215867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8e738d654f4d73888ff1aa24c4566d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:58.254820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8e738d654f4d73888ff1aa24c4566d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:58.256615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8e738d654f4d73888ff1aa24c4566d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:58.282592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8e738d654f4d73888ff1aa24c4566d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:58.307520 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4114/8244] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:58 2022] DELETE /identity/v3/users/2b8e738d654f4d73888ff1aa24c4566d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:58.310061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:58.310570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:58.311018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:58.357636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:32:58.358850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:58.450210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4131/8245] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:32:58.476473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:58.478358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:58.552284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af080d3-1270-4931-aae1-5c988a8bbc71 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:58.557284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:58.557957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:58.558416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:58.558860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:58.570285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:58.572383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:58.589597 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4115/8246] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:58.710280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:58.711860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:58.737443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004a4f6-450e-4157-889d-c97f8810d06b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:58.743810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:58.744735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:58.745833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:58.745833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:58.748611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:58.854340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:58.855846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:58.874210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4132/8247] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:32:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:32:58.991144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:58.992700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:32:59.015043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943a333-908f-4109-8b81-231ac2de318b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:59.034095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:59.035549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:59.035549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:59.035549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] PATH_INFO: `/v3/projects/e4380f4a345b4cffb731c106bec8241a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:59.036791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4380f4a345b4cffb731c106bec8241a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:59.038761 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:59.137452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4380f4a345b4cffb731c106bec8241a', 'request_id': 'req-15bd3e3f-06b7-4d48-8654-4c098e540eed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.149046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4380f4a345b4cffb731c106bec8241a', 'request_id': 'req-15bd3e3f-06b7-4d48-8654-4c098e540eed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.160796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4380f4a345b4cffb731c106bec8241a', 'request_id': 'req-15bd3e3f-06b7-4d48-8654-4c098e540eed'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.181919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] The token cache is being invalidate because project e4380f4a345b4cffb731c106bec8241a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:32:59.182214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.183087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.185218 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4116/8248] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:32:58 2022] DELETE /identity/v3/projects/e4380f4a345b4cffb731c106bec8241a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:32:59.189306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:32:59.205697 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113334cb-f70e-4ff9-9d64-749a7097fe3e service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:32:59.351803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:59.414205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:32:59.415613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:32:59.415900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:32:59.418402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] PATH_INFO: `/v3/users/37c6058dd6d24ef6aacec58f2575b064` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:32:59.433373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c6058dd6d24ef6aacec58f2575b064)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:32:59.443169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:32:59.584680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c6058dd6d24ef6aacec58f2575b064'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.586580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c6058dd6d24ef6aacec58f2575b064'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.615036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c6058dd6d24ef6aacec58f2575b064'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.616047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c6058dd6d24ef6aacec58f2575b064'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.642504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-965b348e-e2dc-4489-aea2-31cc540698a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c6058dd6d24ef6aacec58f2575b064'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:32:59.676321 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4133/8249] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:32:59 2022] DELETE /identity/v3/users/37c6058dd6d24ef6aacec58f2575b064 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:00.405739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:00.407830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:00.430692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd3e3f-06b7-4d48-8654-4c098e540eed admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:00.553502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:00.593059 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:00.594313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:00.594749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:00.595173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] PATH_INFO: `/v3/projects/2b9c5bada5824b56964f281823f2cfae` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:00.596850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9c5bada5824b56964f281823f2cfae)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:00.599171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:00.721876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9c5bada5824b56964f281823f2cfae', 'request_id': 'req-e1681b8f-f6d4-4bec-96d9-8449daae6de1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:00.732260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9c5bada5824b56964f281823f2cfae', 'request_id': 'req-e1681b8f-f6d4-4bec-96d9-8449daae6de1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:00.760900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9c5bada5824b56964f281823f2cfae', 'request_id': 'req-e1681b8f-f6d4-4bec-96d9-8449daae6de1'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:00.784537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] The token cache is being invalidate because project 2b9c5bada5824b56964f281823f2cfae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:00.784537 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:00.785286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e1681b8f-f6d4-4bec-96d9-8449daae6de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:00.789559 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4117/8250] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:00 2022] DELETE /identity/v3/projects/2b9c5bada5824b56964f281823f2cfae => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:00.793864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d8ac-49b3-4b16-b9af-5181ae73b47c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:00.795473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d8ac-49b3-4b16-b9af-5181ae73b47c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:00.795839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d8ac-49b3-4b16-b9af-5181ae73b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:00.832407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2887d8ac-49b3-4b16-b9af-5181ae73b47c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:00.842520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2887d8ac-49b3-4b16-b9af-5181ae73b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:00.959076 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4134/8251] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:00.959947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4859-bffc-4bb6-9558-038640cd8b65 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:00.960837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4859-bffc-4bb6-9558-038640cd8b65 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:00.961178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4859-bffc-4bb6-9558-038640cd8b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.004450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-259a4859-bffc-4bb6-9558-038640cd8b65 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:01.006174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-259a4859-bffc-4bb6-9558-038640cd8b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:01.021849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d8ac-49b3-4b16-b9af-5181ae73b47c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:01.025794 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4118/8252] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:33:01.045443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d8ac-49b3-4b16-b9af-5181ae73b47c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:01.081980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:01.084235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:01.085067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:01.085067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.085996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:01.086416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:01.088347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:01.104225 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4135/8253] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:01.108882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4859-bffc-4bb6-9558-038640cd8b65 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:01.123589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4859-bffc-4bb6-9558-038640cd8b65 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:01.137657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:01.138672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:01.139362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:01.139362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.140086 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:01.143035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:01.207101 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4119/8254] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:01 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:01.208524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:01.219937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e285e-02c1-416e-9daa-9f938ffd9e80 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:01.304933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:01.328421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:01.329254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:01.329828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:01.330365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.331440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:01.336026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:01.393088 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4136/8255] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:01 2022] POST /identity/v3/users => generated 279 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:01.397308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:01.419063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c32b2-5e9d-4e67-b6a0-d62a7adb6374 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:01.429679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:01.430784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:01.431925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:01.432394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.433441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:01.436292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:01.449935 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4120/8256] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:01.453923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:01.471173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35319a-adfa-487d-8dff-052bfbcabc3c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:01.488478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02486-5452-465d-9d6b-21677e733bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:01.489253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02486-5452-465d-9d6b-21677e733bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:01.489547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02486-5452-465d-9d6b-21677e733bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:01.489894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02486-5452-465d-9d6b-21677e733bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.490688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02486-5452-465d-9d6b-21677e733bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:01.492479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02486-5452-465d-9d6b-21677e733bb5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:01.509814 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4137/8257] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:01.510752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:01.538628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943cddd-f681-4b7f-b454-ca6ac139c178 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:01.554032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:01.557017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:01.558424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:01.561466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] PATH_INFO: `/v3/projects/6c5a3665c543459a8a9d1a0f74bce31d/users/23b3e8036b7e450d8fcfbd8c6630be7c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.602181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5a3665c543459a8a9d1a0f74bce31d, user_id=23b3e8036b7e450d8fcfbd8c6630be7c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:01.608802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:01.648347 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4121/8258] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:01 2022] PUT /identity/v3/projects/6c5a3665c543459a8a9d1a0f74bce31d/users/23b3e8036b7e450d8fcfbd8c6630be7c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:01.661530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc789b-3345-4645-9bf6-aec520d391bc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:01.661959 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc789b-3345-4645-9bf6-aec520d391bc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:01.662303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc789b-3345-4645-9bf6-aec520d391bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:01.744022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cadc789b-3345-4645-9bf6-aec520d391bc None None] MFA Rules not processed for user `23b3e8036b7e450d8fcfbd8c6630be7c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:01.745325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cadc789b-3345-4645-9bf6-aec520d391bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:01.918738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:01.919373 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4138/8259] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:01 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:02.072653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfded34-6cc5-433b-90cd-eafc620d8667 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:02.086480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:02.087297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:02.087650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:02.087999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:02.088813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:02.091576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:02.127908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:02.155476 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4122/8260] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:01 2022] POST /identity/v3/projects => generated 357 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:33:02.158496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc789b-3345-4645-9bf6-aec520d391bc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:02.182963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc789b-3345-4645-9bf6-aec520d391bc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:02.328845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:02.329599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:02.330388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:02.331888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:02.332616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:02.338448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:02.389832 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4139/8261] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:02 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:02.393562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:02.410685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca822165-dbcd-4c97-8f25-01a2c93ddded admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:02.419273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:02.420867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:02.421442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:02.422001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:02.423173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:02.425234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:02.444030 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4123/8262] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:02.448846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:02.477405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f31f-90d8-443b-8b5e-8ec3d684d6c5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:02.483720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:02.487773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:02.488331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:02.488804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] PATH_INFO: `/v3/projects/72a92ecf0ab641e781fef9f049abe37c/users/51bf310b8c4541e4a3eb9df9a713ceb5/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:02.536009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a92ecf0ab641e781fef9f049abe37c, user_id=51bf310b8c4541e4a3eb9df9a713ceb5, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:02.540321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:02.571503 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4140/8263] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:02 2022] PUT /identity/v3/projects/72a92ecf0ab641e781fef9f049abe37c/users/51bf310b8c4541e4a3eb9df9a713ceb5/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:02.575770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:02.586756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4872a7-46a4-44b9-b52f-22e31aec4d73 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:02.663989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb3c9-4f2e-42fd-826c-7d9d568e7ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:02.665025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb3c9-4f2e-42fd-826c-7d9d568e7ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:02.665429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb3c9-4f2e-42fd-826c-7d9d568e7ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:02.666131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb3c9-4f2e-42fd-826c-7d9d568e7ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:02.666650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb3c9-4f2e-42fd-826c-7d9d568e7ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:02.668811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb3c9-4f2e-42fd-826c-7d9d568e7ab9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:02.689391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:02.690348 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4124/8264] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:02.705878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b37c8-6080-4a56-a76a-6fb602e3f44c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:02.712280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:02.722553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:02.723244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:02.723714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] PATH_INFO: `/v3/projects/72a92ecf0ab641e781fef9f049abe37c/users/51bf310b8c4541e4a3eb9df9a713ceb5/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:02.726340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a92ecf0ab641e781fef9f049abe37c, user_id=51bf310b8c4541e4a3eb9df9a713ceb5, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:02.730964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:02.755802 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4141/8265] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:02 2022] PUT /identity/v3/projects/72a92ecf0ab641e781fef9f049abe37c/users/51bf310b8c4541e4a3eb9df9a713ceb5/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:02.764599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b53c-6400-4aa7-80ec-8ddc510fac3d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:02.764796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b53c-6400-4aa7-80ec-8ddc510fac3d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:02.765164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b53c-6400-4aa7-80ec-8ddc510fac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:02.859174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-77c8b53c-6400-4aa7-80ec-8ddc510fac3d None None] MFA Rules not processed for user `51bf310b8c4541e4a3eb9df9a713ceb5`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:02.860716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-77c8b53c-6400-4aa7-80ec-8ddc510fac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:03.054426 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4125/8266] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:02 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:03.055778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:03.069651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295562-0964-414c-9787-3737696070a3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:03.079648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51bf310b8c4541e4a3eb9df9a713ceb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72a92ecf0ab641e781fef9f049abe37c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:03.081325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:03.081830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:03.082150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:03.082942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:03.083224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:03.085846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:03.087695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:03.110559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b53c-6400-4aa7-80ec-8ddc510fac3d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:03.121712 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4142/8267] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:03.145499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:03.148174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:03.149313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b53c-6400-4aa7-80ec-8ddc510fac3d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:03.157266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51bf310b8c4541e4a3eb9df9a713ceb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72a92ecf0ab641e781fef9f049abe37c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:03.157969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:03.158261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:03.158543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:03.159258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:03.161397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:03.206936 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4126/8268] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:03 2022] POST /identity/v3/projects => generated 349 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:03.210373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:03.299833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:03.311884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7a14c-f633-4789-ba8b-136ce0a4f0c9 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:03.349737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd55ea8-c20a-4bc2-9c0a-452360026cbf tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:03.370824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51bf310b8c4541e4a3eb9df9a713ceb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72a92ecf0ab641e781fef9f049abe37c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:03.374844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:03.375747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:03.375747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:03.376939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:03.379264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:03.383075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:03.420179 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4127/8269] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:03.437061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:03.437756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:03.438039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:03.438312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:03.457331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:03.464163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:03.471095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:03.499390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cb374-d4ce-4810-8e1a-426255592e62 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:03.506990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:03.507673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:03.508023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:03.508666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:03.509871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:03.512563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:03.523882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:03.526848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:03.537487 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4143/8270] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:03.539320 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4128/8271] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:03 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:03.987678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:04.007364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cba2d-ed96-4035-b4c6-9cf07bb33fe4 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:04.023787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51bf310b8c4541e4a3eb9df9a713ceb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72a92ecf0ab641e781fef9f049abe37c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:04.025103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:04.025474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:04.025866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] PATH_INFO: `/v3/projects/652f06fedc334dceae26dd640171d099` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:04.042615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorizing `identity:delete_project(project_id=652f06fedc334dceae26dd640171d099)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:04.044818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:04.164426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652f06fedc334dceae26dd640171d099', 'request_id': 'req-020f887c-734b-44e9-af41-706901b825a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:04.178039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652f06fedc334dceae26dd640171d099', 'request_id': 'req-020f887c-734b-44e9-af41-706901b825a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:04.197745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652f06fedc334dceae26dd640171d099', 'request_id': 'req-020f887c-734b-44e9-af41-706901b825a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:04.229933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] The token cache is being invalidate because project 652f06fedc334dceae26dd640171d099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:04.230321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:04.230967 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-020f887c-734b-44e9-af41-706901b825a8 tempest-QuotasTest-1086124688 tempest-QuotasTest-1086124688-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:04.233165 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4144/8272] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:03 2022] DELETE /identity/v3/projects/652f06fedc334dceae26dd640171d099 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:05.110861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:05.244689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d90f7-3a43-4b02-8976-337882f57c0a service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:05.383982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:05.390639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:05.392769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:05.393754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] PATH_INFO: `/v3/users/23b3e8036b7e450d8fcfbd8c6630be7c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:05.399390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b3e8036b7e450d8fcfbd8c6630be7c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:05.413236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:05.558213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b3e8036b7e450d8fcfbd8c6630be7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:05.563399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b3e8036b7e450d8fcfbd8c6630be7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:05.588016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b3e8036b7e450d8fcfbd8c6630be7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:05.588676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b3e8036b7e450d8fcfbd8c6630be7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:05.594935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:05.597266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b3e8036b7e450d8fcfbd8c6630be7c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:05.625342 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4129/8273] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:05 2022] DELETE /identity/v3/users/23b3e8036b7e450d8fcfbd8c6630be7c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:05.627861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:05.627861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:05.627861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:05.662027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:05.663521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:05.716197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:05.783918 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4145/8274] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:05.807639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:05.811214 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:05.916104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042fd66-60b3-4898-8300-ff6e43f5f496 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:05.920734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:05.921925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:05.922270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:05.922648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:05.934802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:05.936425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:05.949664 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4130/8275] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:07.164608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:07.166151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:07.180416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64f5f-dfa2-47bf-8266-bc0df2262b86 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:07.185943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:07.186918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:07.187138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:07.187414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] PATH_INFO: `/v3/projects/6c5a3665c543459a8a9d1a0f74bce31d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:07.188674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5a3665c543459a8a9d1a0f74bce31d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:07.190691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:07.262883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5a3665c543459a8a9d1a0f74bce31d', 'request_id': 'req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.270194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5a3665c543459a8a9d1a0f74bce31d', 'request_id': 'req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.286937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5a3665c543459a8a9d1a0f74bce31d', 'request_id': 'req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.303949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] The token cache is being invalidate because project 6c5a3665c543459a8a9d1a0f74bce31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:07.304248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.304924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-140f297a-ad4c-471b-8d66-dd2aa04cf6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.307032 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4146/8276] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:07 2022] DELETE /identity/v3/projects/6c5a3665c543459a8a9d1a0f74bce31d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:07.311342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:07.322678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc34660-607b-4995-8866-c8a8be609cd0 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:07.397897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:07.398976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:07.399254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:07.399528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] PATH_INFO: `/v3/users/51bf310b8c4541e4a3eb9df9a713ceb5` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:07.400991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51bf310b8c4541e4a3eb9df9a713ceb5)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:07.404061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:07.515610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51bf310b8c4541e4a3eb9df9a713ceb5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.516557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51bf310b8c4541e4a3eb9df9a713ceb5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.546972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51bf310b8c4541e4a3eb9df9a713ceb5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.547757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51bf310b8c4541e4a3eb9df9a713ceb5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.565492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51bf310b8c4541e4a3eb9df9a713ceb5'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:07.586948 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4131/8277] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:07 2022] DELETE /identity/v3/users/51bf310b8c4541e4a3eb9df9a713ceb5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:08.302593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.303488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.304078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.341905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] MFA Rules not processed for user `be11c009c2d647d59e5ab06ad9a79a77`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:08.343599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:08.426111 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4147/8278] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:08.430096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:08.432060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:08.451095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:08.492404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:08.494557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:08.543390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674b19e-61e0-42a3-b2b8-16b45454ff9f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:08.550269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:08.551563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.552074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.552554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.553584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:08.555973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:08.575583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:08.606649 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4132/8279] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:08 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:33:08.607871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:08.611045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3bb88-d1fe-43ce-89b3-6e9c3ce50715 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:08.702066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af380a7-8618-44ee-a18b-19597c997dbb admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:08.705545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e92d-0689-4002-9440-082862638994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:08.706690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e92d-0689-4002-9440-082862638994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.706934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:08.707180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e92d-0689-4002-9440-082862638994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.707552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e92d-0689-4002-9440-082862638994 admin admin] PATH_INFO: `/v3/projects/72a92ecf0ab641e781fef9f049abe37c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.707668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.707958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.708147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.708848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:08.709406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789e92d-0689-4002-9440-082862638994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a92ecf0ab641e781fef9f049abe37c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:08.710994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:08.711675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789e92d-0689-4002-9440-082862638994 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:08.734152 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4133/8280] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:08 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:08.734863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:08.736434 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:08.749001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dfb6-1e07-4a2c-b7ef-7e96e124e8c2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:08.758782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:08.758782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.758782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.758782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] PATH_INFO: `/v3/users/08014ddde12a4fc088c34738c29b8c81` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.759205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08014ddde12a4fc088c34738c29b8c81)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:08.759804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:08.775915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a92ecf0ab641e781fef9f049abe37c', 'request_id': 'req-f789e92d-0689-4002-9440-082862638994'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.783426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a92ecf0ab641e781fef9f049abe37c', 'request_id': 'req-f789e92d-0689-4002-9440-082862638994'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.795324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a92ecf0ab641e781fef9f049abe37c', 'request_id': 'req-f789e92d-0689-4002-9440-082862638994'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.807873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f789e92d-0689-4002-9440-082862638994 admin admin] The token cache is being invalidate because project 72a92ecf0ab641e781fef9f049abe37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:08.808282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.809051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.816209 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4148/8281] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:08 2022] DELETE /identity/v3/projects/72a92ecf0ab641e781fef9f049abe37c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:08.816209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:08.816209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:08.822574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08014ddde12a4fc088c34738c29b8c81'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.823488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08014ddde12a4fc088c34738c29b8c81'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.839255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08014ddde12a4fc088c34738c29b8c81'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.839990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08014ddde12a4fc088c34738c29b8c81'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.847595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-74b448b5-a99b-4edf-b4bd-b477b379aa06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08014ddde12a4fc088c34738c29b8c81'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:08.857668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:08.864267 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4134/8282] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:08 2022] DELETE /identity/v3/users/08014ddde12a4fc088c34738c29b8c81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:08.865861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb2d7-faa8-4e34-992c-b54c741edae9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.866406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb2d7-faa8-4e34-992c-b54c741edae9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.868083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcb2d7-faa8-4e34-992c-b54c741edae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.891097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e92d-0689-4002-9440-082862638994 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:08.891366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-34dcb2d7-faa8-4e34-992c-b54c741edae9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:08.892636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-34dcb2d7-faa8-4e34-992c-b54c741edae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:08.926382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:08.973401 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4135/8283] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:08.982031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3d7df-d162-4462-affc-d00f54131b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:08.982896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d7df-d162-4462-affc-d00f54131b6a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.983053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87408-37b4-49e1-a88b-c1f4acad9e2f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:08.983252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87408-37b4-49e1-a88b-c1f4acad9e2f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.983456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d7df-d162-4462-affc-d00f54131b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:08.983585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87408-37b4-49e1-a88b-c1f4acad9e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.983909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d7df-d162-4462-affc-d00f54131b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:08.986072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3d7df-d162-4462-affc-d00f54131b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:08.986845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3d7df-d162-4462-affc-d00f54131b6a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.001447 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4149/8284] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:09.002990 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.003387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.003867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.029004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:09.030907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:09.032619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e3d87408-37b4-49e1-a88b-c1f4acad9e2f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:09.037585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3d87408-37b4-49e1-a88b-c1f4acad9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:09.048746 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4150/8285] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:09.053979 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4136/8286] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:09.054189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.055315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d87408-37b4-49e1-a88b-c1f4acad9e2f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.061386 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:09.076049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c326-293c-4e1e-a070-ed1dde4c754d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.078801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d87408-37b4-49e1-a88b-c1f4acad9e2f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.081662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.082583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.082868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.083149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] PATH_INFO: `/v3/projects/33de6b37fcb24e4db04544578a04c3b7/users/7ca7bff0733f4822957ebd43ce88b0a4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.087943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.088808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.089228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.089599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.090599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:09.091048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.092914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.119491 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4137/8287] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:09.120425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.124016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:09.125254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33de6b37fcb24e4db04544578a04c3b7, user_id=7ca7bff0733f4822957ebd43ce88b0a4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.132736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.162273 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4151/8288] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:09 2022] PUT /identity/v3/projects/33de6b37fcb24e4db04544578a04c3b7/users/7ca7bff0733f4822957ebd43ce88b0a4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:09.163341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.275365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb1467-c73c-4703-be86-c885582b2a30 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.307886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7425148-bf24-4054-bfca-3797c13c076a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.311106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.311271 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.311574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.313928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.314873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.318374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.366290 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4152/8289] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:09 2022] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:09.368635 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.386819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.387736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.388189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.388570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.404227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.409893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.423526 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4138/8290] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:09.433349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.446735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcec227-af68-4eae-94c7-fd6a0e68ba70 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.454136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.456561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.456850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.457164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.457924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.459581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.461142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74004bef-cc1e-494e-b44f-6327df5a89da service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.471763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4153/8291] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:09.476479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.479770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.480524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.481468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.481881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.483491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.489060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.500085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d20084-c818-4336-b1a9-845365efc222 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.507131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.508449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.508832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.509244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] PATH_INFO: `/v3/projects/33de6b37fcb24e4db04544578a04c3b7/users/7ca7bff0733f4822957ebd43ce88b0a4/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.512427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33de6b37fcb24e4db04544578a04c3b7, user_id=7ca7bff0733f4822957ebd43ce88b0a4, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.516409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.536658 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4154/8292] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:09 2022] PUT /identity/v3/projects/33de6b37fcb24e4db04544578a04c3b7/users/7ca7bff0733f4822957ebd43ce88b0a4/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:09.542309 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4139/8293] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:09 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:09.548617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.572374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:09.724532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeab8f-80c3-42df-afc7-78e19ed0aff1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.736909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.739269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.739542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:09.742128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.742128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.745731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.745912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.750638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.777190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5245c-f965-4d95-9bb2-7d5755107118 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.782068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4155/8294] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:09.785699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.796821 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.797993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.798376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.798751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] PATH_INFO: `/v3/projects/af80217fc26f457cbd0e3713dcee4739` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.800113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af80217fc26f457cbd0e3713dcee4739)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.802390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.809297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457bef8-ab56-49c2-9b77-304f9c2f6882 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.824166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:09.825430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:09.827118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:09.827636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:09.829250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:09.832058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:09.842105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:09.863878 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4156/8295] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:33:09.867639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:09.893717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326c992-c4fb-487e-b126-277475be7868 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:09.927062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af80217fc26f457cbd0e3713dcee4739', 'request_id': 'req-50be566b-92b3-4698-bdcc-7acf5c139153'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:09.946146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af80217fc26f457cbd0e3713dcee4739', 'request_id': 'req-50be566b-92b3-4698-bdcc-7acf5c139153'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:09.965476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af80217fc26f457cbd0e3713dcee4739', 'request_id': 'req-50be566b-92b3-4698-bdcc-7acf5c139153'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:09.982726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] The token cache is being invalidate because project af80217fc26f457cbd0e3713dcee4739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:09.997475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:09.999530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-50be566b-92b3-4698-bdcc-7acf5c139153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:10.004602 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4140/8296] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:09 2022] DELETE /identity/v3/projects/af80217fc26f457cbd0e3713dcee4739 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:33:10.012760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fe9d1-b846-4392-9063-889122cbd8fb None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.015407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fe9d1-b846-4392-9063-889122cbd8fb None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.016115 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fe9d1-b846-4392-9063-889122cbd8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.052167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-902fe9d1-b846-4392-9063-889122cbd8fb None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:10.055463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-902fe9d1-b846-4392-9063-889122cbd8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:10.058139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1439171-505a-45d1-b5b4-e61360d16e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.059384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1439171-505a-45d1-b5b4-e61360d16e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.059840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1439171-505a-45d1-b5b4-e61360d16e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.060211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1439171-505a-45d1-b5b4-e61360d16e76 admin admin] PATH_INFO: `/v3/projects/a51e3ed6b6624560bd29183dabd06ad2/users/0ff4a06dd81f4e83b3965f26a04b4170/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.078743 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4141/8297] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:10.087314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e731f2-e394-49b2-889a-c2cdd1efeb1b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.088066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e731f2-e394-49b2-889a-c2cdd1efeb1b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.088230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e731f2-e394-49b2-889a-c2cdd1efeb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.095992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1439171-505a-45d1-b5b4-e61360d16e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51e3ed6b6624560bd29183dabd06ad2, user_id=0ff4a06dd81f4e83b3965f26a04b4170, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.099022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1439171-505a-45d1-b5b4-e61360d16e76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.113286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f4e731f2-e394-49b2-889a-c2cdd1efeb1b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:10.116428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f4e731f2-e394-49b2-889a-c2cdd1efeb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:10.130602 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4157/8298] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:09 2022] PUT /identity/v3/projects/a51e3ed6b6624560bd29183dabd06ad2/users/0ff4a06dd81f4e83b3965f26a04b4170/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:10.140938 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4142/8299] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:33:10.143532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.143860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.144145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.145367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e731f2-e394-49b2-889a-c2cdd1efeb1b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.171456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e731f2-e394-49b2-889a-c2cdd1efeb1b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.194085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] MFA Rules not processed for user `0ff4a06dd81f4e83b3965f26a04b4170`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:10.195379 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:10.315700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.316698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.317748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.318186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.319135 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:10.319603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.325797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.329083 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4158/8300] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:10.332067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.337862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:10.352242 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4143/8301] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:10.358453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.368251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:10.375331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797c4f-6f1c-4ea8-8879-0d1447b0bff6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.377074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167afa6b-5989-4d93-843a-45bb535592e0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.380574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.381398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.381783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.382061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.383055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.385104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.389702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.390824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.390824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.391247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.392071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.394326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.426389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4144/8302] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:10.431960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.450008 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4159/8303] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:10.453092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.538754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974e506-0613-4d1a-8fef-d328e4800cb5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.544192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:10.555392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf596dd3-860d-4c5f-9a9b-15eaf148e498 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.572372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.572372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.572372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.588313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.589254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.591321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.640479 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4160/8304] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/users => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:10.641890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.649116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.649947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.650336 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.651273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.652179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.654588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.660306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173f567-f63b-4e44-8b12-07dca4e6c700 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.667619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.668689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.669075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.669374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.670177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.672729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.688077 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4145/8305] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:10.689208 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4161/8306] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:10.690358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.692136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.702714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceb453-5302-44fe-ba30-e6cfcf80a881 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.703343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effb22e-7a7e-4851-adf8-22cb957d7486 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.708749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.709576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.710052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.710445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.711393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.711577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.712806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.713572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.713815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.714528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] PATH_INFO: `/v3/projects/2f0e8546ae1c4fb5b2600b77da5d2b7c/users/dfc30808ee0449ac8ea31f461b39139f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.740744 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4162/8307] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:33:10.741318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0e8546ae1c4fb5b2600b77da5d2b7c, user_id=dfc30808ee0449ac8ea31f461b39139f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.744409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.744738 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.762468 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4146/8308] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:10 2022] PUT /identity/v3/projects/2f0e8546ae1c4fb5b2600b77da5d2b7c/users/dfc30808ee0449ac8ea31f461b39139f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:10.767166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.784799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87d1a9-45cb-4f52-aed4-345d539bc4ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.882269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c608-7ed8-43a7-8409-5e01d6894111 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.887568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.888780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.890209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.891065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.891988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.894227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.909721 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4147/8309] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:10.913637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.925472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574b88e-3796-4f60-b1d7-f9fc368b1521 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.932896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ab6ea-4b53-49fe-bb59-12ff9b3efca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.934514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab6ea-4b53-49fe-bb59-12ff9b3efca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.935515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab6ea-4b53-49fe-bb59-12ff9b3efca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.936975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab6ea-4b53-49fe-bb59-12ff9b3efca4 admin admin] PATH_INFO: `/v3/projects/2f0e8546ae1c4fb5b2600b77da5d2b7c/users/dfc30808ee0449ac8ea31f461b39139f/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.940201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:10.943446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.943733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.944011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:10.944766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.946039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ab6ea-4b53-49fe-bb59-12ff9b3efca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0e8546ae1c4fb5b2600b77da5d2b7c, user_id=dfc30808ee0449ac8ea31f461b39139f, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:10.946524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.952297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ab6ea-4b53-49fe-bb59-12ff9b3efca4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:10.961462 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4163/8310] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:33:10.965617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:10.975872 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4148/8311] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:10 2022] PUT /identity/v3/projects/2f0e8546ae1c4fb5b2600b77da5d2b7c/users/dfc30808ee0449ac8ea31f461b39139f/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:33:10.982921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200ce6d-a914-45ca-a86c-eb35741b6a82 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:10.988355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:10.988942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:10.989483 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:11.044237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] MFA Rules not processed for user `dfc30808ee0449ac8ea31f461b39139f`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:11.046512 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:11.054904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:11.090118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21caf9b-6b2b-4c25-8e7f-a23696a6bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:11.091121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21caf9b-6b2b-4c25-8e7f-a23696a6bbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:11.091407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21caf9b-6b2b-4c25-8e7f-a23696a6bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:11.091781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21caf9b-6b2b-4c25-8e7f-a23696a6bbd2 admin admin] PATH_INFO: `/v3/projects/0ea6a2d8d3c3489aa3b0199fd3492915/users/7d4a1e9194b34c60b9b0c418282589f9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:11.119160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21caf9b-6b2b-4c25-8e7f-a23696a6bbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea6a2d8d3c3489aa3b0199fd3492915, user_id=7d4a1e9194b34c60b9b0c418282589f9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:11.123437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21caf9b-6b2b-4c25-8e7f-a23696a6bbd2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:11.139031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:11.155979 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4164/8312] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:10 2022] PUT /identity/v3/projects/0ea6a2d8d3c3489aa3b0199fd3492915/users/7d4a1e9194b34c60b9b0c418282589f9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:33:11.168048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d950-c4e6-4e1d-8759-4295cfe1b466 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:11.168756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d950-c4e6-4e1d-8759-4295cfe1b466 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:11.169810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6d950-c4e6-4e1d-8759-4295cfe1b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:11.181435 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4149/8313] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:33:11.190513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:11.192492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:11.221417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ec6d950-c4e6-4e1d-8759-4295cfe1b466 None None] MFA Rules not processed for user `7d4a1e9194b34c60b9b0c418282589f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:11.223035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ec6d950-c4e6-4e1d-8759-4295cfe1b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:11.301892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd2dcd-bec4-45d5-b7c3-e5fbe75a982b None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:11.382996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb334-c4f4-4938-9606-7e69e769fd99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:11.383776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb334-c4f4-4938-9606-7e69e769fd99 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:11.384272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb334-c4f4-4938-9606-7e69e769fd99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:11.384670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb334-c4f4-4938-9606-7e69e769fd99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:11.402471 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4165/8314] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:33:11.413802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6d950-c4e6-4e1d-8759-4295cfe1b466 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:11.432101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6d950-c4e6-4e1d-8759-4295cfe1b466 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:11.437648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:11.438346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:11.438634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:11.438914 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:11.454573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:11.456244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:11.487085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4166/8315] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:33:11.522957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb334-c4f4-4938-9606-7e69e769fd99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:11.524782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb334-c4f4-4938-9606-7e69e769fd99 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:11.540268 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4150/8316] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:33:15.352661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:15.555907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8a053-cbab-42d4-af75-90ec277238d7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:15.561774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:15.562693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:15.562976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:15.563252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] PATH_INFO: `/v3/users/0ff4a06dd81f4e83b3965f26a04b4170` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:15.564647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff4a06dd81f4e83b3965f26a04b4170)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:15.566658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:15.650087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff4a06dd81f4e83b3965f26a04b4170'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:15.651005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff4a06dd81f4e83b3965f26a04b4170'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:15.652489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:15.683241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff4a06dd81f4e83b3965f26a04b4170'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:15.684660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff4a06dd81f4e83b3965f26a04b4170'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:15.694757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff4a06dd81f4e83b3965f26a04b4170'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:15.715885 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4167/8317] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:15 2022] DELETE /identity/v3/users/0ff4a06dd81f4e83b3965f26a04b4170 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:15.725265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:15.726818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:15.727272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:15.752201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:15.754033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:15.827272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:15.884062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:15.887147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:15.908395 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4151/8318] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:16.008725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3025d-5c2a-456b-b217-201b59199bf2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:16.014936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aaa4b3-d4ec-4571-a86e-045b1b27f1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:16.017828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa4b3-d4ec-4571-a86e-045b1b27f1df service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:16.018268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa4b3-d4ec-4571-a86e-045b1b27f1df service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:16.019196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaa4b3-d4ec-4571-a86e-045b1b27f1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:16.064404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aaa4b3-d4ec-4571-a86e-045b1b27f1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:16.066031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aaa4b3-d4ec-4571-a86e-045b1b27f1df service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:16.083003 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4168/8319] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:33:16.814961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:16.821424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:16.847849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8dfea-bff4-42a6-8468-8bb7237802a4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:16.856315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:16.857624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:16.858065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:16.858405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:16.861339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:16.958619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:16.959163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:16.959163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:16.988119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:16.990009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:17.003113 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4152/8320] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:17.064811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] MFA Rules not processed for user `7ca7bff0733f4822957ebd43ce88b0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:17.066376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:17.119950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:17.121892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:17.143452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4622-8407-42cf-8a03-00a4da856d0f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:17.151431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:17.152603 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:17.152859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:17.153874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] PATH_INFO: `/v3/projects/a51e3ed6b6624560bd29183dabd06ad2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:17.155484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51e3ed6b6624560bd29183dabd06ad2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:17.157920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:17.204139 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4169/8321] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:17.218543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:17.220417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:17.239848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51e3ed6b6624560bd29183dabd06ad2', 'request_id': 'req-e3c16af1-3b09-42e5-b797-670629459cd3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.250249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51e3ed6b6624560bd29183dabd06ad2', 'request_id': 'req-e3c16af1-3b09-42e5-b797-670629459cd3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.265073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51e3ed6b6624560bd29183dabd06ad2', 'request_id': 'req-e3c16af1-3b09-42e5-b797-670629459cd3'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.294997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] The token cache is being invalidate because project a51e3ed6b6624560bd29183dabd06ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:17.295868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.296987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.299066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:17.302390 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4153/8322] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:17 2022] DELETE /identity/v3/projects/a51e3ed6b6624560bd29183dabd06ad2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:17.307958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:17.311384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:17.357829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6cdd-f228-42bd-8fbf-3e34212c2d85 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:17.486641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c16af1-3b09-42e5-b797-670629459cd3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:17.492599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:17.494015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:17.494163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:17.494455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] PATH_INFO: `/v3/users/dfc30808ee0449ac8ea31f461b39139f` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:17.497681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc30808ee0449ac8ea31f461b39139f)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:17.499586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:17.508355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:17.513309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:17.514314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:17.517156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:17.517668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:17.519816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:17.595095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc30808ee0449ac8ea31f461b39139f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.596267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc30808ee0449ac8ea31f461b39139f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.632752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc30808ee0449ac8ea31f461b39139f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.634352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc30808ee0449ac8ea31f461b39139f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.643601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc30808ee0449ac8ea31f461b39139f'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:17.643844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:17.646936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:17.660246 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4154/8323] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:17 2022] DELETE /identity/v3/users/dfc30808ee0449ac8ea31f461b39139f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:33:17.665255 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4170/8324] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:33:18.036520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:18.045335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:18.200361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:18.216418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecbb-52a0-454e-ba46-efdd6b578631 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:18.253395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e9e64-ac29-4db0-9c56-f5f3baf496a6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:18.263987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1823869-3b24-4486-a15a-d3ab26987a59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:18.269463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1823869-3b24-4486-a15a-d3ab26987a59 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:18.270596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1823869-3b24-4486-a15a-d3ab26987a59 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:18.271585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1823869-3b24-4486-a15a-d3ab26987a59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:18.275329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a1823869-3b24-4486-a15a-d3ab26987a59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:18.322182 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:18.323074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:18.323367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:18.323639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] PATH_INFO: `/v3/projects/2f0e8546ae1c4fb5b2600b77da5d2b7c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:18.325463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0e8546ae1c4fb5b2600b77da5d2b7c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:18.328471 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:18.332923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1823869-3b24-4486-a15a-d3ab26987a59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:18.336575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1823869-3b24-4486-a15a-d3ab26987a59 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:18.376886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:18.397584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4155/8325] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:18.400998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0e8546ae1c4fb5b2600b77da5d2b7c', 'request_id': 'req-87cc9132-4f8d-4331-85a2-8ca96d78d33d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:18.408948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0e8546ae1c4fb5b2600b77da5d2b7c', 'request_id': 'req-87cc9132-4f8d-4331-85a2-8ca96d78d33d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:18.426983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0e8546ae1c4fb5b2600b77da5d2b7c', 'request_id': 'req-87cc9132-4f8d-4331-85a2-8ca96d78d33d'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:18.461528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] The token cache is being invalidate because project 2f0e8546ae1c4fb5b2600b77da5d2b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:18.461822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:18.462694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-87cc9132-4f8d-4331-85a2-8ca96d78d33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:18.466330 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4171/8326] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:18 2022] DELETE /identity/v3/projects/2f0e8546ae1c4fb5b2600b77da5d2b7c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:33:18.472056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4f213-03d2-4f36-8a5c-024c094f91c4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:18.472597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4f213-03d2-4f36-8a5c-024c094f91c4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:18.473418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4f213-03d2-4f36-8a5c-024c094f91c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:18.508501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-67d4f213-03d2-4f36-8a5c-024c094f91c4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:18.511551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-67d4f213-03d2-4f36-8a5c-024c094f91c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:18.715374 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4156/8327] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:18.724071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76701f-d03d-437b-8345-ddba8deddc69 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:18.724287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76701f-d03d-437b-8345-ddba8deddc69 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:18.724559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76701f-d03d-437b-8345-ddba8deddc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:18.766694 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5e76701f-d03d-437b-8345-ddba8deddc69 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:18.769179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5e76701f-d03d-437b-8345-ddba8deddc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:18.793799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4f213-03d2-4f36-8a5c-024c094f91c4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:18.804368 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4172/8328] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:18.811901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4f213-03d2-4f36-8a5c-024c094f91c4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:18.835932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:18.836665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:18.836949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:18.837240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:18.838002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:18.838307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:18.852085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:18.888719 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4157/8329] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:33:18.893794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76701f-d03d-437b-8345-ddba8deddc69 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:18.905918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76701f-d03d-437b-8345-ddba8deddc69 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:18.919091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:18.919805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:18.920084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:18.920375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:18.921094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:18.923138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:18.997095 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4173/8330] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:18 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:19.001111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:19.007065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:19.025828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9126573-a262-4d3d-b3a8-c09e85962faf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:19.087333 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:19.089534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:19.149492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:19.150208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:19.150593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:19.150876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:19.151581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:19.156158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:19.198550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448f2d4-f5a1-4001-bec7-043465efca32 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:19.202114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4158/8331] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:19 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:19.203414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:19.210831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:19.211567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:19.211788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:19.212064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:19.214548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:19.223221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d591b8-9756-40d4-ba3d-ca07b9e5e99d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:19.236735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:19.238210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:19.239483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:19.239640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:19.239865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:19.241674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:19.242980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:19.247168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:19.274062 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4159/8332] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:33:19.274281 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4174/8333] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:19.275758 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:19.295750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2dc7-57b4-4317-89e3-7e75c077638d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:19.316488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266828b-fe33-48c2-bbf5-b96c2212644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:19.317239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266828b-fe33-48c2-bbf5-b96c2212644f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:19.317517 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266828b-fe33-48c2-bbf5-b96c2212644f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:19.318436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266828b-fe33-48c2-bbf5-b96c2212644f admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:19.319212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266828b-fe33-48c2-bbf5-b96c2212644f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:19.320866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266828b-fe33-48c2-bbf5-b96c2212644f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:19.348663 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4160/8334] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:19.349363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:19.384570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cb4a7-109a-47a0-8624-c0ee8fad1655 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:19.415771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:19.416718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:19.416999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:19.417302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] PATH_INFO: `/v3/projects/ac2d77a8fd14417dbd753c43fb0eb884/users/646109438db143358242fe80435bd974/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:19.452370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2d77a8fd14417dbd753c43fb0eb884, user_id=646109438db143358242fe80435bd974, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:19.455702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:19.500832 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4175/8335] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:19 2022] PUT /identity/v3/projects/ac2d77a8fd14417dbd753c43fb0eb884/users/646109438db143358242fe80435bd974/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:19.512969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9920c-8649-438a-8e50-1926bf8f51ba None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:19.513323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9920c-8649-438a-8e50-1926bf8f51ba None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:19.513667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9920c-8649-438a-8e50-1926bf8f51ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:19.553656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d4a9920c-8649-438a-8e50-1926bf8f51ba None None] MFA Rules not processed for user `646109438db143358242fe80435bd974`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:19.555138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d4a9920c-8649-438a-8e50-1926bf8f51ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:19.743350 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4161/8336] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:19.796607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:19.798464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:19.903844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1e695-6ae1-4a69-9d52-606c7d9a94d9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:19.908299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca48435-4109-4753-9d61-726dd9917c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:19.909429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca48435-4109-4753-9d61-726dd9917c43 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:19.909932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca48435-4109-4753-9d61-726dd9917c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:19.910403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca48435-4109-4753-9d61-726dd9917c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:19.922589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:19.935901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca48435-4109-4753-9d61-726dd9917c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:19.938422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca48435-4109-4753-9d61-726dd9917c43 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:19.961558 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4176/8337] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:20.045158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9920c-8649-438a-8e50-1926bf8f51ba None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:20.194177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9920c-8649-438a-8e50-1926bf8f51ba None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:20.209796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:20.210521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:20.210792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:20.211065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] PATH_INFO: `/v3/users/646109438db143358242fe80435bd974` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:20.214395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=646109438db143358242fe80435bd974)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:20.217245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:20.221297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:20.363694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646109438db143358242fe80435bd974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:20.364547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646109438db143358242fe80435bd974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:20.400622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646109438db143358242fe80435bd974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:20.401553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646109438db143358242fe80435bd974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:20.418972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646109438db143358242fe80435bd974'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:20.452302 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4162/8338] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:20 2022] DELETE /identity/v3/users/646109438db143358242fe80435bd974 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:20.456949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:20.457489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:20.463255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:20.502329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:20.503754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:20.633253 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4177/8339] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:20.655058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:20.656960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:20.872358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c499f-78bc-422a-9e04-318e6b3a3be0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:20.889161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae591e-2a88-475c-b0e2-ce57aed94f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:20.889848 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae591e-2a88-475c-b0e2-ce57aed94f53 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:20.890134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae591e-2a88-475c-b0e2-ce57aed94f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:20.890418 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae591e-2a88-475c-b0e2-ce57aed94f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:20.917228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae591e-2a88-475c-b0e2-ce57aed94f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:20.919793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae591e-2a88-475c-b0e2-ce57aed94f53 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:20.945324 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4163/8340] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:21.586825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:21.588968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:21.615794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15668fab-534a-4a16-98a2-0dc29c69b350 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:21.632496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:21.633638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:21.634010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:21.634350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] PATH_INFO: `/v3/projects/ac2d77a8fd14417dbd753c43fb0eb884` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:21.635670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2d77a8fd14417dbd753c43fb0eb884)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:21.638004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:21.712585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2d77a8fd14417dbd753c43fb0eb884', 'request_id': 'req-06ea4f52-06c2-4374-bd8b-8176fe684324'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:21.720566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2d77a8fd14417dbd753c43fb0eb884', 'request_id': 'req-06ea4f52-06c2-4374-bd8b-8176fe684324'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:21.734725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2d77a8fd14417dbd753c43fb0eb884', 'request_id': 'req-06ea4f52-06c2-4374-bd8b-8176fe684324'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:21.770080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] The token cache is being invalidate because project ac2d77a8fd14417dbd753c43fb0eb884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:21.770080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:21.770080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-06ea4f52-06c2-4374-bd8b-8176fe684324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:21.770080 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4178/8341] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:21 2022] DELETE /identity/v3/projects/ac2d77a8fd14417dbd753c43fb0eb884 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:21.773638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d9fa-dd66-4d47-baeb-36f0e189618f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:21.774057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d9fa-dd66-4d47-baeb-36f0e189618f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:21.774261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d9fa-dd66-4d47-baeb-36f0e189618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:21.843198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3056d9fa-dd66-4d47-baeb-36f0e189618f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:21.844660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3056d9fa-dd66-4d47-baeb-36f0e189618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:22.013069 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4164/8342] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:22.021232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675603bf-4b7c-460c-9ba2-d81570fe238d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.021523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675603bf-4b7c-460c-9ba2-d81570fe238d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.021806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675603bf-4b7c-460c-9ba2-d81570fe238d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.049220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-675603bf-4b7c-460c-9ba2-d81570fe238d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:22.050770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-675603bf-4b7c-460c-9ba2-d81570fe238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:22.068736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d9fa-dd66-4d47-baeb-36f0e189618f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:22.076259 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4179/8343] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:22.081999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d9fa-dd66-4d47-baeb-36f0e189618f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:22.088111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:22.089066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.089482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.089815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.090813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:22.091190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:22.093309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:22.108026 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4165/8344] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:22.112547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675603bf-4b7c-460c-9ba2-d81570fe238d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:22.130601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675603bf-4b7c-460c-9ba2-d81570fe238d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:22.143458 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:22.144188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.144474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.144757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.146218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:22.151627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:22.206314 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4180/8345] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:22 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:22.210539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:22.224941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3accf-90d4-41ee-9e85-a61c05263515 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:22.235150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:22.328871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:22.329817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.330198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.330901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.331647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:22.333753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:22.374939 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4166/8346] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:22 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:33:22.379261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:22.393119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f051-e999-4166-9337-81129e0c2293 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:22.400611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:22.403388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.403894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.404197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.404952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:22.406686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:22.419068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4181/8347] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:22.423586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:22.435361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68918224-f816-4f60-af9c-3db859a26165 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:22.442664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be2b00-9a1e-469e-8547-06543d023fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:22.442837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2b00-9a1e-469e-8547-06543d023fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.443298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2b00-9a1e-469e-8547-06543d023fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.443575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2b00-9a1e-469e-8547-06543d023fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.444321 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be2b00-9a1e-469e-8547-06543d023fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:22.446148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be2b00-9a1e-469e-8547-06543d023fe0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:22.464237 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4167/8348] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:22.470111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:22.485190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342ccdf-7be6-4b43-b56d-c631b9250690 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:22.490920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:22.491936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.492290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.492783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] PATH_INFO: `/v3/projects/cde873f15b0a48159e2c2cc3a914eb6f/users/336d8fa7c42543acbf06cef87d94a30a/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.516852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde873f15b0a48159e2c2cc3a914eb6f, user_id=336d8fa7c42543acbf06cef87d94a30a, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:22.520517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:22.551129 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4182/8349] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:22 2022] PUT /identity/v3/projects/cde873f15b0a48159e2c2cc3a914eb6f/users/336d8fa7c42543acbf06cef87d94a30a/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:22.554408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.556260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.556816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.608785 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] MFA Rules not processed for user `336d8fa7c42543acbf06cef87d94a30a`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:22.610138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:22.745141 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4168/8350] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:22.756531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:22.759362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:22.780107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:22.843722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266ceb-8828-4c10-abe6-038af9bc7254 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:22.848808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:22.849797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:22.850082 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:22.850363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:22.861776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:22.863433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:22.877732 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4183/8351] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:31.942351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:31.943945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:32.073466 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2bdaa-c156-4997-a82d-6c0b6d076807 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:32.099198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:32.101423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:32.101960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:32.102239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] PATH_INFO: `/v3/users/be11c009c2d647d59e5ab06ad9a79a77` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:32.109150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be11c009c2d647d59e5ab06ad9a79a77)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:32.115488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:32.153802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:32.199568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39d48-16b9-4f04-a6c0-80d3cca10064 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:32.271931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:32.279360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:32.279831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:32.283785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:32.302460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:32.337765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:32.348433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:32.368939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:32.416073 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4184/8352] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:32.433826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be11c009c2d647d59e5ab06ad9a79a77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:32.434843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be11c009c2d647d59e5ab06ad9a79a77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:32.463084 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be11c009c2d647d59e5ab06ad9a79a77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:32.465238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be11c009c2d647d59e5ab06ad9a79a77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:32.495526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be11c009c2d647d59e5ab06ad9a79a77'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:32.518806 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4169/8353] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:31 2022] DELETE /identity/v3/users/be11c009c2d647d59e5ab06ad9a79a77 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:33.018470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:33.041719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f630c3d-ed29-4c27-97b0-5ba6e5323427 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:33.198683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:33.199787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:33.200170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:33.200549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] PATH_INFO: `/v3/projects/bc95151a35ea4e35b567edf469eb4b42` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:33.203624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc95151a35ea4e35b567edf469eb4b42)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:33.206134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:33.319183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc95151a35ea4e35b567edf469eb4b42', 'request_id': 'req-79604d65-6301-43b9-a72a-83432bae1a5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.330166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc95151a35ea4e35b567edf469eb4b42', 'request_id': 'req-79604d65-6301-43b9-a72a-83432bae1a5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.345489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc95151a35ea4e35b567edf469eb4b42', 'request_id': 'req-79604d65-6301-43b9-a72a-83432bae1a5a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.370940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] The token cache is being invalidate because project bc95151a35ea4e35b567edf469eb4b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:33.371540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.372810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.378484 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4185/8354] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:33 2022] DELETE /identity/v3/projects/bc95151a35ea4e35b567edf469eb4b42 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:33.379577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:33.381225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:33.410852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee97d77-cb72-40e8-9609-6d7c5651030d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:33.552819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:33.553812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:33.554094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:33.554368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] PATH_INFO: `/v3/users/7ca7bff0733f4822957ebd43ce88b0a4` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:33.556087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca7bff0733f4822957ebd43ce88b0a4)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:33.558088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:33.645208 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca7bff0733f4822957ebd43ce88b0a4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.645883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca7bff0733f4822957ebd43ce88b0a4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.669952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca7bff0733f4822957ebd43ce88b0a4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.671261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca7bff0733f4822957ebd43ce88b0a4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.693524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-eb4e8946-181d-4db4-85eb-e5f97f76cf79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca7bff0733f4822957ebd43ce88b0a4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:33.735957 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4170/8355] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:33 2022] DELETE /identity/v3/users/7ca7bff0733f4822957ebd43ce88b0a4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:34.035512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:34.043975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:34.068279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79604d65-6301-43b9-a72a-83432bae1a5a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:34.123547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:34.165629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:34.166883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:34.167624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:34.168045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] PATH_INFO: `/v3/projects/33de6b37fcb24e4db04544578a04c3b7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:34.169717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33de6b37fcb24e4db04544578a04c3b7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:34.172919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:34.274802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33de6b37fcb24e4db04544578a04c3b7', 'request_id': 'req-2829eddb-3f44-4398-a868-d00a5c4671d4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:34.282685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33de6b37fcb24e4db04544578a04c3b7', 'request_id': 'req-2829eddb-3f44-4398-a868-d00a5c4671d4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:34.294707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33de6b37fcb24e4db04544578a04c3b7', 'request_id': 'req-2829eddb-3f44-4398-a868-d00a5c4671d4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:34.309873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] The token cache is being invalidate because project 33de6b37fcb24e4db04544578a04c3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:34.310225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:34.311393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-2829eddb-3f44-4398-a868-d00a5c4671d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:34.317704 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4186/8356] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:34 2022] DELETE /identity/v3/projects/33de6b37fcb24e4db04544578a04c3b7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:34.319728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417a01-70a2-4620-8606-608da20fd2b5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:34.320226 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417a01-70a2-4620-8606-608da20fd2b5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:34.320800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae417a01-70a2-4620-8606-608da20fd2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:34.347168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ae417a01-70a2-4620-8606-608da20fd2b5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:34.348843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ae417a01-70a2-4620-8606-608da20fd2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:34.365973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:34.441845 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4171/8357] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:34.451048 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb96c56-8cdc-45c6-8702-15bcf337150c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:34.451475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb96c56-8cdc-45c6-8702-15bcf337150c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:34.451851 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb96c56-8cdc-45c6-8702-15bcf337150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:34.475022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9eb96c56-8cdc-45c6-8702-15bcf337150c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:34.476399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9eb96c56-8cdc-45c6-8702-15bcf337150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:34.489286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4187/8358] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:34.493923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417a01-70a2-4620-8606-608da20fd2b5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:34.505110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae417a01-70a2-4620-8606-608da20fd2b5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:34.511041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:34.512141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:34.512443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:34.512731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:34.513757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:34.514054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:34.530019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:34.565381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb96c56-8cdc-45c6-8702-15bcf337150c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:34.576417 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4172/8359] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:34.580180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb96c56-8cdc-45c6-8702-15bcf337150c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:34.604763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:34.608687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:34.610378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:34.610768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:34.611638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:34.622735 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:34.713079 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4188/8360] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:34 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:34.717437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:34.732249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c96da-5f6c-4848-858f-d71bc98ec3f6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:34.846567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:34.846567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:34.846567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:34.846567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:34.850315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:34.852423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:34.919293 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4173/8361] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:34 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:34.920764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:34.938378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b387b-8257-4ae8-af55-38676315e35a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:34.945187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:34.945892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:34.946451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:34.946811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:34.947837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:34.950742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:34.980455 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4189/8362] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:34.981845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:34.999128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59547711-8dce-4413-9ddc-0c5874381acf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:35.011813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fde5f-be46-44cd-8d5e-d445f5f42a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:35.012616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fde5f-be46-44cd-8d5e-d445f5f42a33 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.014091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fde5f-be46-44cd-8d5e-d445f5f42a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.015020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fde5f-be46-44cd-8d5e-d445f5f42a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.015307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fde5f-be46-44cd-8d5e-d445f5f42a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:35.019551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fde5f-be46-44cd-8d5e-d445f5f42a33 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:35.051722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4174/8363] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:35.056269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:35.076296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96391a-3707-4d52-aa29-df5932d22f7d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:35.102193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:35.105783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.106446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.106962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] PATH_INFO: `/v3/projects/521b75c65b1a4064befdab485a1dfec2/users/259af49e467e4c4fbd01ae55251511e3/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.135253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521b75c65b1a4064befdab485a1dfec2, user_id=259af49e467e4c4fbd01ae55251511e3, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:35.139933 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:35.181674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4190/8364] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:35 2022] PUT /identity/v3/projects/521b75c65b1a4064befdab485a1dfec2/users/259af49e467e4c4fbd01ae55251511e3/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:35.186623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd9a20-e70a-467b-953f-abe32e26e96c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.186917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd9a20-e70a-467b-953f-abe32e26e96c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.187196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd9a20-e70a-467b-953f-abe32e26e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.274959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-47dd9a20-e70a-467b-953f-abe32e26e96c None None] MFA Rules not processed for user `259af49e467e4c4fbd01ae55251511e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:35.276638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-47dd9a20-e70a-467b-953f-abe32e26e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:35.428584 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4175/8365] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:35.429335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:35.515676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ba709-d855-46a1-a396-482e807f8f10 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:35.521558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:35.522558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.523035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.523491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.524371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:35.528782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:35.535456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:35.573440 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4191/8366] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:35 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:33:35.574534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd9a20-e70a-467b-953f-abe32e26e96c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:35.589897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd9a20-e70a-467b-953f-abe32e26e96c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:35.605077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:35.708239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:35.709103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.709441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.709775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.710571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:35.712614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:35.736313 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4176/8367] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:35 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:35.740099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:35.751212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671e18-7c3d-44ce-ba27-b7cc177ba182 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:35.756146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:35.756827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.757140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.757416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.758150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:35.760118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:35.774859 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4192/8368] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:35.776085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:35.787042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcffba-4875-4189-a6e5-72a00a2252c3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:35.793073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caffea-6c4a-4b88-8c22-daee385bc29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:35.793851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caffea-6c4a-4b88-8c22-daee385bc29e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.794034 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caffea-6c4a-4b88-8c22-daee385bc29e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.794305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caffea-6c4a-4b88-8c22-daee385bc29e admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.795055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caffea-6c4a-4b88-8c22-daee385bc29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:35.797077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caffea-6c4a-4b88-8c22-daee385bc29e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:35.815792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4177/8369] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:33:35.817067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:35.832165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e434db-72ab-4cbc-b7d5-87f2ed7a6e4b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:35.837292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:35.838340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.838884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.839246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] PATH_INFO: `/v3/projects/2cb8493cefbd4d8fbae905bd2df24cac/users/11a9008c26844666955868adbeee0f42/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.859713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb8493cefbd4d8fbae905bd2df24cac, user_id=11a9008c26844666955868adbeee0f42, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:35.862714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:35.882953 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4193/8370] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:35 2022] PUT /identity/v3/projects/2cb8493cefbd4d8fbae905bd2df24cac/users/11a9008c26844666955868adbeee0f42/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:33:35.893995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500be89e-7851-4974-9ace-17375188f876 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:35.894382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500be89e-7851-4974-9ace-17375188f876 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:35.894752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500be89e-7851-4974-9ace-17375188f876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:35.926857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-500be89e-7851-4974-9ace-17375188f876 None None] MFA Rules not processed for user `11a9008c26844666955868adbeee0f42`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:35.928118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-500be89e-7851-4974-9ace-17375188f876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:36.013863 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4178/8371] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:36.015043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:36.085254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870312e-c80e-4f07-bb79-ce87cb81bcdb admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:36.091336 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:36.092030 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.092314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.092594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:36.093389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:36.095335 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:36.130399 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4194/8372] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:36 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:36.134718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500be89e-7851-4974-9ace-17375188f876 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:36.149277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500be89e-7851-4974-9ace-17375188f876 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:36.224354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:36.224928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.225408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.226427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:36.226826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:36.229534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:36.273284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4179/8373] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:36 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:36.277460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:36.288820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419e623-af1e-4165-905c-5e2358700bab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:36.294577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:36.295837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.295837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.296037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:36.296732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:36.298650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:36.311057 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4195/8374] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:36.315365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:36.326286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366428e7-21fe-4803-9c3c-26f6d61f6594 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:36.331498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:36.332397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.332679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.332955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] PATH_INFO: `/v3/projects/5476b0847e4e43eebd45bee30a9da6db/users/73dc2e822cef4aada7d0e3119555b811/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:36.337317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:36.352806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5476b0847e4e43eebd45bee30a9da6db, user_id=73dc2e822cef4aada7d0e3119555b811, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:36.355595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:36.384042 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4180/8375] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:36 2022] PUT /identity/v3/projects/5476b0847e4e43eebd45bee30a9da6db/users/73dc2e822cef4aada7d0e3119555b811/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:36.385189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:36.399384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d75e9-4b00-4b3d-9887-dcc093ce9ff1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:36.475330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3fa84-59dd-40f3-a34a-703ef693e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:36.476757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3fa84-59dd-40f3-a34a-703ef693e990 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.477248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3fa84-59dd-40f3-a34a-703ef693e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.479268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3fa84-59dd-40f3-a34a-703ef693e990 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:36.479268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3fa84-59dd-40f3-a34a-703ef693e990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:36.479903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3fa84-59dd-40f3-a34a-703ef693e990 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:36.492118 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4196/8376] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:36.497383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:36.512688 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe32336-88dc-483b-ac07-6e7d9189615b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:36.520105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:36.521191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.521574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.522116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] PATH_INFO: `/v3/projects/5476b0847e4e43eebd45bee30a9da6db/users/73dc2e822cef4aada7d0e3119555b811/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:36.524527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5476b0847e4e43eebd45bee30a9da6db, user_id=73dc2e822cef4aada7d0e3119555b811, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:36.528306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:36.555357 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4181/8377] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:36 2022] PUT /identity/v3/projects/5476b0847e4e43eebd45bee30a9da6db/users/73dc2e822cef4aada7d0e3119555b811/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:36.568660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.568813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.569175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:36.609413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] MFA Rules not processed for user `73dc2e822cef4aada7d0e3119555b811`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:36.610685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:36.621414 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:36.746016 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4197/8378] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:36.767061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:36.768975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:36.953083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96341b7-3627-4577-be0a-7bf62fb6691b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:36.964388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:36.967247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:36.967839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:36.968440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:37.067969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:37.070382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:37.091944 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4182/8379] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:40.895917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:40.898844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:41.004821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663b4c2-e354-49f0-afa8-10007e8e6435 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:41.009451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0539d-4149-4e6d-93a8-b2b139e76dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:41.010448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0539d-4149-4e6d-93a8-b2b139e76dae service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:41.010946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0539d-4149-4e6d-93a8-b2b139e76dae service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:41.011592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0539d-4149-4e6d-93a8-b2b139e76dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:41.023846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0539d-4149-4e6d-93a8-b2b139e76dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:41.026154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0539d-4149-4e6d-93a8-b2b139e76dae service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:41.052905 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4198/8380] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:41.556628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:41.558357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:41.666767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceda46f-c771-463a-8cd4-14263de83d9d service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:41.672608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:41.673952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:41.674233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:41.674509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] PATH_INFO: `/v3/users/336d8fa7c42543acbf06cef87d94a30a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:41.675845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336d8fa7c42543acbf06cef87d94a30a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:41.686970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:41.704911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:41.809187 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336d8fa7c42543acbf06cef87d94a30a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:41.810021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336d8fa7c42543acbf06cef87d94a30a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:41.840211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336d8fa7c42543acbf06cef87d94a30a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:41.841419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336d8fa7c42543acbf06cef87d94a30a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:41.861259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336d8fa7c42543acbf06cef87d94a30a'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:41.891116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4183/8381] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:41 2022] DELETE /identity/v3/users/336d8fa7c42543acbf06cef87d94a30a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:41.893797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:41.894095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:41.894373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:41.941404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:41.945022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:42.094716 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4199/8382] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:33:42.127013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:42.128641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:42.283290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca4d1e-bcaf-43fc-b539-4d3692cf51f1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:42.289975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa2241-bf91-44a3-b7cd-cbda0b01f857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:42.312981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2241-bf91-44a3-b7cd-cbda0b01f857 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:42.314459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2241-bf91-44a3-b7cd-cbda0b01f857 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:42.314756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa2241-bf91-44a3-b7cd-cbda0b01f857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:42.334912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa2241-bf91-44a3-b7cd-cbda0b01f857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:42.337891 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa2241-bf91-44a3-b7cd-cbda0b01f857 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:42.359555 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4184/8383] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:42.904586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:42.910356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:42.937537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06f5a3-9d9d-4efc-91eb-f2d350f7a4bd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:42.946200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:42.950618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:42.951186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:42.952053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] PATH_INFO: `/v3/projects/cde873f15b0a48159e2c2cc3a914eb6f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:42.955612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde873f15b0a48159e2c2cc3a914eb6f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:42.958829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:43.069267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:43.076728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde873f15b0a48159e2c2cc3a914eb6f', 'request_id': 'req-7cb004ae-2a6b-4aed-905b-3188ad9051f7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:43.090775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde873f15b0a48159e2c2cc3a914eb6f', 'request_id': 'req-7cb004ae-2a6b-4aed-905b-3188ad9051f7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:43.104070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde873f15b0a48159e2c2cc3a914eb6f', 'request_id': 'req-7cb004ae-2a6b-4aed-905b-3188ad9051f7'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:43.145815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] The token cache is being invalidate because project cde873f15b0a48159e2c2cc3a914eb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:43.147003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:43.148001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7cb004ae-2a6b-4aed-905b-3188ad9051f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:43.152483 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4200/8384] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:42 2022] DELETE /identity/v3/projects/cde873f15b0a48159e2c2cc3a914eb6f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:43.157632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9ef9-1ce2-4807-bae2-76e30db7b661 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:43.158162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9ef9-1ce2-4807-bae2-76e30db7b661 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:43.158162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9ef9-1ce2-4807-bae2-76e30db7b661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:43.191745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e97c9ef9-1ce2-4807-bae2-76e30db7b661 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:43.193085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e97c9ef9-1ce2-4807-bae2-76e30db7b661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:43.344757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634150b-896d-495e-8f59-5588332ed20d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:43.345070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634150b-896d-495e-8f59-5588332ed20d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:43.345217 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4185/8385] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:43.345364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634150b-896d-495e-8f59-5588332ed20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:43.384994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-c634150b-896d-495e-8f59-5588332ed20d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:43.386349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c634150b-896d-495e-8f59-5588332ed20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:43.406311 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4201/8386] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:33:43.410409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c9ef9-1ce2-4807-bae2-76e30db7b661 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:43.425760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c9ef9-1ce2-4807-bae2-76e30db7b661 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:43.438364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:43.445819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:43.447391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:43.448594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:43.451967 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:43.455020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:43.461513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:43.505974 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4186/8387] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:43.512326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634150b-896d-495e-8f59-5588332ed20d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:43.533704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634150b-896d-495e-8f59-5588332ed20d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:43.545391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:43.546085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:43.546375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:43.546672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:43.547540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:43.551208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:43.658726 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4202/8388] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:43 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:43.661596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:43.676701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea4e0-37de-4836-97e3-6841e38bc68e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:43.737431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:43.830519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:43.831237 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:43.831560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:43.831847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:43.834948 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:43.837871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:43.889181 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4187/8389] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:43 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:43.892712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:43.915771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f0068-f708-4a4e-adbd-b94b22452047 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:43.938490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:43.940670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:43.941316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:43.941928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:43.943537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:43.948688 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:43.974031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:43.999333 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4203/8390] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:44.005986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a8db1-b435-4521-9c28-51d95cb86743 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:44.012791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74352357-91c6-4e1f-9d41-615956ae09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:44.013833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74352357-91c6-4e1f-9d41-615956ae09a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:44.014653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74352357-91c6-4e1f-9d41-615956ae09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:44.015443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74352357-91c6-4e1f-9d41-615956ae09a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:44.016463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74352357-91c6-4e1f-9d41-615956ae09a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:44.018890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74352357-91c6-4e1f-9d41-615956ae09a5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:44.039129 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4188/8391] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:44.042478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:44.061164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee5015-0443-4ffa-b8c0-10d695f54b7a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:44.069763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:44.071246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:44.072104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:44.072572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] PATH_INFO: `/v3/projects/cf9309f5a76b4fee8c7430693d390b0b/users/b547c47f6e0b4b4a937d9c40b3cacf91/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:44.120566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9309f5a76b4fee8c7430693d390b0b, user_id=b547c47f6e0b4b4a937d9c40b3cacf91, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:44.127714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:44.157180 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4204/8392] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:44 2022] PUT /identity/v3/projects/cf9309f5a76b4fee8c7430693d390b0b/users/b547c47f6e0b4b4a937d9c40b3cacf91/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:44.173874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1a23-09fa-4913-a016-8b198223520c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:44.174367 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1a23-09fa-4913-a016-8b198223520c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:44.174610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af1a23-09fa-4913-a016-8b198223520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:44.223554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75af1a23-09fa-4913-a016-8b198223520c None None] MFA Rules not processed for user `b547c47f6e0b4b4a937d9c40b3cacf91`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:44.226111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75af1a23-09fa-4913-a016-8b198223520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:44.365083 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4189/8393] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:44.376035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:44.379052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:44.473968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246390fc-59c6-41fb-bd9d-6f52b8f74d12 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:44.479357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b292ec9-5966-4508-987e-30ff7fe5512c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:44.480054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b292ec9-5966-4508-987e-30ff7fe5512c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:44.480340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b292ec9-5966-4508-987e-30ff7fe5512c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:44.480613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b292ec9-5966-4508-987e-30ff7fe5512c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:44.493647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b292ec9-5966-4508-987e-30ff7fe5512c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:44.495172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b292ec9-5966-4508-987e-30ff7fe5512c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:44.508659 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4205/8394] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:45.866889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:45.868275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:45.868817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:45.913516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] MFA Rules not processed for user `61121749f1aa4a2285c8f270abb74fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:45.916591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:46.104950 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4190/8395] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:47.302576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fa555-425e-47f2-9f56-dcd25a609414 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:47.303117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fa555-425e-47f2-9f56-dcd25a609414 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:47.303117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fa555-425e-47f2-9f56-dcd25a609414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:47.342745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-013fa555-425e-47f2-9f56-dcd25a609414 None None] MFA Rules not processed for user `259af49e467e4c4fbd01ae55251511e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:47.345563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-013fa555-425e-47f2-9f56-dcd25a609414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:47.478637 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4206/8396] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:56.091345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:57.459081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:57.984855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:57.989795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:58.103801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95721da-8f1e-45ba-a619-0a2748510093 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:58.109584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:58.110866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:58.111314 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:58.111770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] PATH_INFO: `/v3/users/7d4a1e9194b34c60b9b0c418282589f9` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:58.113284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d4a1e9194b34c60b9b0c418282589f9)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:58.115590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:58.190328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d4a1e9194b34c60b9b0c418282589f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:58.191111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d4a1e9194b34c60b9b0c418282589f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:58.209638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d4a1e9194b34c60b9b0c418282589f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:58.210604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d4a1e9194b34c60b9b0c418282589f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:58.236424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d4a1e9194b34c60b9b0c418282589f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:58.267012 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4191/8397] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:33:57 2022] DELETE /identity/v3/users/7d4a1e9194b34c60b9b0c418282589f9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:58.272973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:58.273303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:58.273577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:58.311000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:58.313740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:58.434151 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4207/8398] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:58.449304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:58.450968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:58.558302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9dc5c-bc91-464c-8868-5be4c4cd8bc4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:58.572649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae971b-045a-48a3-a10b-d9ee72eea5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:58.574123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae971b-045a-48a3-a10b-d9ee72eea5da service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:58.575232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae971b-045a-48a3-a10b-d9ee72eea5da service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:58.575232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae971b-045a-48a3-a10b-d9ee72eea5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:58.588628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae971b-045a-48a3-a10b-d9ee72eea5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:58.592217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae971b-045a-48a3-a10b-d9ee72eea5da service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:58.612192 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4192/8399] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:33:58.920410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:58.922197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:58.968353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c4417-ab67-4c58-b6d2-d93024b584e7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:58.978053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:58.979299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:58.979663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:58.980401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] PATH_INFO: `/v3/projects/0ea6a2d8d3c3489aa3b0199fd3492915` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:58.982023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea6a2d8d3c3489aa3b0199fd3492915)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:58.984590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:59.080924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea6a2d8d3c3489aa3b0199fd3492915', 'request_id': 'req-09a76093-3083-4f24-85d8-3c333fe18406'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:59.088172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea6a2d8d3c3489aa3b0199fd3492915', 'request_id': 'req-09a76093-3083-4f24-85d8-3c333fe18406'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:59.103238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea6a2d8d3c3489aa3b0199fd3492915', 'request_id': 'req-09a76093-3083-4f24-85d8-3c333fe18406'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:59.127541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] The token cache is being invalidate because project 0ea6a2d8d3c3489aa3b0199fd3492915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:33:59.127841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:59.128500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-09a76093-3083-4f24-85d8-3c333fe18406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:33:59.130443 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4208/8400] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:33:58 2022] DELETE /identity/v3/projects/0ea6a2d8d3c3489aa3b0199fd3492915 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:59.138427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e515-e951-48d5-9edf-718bf9e38352 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.139024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e515-e951-48d5-9edf-718bf9e38352 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.139118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e515-e951-48d5-9edf-718bf9e38352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.174175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0b13e515-e951-48d5-9edf-718bf9e38352 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:59.176026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0b13e515-e951-48d5-9edf-718bf9e38352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:59.205893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:59.295172 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4193/8401] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:59.295796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91892f0c-b4ae-43a2-aca8-8df4a9c4982a None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.296091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91892f0c-b4ae-43a2-aca8-8df4a9c4982a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.296374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91892f0c-b4ae-43a2-aca8-8df4a9c4982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.322801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-91892f0c-b4ae-43a2-aca8-8df4a9c4982a None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:59.324486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-91892f0c-b4ae-43a2-aca8-8df4a9c4982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:59.334877 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4209/8402] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:59.340451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e515-e951-48d5-9edf-718bf9e38352 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:59.351735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e515-e951-48d5-9edf-718bf9e38352 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:59.359510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:59.360591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.361127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.361594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.362766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:33:59.364094 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:59.365503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:59.382037 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4194/8403] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:33:59.389430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91892f0c-b4ae-43a2-aca8-8df4a9c4982a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:59.404287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91892f0c-b4ae-43a2-aca8-8df4a9c4982a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:59.412099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:59.413105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.413508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.414066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.415427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:59.417636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:59.459467 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4210/8404] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:33:59 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:59.465462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:59.478923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209b01d-ae2c-4a18-a2bb-6b8462c19264 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:59.580407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:59.586920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.587893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.588553 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.591205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:59.595324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:59.623362 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4195/8405] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:33:59 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:33:59.627389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:59.639543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc4c2d-bbd5-46f5-9148-3c7194b7ecab admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:59.645888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:59.646582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.646869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.647181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.648026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:59.650005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:59.664529 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4211/8406] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:59.665811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:59.678031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85716c68-d62e-4e40-a80a-cddea60f6a36 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:59.685010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc8ac0-fc29-4649-80a4-91d0dc2ab8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:59.685901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8ac0-fc29-4649-80a4-91d0dc2ab8fe admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.686247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8ac0-fc29-4649-80a4-91d0dc2ab8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.686617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8ac0-fc29-4649-80a4-91d0dc2ab8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.688154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc8ac0-fc29-4649-80a4-91d0dc2ab8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:59.689705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc8ac0-fc29-4649-80a4-91d0dc2ab8fe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:59.703169 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4196/8407] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:33:59.707467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:59.726867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214cf04-0211-459c-b9a1-e8a5bb05429e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:33:59.733081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:33:59.734169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.734535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.734945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] PATH_INFO: `/v3/projects/93816e999a5545609c0863e1bcd2f40a/users/ac45109a72144718b737fc4b18323959/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.751311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93816e999a5545609c0863e1bcd2f40a, user_id=ac45109a72144718b737fc4b18323959, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:33:59.754049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:33:59.768819 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4212/8408] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:33:59 2022] PUT /identity/v3/projects/93816e999a5545609c0863e1bcd2f40a/users/ac45109a72144718b737fc4b18323959/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:33:59.779807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760024-f601-447e-be9e-b8297164910e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:33:59.780556 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760024-f601-447e-be9e-b8297164910e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:33:59.780942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760024-f601-447e-be9e-b8297164910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:33:59.823297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-53760024-f601-447e-be9e-b8297164910e None None] MFA Rules not processed for user `ac45109a72144718b737fc4b18323959`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:33:59.824815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-53760024-f601-447e-be9e-b8297164910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:59.923264 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4197/8409] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:33:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:33:59.934649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:33:59.936901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:33:59.969432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:00.044091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aea35-52b4-4185-9e44-7b2324d59342 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:00.049670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc58f4-2e0e-49eb-8a0d-1c72829c4897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:00.050811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc58f4-2e0e-49eb-8a0d-1c72829c4897 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:00.051141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc58f4-2e0e-49eb-8a0d-1c72829c4897 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:00.051510 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc58f4-2e0e-49eb-8a0d-1c72829c4897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:00.066001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc58f4-2e0e-49eb-8a0d-1c72829c4897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:00.068194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc58f4-2e0e-49eb-8a0d-1c72829c4897 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:00.081556 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4213/8410] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:33:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:34:09.919148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:10.075122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=17 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:24.373082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760024-f601-447e-be9e-b8297164910e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:24.457718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760024-f601-447e-be9e-b8297164910e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:24.462407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:24.463315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:24.463597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:24.463887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] PATH_INFO: `/v3/users/ac45109a72144718b737fc4b18323959` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:24.465125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac45109a72144718b737fc4b18323959)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:24.467067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:24.518508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac45109a72144718b737fc4b18323959'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:24.519170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac45109a72144718b737fc4b18323959'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:24.531622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac45109a72144718b737fc4b18323959'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:24.532292 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac45109a72144718b737fc4b18323959'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:24.541307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac45109a72144718b737fc4b18323959'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:24.560380 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4198/8411] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:34:24 2022] DELETE /identity/v3/users/ac45109a72144718b737fc4b18323959 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:34:24.565689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:24.566222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:24.566906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:24.587100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:24.588496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:24.651492 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4214/8412] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:34:24.661361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:24.662778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:24.727446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54d797-8ba0-4781-b965-6f30c7772cb3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:24.733376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5a75-87e6-4acd-97c6-ed6616b771d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:24.734124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5a75-87e6-4acd-97c6-ed6616b771d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:24.734405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5a75-87e6-4acd-97c6-ed6616b771d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:24.734674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5a75-87e6-4acd-97c6-ed6616b771d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:24.746378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5a75-87e6-4acd-97c6-ed6616b771d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:24.748030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5a75-87e6-4acd-97c6-ed6616b771d6 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:24.759949 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4199/8413] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:24.961294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:24.962849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:24.982185 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f028-b307-4c47-9014-3a7a37260cbc None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:24.988140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:24.989063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:24.989350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:24.989624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] PATH_INFO: `/v3/projects/93816e999a5545609c0863e1bcd2f40a` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:24.991157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93816e999a5545609c0863e1bcd2f40a)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:24.993189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:25.070662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93816e999a5545609c0863e1bcd2f40a', 'request_id': 'req-7afea4f4-5a79-4062-83c9-1493d495a928'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:25.078163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93816e999a5545609c0863e1bcd2f40a', 'request_id': 'req-7afea4f4-5a79-4062-83c9-1493d495a928'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:25.097145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93816e999a5545609c0863e1bcd2f40a', 'request_id': 'req-7afea4f4-5a79-4062-83c9-1493d495a928'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:25.116446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] The token cache is being invalidate because project 93816e999a5545609c0863e1bcd2f40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:34:25.116741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:25.117536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7afea4f4-5a79-4062-83c9-1493d495a928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:25.120115 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4215/8414] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:34:24 2022] DELETE /identity/v3/projects/93816e999a5545609c0863e1bcd2f40a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:25.125251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682203-f079-4062-a2a2-787d856abb34 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.127052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682203-f079-4062-a2a2-787d856abb34 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.128026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e682203-f079-4062-a2a2-787d856abb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.153788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3e682203-f079-4062-a2a2-787d856abb34 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:25.155184 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3e682203-f079-4062-a2a2-787d856abb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:25.175393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:25.262397 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4200/8415] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:25.271270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df08ae-6590-4708-b31d-a218c6e8c4e3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.271561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df08ae-6590-4708-b31d-a218c6e8c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.271843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df08ae-6590-4708-b31d-a218c6e8c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.301679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-22df08ae-6590-4708-b31d-a218c6e8c4e3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:25.302929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22df08ae-6590-4708-b31d-a218c6e8c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:25.318009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e682203-f079-4062-a2a2-787d856abb34 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:25.331785 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4216/8416] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:25.332234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e682203-f079-4062-a2a2-787d856abb34 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:25.337323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:25.338123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.338468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.338953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.339692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:34:25.340000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:25.342047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:25.356591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4201/8417] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:34:25.360976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df08ae-6590-4708-b31d-a218c6e8c4e3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:25.372834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df08ae-6590-4708-b31d-a218c6e8c4e3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:25.378398 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:25.379087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.379365 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.379641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.380355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:25.382768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:25.427825 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4217/8418] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:34:25 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:25.432851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:25.448660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fb0bf-d8bf-4825-a6df-56559584069f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:25.547072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:25.552673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.552969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.553280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.557111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:25.560322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:25.597113 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4202/8419] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:34:25 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:25.603045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:25.622557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae98960-b981-4268-bb1e-117eaaee61a5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:25.628695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:25.630147 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.630531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.631827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.637274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:25.643652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:25.663451 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4218/8420] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:25.667566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:25.685705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4c289-d488-43c1-8bf3-5189a40c0aa8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:25.691353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bd666-3730-4c16-ad08-0690f7de78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:25.692260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bd666-3730-4c16-ad08-0690f7de78c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.692400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bd666-3730-4c16-ad08-0690f7de78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.692593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bd666-3730-4c16-ad08-0690f7de78c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.693376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bd666-3730-4c16-ad08-0690f7de78c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:25.695006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bd666-3730-4c16-ad08-0690f7de78c5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:25.706882 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4203/8421] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:25.711289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:25.722397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e15e1-9ade-4091-94d8-0c0cbe10828b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:25.727277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:25.728245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.728528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.728804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] PATH_INFO: `/v3/projects/3c43e2eea79d4ef3a1ca3a4c315923c0/users/2bd9adf893c243bbacdb6b0b16f08173/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.746397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c43e2eea79d4ef3a1ca3a4c315923c0, user_id=2bd9adf893c243bbacdb6b0b16f08173, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:25.749470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:25.774190 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4219/8422] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:34:25 2022] PUT /identity/v3/projects/3c43e2eea79d4ef3a1ca3a4c315923c0/users/2bd9adf893c243bbacdb6b0b16f08173/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:34:25.785249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ae90-919f-4b55-b260-bc4c1c454a7e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:25.785532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ae90-919f-4b55-b260-bc4c1c454a7e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:25.785817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ae90-919f-4b55-b260-bc4c1c454a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:25.822131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5e75ae90-919f-4b55-b260-bc4c1c454a7e None None] MFA Rules not processed for user `2bd9adf893c243bbacdb6b0b16f08173`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:25.825768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5e75ae90-919f-4b55-b260-bc4c1c454a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:25.933951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:25.935989 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4204/8423] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:25.964737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:26.022734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e4f74-b115-4b50-9fa1-681ba7fa45d6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.028861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.029698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.030214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.030514 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.031284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.034624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.075435 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4220/8424] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:34:25 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:26.079532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75ae90-919f-4b55-b260-bc4c1c454a7e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:26.092960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75ae90-919f-4b55-b260-bc4c1c454a7e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.123252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:26.183372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.184274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.184544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.184893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.185857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.188241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.222186 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4205/8425] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:34:26 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:34:26.223214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:26.244962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ec6df-9ca6-4f51-a630-e7f13de567ba admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.250987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.251690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.251972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.252248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.252993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.254829 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.275734 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4221/8426] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:34:26.279611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:26.292088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35110-6f71-4774-a243-20d183441fbe admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.297727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.298657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.298973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.299428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] PATH_INFO: `/v3/projects/017cbf20939d4bd4840705ed3ac4d613/users/dd9e7027c1a9440cb67bb2a865fee5f6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.318350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=017cbf20939d4bd4840705ed3ac4d613, user_id=dd9e7027c1a9440cb67bb2a865fee5f6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.322889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.340692 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4206/8427] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:34:26 2022] PUT /identity/v3/projects/017cbf20939d4bd4840705ed3ac4d613/users/dd9e7027c1a9440cb67bb2a865fee5f6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:34:26.344882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:26.356348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16002dc4-dbbc-41f5-981b-b0cb64b441d0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.425794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60a11e-fb17-4440-b440-2c68aee3bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.426493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60a11e-fb17-4440-b440-2c68aee3bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.426788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60a11e-fb17-4440-b440-2c68aee3bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.427057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60a11e-fb17-4440-b440-2c68aee3bea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.428305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60a11e-fb17-4440-b440-2c68aee3bea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.429901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60a11e-fb17-4440-b440-2c68aee3bea3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.444659 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4222/8428] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:34:26.450163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:26.464959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d06783-b54c-4027-812d-aa2d157c4f2d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.473813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.474746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.475023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.475473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] PATH_INFO: `/v3/projects/017cbf20939d4bd4840705ed3ac4d613/users/dd9e7027c1a9440cb67bb2a865fee5f6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.477622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] RBAC: Authorizing `identity:create_grant(project_id=017cbf20939d4bd4840705ed3ac4d613, user_id=dd9e7027c1a9440cb67bb2a865fee5f6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.480382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.492290 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4207/8429] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:34:26 2022] PUT /identity/v3/projects/017cbf20939d4bd4840705ed3ac4d613/users/dd9e7027c1a9440cb67bb2a865fee5f6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:26.502617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022b7b-13e1-41d7-a988-8d086a3ce740 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.502910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022b7b-13e1-41d7-a988-8d086a3ce740 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.503195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8022b7b-13e1-41d7-a988-8d086a3ce740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.533509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d8022b7b-13e1-41d7-a988-8d086a3ce740 None None] MFA Rules not processed for user `dd9e7027c1a9440cb67bb2a865fee5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:26.534740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d8022b7b-13e1-41d7-a988-8d086a3ce740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:26.616717 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4223/8430] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:26.636792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:26.636792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:26.719271 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42057373-df0a-4271-b032-62ffa5e6540a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.723898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.725007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.725372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.725648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.740650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.742549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.755267 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4208/8431] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:26.852880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022b7b-13e1-41d7-a988-8d086a3ce740 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:26.871165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8022b7b-13e1-41d7-a988-8d086a3ce740 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:26.875402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:26.876077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:26.877088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:26.877088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:26.893814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:26.960081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:26.961614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:26.973735 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4224/8432] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:31.291432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:31.293047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:31.398010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae777b5-232f-4644-8d55-875b2a85c34e service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:31.406780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88956452-2cb1-485d-b7b4-e14296aca6ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:31.409826 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88956452-2cb1-485d-b7b4-e14296aca6ae service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:31.410435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88956452-2cb1-485d-b7b4-e14296aca6ae service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:31.411019 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88956452-2cb1-485d-b7b4-e14296aca6ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:31.413238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-88956452-2cb1-485d-b7b4-e14296aca6ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:31.430903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88956452-2cb1-485d-b7b4-e14296aca6ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:31.432706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88956452-2cb1-485d-b7b4-e14296aca6ae service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:31.459802 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4209/8433] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:34.178161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:34.271831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705be21a-da0e-448e-bd52-5ecd24cfe1e8 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:34.277097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:34.277707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:34.277984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:34.278254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] PATH_INFO: `/v3/users/2bd9adf893c243bbacdb6b0b16f08173` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:34.279457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd9adf893c243bbacdb6b0b16f08173)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:34.281648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:34.355702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd9adf893c243bbacdb6b0b16f08173'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:34.356908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd9adf893c243bbacdb6b0b16f08173'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:34.375120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd9adf893c243bbacdb6b0b16f08173'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:34.376233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd9adf893c243bbacdb6b0b16f08173'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:34.388804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd9adf893c243bbacdb6b0b16f08173'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:34.413117 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4225/8434] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:34:34 2022] DELETE /identity/v3/users/2bd9adf893c243bbacdb6b0b16f08173 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:34.417899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:34.419025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:34.420121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:34.428137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:34.450770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:34.452464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:34.562111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4210/8435] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:34.571518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:34.574788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:34.638274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:34.681753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a727b64-bffc-41eb-8f80-69838e7c6d1f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:34.686686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:34.687492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:34.687778 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:34.688107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:34.700743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:34.702254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:34.715475 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4226/8436] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:34:35.236763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:35.239077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:35.261120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e866c-6faa-4e5c-9157-c32a23dbb705 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:35.287106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:35.288021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:35.288301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:35.288581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] PATH_INFO: `/v3/projects/3c43e2eea79d4ef3a1ca3a4c315923c0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:35.290164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c43e2eea79d4ef3a1ca3a4c315923c0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:35.293896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:35.382986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c43e2eea79d4ef3a1ca3a4c315923c0', 'request_id': 'req-394824dd-8f43-4249-88e9-c5e2e0f76ca9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.393838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c43e2eea79d4ef3a1ca3a4c315923c0', 'request_id': 'req-394824dd-8f43-4249-88e9-c5e2e0f76ca9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.405770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c43e2eea79d4ef3a1ca3a4c315923c0', 'request_id': 'req-394824dd-8f43-4249-88e9-c5e2e0f76ca9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.421283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] The token cache is being invalidate because project 3c43e2eea79d4ef3a1ca3a4c315923c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:34:35.421913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.422488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.425916 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4211/8437] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:34:35 2022] DELETE /identity/v3/projects/3c43e2eea79d4ef3a1ca3a4c315923c0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:35.430263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:35.442408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972175-0643-455a-b44e-e6e5b4eb85a8 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:35.511845 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:35.513259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:35.513650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:35.514054 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] PATH_INFO: `/v3/users/dd9e7027c1a9440cb67bb2a865fee5f6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:35.515945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9e7027c1a9440cb67bb2a865fee5f6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:35.518696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:35.579880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9e7027c1a9440cb67bb2a865fee5f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.581427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9e7027c1a9440cb67bb2a865fee5f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.595601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9e7027c1a9440cb67bb2a865fee5f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.596568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9e7027c1a9440cb67bb2a865fee5f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.605710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-0392fc91-e1aa-43f6-b932-5f345669eda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9e7027c1a9440cb67bb2a865fee5f6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:35.622395 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4227/8438] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:34:35 2022] DELETE /identity/v3/users/dd9e7027c1a9440cb67bb2a865fee5f6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:34:35.957810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:35.959375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:35.979076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394824dd-8f43-4249-88e9-c5e2e0f76ca9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.078777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.080063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.080192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.080557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] PATH_INFO: `/v3/projects/017cbf20939d4bd4840705ed3ac4d613` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.081978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017cbf20939d4bd4840705ed3ac4d613)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.084137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.128423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:36.162585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017cbf20939d4bd4840705ed3ac4d613', 'request_id': 'req-99967676-2f63-4503-b73e-6d1df2532696'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:36.173149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017cbf20939d4bd4840705ed3ac4d613', 'request_id': 'req-99967676-2f63-4503-b73e-6d1df2532696'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:36.185592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017cbf20939d4bd4840705ed3ac4d613', 'request_id': 'req-99967676-2f63-4503-b73e-6d1df2532696'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:36.199140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] The token cache is being invalidate because project 017cbf20939d4bd4840705ed3ac4d613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:34:36.199533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:36.200117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-99967676-2f63-4503-b73e-6d1df2532696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:36.202591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4212/8439] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:34:35 2022] DELETE /identity/v3/projects/017cbf20939d4bd4840705ed3ac4d613 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:36.209174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00de88-b13a-4f92-883a-fea3954d68e1 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.209472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00de88-b13a-4f92-883a-fea3954d68e1 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.209827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00de88-b13a-4f92-883a-fea3954d68e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.236569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-0d00de88-b13a-4f92-883a-fea3954d68e1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:36.237175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-0d00de88-b13a-4f92-883a-fea3954d68e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:36.298815 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:36.321872 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4228/8440] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:36.329833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abeeef-7a34-4abf-b9df-5a72554ddbdf None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.330182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abeeef-7a34-4abf-b9df-5a72554ddbdf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.330541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abeeef-7a34-4abf-b9df-5a72554ddbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.353678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b9abeeef-7a34-4abf-b9df-5a72554ddbdf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:36.355178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b9abeeef-7a34-4abf-b9df-5a72554ddbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:36.365284 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4213/8441] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:36.370405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00de88-b13a-4f92-883a-fea3954d68e1 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.382468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00de88-b13a-4f92-883a-fea3954d68e1 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.387429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.388105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.388385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.388660 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.389428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:34:36.389790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.391574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.407451 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4229/8442] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:34:36.408584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abeeef-7a34-4abf-b9df-5a72554ddbdf None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.419447 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abeeef-7a34-4abf-b9df-5a72554ddbdf None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.424296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.424975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.425281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.425725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.426586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.428836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.460880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.464377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:36.466863 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4214/8443] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:34:36 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:36.470991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.545570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5acd-8a2e-4dec-bceb-dbacebd53a01 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.552212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.552980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.555085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.555460 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.556309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.558475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.573409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4433e-aa1e-450b-b1a2-aa607eef8b3b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.588800 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4215/8444] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:34:36 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:34:36.592350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.604919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f0223-7f20-49fa-8353-0dccf66c5dcc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.613799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.614986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.615493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.616243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.619362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.621002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.639587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4216/8445] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:34:36.643866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.658597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82662-c36e-4454-9691-69f9cf1bcc85 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.658921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2406e1-9889-4f32-b4ef-d8a424372f30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.659606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2406e1-9889-4f32-b4ef-d8a424372f30 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.660706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2406e1-9889-4f32-b4ef-d8a424372f30 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.661092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2406e1-9889-4f32-b4ef-d8a424372f30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.664005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ee2406e1-9889-4f32-b4ef-d8a424372f30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:36.667508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.668305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.668679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.669075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.670080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.671869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.686039 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4217/8446] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:36.687005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2406e1-9889-4f32-b4ef-d8a424372f30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.688717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2406e1-9889-4f32-b4ef-d8a424372f30 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.693616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.709307 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4230/8447] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:34:36.710873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210bc74-cd6e-490f-94c6-f52cd5475406 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:36.716137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:36.717023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.717544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.717994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] PATH_INFO: `/v3/projects/cf877d3d3b2044a089edd8b07f303d54/users/a2605f28a07b465cb9fd2c543a69c38e/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.735706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf877d3d3b2044a089edd8b07f303d54, user_id=a2605f28a07b465cb9fd2c543a69c38e, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:36.739769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:36.763390 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4218/8448] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:34:36 2022] PUT /identity/v3/projects/cf877d3d3b2044a089edd8b07f303d54/users/a2605f28a07b465cb9fd2c543a69c38e/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:36.773854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83853-8070-4d25-a2ec-c0404bc062c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:36.774886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83853-8070-4d25-a2ec-c0404bc062c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:36.775421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a83853-8070-4d25-a2ec-c0404bc062c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:36.815676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-35a83853-8070-4d25-a2ec-c0404bc062c3 None None] MFA Rules not processed for user `a2605f28a07b465cb9fd2c543a69c38e`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:36.820581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-35a83853-8070-4d25-a2ec-c0404bc062c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:36.913232 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4231/8449] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:36.915014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:36.955052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:36.998151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b59a8c-3af7-4da5-8295-e7cc44908ad1 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:37.003365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:37.004062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.004348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.004632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.005366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:37.007353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:37.049175 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4219/8450] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:34:36 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:37.050341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83853-8070-4d25-a2ec-c0404bc062c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:37.058446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:37.063442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a83853-8070-4d25-a2ec-c0404bc062c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:37.125814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:37.127049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.127342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.127641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.128349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:37.130585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:37.153670 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4232/8451] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:34:37 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:34:37.157898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:37.169742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76babbbc-d662-4e29-b764-fb7a0cf97d77 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:37.175971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:37.176670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.176953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.177269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.178037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:37.180047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:37.193956 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4220/8452] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:37.198498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:37.209640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5edd-bbb6-41e4-9d05-a0561ad7b38c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:37.214822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:37.216143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.216626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.216936 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] PATH_INFO: `/v3/projects/6152febbced144b8ac96a121df8bbc4b/users/73d3579affa840b5a74967628cd0cd52/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.239899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6152febbced144b8ac96a121df8bbc4b, user_id=73d3579affa840b5a74967628cd0cd52, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:37.242840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:37.263036 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4233/8453] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:34:37 2022] PUT /identity/v3/projects/6152febbced144b8ac96a121df8bbc4b/users/73d3579affa840b5a74967628cd0cd52/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:37.267433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:37.282105 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801eea1-3f6c-41da-a6fe-736a72b400fa admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:37.353106 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec3050-de83-4237-aec1-425919bddd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:37.353962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3050-de83-4237-aec1-425919bddd58 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.354337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3050-de83-4237-aec1-425919bddd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.354703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec3050-de83-4237-aec1-425919bddd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.355531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec3050-de83-4237-aec1-425919bddd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:37.357299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec3050-de83-4237-aec1-425919bddd58 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:37.368702 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4221/8454] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:37.373101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:37.383809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc660-cadb-462b-ad42-b9b640aaaed0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:37.389103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:37.390071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.390352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.390627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] PATH_INFO: `/v3/projects/6152febbced144b8ac96a121df8bbc4b/users/73d3579affa840b5a74967628cd0cd52/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.393516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6152febbced144b8ac96a121df8bbc4b, user_id=73d3579affa840b5a74967628cd0cd52, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:37.395742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:37.411987 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4234/8455] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:34:37 2022] PUT /identity/v3/projects/6152febbced144b8ac96a121df8bbc4b/users/73d3579affa840b5a74967628cd0cd52/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:37.423876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.424198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.424824 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.455160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] MFA Rules not processed for user `73d3579affa840b5a74967628cd0cd52`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:37.456777 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:37.543116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4222/8456] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:37.556611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:37.559004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:37.629223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118fd8f-ac23-4887-a841-d42ef0491ae2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:37.634093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:37.634769 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:37.635165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:37.635483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:37.707378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:37.709247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:37.721888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4235/8457] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:42.631501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:42.633299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:42.649414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e7118-1580-4c65-b93f-b4a950ae92e6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:42.654056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13513-2cc1-4703-8796-c9f64aa67e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:42.654741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13513-2cc1-4703-8796-c9f64aa67e73 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:42.655028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13513-2cc1-4703-8796-c9f64aa67e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:42.655504 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13513-2cc1-4703-8796-c9f64aa67e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:42.667042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13513-2cc1-4703-8796-c9f64aa67e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:42.668497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13513-2cc1-4703-8796-c9f64aa67e73 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:42.680423 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4223/8458] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:45.124162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:45.125763 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:45.140291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:45.192487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d71adf-ef34-49d4-91cc-b3e30f49a898 service cinder] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:45.197148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:45.198028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.198302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.198593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] PATH_INFO: `/v3/users/b547c47f6e0b4b4a937d9c40b3cacf91` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.199789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b547c47f6e0b4b4a937d9c40b3cacf91)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:45.201746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:45.255314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b547c47f6e0b4b4a937d9c40b3cacf91'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.256029 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b547c47f6e0b4b4a937d9c40b3cacf91'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.268058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b547c47f6e0b4b4a937d9c40b3cacf91'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.268695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b547c47f6e0b4b4a937d9c40b3cacf91'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.276709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b547c47f6e0b4b4a937d9c40b3cacf91'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.291387 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4236/8459] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:34:45 2022] DELETE /identity/v3/users/b547c47f6e0b4b4a937d9c40b3cacf91 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:45.296218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.296693 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.296802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.319114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:45.320437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:45.329868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:45.396533 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4224/8460] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:45.406833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:45.408289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:45.475612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6585e-e15c-46ac-bbe3-af67183c87bf admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:45.480064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99044fc6-fc4e-4c57-8c8c-0e3500553f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:45.480756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044fc6-fc4e-4c57-8c8c-0e3500553f49 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.481022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044fc6-fc4e-4c57-8c8c-0e3500553f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.481342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99044fc6-fc4e-4c57-8c8c-0e3500553f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.492877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99044fc6-fc4e-4c57-8c8c-0e3500553f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:45.494256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99044fc6-fc4e-4c57-8c8c-0e3500553f49 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:45.504932 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4237/8461] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:45.682996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:45.684503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:45.699092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863c90f-7135-436c-839b-e2d36794b07f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:45.704169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:45.705080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.705361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.705633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] PATH_INFO: `/v3/projects/cf9309f5a76b4fee8c7430693d390b0b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.706828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9309f5a76b4fee8c7430693d390b0b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:45.708963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:45.761728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9309f5a76b4fee8c7430693d390b0b', 'request_id': 'req-b97cac25-beeb-4efb-8e57-dd4492d46bde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.768394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9309f5a76b4fee8c7430693d390b0b', 'request_id': 'req-b97cac25-beeb-4efb-8e57-dd4492d46bde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.777166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9309f5a76b4fee8c7430693d390b0b', 'request_id': 'req-b97cac25-beeb-4efb-8e57-dd4492d46bde'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.788623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] The token cache is being invalidate because project cf9309f5a76b4fee8c7430693d390b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:34:45.789158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.789886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b97cac25-beeb-4efb-8e57-dd4492d46bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:45.791665 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4225/8462] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:34:45 2022] DELETE /identity/v3/projects/cf9309f5a76b4fee8c7430693d390b0b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:45.799296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2fa82-5ee2-4f29-a0bb-67f8406edd60 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.799585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2fa82-5ee2-4f29-a0bb-67f8406edd60 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.799858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2fa82-5ee2-4f29-a0bb-67f8406edd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.818784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-35c2fa82-5ee2-4f29-a0bb-67f8406edd60 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:45.820074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-35c2fa82-5ee2-4f29-a0bb-67f8406edd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:45.854585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:45.888896 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4238/8463] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:45.898551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961a88-bb61-4821-9e1b-de78dd2714d1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.898956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961a88-bb61-4821-9e1b-de78dd2714d1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.899251 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961a88-bb61-4821-9e1b-de78dd2714d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.917772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-7e961a88-bb61-4821-9e1b-de78dd2714d1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:45.918991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7e961a88-bb61-4821-9e1b-de78dd2714d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:45.926982 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4226/8464] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:45.931923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2fa82-5ee2-4f29-a0bb-67f8406edd60 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:45.942311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2fa82-5ee2-4f29-a0bb-67f8406edd60 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:45.947784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:45.948445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.948765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.949063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.949793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:34:45.950113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:45.951742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:45.964158 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4239/8465] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:34:45.968607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961a88-bb61-4821-9e1b-de78dd2714d1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:45.978245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961a88-bb61-4821-9e1b-de78dd2714d1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:45.983297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:45.983966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:45.984238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:45.984522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:45.985273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:45.987175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:46.013692 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4227/8466] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:34:45 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:46.017883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:46.035302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35a1f0-387a-479c-8f1b-d79797aa1a5b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:46.100835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:46.101551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:46.101838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:46.102143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:46.102855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:46.104796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:46.125588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4240/8467] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:34:46 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:46.129942 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:46.141854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678b52d-8e0f-4abf-951b-667de8897458 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:46.147319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:46.148070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:46.148432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:46.148786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:46.149737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:46.151430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:46.163473 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4228/8468] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:46.167292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:46.178269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6a53-0800-4fda-8246-763b44f6a816 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:46.184560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c0edc-e72f-4c99-83f4-b39f6a62f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:46.185262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c0edc-e72f-4c99-83f4-b39f6a62f30e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:46.185540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c0edc-e72f-4c99-83f4-b39f6a62f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:46.185810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c0edc-e72f-4c99-83f4-b39f6a62f30e admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:46.186526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c0edc-e72f-4c99-83f4-b39f6a62f30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:46.188130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c0edc-e72f-4c99-83f4-b39f6a62f30e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:46.199329 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4241/8469] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:46.203892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:46.214912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81d69-3d03-45e0-8b6d-461e5e370b74 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:46.220284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:46.221407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:46.221529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:46.221784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] PATH_INFO: `/v3/projects/6100fb6a59f045ebb542416b28abc5cb/users/dd5883e1aa9c4dd2bb9ff73e08967526/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:46.240882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6100fb6a59f045ebb542416b28abc5cb, user_id=dd5883e1aa9c4dd2bb9ff73e08967526, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:46.243139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:46.258679 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4229/8470] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:34:46 2022] PUT /identity/v3/projects/6100fb6a59f045ebb542416b28abc5cb/users/dd5883e1aa9c4dd2bb9ff73e08967526/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:46.269638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:46.269929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:46.270205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:46.299114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] MFA Rules not processed for user `dd5883e1aa9c4dd2bb9ff73e08967526`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:46.300358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:46.374810 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4242/8471] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:34:46.385328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:46.387061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:46.429081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:46.460353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ab23-daa6-4292-a559-c3d068501e91 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:46.464269 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac44c1-a09b-4422-92a5-3be9fc12e3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:46.464938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac44c1-a09b-4422-92a5-3be9fc12e3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:46.465316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac44c1-a09b-4422-92a5-3be9fc12e3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:46.465759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac44c1-a09b-4422-92a5-3be9fc12e3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:46.475595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac44c1-a09b-4422-92a5-3be9fc12e3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:46.477390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac44c1-a09b-4422-92a5-3be9fc12e3c5 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:46.488155 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4230/8472] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:34:56.370490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:56.483725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=11 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:58.110106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:58.111682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:58.181007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a68f70-e9e5-44eb-a00d-3f4d22829fde None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:58.185877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:58.186800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:58.187090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:58.187369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] PATH_INFO: `/v3/users/a2605f28a07b465cb9fd2c543a69c38e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:58.188579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2605f28a07b465cb9fd2c543a69c38e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:58.190536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:58.246120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2605f28a07b465cb9fd2c543a69c38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.246812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2605f28a07b465cb9fd2c543a69c38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.259267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2605f28a07b465cb9fd2c543a69c38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.260023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2605f28a07b465cb9fd2c543a69c38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.267804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2605f28a07b465cb9fd2c543a69c38e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.282263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4243/8473] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:34:58 2022] DELETE /identity/v3/users/a2605f28a07b465cb9fd2c543a69c38e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:34:58.287538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:58.288121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:58.288238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:58.308459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:58.309852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:58.376245 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4231/8474] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:34:58.386273 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:58.387745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:58.449605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca92a4a-8962-4e36-a5d1-7d07757c3c15 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:58.453901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:58.454683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:58.454971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:58.455250 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:58.465052 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:58.466515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:58.477154 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4244/8475] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:34:58.800745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:58.802503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:58.820807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7b52a-6c44-4865-951e-96f9de174bf5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:58.825272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:58.826156 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:58.826435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:58.826705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] PATH_INFO: `/v3/projects/cf877d3d3b2044a089edd8b07f303d54` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:58.827905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf877d3d3b2044a089edd8b07f303d54)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:58.829914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:58.881558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf877d3d3b2044a089edd8b07f303d54', 'request_id': 'req-9a098db9-1707-4040-ba13-bf7c04d95db7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.888576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf877d3d3b2044a089edd8b07f303d54', 'request_id': 'req-9a098db9-1707-4040-ba13-bf7c04d95db7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.897938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf877d3d3b2044a089edd8b07f303d54', 'request_id': 'req-9a098db9-1707-4040-ba13-bf7c04d95db7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.914178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] The token cache is being invalidate because project cf877d3d3b2044a089edd8b07f303d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:34:58.914178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.915930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:58.920500 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4232/8476] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:34:58 2022] DELETE /identity/v3/projects/cf877d3d3b2044a089edd8b07f303d54 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:34:58.921831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:58.932293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17cba-8d07-4486-acb9-064b5aeeb755 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:58.950992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:58.996885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:58.997824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:58.998104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:58.998376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] PATH_INFO: `/v3/users/73d3579affa840b5a74967628cd0cd52` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:58.999567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d3579affa840b5a74967628cd0cd52)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:59.001609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:59.059217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d3579affa840b5a74967628cd0cd52'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.059873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d3579affa840b5a74967628cd0cd52'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.072324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d3579affa840b5a74967628cd0cd52'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.072934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d3579affa840b5a74967628cd0cd52'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.079984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c9bd5027-0961-45cf-8d25-549d0194c930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d3579affa840b5a74967628cd0cd52'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.097463 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4245/8477] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:34:58 2022] DELETE /identity/v3/users/73d3579affa840b5a74967628cd0cd52 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:59.391526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:59.393112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:59.411607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098db9-1707-4040-ba13-bf7c04d95db7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:59.474972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:59.475851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:59.476128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:59.476399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] PATH_INFO: `/v3/projects/6152febbced144b8ac96a121df8bbc4b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:59.477604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6152febbced144b8ac96a121df8bbc4b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:59.479578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:59.512158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:59.532565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6152febbced144b8ac96a121df8bbc4b', 'request_id': 'req-40ffe133-8698-4575-9ebd-e9b0117c92f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.539061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6152febbced144b8ac96a121df8bbc4b', 'request_id': 'req-40ffe133-8698-4575-9ebd-e9b0117c92f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.548033 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6152febbced144b8ac96a121df8bbc4b', 'request_id': 'req-40ffe133-8698-4575-9ebd-e9b0117c92f9'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.559264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] The token cache is being invalidate because project 6152febbced144b8ac96a121df8bbc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:34:59.559560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.560192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-40ffe133-8698-4575-9ebd-e9b0117c92f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:34:59.562064 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4233/8478] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:34:59 2022] DELETE /identity/v3/projects/6152febbced144b8ac96a121df8bbc4b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:34:59.567043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5466-e9d3-4369-8712-9ef74f43b977 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:59.567527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5466-e9d3-4369-8712-9ef74f43b977 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:59.567619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5466-e9d3-4369-8712-9ef74f43b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:59.585752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3a8f5466-e9d3-4369-8712-9ef74f43b977 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:59.586880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3a8f5466-e9d3-4369-8712-9ef74f43b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:59.650794 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4246/8479] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:59.659009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5ac8-4042-4cd3-b21a-d26b39187341 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:59.659358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5ac8-4042-4cd3-b21a-d26b39187341 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:59.659640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc5ac8-4042-4cd3-b21a-d26b39187341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:59.679378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9cbc5ac8-4042-4cd3-b21a-d26b39187341 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:34:59.680589 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9cbc5ac8-4042-4cd3-b21a-d26b39187341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:34:59.690034 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4234/8480] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:34:59.694140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f5466-e9d3-4369-8712-9ef74f43b977 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:59.706841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f5466-e9d3-4369-8712-9ef74f43b977 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:59.711793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:59.712545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:59.712830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:59.713167 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:59.713919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:34:59.714316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:59.715862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:59.734243 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4247/8481] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:34:59.739534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5ac8-4042-4cd3-b21a-d26b39187341 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:59.762684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc5ac8-4042-4cd3-b21a-d26b39187341 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:59.767921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:59.768608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:59.769395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:59.769395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:59.769950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:59.772031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:59.811474 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4235/8482] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:34:59 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:34:59.815511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:59.826107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8b07a-6348-4956-a87c-30620946751a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:59.858686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:59.920551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:59.921297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:59.922929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:59.923198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:59.924063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:59.928627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:59.959085 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4248/8483] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:34:59 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:34:59.963373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:34:59.974511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61735e0f-d2fa-45e0-9927-cba9206313a7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:34:59.979242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:34:59.979930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:34:59.980204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:34:59.980480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:34:59.981255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:34:59.982874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:34:59.994857 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4236/8484] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:34:59.998979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:00.009309 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8b58-a150-45fc-82b9-974e3a30027d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:00.017358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33266c-34ac-471a-b6c5-83c39a02fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:00.018053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33266c-34ac-471a-b6c5-83c39a02fb8d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:00.018334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33266c-34ac-471a-b6c5-83c39a02fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:00.018613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33266c-34ac-471a-b6c5-83c39a02fb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:00.019354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33266c-34ac-471a-b6c5-83c39a02fb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:00.021169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33266c-34ac-471a-b6c5-83c39a02fb8d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:00.041249 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4249/8485] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:00.043093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:00.057444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fc161-f598-4a8d-b81f-64059046a0b3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:00.062586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:00.063790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:00.064102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:00.064571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] PATH_INFO: `/v3/projects/6a4ac7afa8ff4ccda354f0ec7af80e9a/users/e8139edfa85b439c818f8eb10e0e31b5/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:00.085229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4ac7afa8ff4ccda354f0ec7af80e9a, user_id=e8139edfa85b439c818f8eb10e0e31b5, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:00.088126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:00.107601 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4237/8486] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:35:00 2022] PUT /identity/v3/projects/6a4ac7afa8ff4ccda354f0ec7af80e9a/users/e8139edfa85b439c818f8eb10e0e31b5/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:35:00.109001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829772-73f5-4bde-a1a2-456f4d68ad05 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:00.109317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829772-73f5-4bde-a1a2-456f4d68ad05 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:00.109643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829772-73f5-4bde-a1a2-456f4d68ad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:00.129799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8b829772-73f5-4bde-a1a2-456f4d68ad05 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:00.131161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8b829772-73f5-4bde-a1a2-456f4d68ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:00.210298 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4250/8487] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:35:00.219608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:00.221497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:00.310754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454292a3-3c35-46d6-8553-1e4376869a1d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:00.314773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:00.315480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:00.315768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:00.316049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:00.327349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:00.328968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:00.340300 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4238/8488] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:01.100668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911eaf-8450-4e5a-8588-76252201ffaf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:01.101731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911eaf-8450-4e5a-8588-76252201ffaf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:01.102130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911eaf-8450-4e5a-8588-76252201ffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:01.132221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-db911eaf-8450-4e5a-8588-76252201ffaf None None] MFA Rules not processed for user `e8139edfa85b439c818f8eb10e0e31b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:01.133911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-db911eaf-8450-4e5a-8588-76252201ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:01.209968 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4251/8489] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:01.223467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:01.226484 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:01.316972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99710cfa-9011-45ab-81aa-91048ae9d768 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:01.316972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:01.316972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:01.316972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:01.317520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:01.329782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:01.332502 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:01.334456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:01.356723 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4239/8490] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:02.821926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6dd81-1b44-403a-a416-ace8ee3d4c79 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:02.822465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6dd81-1b44-403a-a416-ace8ee3d4c79 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:02.822465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6dd81-1b44-403a-a416-ace8ee3d4c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:02.841598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ece6dd81-1b44-403a-a416-ace8ee3d4c79 None None] MFA Rules not processed for user `e8139edfa85b439c818f8eb10e0e31b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:02.843326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ece6dd81-1b44-403a-a416-ace8ee3d4c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:02.853013 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4252/8491] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:09.609088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:09.610602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:09.702171 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595c056-d07e-41d6-9037-bd97f7982ede service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:09.707586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594c10-91b9-4ff2-b818-17bb760dfd3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:09.708278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594c10-91b9-4ff2-b818-17bb760dfd3d service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:09.708561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594c10-91b9-4ff2-b818-17bb760dfd3d service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:09.708839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594c10-91b9-4ff2-b818-17bb760dfd3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:09.710798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a594c10-91b9-4ff2-b818-17bb760dfd3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:09.725455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594c10-91b9-4ff2-b818-17bb760dfd3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:09.727207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594c10-91b9-4ff2-b818-17bb760dfd3d service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:09.749792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4240/8492] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:12.835555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:19.089088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:19.089639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:19.089639 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:19.110123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] MFA Rules not processed for user `e8139edfa85b439c818f8eb10e0e31b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:19.111540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:19.120250 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4253/8493] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:35:19.736790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=34 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:26.700261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494cd9-725d-4a61-b39f-786309e29044 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:26.702117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494cd9-725d-4a61-b39f-786309e29044 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:26.702592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494cd9-725d-4a61-b39f-786309e29044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:26.728458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9b494cd9-725d-4a61-b39f-786309e29044 None None] MFA Rules not processed for user `259af49e467e4c4fbd01ae55251511e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:26.730190 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9b494cd9-725d-4a61-b39f-786309e29044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:26.805436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4241/8494] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:29.104400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:36.035848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:36.038175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:36.171854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502065c0-e846-4325-a868-b0a9bada4ebf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:36.180397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38ca94-a7ed-42dd-a6f2-3cdebbe317d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:36.181618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38ca94-a7ed-42dd-a6f2-3cdebbe317d6 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:36.182094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38ca94-a7ed-42dd-a6f2-3cdebbe317d6 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:36.182720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38ca94-a7ed-42dd-a6f2-3cdebbe317d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:36.185077 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3e38ca94-a7ed-42dd-a6f2-3cdebbe317d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:36.265992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494cd9-725d-4a61-b39f-786309e29044 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:36.285223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38ca94-a7ed-42dd-a6f2-3cdebbe317d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:36.287303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38ca94-a7ed-42dd-a6f2-3cdebbe317d6 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:36.290073 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494cd9-725d-4a61-b39f-786309e29044 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:36.294431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52874-f726-404a-9279-1b323f67dbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:36.296030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52874-f726-404a-9279-1b323f67dbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:36.296323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52874-f726-404a-9279-1b323f67dbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:36.296979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52874-f726-404a-9279-1b323f67dbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:36.303285 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4254/8495] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:36.332949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52874-f726-404a-9279-1b323f67dbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:36.335141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c52874-f726-404a-9279-1b323f67dbe8 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:36.353881 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4242/8496] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:39.962411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:39.963870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:39.964327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:40.006621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] MFA Rules not processed for user `406628da7a8140fd83200ffc90e71198`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:40.011008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:40.037885 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4255/8497] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:40.939650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:40.940527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:40.941010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:41.073915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:41.075895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:41.190228 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4243/8498] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:41.267585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:41.269872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:41.398636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce08f6-3d48-4085-8999-eba73ef6150b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:41.403840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50217c5b-8052-4e09-b5eb-c1136fca3678 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:41.404585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50217c5b-8052-4e09-b5eb-c1136fca3678 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:41.404772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50217c5b-8052-4e09-b5eb-c1136fca3678 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:41.405063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50217c5b-8052-4e09-b5eb-c1136fca3678 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:41.423157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50217c5b-8052-4e09-b5eb-c1136fca3678 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:41.424876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50217c5b-8052-4e09-b5eb-c1136fca3678 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:41.438726 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4256/8499] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:35:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:35:45.856945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:45.860828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:45.934408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebd84e-f831-4409-af9d-d55e67f46098 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:45.950197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:45.951120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:45.951438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:45.951723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] PATH_INFO: `/v3/users/dd5883e1aa9c4dd2bb9ff73e08967526` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:45.953161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5883e1aa9c4dd2bb9ff73e08967526)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:45.955291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:46.055743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5883e1aa9c4dd2bb9ff73e08967526'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:46.056711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5883e1aa9c4dd2bb9ff73e08967526'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:46.086358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:46.098201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5883e1aa9c4dd2bb9ff73e08967526'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:46.099505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5883e1aa9c4dd2bb9ff73e08967526'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:46.109922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5883e1aa9c4dd2bb9ff73e08967526'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:46.152516 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4244/8500] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:35:45 2022] DELETE /identity/v3/users/dd5883e1aa9c4dd2bb9ff73e08967526 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:46.157051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:46.157606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:46.157606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:46.230831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:46.233023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:46.243643 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:46.324088 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4257/8501] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:46.340529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:46.342188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:46.449010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85017b9-c892-443b-9e9c-9866d183cfac admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:46.454081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aaf7d-89f4-4dbe-9034-8cf0b4ebd375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:46.454838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aaf7d-89f4-4dbe-9034-8cf0b4ebd375 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:46.455495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aaf7d-89f4-4dbe-9034-8cf0b4ebd375 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:46.455784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aaf7d-89f4-4dbe-9034-8cf0b4ebd375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:46.473694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aaf7d-89f4-4dbe-9034-8cf0b4ebd375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:46.482112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aaf7d-89f4-4dbe-9034-8cf0b4ebd375 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:46.511091 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4245/8502] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:47.618950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:47.620527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:47.648013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cca8a-d7f5-44c9-af08-7ec47c5be5c0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:47.653699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:47.654739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:47.655089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:47.655481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] PATH_INFO: `/v3/projects/6100fb6a59f045ebb542416b28abc5cb` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:47.659437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6100fb6a59f045ebb542416b28abc5cb)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:47.661512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:47.739890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6100fb6a59f045ebb542416b28abc5cb', 'request_id': 'req-5fa72468-dabd-4265-977e-70d478cb3e53'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:47.746874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6100fb6a59f045ebb542416b28abc5cb', 'request_id': 'req-5fa72468-dabd-4265-977e-70d478cb3e53'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:47.759434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6100fb6a59f045ebb542416b28abc5cb', 'request_id': 'req-5fa72468-dabd-4265-977e-70d478cb3e53'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:47.774597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] The token cache is being invalidate because project 6100fb6a59f045ebb542416b28abc5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:35:47.775074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:47.775844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5fa72468-dabd-4265-977e-70d478cb3e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:47.777963 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4258/8503] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:35:47 2022] DELETE /identity/v3/projects/6100fb6a59f045ebb542416b28abc5cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:47.783526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363c1da-d5fc-4d3a-9700-2b768739ba97 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:47.784117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363c1da-d5fc-4d3a-9700-2b768739ba97 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:47.784117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363c1da-d5fc-4d3a-9700-2b768739ba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:47.824813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-8363c1da-d5fc-4d3a-9700-2b768739ba97 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:47.827920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8363c1da-d5fc-4d3a-9700-2b768739ba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:47.971253 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4246/8504] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:35:47.979158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f736-d810-49ef-9719-f179a176258b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:47.979443 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f736-d810-49ef-9719-f179a176258b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:47.979722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f736-d810-49ef-9719-f179a176258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.020241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1d01f736-d810-49ef-9719-f179a176258b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:48.021508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1d01f736-d810-49ef-9719-f179a176258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:48.038482 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4259/8505] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:48.039209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363c1da-d5fc-4d3a-9700-2b768739ba97 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:48.065609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363c1da-d5fc-4d3a-9700-2b768739ba97 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:48.076088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:48.076837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:48.077162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:48.077718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.079912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:35:48.080259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:48.082346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:48.097012 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4247/8506] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:35:48.101480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01f736-d810-49ef-9719-f179a176258b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:48.113940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01f736-d810-49ef-9719-f179a176258b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:48.136584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:48.137607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:48.138065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:48.138508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.139573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:48.142665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:48.196245 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4260/8507] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:35:48 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:48.200558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:48.216424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8436d-0873-40ff-82f3-3d79ae10c25b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:48.421213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:48.432487 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:48.433572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:48.434337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.435605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:48.440337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:48.502045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:48.521141 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4248/8508] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:35:48 2022] POST /identity/v3/users => generated 294 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:48.526179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:48.542494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebba4e6-d42f-4946-b474-74c95c305c25 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:48.573977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:48.574671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:48.574948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:48.575220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.575966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:48.577678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:48.612475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:48.613663 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4261/8509] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:48.629959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb0db2-36bb-45b6-beaf-84335c6bcf8a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:48.646406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89656182-ea45-481f-b0aa-2500aeb0f210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:48.647209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656182-ea45-481f-b0aa-2500aeb0f210 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:48.647687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656182-ea45-481f-b0aa-2500aeb0f210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:48.648137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89656182-ea45-481f-b0aa-2500aeb0f210 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.649102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89656182-ea45-481f-b0aa-2500aeb0f210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:48.650915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89656182-ea45-481f-b0aa-2500aeb0f210 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:48.680122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4249/8510] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:48.681488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:48.702376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea402242-f3b5-40bf-9db8-1308229f5a25 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:48.718307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:48.719542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:48.720023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:48.720310 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] PATH_INFO: `/v3/projects/2527e413d9354a75ac1251127ef67e30/users/6f10c3238be7479a94282a8581e6dfdf/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.780932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2527e413d9354a75ac1251127ef67e30, user_id=6f10c3238be7479a94282a8581e6dfdf, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:48.784757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:48.833987 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4262/8511] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:35:48 2022] PUT /identity/v3/projects/2527e413d9354a75ac1251127ef67e30/users/6f10c3238be7479a94282a8581e6dfdf/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:48.845318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62114c6-d5ab-4969-9acc-1fc26b8c275c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:48.846355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62114c6-d5ab-4969-9acc-1fc26b8c275c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:48.847224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62114c6-d5ab-4969-9acc-1fc26b8c275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:48.885778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b62114c6-d5ab-4969-9acc-1fc26b8c275c None None] MFA Rules not processed for user `6f10c3238be7479a94282a8581e6dfdf`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:48.888802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b62114c6-d5ab-4969-9acc-1fc26b8c275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:48.966043 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4250/8512] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:48.970877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:49.063288 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:49.143459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163dd78-9978-4c1d-b842-cfd388df3e52 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:49.157265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:49.161419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:49.162602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:49.163730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:49.165648 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:49.168234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:49.245835 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4263/8513] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:35:48 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:49.251063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62114c6-d5ab-4969-9acc-1fc26b8c275c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:49.282444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62114c6-d5ab-4969-9acc-1fc26b8c275c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:49.406925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:49.407832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:49.408279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:49.408742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:49.409629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:49.411605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:49.455995 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4251/8514] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:35:49 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:49.456722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:49.471197 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49032cac-0d6c-4324-b9ee-778418410da9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:49.487137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:49.490449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:49.490730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:49.491014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:49.491826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:49.493574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:49.532437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:49.534716 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4264/8515] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:49.550204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdb72c-7c7c-4025-87b3-2bc27129e7c2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:49.558233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:49.559162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:49.559448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:49.559726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] PATH_INFO: `/v3/projects/158749fcf31f4c93904ab24e847a734c/users/07ccd7a75a45401797ef20a287ed4596/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:49.581168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158749fcf31f4c93904ab24e847a734c, user_id=07ccd7a75a45401797ef20a287ed4596, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:49.584064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:49.614755 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4252/8516] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:35:49 2022] PUT /identity/v3/projects/158749fcf31f4c93904ab24e847a734c/users/07ccd7a75a45401797ef20a287ed4596/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:49.619218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:49.638442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bc066-db8b-4f79-abf6-42e4d9ab90f9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:49.743719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd7de2-65f7-462d-b445-63e68e1d3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:49.745513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7de2-65f7-462d-b445-63e68e1d3d03 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:49.746329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7de2-65f7-462d-b445-63e68e1d3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:49.746516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd7de2-65f7-462d-b445-63e68e1d3d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:49.747871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd7de2-65f7-462d-b445-63e68e1d3d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:49.751603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd7de2-65f7-462d-b445-63e68e1d3d03 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:49.771957 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4265/8517] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:35:49.779319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:49.798771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82279-1c0f-4891-8666-9f557b06e176 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:49.808757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:49.809762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:49.810535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:49.811322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] PATH_INFO: `/v3/projects/158749fcf31f4c93904ab24e847a734c/users/07ccd7a75a45401797ef20a287ed4596/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:49.813687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=158749fcf31f4c93904ab24e847a734c, user_id=07ccd7a75a45401797ef20a287ed4596, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:49.816825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:49.834822 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4253/8518] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:35:49 2022] PUT /identity/v3/projects/158749fcf31f4c93904ab24e847a734c/users/07ccd7a75a45401797ef20a287ed4596/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:49.847948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258346-fd3c-4779-baf3-34ec7e73c29f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:49.847948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258346-fd3c-4779-baf3-34ec7e73c29f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:49.848298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f258346-fd3c-4779-baf3-34ec7e73c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:49.886525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7f258346-fd3c-4779-baf3-34ec7e73c29f None None] MFA Rules not processed for user `07ccd7a75a45401797ef20a287ed4596`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:49.887786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7f258346-fd3c-4779-baf3-34ec7e73c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:50.139520 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4266/8519] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:50.151122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:50.152738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:50.251104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:50.307319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ce66-a681-4ab7-aa72-d10cd189f1cd admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:50.325960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753d64-42c6-443d-a9c6-3eff2683f573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:50.327864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753d64-42c6-443d-a9c6-3eff2683f573 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:50.330416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753d64-42c6-443d-a9c6-3eff2683f573 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:50.330820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753d64-42c6-443d-a9c6-3eff2683f573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:50.367139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753d64-42c6-443d-a9c6-3eff2683f573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:50.374470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753d64-42c6-443d-a9c6-3eff2683f573 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:50.414329 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4254/8520] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:50.647393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258346-fd3c-4779-baf3-34ec7e73c29f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:50.692943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:50.743155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f258346-fd3c-4779-baf3-34ec7e73c29f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:50.755956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:50.757567 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:50.757853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:50.758198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] PATH_INFO: `/v3/users/6f10c3238be7479a94282a8581e6dfdf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:50.760552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f10c3238be7479a94282a8581e6dfdf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:50.762780 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:50.848062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f10c3238be7479a94282a8581e6dfdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:50.850534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f10c3238be7479a94282a8581e6dfdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:50.890043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f10c3238be7479a94282a8581e6dfdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:50.897057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f10c3238be7479a94282a8581e6dfdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:50.911730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f10c3238be7479a94282a8581e6dfdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:50.938190 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4267/8521] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:35:50 2022] DELETE /identity/v3/users/6f10c3238be7479a94282a8581e6dfdf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:50.943559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:50.943888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:50.944197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:50.982471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:50.983546 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:51.107248 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4255/8522] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:51.118022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:51.119770 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:51.226773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85e0c-791b-44ce-94ae-242725c788c9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:51.242132 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:51.245439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:51.247803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:51.248104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:51.282730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:51.286640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:51.309154 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4268/8523] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:51.952685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:51.954163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:51.981794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96f3e-5ced-4490-a343-009437e35631 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:51.997543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:51.998698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:51.999273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:51.999770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] PATH_INFO: `/v3/projects/2527e413d9354a75ac1251127ef67e30` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:52.001421 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2527e413d9354a75ac1251127ef67e30)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:52.006889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:52.103759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2527e413d9354a75ac1251127ef67e30', 'request_id': 'req-7130afbb-adff-4c58-9f68-885758c0dd1b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.112954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2527e413d9354a75ac1251127ef67e30', 'request_id': 'req-7130afbb-adff-4c58-9f68-885758c0dd1b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.136778 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2527e413d9354a75ac1251127ef67e30', 'request_id': 'req-7130afbb-adff-4c58-9f68-885758c0dd1b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.184609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] The token cache is being invalidate because project 2527e413d9354a75ac1251127ef67e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:35:52.186216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.187386 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.195233 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4256/8524] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:35:51 2022] DELETE /identity/v3/projects/2527e413d9354a75ac1251127ef67e30 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:52.211026 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:52.240262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56772070-faef-493c-b47d-c9ba2a435ee1 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:52.347490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:52.374675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:52.374675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:52.374675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:52.375152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] PATH_INFO: `/v3/users/07ccd7a75a45401797ef20a287ed4596` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:52.377680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ccd7a75a45401797ef20a287ed4596)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:52.379968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:52.507172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ccd7a75a45401797ef20a287ed4596'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.510296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ccd7a75a45401797ef20a287ed4596'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.550879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ccd7a75a45401797ef20a287ed4596'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.552736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ccd7a75a45401797ef20a287ed4596'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.576437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-dbb3d92a-40c3-4952-9f94-3bc4f4492433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ccd7a75a45401797ef20a287ed4596'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:52.606678 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4269/8525] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:35:52 2022] DELETE /identity/v3/users/07ccd7a75a45401797ef20a287ed4596 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:53.230491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:53.234192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:53.258393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130afbb-adff-4c58-9f68-885758c0dd1b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:53.391616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:53.411324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:53.412835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:53.413493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:53.413776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] PATH_INFO: `/v3/projects/158749fcf31f4c93904ab24e847a734c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:53.415382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=158749fcf31f4c93904ab24e847a734c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:53.418370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:53.554232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158749fcf31f4c93904ab24e847a734c', 'request_id': 'req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:53.579162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158749fcf31f4c93904ab24e847a734c', 'request_id': 'req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:53.606281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158749fcf31f4c93904ab24e847a734c', 'request_id': 'req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:53.642381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] The token cache is being invalidate because project 158749fcf31f4c93904ab24e847a734c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:35:53.642618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:53.645954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-baf6ad4f-ca95-47c6-bec5-5d830cbbfe62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:35:53.654459 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4257/8526] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:35:53 2022] DELETE /identity/v3/projects/158749fcf31f4c93904ab24e847a734c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:35:53.656075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70df51-de41-4967-b26a-24d0815e567b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:53.656491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70df51-de41-4967-b26a-24d0815e567b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:53.656596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70df51-de41-4967-b26a-24d0815e567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:53.710405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dd70df51-de41-4967-b26a-24d0815e567b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:53.727894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dd70df51-de41-4967-b26a-24d0815e567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:53.846648 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4270/8527] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:35:53.857772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c172cb-959a-4d4e-ad08-1d1d9cbe45f4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:53.858923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c172cb-959a-4d4e-ad08-1d1d9cbe45f4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:53.860666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c172cb-959a-4d4e-ad08-1d1d9cbe45f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:53.936622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f6c172cb-959a-4d4e-ad08-1d1d9cbe45f4 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:53.938838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f6c172cb-959a-4d4e-ad08-1d1d9cbe45f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:53.949903 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4258/8528] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:53.954423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70df51-de41-4967-b26a-24d0815e567b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:53.966267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70df51-de41-4967-b26a-24d0815e567b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:53.971952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:53.972636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:53.973145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:53.973796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:53.974791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:35:53.975270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:53.980991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:54.002775 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4271/8529] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:35:54.009330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c172cb-959a-4d4e-ad08-1d1d9cbe45f4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:54.022762 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c172cb-959a-4d4e-ad08-1d1d9cbe45f4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:54.053982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:54.057676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:54.057963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:54.058241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:54.059043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:54.060914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:54.135935 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4259/8530] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:35:54 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:54.140108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:54.154378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6033e-8839-4390-bc03-4962d38f2dcc admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:54.239515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:54.257240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:54.258722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:54.259272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:54.260217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:54.260548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:54.267191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:54.303357 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4272/8531] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:35:54 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:54.307372 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:54.327429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0954-9f10-44e6-b900-2c3ff0dfe64e admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:54.338673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:54.340038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:54.340505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:54.341388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:54.342522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:54.346370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:54.370311 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4260/8532] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:54.374681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:54.389017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea5e66-8094-4211-abf4-ff3b008da22d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:54.395090 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a8d96-0b21-4bbd-9020-fdd11a30f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:54.396146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a8d96-0b21-4bbd-9020-fdd11a30f143 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:54.396602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a8d96-0b21-4bbd-9020-fdd11a30f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:54.397134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a8d96-0b21-4bbd-9020-fdd11a30f143 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:54.399866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a8d96-0b21-4bbd-9020-fdd11a30f143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:54.401724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a8d96-0b21-4bbd-9020-fdd11a30f143 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:54.415389 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4273/8533] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:54.419568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:54.433956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bd4f8-ad0a-495b-ba6c-dc882798f166 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:54.440823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:54.442680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:54.443382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:54.443820 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] PATH_INFO: `/v3/projects/91c64dd112fa4f7c89b2f07494e6be49/users/f1b184b4aef04efc8996eff7af43dadb/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:54.480763 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c64dd112fa4f7c89b2f07494e6be49, user_id=f1b184b4aef04efc8996eff7af43dadb, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:54.486313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:54.524093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4261/8534] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:35:54 2022] PUT /identity/v3/projects/91c64dd112fa4f7c89b2f07494e6be49/users/f1b184b4aef04efc8996eff7af43dadb/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:35:54.537472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e934e-27df-4dad-ad9d-b4dfa4feb609 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:54.538395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e934e-27df-4dad-ad9d-b4dfa4feb609 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:54.538674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e934e-27df-4dad-ad9d-b4dfa4feb609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:54.632421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e57e934e-27df-4dad-ad9d-b4dfa4feb609 None None] MFA Rules not processed for user `f1b184b4aef04efc8996eff7af43dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:54.633729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e57e934e-27df-4dad-ad9d-b4dfa4feb609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:54.805073 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4274/8535] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:54.806737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:55.015392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5e5be-378c-436b-bc2a-b52ed3139f20 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:55.036832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:55.037584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:55.037919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:55.038197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:55.045151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:55.053687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:55.140963 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4262/8536] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:35:54 2022] POST /identity/v3/projects => generated 393 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:55.145822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e934e-27df-4dad-ad9d-b4dfa4feb609 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:55.161677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e934e-27df-4dad-ad9d-b4dfa4feb609 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:55.332495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:55.336950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:55.339582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:55.340247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:55.341584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:55.346976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:55.417397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:55.417964 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4275/8537] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:35:55 2022] POST /identity/v3/users => generated 303 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:35:55.419535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:55.429334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ad61-991f-4303-ba93-d8ec767eef9c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:55.445943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:55.447676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:55.449477 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:55.450424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:55.455790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:55.457776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:55.488662 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4263/8538] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:55.492260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:55.515732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f796-70cc-45b4-885f-4fd2f5a390e9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:55.529086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:55.530620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:55.531175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:55.531685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] PATH_INFO: `/v3/projects/bf2f16bccc6b4dcbac155f125226ca8f/users/c8701ca4ee934249b5071bf8c8069d85/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:55.564668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2f16bccc6b4dcbac155f125226ca8f, user_id=c8701ca4ee934249b5071bf8c8069d85, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:55.569408 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:55.603064 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4276/8539] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:35:55 2022] PUT /identity/v3/projects/bf2f16bccc6b4dcbac155f125226ca8f/users/c8701ca4ee934249b5071bf8c8069d85/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:35:55.606038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:55.620335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8213ad2-7f92-4b0d-888f-cbeda8b691a9 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:55.728052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2df0c2-f23c-4f1b-9c07-2694aa632f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:55.728732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df0c2-f23c-4f1b-9c07-2694aa632f2a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:55.729012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df0c2-f23c-4f1b-9c07-2694aa632f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:55.729319 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2df0c2-f23c-4f1b-9c07-2694aa632f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:55.730057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2df0c2-f23c-4f1b-9c07-2694aa632f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:55.732359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2df0c2-f23c-4f1b-9c07-2694aa632f2a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:55.750127 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4264/8540] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:35:55.750999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:55.765155 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292b256-84e0-4792-91de-e9eb5cb9eeb6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:55.772159 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:55.773508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:55.773941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:55.775130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] PATH_INFO: `/v3/projects/bf2f16bccc6b4dcbac155f125226ca8f/users/c8701ca4ee934249b5071bf8c8069d85/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:55.778340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2f16bccc6b4dcbac155f125226ca8f, user_id=c8701ca4ee934249b5071bf8c8069d85, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:55.782496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:55.828397 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4277/8541] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:35:55 2022] PUT /identity/v3/projects/bf2f16bccc6b4dcbac155f125226ca8f/users/c8701ca4ee934249b5071bf8c8069d85/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:35:55.921741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:55.922522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:55.922902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:55.973771 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] MFA Rules not processed for user `c8701ca4ee934249b5071bf8c8069d85`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:35:55.975158 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:56.102680 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4265/8542] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:35:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:35:56.121932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:56.124388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:56.153786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:56.326329 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e61a2a-445b-460c-b57f-e2efc425e6e6 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:56.344913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:56.345689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:56.345982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:56.346254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:56.484628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:56.488425 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:56.543593 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4278/8543] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:35:56.806558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:35:56.808901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:56.953359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdba4f-fd7c-4bdb-a717-b7284f16a147 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:35:56.973663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:35:56.974450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:35:56.974743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:35:56.975018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:35:56.987725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:35:57.085341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:57.139834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:35:57.141467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:35:57.165728 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4266/8544] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:35:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:04.276844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:04.279140 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:04.359169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08bde-bab3-4b83-b099-898684deeefb service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:04.363945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:04.364642 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:04.364941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:04.365236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:04.403876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:04.413337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:04.437368 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4279/8545] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:04.875608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:04.877671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:04.925933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49847cc-5a88-48ee-8f01-c83aff2518cb service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:04.951018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd322fd-3adb-4f04-8187-efee3925f3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:04.956149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd322fd-3adb-4f04-8187-efee3925f3b5 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:04.956437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd322fd-3adb-4f04-8187-efee3925f3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:04.956718 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd322fd-3adb-4f04-8187-efee3925f3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:04.964790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8cd322fd-3adb-4f04-8187-efee3925f3b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:05.004288 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd322fd-3adb-4f04-8187-efee3925f3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:05.005982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd322fd-3adb-4f04-8187-efee3925f3b5 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:05.062585 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4267/8546] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:11.127606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:11.130089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:11.311927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:11.345109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ec4d-2c4c-4be2-9f70-a6afe5147664 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:11.358796 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:11.360097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:11.360822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:11.361307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] PATH_INFO: `/v3/users/259af49e467e4c4fbd01ae55251511e3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:11.365410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=259af49e467e4c4fbd01ae55251511e3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:11.369706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:11.537216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259af49e467e4c4fbd01ae55251511e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:11.549114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259af49e467e4c4fbd01ae55251511e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:11.579223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259af49e467e4c4fbd01ae55251511e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:11.579223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259af49e467e4c4fbd01ae55251511e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:11.601749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259af49e467e4c4fbd01ae55251511e3'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:11.642898 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4280/8547] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:11 2022] DELETE /identity/v3/users/259af49e467e4c4fbd01ae55251511e3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:11.649708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e2cf-1a39-4b4d-88f5-0c001756c553 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:11.650234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e2cf-1a39-4b4d-88f5-0c001756c553 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:11.650584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e2cf-1a39-4b4d-88f5-0c001756c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:11.682859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-1929e2cf-1a39-4b4d-88f5-0c001756c553 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:11.684582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1929e2cf-1a39-4b4d-88f5-0c001756c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:11.781248 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4268/8548] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:11.794703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:11.796720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:11.869295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fd509-8b41-40b7-8e74-3b90d655b282 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:11.869816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fd509-8b41-40b7-8e74-3b90d655b282 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:11.870245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fd509-8b41-40b7-8e74-3b90d655b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:11.896121 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3463c86-1557-43ea-8a30-6a1f2f221a0b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:11.898151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a94fd509-8b41-40b7-8e74-3b90d655b282 None None] MFA Rules not processed for user `f1b184b4aef04efc8996eff7af43dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:11.899383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a94fd509-8b41-40b7-8e74-3b90d655b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:11.900624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:11.901353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:11.901637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:11.901917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:11.913644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:11.915128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:11.936393 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4281/8549] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:36:12.009679 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4269/8550] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:13.155709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:13.157916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:13.181290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d86c-b1a6-491f-8466-99bb45600182 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:13.196940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:13.198384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:13.198817 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:13.199330 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] PATH_INFO: `/v3/projects/521b75c65b1a4064befdab485a1dfec2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:13.202850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521b75c65b1a4064befdab485a1dfec2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:13.205595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:13.320719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521b75c65b1a4064befdab485a1dfec2', 'request_id': 'req-71e91767-a8ef-413a-9ed1-05749745b5f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.335485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521b75c65b1a4064befdab485a1dfec2', 'request_id': 'req-71e91767-a8ef-413a-9ed1-05749745b5f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.352509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521b75c65b1a4064befdab485a1dfec2', 'request_id': 'req-71e91767-a8ef-413a-9ed1-05749745b5f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.365873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:13.379558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] The token cache is being invalidate because project 521b75c65b1a4064befdab485a1dfec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:13.380504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.384603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.392850 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4282/8551] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:13 2022] DELETE /identity/v3/projects/521b75c65b1a4064befdab485a1dfec2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:13.394230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fd509-8b41-40b7-8e74-3b90d655b282 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:13.433103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fd509-8b41-40b7-8e74-3b90d655b282 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:13.648031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:13.650241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:13.651757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:13.652544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] PATH_INFO: `/v3/users/11a9008c26844666955868adbeee0f42` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:13.656380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a9008c26844666955868adbeee0f42)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:13.662885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:13.668819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:13.792898 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a9008c26844666955868adbeee0f42'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.794174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a9008c26844666955868adbeee0f42'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.813116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a9008c26844666955868adbeee0f42'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.815572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a9008c26844666955868adbeee0f42'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.833228 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a9008c26844666955868adbeee0f42'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:13.855070 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4270/8552] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:13 2022] DELETE /identity/v3/users/11a9008c26844666955868adbeee0f42 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:14.392078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:14.393691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:14.419115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e91767-a8ef-413a-9ed1-05749745b5f4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:14.563028 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:14.563937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:14.564209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:14.564488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] PATH_INFO: `/v3/projects/2cb8493cefbd4d8fbae905bd2df24cac` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:14.565748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb8493cefbd4d8fbae905bd2df24cac)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:14.567682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:14.750316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb8493cefbd4d8fbae905bd2df24cac', 'request_id': 'req-4d592eaa-1607-4593-ae06-246ed2976124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:14.768422 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb8493cefbd4d8fbae905bd2df24cac', 'request_id': 'req-4d592eaa-1607-4593-ae06-246ed2976124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:14.795229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb8493cefbd4d8fbae905bd2df24cac', 'request_id': 'req-4d592eaa-1607-4593-ae06-246ed2976124'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:14.818892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] The token cache is being invalidate because project 2cb8493cefbd4d8fbae905bd2df24cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:14.819188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:14.819979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:14.825728 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4283/8553] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:14 2022] DELETE /identity/v3/projects/2cb8493cefbd4d8fbae905bd2df24cac => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:14.826405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:14.827847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:14.842406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4b544-8514-473e-9f3e-7f74ad85881f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:15.055174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:15.064308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:15.064753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:15.065152 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] PATH_INFO: `/v3/users/73dc2e822cef4aada7d0e3119555b811` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:15.072594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73dc2e822cef4aada7d0e3119555b811)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:15.075991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:15.192071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73dc2e822cef4aada7d0e3119555b811'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.192668 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73dc2e822cef4aada7d0e3119555b811'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.225867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73dc2e822cef4aada7d0e3119555b811'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.226406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73dc2e822cef4aada7d0e3119555b811'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.241917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-bdb0afc2-8512-468e-bb5f-c23986e6e91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73dc2e822cef4aada7d0e3119555b811'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.253776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:15.258919 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4271/8554] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:14 2022] DELETE /identity/v3/users/73dc2e822cef4aada7d0e3119555b811 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:15.533455 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:15.536183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:15.561809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592eaa-1607-4593-ae06-246ed2976124 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:15.713824 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:15.716442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:15.719148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:15.719444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] PATH_INFO: `/v3/projects/5476b0847e4e43eebd45bee30a9da6db` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:15.721833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5476b0847e4e43eebd45bee30a9da6db)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:15.727783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:15.820367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:15.856970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5476b0847e4e43eebd45bee30a9da6db', 'request_id': 'req-4feed192-9fb5-4963-82c9-391c210a80f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.867942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5476b0847e4e43eebd45bee30a9da6db', 'request_id': 'req-4feed192-9fb5-4963-82c9-391c210a80f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.879951 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5476b0847e4e43eebd45bee30a9da6db', 'request_id': 'req-4feed192-9fb5-4963-82c9-391c210a80f8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.900541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] The token cache is being invalidate because project 5476b0847e4e43eebd45bee30a9da6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:15.900980 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.902049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:15.915295 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4284/8555] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:15 2022] DELETE /identity/v3/projects/5476b0847e4e43eebd45bee30a9da6db => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:16.340555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:16.341093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:16.341210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:16.399731 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:16.401189 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:16.509844 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4272/8556] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:36:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:16.528624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:16.531319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:16.533604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:16.535011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:16.618339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9e67e-939b-4440-b575-9583a9f03d7a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:16.623170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:16.624110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:16.624536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:16.624970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:16.627311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:16.630622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feed192-9fb5-4963-82c9-391c210a80f8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:16.638136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:16.638822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:16.639102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:16.639382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:16.656814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:16.664100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:16.676604 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4285/8557] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:36:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:36:16.705137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:16.710872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:16.722628 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4273/8558] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:36:17.456235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:17.462709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:17.499350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe6a82-da49-433a-81e3-917ad71e63c4 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:17.529380 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:17.532101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:17.532598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:17.533612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] PATH_INFO: `/v3/users/61121749f1aa4a2285c8f270abb74fdf` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:17.538816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61121749f1aa4a2285c8f270abb74fdf)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:17.541941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:17.677650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61121749f1aa4a2285c8f270abb74fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:17.679213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61121749f1aa4a2285c8f270abb74fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:17.703293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61121749f1aa4a2285c8f270abb74fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:17.706712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61121749f1aa4a2285c8f270abb74fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:17.719177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-df6b3e69-b1e2-4abf-8295-378b9a87dd2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61121749f1aa4a2285c8f270abb74fdf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:17.763154 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4286/8559] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:17 2022] DELETE /identity/v3/users/61121749f1aa4a2285c8f270abb74fdf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:18.058680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.084647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fc445-b775-4a19-9944-70b5811f8893 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.192453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:18.200814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.201746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.202029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.202306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] PATH_INFO: `/v3/projects/d65dfa8232fa458fb3c49822a1f4ede1` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.203531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65dfa8232fa458fb3c49822a1f4ede1)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.205521 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.265536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65dfa8232fa458fb3c49822a1f4ede1', 'request_id': 'req-25c3e197-97ba-4f82-a5c9-3724000b728d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:18.273475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65dfa8232fa458fb3c49822a1f4ede1', 'request_id': 'req-25c3e197-97ba-4f82-a5c9-3724000b728d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:18.295254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65dfa8232fa458fb3c49822a1f4ede1', 'request_id': 'req-25c3e197-97ba-4f82-a5c9-3724000b728d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:18.327870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] The token cache is being invalidate because project d65dfa8232fa458fb3c49822a1f4ede1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:18.328175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:18.336499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-25c3e197-97ba-4f82-a5c9-3724000b728d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:18.338479 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4274/8560] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:18 2022] DELETE /identity/v3/projects/d65dfa8232fa458fb3c49822a1f4ede1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:18.348307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb5d87-16fa-4caa-af36-7a705db45a58 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.348540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb5d87-16fa-4caa-af36-7a705db45a58 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.348849 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb5d87-16fa-4caa-af36-7a705db45a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.379202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2beb5d87-16fa-4caa-af36-7a705db45a58 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:18.380953 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2beb5d87-16fa-4caa-af36-7a705db45a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:18.402260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:18.486020 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4287/8561] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:18.495552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aded95-46bd-4e48-bfba-7f9fdbfe403e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.496030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aded95-46bd-4e48-bfba-7f9fdbfe403e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.497060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aded95-46bd-4e48-bfba-7f9fdbfe403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.522128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d0aded95-46bd-4e48-bfba-7f9fdbfe403e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:18.524369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d0aded95-46bd-4e48-bfba-7f9fdbfe403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:18.539237 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4275/8562] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:18.544481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb5d87-16fa-4caa-af36-7a705db45a58 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.569115 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb5d87-16fa-4caa-af36-7a705db45a58 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.577235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.578141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.579230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.579718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.580559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:36:18.581196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.583076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.609434 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4288/8563] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:36:18.613978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aded95-46bd-4e48-bfba-7f9fdbfe403e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.631952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aded95-46bd-4e48-bfba-7f9fdbfe403e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.640495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.641492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.641834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.642173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.643145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.645709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.691779 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4276/8564] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:36:18 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:18.697631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.713878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299beb-adc9-4a6c-a4b0-dcff2ac1966e admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.779033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.779722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.780006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.780283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.780976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.782962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.806604 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4289/8565] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:36:18 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:18.810578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.821375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74bea7-9ec7-4324-a3eb-a723bd66c094 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.827671 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.828356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.828637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.828928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.829691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.831405 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.845382 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4277/8566] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:18.846492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.857353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cf8dd-3c9b-4d5a-a0d4-6eb4f1650a65 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.863315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.864146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.864497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.864821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.865685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.867409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.887171 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4290/8567] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:18.891075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.909255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819fe1-82b3-45c1-919e-c9ce0909e9af admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.916744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77978-38a3-47a5-ab7a-34e4d9b34b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.917796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77978-38a3-47a5-ab7a-34e4d9b34b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.918042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77978-38a3-47a5-ab7a-34e4d9b34b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.918338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77978-38a3-47a5-ab7a-34e4d9b34b98 admin admin] PATH_INFO: `/v3/projects/1224106f5de04ea084a313a56a1949c9/users/e4fe3c12cc414bdd97c19803c6911b35/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.937401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:18.939218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:18.949371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c77978-38a3-47a5-ab7a-34e4d9b34b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1224106f5de04ea084a313a56a1949c9, user_id=e4fe3c12cc414bdd97c19803c6911b35, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.954410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c77978-38a3-47a5-ab7a-34e4d9b34b98 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.954992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571404-e599-40c4-a6c5-6ef556eca7c8 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:18.963238 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:18.964437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.964547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.964794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] PATH_INFO: `/v3/users/e8139edfa85b439c818f8eb10e0e31b5` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:18.966466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8139edfa85b439c818f8eb10e0e31b5)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:18.968593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:18.972977 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4278/8568] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:36:18 2022] PUT /identity/v3/projects/1224106f5de04ea084a313a56a1949c9/users/e4fe3c12cc414bdd97c19803c6911b35/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:18.983747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:18.984047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:18.984327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.003296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:19.004746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:19.036737 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8139edfa85b439c818f8eb10e0e31b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.038133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8139edfa85b439c818f8eb10e0e31b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.056230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8139edfa85b439c818f8eb10e0e31b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.056971 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8139edfa85b439c818f8eb10e0e31b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.064341 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8139edfa85b439c818f8eb10e0e31b5'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.073704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:19.080423 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4291/8569] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:18 2022] DELETE /identity/v3/users/e8139edfa85b439c818f8eb10e0e31b5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:19.089741 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4279/8570] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:19.100117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.101744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:19.170301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a112f1-a048-4ea5-9842-1c70e7615fe0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.175317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b9e4a-c8c0-4ad7-96a8-64285a485f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.176107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9e4a-c8c0-4ad7-96a8-64285a485f76 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.176752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9e4a-c8c0-4ad7-96a8-64285a485f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.177679 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9e4a-c8c0-4ad7-96a8-64285a485f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.243726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b9e4a-c8c0-4ad7-96a8-64285a485f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.245404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b9e4a-c8c0-4ad7-96a8-64285a485f76 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.261845 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4292/8571] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:19.272102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.274132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:19.295250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb6af8-21ac-4e16-bf8b-1387c7ba78f5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.300542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.301979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.302126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.302432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] PATH_INFO: `/v3/projects/6a4ac7afa8ff4ccda354f0ec7af80e9a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.303757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4ac7afa8ff4ccda354f0ec7af80e9a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.305772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.316056 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:19.363456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'request_id': 'req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.372427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'request_id': 'req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.384122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'request_id': 'req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.396994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] The token cache is being invalidate because project 6a4ac7afa8ff4ccda354f0ec7af80e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:19.397305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.398236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f5b606d9-8eb0-4e3d-bbcd-af2eb3a9c776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:19.399896 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4280/8572] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:19 2022] DELETE /identity/v3/projects/6a4ac7afa8ff4ccda354f0ec7af80e9a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:36:19.405834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed64ed-c71a-4759-9b86-2c8eb5b147c5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.406129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed64ed-c71a-4759-9b86-2c8eb5b147c5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.406416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed64ed-c71a-4759-9b86-2c8eb5b147c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.429236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-79ed64ed-c71a-4759-9b86-2c8eb5b147c5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:19.430705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-79ed64ed-c71a-4759-9b86-2c8eb5b147c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:19.516202 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4293/8573] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:19.524788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440750-92c0-488e-ab11-731db1445de9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.525151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440750-92c0-488e-ab11-731db1445de9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.525428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9440750-92c0-488e-ab11-731db1445de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.550091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f9440750-92c0-488e-ab11-731db1445de9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:19.552365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f9440750-92c0-488e-ab11-731db1445de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:19.570496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4281/8574] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:19.571989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed64ed-c71a-4759-9b86-2c8eb5b147c5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.584602 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed64ed-c71a-4759-9b86-2c8eb5b147c5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.591479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.592259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.592636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.592913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.593706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:36:19.594038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.595869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.612787 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4294/8575] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:36:19.613971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440750-92c0-488e-ab11-731db1445de9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.623743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9440750-92c0-488e-ab11-731db1445de9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.629576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.630259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.630563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.630839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.631715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.634026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.668118 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4282/8576] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:36:19 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:36:19.672710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.684859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eccf9-40a8-42b2-9b7e-a39e2536afac admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.727975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:19.771921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.772690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.772970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.773315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.774059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.776512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.803937 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4295/8577] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:36:19 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:36:19.808097 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.819525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed7ce-2ef8-4157-959f-31a47bd80d3c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.824677 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.825662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.825991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.826280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.827052 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.828833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.841772 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4283/8578] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:19.845645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.858059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dff694-f4cd-434c-bf77-c272f127a4c1 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.867011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec22fc-642d-4dd4-86de-363a733f29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.867728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec22fc-642d-4dd4-86de-363a733f29e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.868122 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec22fc-642d-4dd4-86de-363a733f29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.868906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec22fc-642d-4dd4-86de-363a733f29e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.869880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec22fc-642d-4dd4-86de-363a733f29e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.871783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec22fc-642d-4dd4-86de-363a733f29e8 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.885397 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4296/8579] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:19.889585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:19.900978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507b525-46ed-4bd1-b308-ced049929557 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:19.906028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:19.907110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.907456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.907769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] PATH_INFO: `/v3/projects/c8e21aaf75c249daadb15c6ee8fd02b4/users/6e0b18a739584c409cd4aaadb7bc9171/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:19.928166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e21aaf75c249daadb15c6ee8fd02b4, user_id=6e0b18a739584c409cd4aaadb7bc9171, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:19.931359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:19.947731 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4284/8580] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:36:19 2022] PUT /identity/v3/projects/c8e21aaf75c249daadb15c6ee8fd02b4/users/6e0b18a739584c409cd4aaadb7bc9171/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:19.958620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:19.959235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:19.959693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:20.001948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] MFA Rules not processed for user `6e0b18a739584c409cd4aaadb7bc9171`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:20.003623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:20.105410 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4297/8581] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:20.115035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:20.117232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:20.192908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f44749-3df9-49a6-9c5c-4c578e37a0ff admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:20.197188 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:20.197674 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:20.197957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:20.198233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:20.213532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:20.217085 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:20.228943 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4285/8582] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:21.487412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:21.490746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:21.575110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2a384-3289-408f-9b1f-6df49f0ce9aa None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:21.579290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6db957-e5d1-48b0-af58-d168a3a4a3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:21.580442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db957-e5d1-48b0-af58-d168a3a4a3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:21.580867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db957-e5d1-48b0-af58-d168a3a4a3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:21.581402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6db957-e5d1-48b0-af58-d168a3a4a3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:21.583722 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6b6db957-e5d1-48b0-af58-d168a3a4a3b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:21.653527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:21.679485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6db957-e5d1-48b0-af58-d168a3a4a3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:21.681978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6db957-e5d1-48b0-af58-d168a3a4a3b6 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:21.706549 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4298/8583] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:23.511560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:23.548029 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8215-4d6a-4623-b51f-22c29f380cc4 service cinder] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:23.565290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:23.566615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:23.567685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:23.568613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:23.574167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:23.617797 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:23.621276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:23.659256 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4286/8584] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:24.546903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193aec6-f6ce-41fc-904d-e5010c0ccfa5 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:24.547404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193aec6-f6ce-41fc-904d-e5010c0ccfa5 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:24.547404 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193aec6-f6ce-41fc-904d-e5010c0ccfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:24.576259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b193aec6-f6ce-41fc-904d-e5010c0ccfa5 None None] MFA Rules not processed for user `e4fe3c12cc414bdd97c19803c6911b35`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:24.577827 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b193aec6-f6ce-41fc-904d-e5010c0ccfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:24.662210 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4299/8585] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:24.666890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:24.669209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:24.699128 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:24.743699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e13d32-be8e-4759-9bf1-e4ba882f5518 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:24.748566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:24.749332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:24.749629 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:24.750039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:24.750760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:24.752683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:24.786010 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4287/8586] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:36:24 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:24.790006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193aec6-f6ce-41fc-904d-e5010c0ccfa5 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:24.832421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193aec6-f6ce-41fc-904d-e5010c0ccfa5 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:24.929548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:24.930279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:24.930879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:24.930879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:24.931569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:24.933689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:24.962109 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4300/8587] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:36:24 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:36:24.963273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:24.975856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789998-b0c7-491a-bfd9-4e5266641ec5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:24.982604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:24.983279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:24.983697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:24.984183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:24.985120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:24.986938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:25.002867 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4288/8588] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:25.012793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:25.033580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4c4b-1a2a-485c-99a2-13058bb61588 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:25.041957 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:25.043682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:25.043982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:25.044292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] PATH_INFO: `/v3/projects/ca621b1e751c47918695e53f52145438/users/ea832a701f7a4b5d9091c89f2829c0ea/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:25.071724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca621b1e751c47918695e53f52145438, user_id=ea832a701f7a4b5d9091c89f2829c0ea, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:25.094872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:25.121326 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4301/8589] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:36:25 2022] PUT /identity/v3/projects/ca621b1e751c47918695e53f52145438/users/ea832a701f7a4b5d9091c89f2829c0ea/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:25.123003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:25.135302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa738-3804-4b20-a123-b0ead4f6b9c5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:25.222960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:25.225088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:25.225567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:25.226080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:25.227051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:25.229695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:25.244289 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4289/8590] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:36:25.251097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:25.268357 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84d58-eb6c-4d91-9809-18fdf2ef1c72 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:25.276083 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02932a6-19cf-4c03-b0df-ba9fc9d62035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:25.276430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02932a6-19cf-4c03-b0df-ba9fc9d62035 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:25.276743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02932a6-19cf-4c03-b0df-ba9fc9d62035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:25.277025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02932a6-19cf-4c03-b0df-ba9fc9d62035 admin admin] PATH_INFO: `/v3/projects/ca621b1e751c47918695e53f52145438/users/ea832a701f7a4b5d9091c89f2829c0ea/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:25.279818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02932a6-19cf-4c03-b0df-ba9fc9d62035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca621b1e751c47918695e53f52145438, user_id=ea832a701f7a4b5d9091c89f2829c0ea, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:25.283352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02932a6-19cf-4c03-b0df-ba9fc9d62035 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:25.297341 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4302/8591] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:36:25 2022] PUT /identity/v3/projects/ca621b1e751c47918695e53f52145438/users/ea832a701f7a4b5d9091c89f2829c0ea/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:36:32.591198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:32.605211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1465b9b-6fa8-43e4-92b9-c1be59e375fc admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:32.732247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:32.733641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:32.734153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:32.735585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] PATH_INFO: `/v3/users/6e0b18a739584c409cd4aaadb7bc9171` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:32.737437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0b18a739584c409cd4aaadb7bc9171)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:32.741458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:32.815151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:32.841209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0b18a739584c409cd4aaadb7bc9171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:32.842633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0b18a739584c409cd4aaadb7bc9171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:32.867467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0b18a739584c409cd4aaadb7bc9171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:32.868396 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0b18a739584c409cd4aaadb7bc9171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:32.898077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0b18a739584c409cd4aaadb7bc9171'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:32.931581 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4290/8592] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:32 2022] DELETE /identity/v3/users/6e0b18a739584c409cd4aaadb7bc9171 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:32.936955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:32.937563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:32.937754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:32.966419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:32.967703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:33.010611 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:33.087099 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4303/8593] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:33.103366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:33.108177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:33.214199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526f902-d16a-48ee-96fb-c6307deb5ff6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:33.221943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295cc61-ef85-4243-ac56-edfda08ec566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:33.223013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295cc61-ef85-4243-ac56-edfda08ec566 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:33.223334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295cc61-ef85-4243-ac56-edfda08ec566 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:33.223702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295cc61-ef85-4243-ac56-edfda08ec566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:33.236729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295cc61-ef85-4243-ac56-edfda08ec566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:33.239074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295cc61-ef85-4243-ac56-edfda08ec566 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:33.265112 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4291/8594] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:33.616773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:33.619903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:33.639196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084199-0c5f-4fb1-b027-27b08b1bdd5d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:33.664937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:33.666813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:33.667175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:33.667464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] PATH_INFO: `/v3/projects/c8e21aaf75c249daadb15c6ee8fd02b4` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:33.669463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e21aaf75c249daadb15c6ee8fd02b4)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:33.671996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:33.751278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e21aaf75c249daadb15c6ee8fd02b4', 'request_id': 'req-da7203f4-fd32-413b-a7da-0daf3e89837e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:33.762170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e21aaf75c249daadb15c6ee8fd02b4', 'request_id': 'req-da7203f4-fd32-413b-a7da-0daf3e89837e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:33.775740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e21aaf75c249daadb15c6ee8fd02b4', 'request_id': 'req-da7203f4-fd32-413b-a7da-0daf3e89837e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:33.795433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] The token cache is being invalidate because project c8e21aaf75c249daadb15c6ee8fd02b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:33.795809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:33.796596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-da7203f4-fd32-413b-a7da-0daf3e89837e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:33.803724 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4304/8595] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:33 2022] DELETE /identity/v3/projects/c8e21aaf75c249daadb15c6ee8fd02b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:33.808726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bf53-3391-4a34-b6db-0841ca4b3f1e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:33.809652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bf53-3391-4a34-b6db-0841ca4b3f1e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:33.810099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bf53-3391-4a34-b6db-0841ca4b3f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:33.850291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-62c7bf53-3391-4a34-b6db-0841ca4b3f1e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:33.854042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-62c7bf53-3391-4a34-b6db-0841ca4b3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:33.937886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:33.938299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:33.938509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:33.971540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] MFA Rules not processed for user `ea832a701f7a4b5d9091c89f2829c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:33.972766 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:33.982685 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4292/8596] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:33.985828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96566-2348-4bad-ba70-25264756158e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:33.986303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96566-2348-4bad-ba70-25264756158e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:33.986743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96566-2348-4bad-ba70-25264756158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.015322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2ac96566-2348-4bad-ba70-25264756158e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:34.017682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2ac96566-2348-4bad-ba70-25264756158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:34.037257 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4293/8597] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:34.039174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96566-2348-4bad-ba70-25264756158e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.053420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96566-2348-4bad-ba70-25264756158e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.058676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.059371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.059653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.059929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.060682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:36:34.061570 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.063217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.079046 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4294/8598] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:36:34.083875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.104349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba390c6-4d86-49b7-9b1a-0993c0e74a81 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.105579 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4305/8599] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:34.109980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.110968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.111249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.111530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.112236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.115680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.121067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.124368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:34.165442 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4295/8600] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:36:34 2022] POST /identity/v3/projects => generated 399 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:34.169619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.194864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:34.210698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:34.284321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304606-76f6-4fb9-9ad2-1086a5bbbf10 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.289838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a5ad4-dddf-4dd5-a755-6ce0f85dea1a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.295495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.295888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.296277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.296665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.297510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.299727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.327900 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4296/8601] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:36:34 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:34.331452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.343320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a52506-1e1f-47c6-8f0f-355642142426 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.349550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.350665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.350953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.351244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.351976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.354377 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.368001 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4297/8602] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:34.371587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e4a32-2cc0-4991-ab20-499523a519e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.371816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.372320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e4a32-2cc0-4991-ab20-499523a519e2 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.372562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e4a32-2cc0-4991-ab20-499523a519e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.372833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e4a32-2cc0-4991-ab20-499523a519e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.382525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5dbb9-30de-40f8-8e6d-f57609999232 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.388669 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.389575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.389971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.390353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.391195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.392813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.406063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4298/8603] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:34.410256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.423091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567ad24-2207-4f3c-9f4e-34c74b41a1f8 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.434615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2e76-f295-4c5b-8674-bc3d118d5c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.435827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2e76-f295-4c5b-8674-bc3d118d5c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.436111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2e76-f295-4c5b-8674-bc3d118d5c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.436391 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2e76-f295-4c5b-8674-bc3d118d5c1a admin admin] PATH_INFO: `/v3/projects/b65538816264444282c3b4d86668802f/users/5f6175e1c1d74ee0b15318a95e0980e7/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.447843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e4a32-2cc0-4991-ab20-499523a519e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.449605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e4a32-2cc0-4991-ab20-499523a519e2 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.452970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2e76-f295-4c5b-8674-bc3d118d5c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65538816264444282c3b4d86668802f, user_id=5f6175e1c1d74ee0b15318a95e0980e7, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.455729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2e76-f295-4c5b-8674-bc3d118d5c1a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.477484 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4306/8604] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:34.487180 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4299/8605] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:36:34 2022] PUT /identity/v3/projects/b65538816264444282c3b4d86668802f/users/5f6175e1c1d74ee0b15318a95e0980e7/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:36:34.497569 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.497858 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.498137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.518168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24fe8-f476-4a15-bea3-7203ff638e0c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.518457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24fe8-f476-4a15-bea3-7203ff638e0c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.518738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24fe8-f476-4a15-bea3-7203ff638e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.527797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] MFA Rules not processed for user `5f6175e1c1d74ee0b15318a95e0980e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:34.528938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:34.539766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9fd24fe8-f476-4a15-bea3-7203ff638e0c None None] MFA Rules not processed for user `e4fe3c12cc414bdd97c19803c6911b35`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:34.541168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9fd24fe8-f476-4a15-bea3-7203ff638e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:34.594909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:34.607092 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4307/8606] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:34.618627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4300/8607] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:36:34.622280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:34.623745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:34.726935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de5e64-5b35-48ab-a834-1eafb8c5e8a2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:34.732256 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d65273-3661-448c-bb1e-a04440049442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028b67b31190461b96d35563506b6c8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:34.733157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65273-3661-448c-bb1e-a04440049442 service cinder] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:34.733733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65273-3661-448c-bb1e-a04440049442 service cinder] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:34.734095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65273-3661-448c-bb1e-a04440049442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:34.746162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d65273-3661-448c-bb1e-a04440049442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:34.747771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d65273-3661-448c-bb1e-a04440049442 service cinder] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:34.761284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4308/8608] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:36:40.258560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd24fe8-f476-4a15-bea3-7203ff638e0c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:40.334364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd24fe8-f476-4a15-bea3-7203ff638e0c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:40.339122 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:40.340010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:40.340284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:40.340554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] PATH_INFO: `/v3/users/5f6175e1c1d74ee0b15318a95e0980e7` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:40.341772 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6175e1c1d74ee0b15318a95e0980e7)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:40.343685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:40.345972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:40.392992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6175e1c1d74ee0b15318a95e0980e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:40.393686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6175e1c1d74ee0b15318a95e0980e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:40.405486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6175e1c1d74ee0b15318a95e0980e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:40.406137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6175e1c1d74ee0b15318a95e0980e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:40.413026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6175e1c1d74ee0b15318a95e0980e7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:40.428379 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4301/8609] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:40 2022] DELETE /identity/v3/users/5f6175e1c1d74ee0b15318a95e0980e7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:40.432992 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:40.433481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:40.433563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:40.450538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:40.451746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:40.512120 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4309/8610] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:40.523510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:40.525131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:40.586916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dee25-ce18-4ede-8210-370ca381c866 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:40.590927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ed514-ff9d-4ba8-8b1b-00e1b3056af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:40.591574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed514-ff9d-4ba8-8b1b-00e1b3056af9 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:40.591858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed514-ff9d-4ba8-8b1b-00e1b3056af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:40.592159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ed514-ff9d-4ba8-8b1b-00e1b3056af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:40.602151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed514-ff9d-4ba8-8b1b-00e1b3056af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:40.603613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ed514-ff9d-4ba8-8b1b-00e1b3056af9 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:40.613414 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4302/8611] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:41.003038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.004745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:41.017568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d2ff-943c-4279-a9cd-66b7dd76bbf3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.031759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.032952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.033716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.033958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] PATH_INFO: `/v3/projects/b65538816264444282c3b4d86668802f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.035764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65538816264444282c3b4d86668802f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.038223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.089891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65538816264444282c3b4d86668802f', 'request_id': 'req-67294579-0834-49f8-9ab5-551221f6b3da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:41.097875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65538816264444282c3b4d86668802f', 'request_id': 'req-67294579-0834-49f8-9ab5-551221f6b3da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:41.106583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65538816264444282c3b4d86668802f', 'request_id': 'req-67294579-0834-49f8-9ab5-551221f6b3da'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:41.117678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] The token cache is being invalidate because project b65538816264444282c3b4d86668802f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:41.117986 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:41.118711 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-67294579-0834-49f8-9ab5-551221f6b3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:41.120408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4310/8612] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:41 2022] DELETE /identity/v3/projects/b65538816264444282c3b4d86668802f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:41.125690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754fe2-73e2-45e6-bd50-c8fe3b252440 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.125978 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754fe2-73e2-45e6-bd50-c8fe3b252440 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.126257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754fe2-73e2-45e6-bd50-c8fe3b252440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.143972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ea754fe2-73e2-45e6-bd50-c8fe3b252440 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:41.145313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ea754fe2-73e2-45e6-bd50-c8fe3b252440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:41.216626 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4303/8613] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:41.220598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684d0d-4b07-4eaa-9b9a-11b1ef771737 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.220888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684d0d-4b07-4eaa-9b9a-11b1ef771737 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.221204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684d0d-4b07-4eaa-9b9a-11b1ef771737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.240412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5f684d0d-4b07-4eaa-9b9a-11b1ef771737 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:41.241704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5f684d0d-4b07-4eaa-9b9a-11b1ef771737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:41.250427 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4311/8614] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:41.255065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754fe2-73e2-45e6-bd50-c8fe3b252440 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.265641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754fe2-73e2-45e6-bd50-c8fe3b252440 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.270225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.270901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.271225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.271492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.272249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:36:41.272557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.274197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.286590 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4304/8615] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:36:41.290788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684d0d-4b07-4eaa-9b9a-11b1ef771737 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.300982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684d0d-4b07-4eaa-9b9a-11b1ef771737 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.306175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.306842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.307127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.307409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.308099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.310093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.327243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:41.350308 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4312/8616] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:36:41 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:41.354172 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.368872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446d79a-9b18-4d85-bec0-9161f9082469 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.378823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:41.429885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.430651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.431001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.431287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.431996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.433974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.457680 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4305/8617] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:36:41 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:41.461962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.472926 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f67d9-83e0-4879-a5ee-502d1e004180 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.478283 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.479088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.479382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.479647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.480381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.482055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.493110 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4313/8618] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 22:36:41.497176 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.507705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a565a-1ae8-46da-b7d2-1133bdeb7237 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.512812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2b982-fba1-4da5-b3fe-fac5baddeb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.513507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b982-fba1-4da5-b3fe-fac5baddeb59 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.513789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b982-fba1-4da5-b3fe-fac5baddeb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.514062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b982-fba1-4da5-b3fe-fac5baddeb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.514817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2b982-fba1-4da5-b3fe-fac5baddeb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.516414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2b982-fba1-4da5-b3fe-fac5baddeb59 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.526804 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4306/8619] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:41.531489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.546561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f748859-9d2c-4b1c-8171-fc5671faf829 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.553590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.554559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.554843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.555118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] PATH_INFO: `/v3/projects/0b73a590b0c1448d8ca007bf07339ff2/users/f65246e72ec749edaef4681d85b0bdb6/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.570920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b73a590b0c1448d8ca007bf07339ff2, user_id=f65246e72ec749edaef4681d85b0bdb6, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.573654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.588947 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4314/8620] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:36:41 2022] PUT /identity/v3/projects/0b73a590b0c1448d8ca007bf07339ff2/users/f65246e72ec749edaef4681d85b0bdb6/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:41.600248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd99f3-c534-471c-b73d-00b34f00d6f8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.600648 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd99f3-c534-471c-b73d-00b34f00d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.600955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd99f3-c534-471c-b73d-00b34f00d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.629719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f3fd99f3-c534-471c-b73d-00b34f00d6f8 None None] MFA Rules not processed for user `f65246e72ec749edaef4681d85b0bdb6`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:41.630944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f3fd99f3-c534-471c-b73d-00b34f00d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:41.697676 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4307/8621] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:41.702313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.766178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1e39c-4992-4467-9937-4a6b8c133598 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.771319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.771987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.772278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.772554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.773257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.775170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.803303 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4315/8622] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:36:41 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:41.807205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd99f3-c534-471c-b73d-00b34f00d6f8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.818351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd99f3-c534-471c-b73d-00b34f00d6f8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.881659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.882331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.882606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.882877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.883566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.885518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.907423 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4308/8623] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:36:41 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:36:41.911413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.922686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6b2d-4499-494c-8ef7-7320d1acce3f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.927868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141dfc-a76e-4a0d-a5b7-248c6dd049ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.928533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141dfc-a76e-4a0d-a5b7-248c6dd049ff admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.928810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141dfc-a76e-4a0d-a5b7-248c6dd049ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.929111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141dfc-a76e-4a0d-a5b7-248c6dd049ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.929804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141dfc-a76e-4a0d-a5b7-248c6dd049ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.931420 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141dfc-a76e-4a0d-a5b7-248c6dd049ff admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:41.942871 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4316/8624] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:36:41.947494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:41.958742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e5f26-8154-4245-8324-b060140714d6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:41.965224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:41.966141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:41.966435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:41.966708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] PATH_INFO: `/v3/projects/07ddd8d285d44ae5af6591c7dd94d49e/users/ef822f1609944c68b512187214cd3ac9/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:41.970317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:41.983995 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ddd8d285d44ae5af6591c7dd94d49e, user_id=ef822f1609944c68b512187214cd3ac9, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:41.986751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:42.007238 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4309/8625] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:36:41 2022] PUT /identity/v3/projects/07ddd8d285d44ae5af6591c7dd94d49e/users/ef822f1609944c68b512187214cd3ac9/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:42.017814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e13b2-6442-4eec-ad37-350ca33bed28 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:42.018098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e13b2-6442-4eec-ad37-350ca33bed28 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:42.018368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e13b2-6442-4eec-ad37-350ca33bed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:42.048452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-013e13b2-6442-4eec-ad37-350ca33bed28 None None] MFA Rules not processed for user `ef822f1609944c68b512187214cd3ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:42.049725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-013e13b2-6442-4eec-ad37-350ca33bed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:42.114315 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4317/8626] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:42 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:42.143006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:42.145223 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:42.223465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c1daa-e8ca-4e93-abaa-4b51b8cbd838 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:42.229358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b032f-74c3-44cb-9bb1-a495ba62a447 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:42.229986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b032f-74c3-44cb-9bb1-a495ba62a447 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:42.230310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b032f-74c3-44cb-9bb1-a495ba62a447 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:42.230558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b032f-74c3-44cb-9bb1-a495ba62a447 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:42.239591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b032f-74c3-44cb-9bb1-a495ba62a447 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:42.241249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b032f-74c3-44cb-9bb1-a495ba62a447 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:42.249551 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4310/8627] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:36:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:36:42.885927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e13b2-6442-4eec-ad37-350ca33bed28 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:42.919864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:42.961439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e13b2-6442-4eec-ad37-350ca33bed28 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:42.966095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:42.966984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:42.967267 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:42.967541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] PATH_INFO: `/v3/users/f65246e72ec749edaef4681d85b0bdb6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:42.968757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65246e72ec749edaef4681d85b0bdb6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:42.970736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:43.018944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65246e72ec749edaef4681d85b0bdb6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.019524 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65246e72ec749edaef4681d85b0bdb6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.031747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65246e72ec749edaef4681d85b0bdb6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.032428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65246e72ec749edaef4681d85b0bdb6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.039865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65246e72ec749edaef4681d85b0bdb6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.055888 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4318/8628] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:42 2022] DELETE /identity/v3/users/f65246e72ec749edaef4681d85b0bdb6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:43.060713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:43.061219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:43.061303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:43.079164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:43.080360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:43.140122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4311/8629] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:43.150186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:43.151874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:43.219927 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74789d54-01d2-4d84-9e83-17601f7f9c9b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:43.223963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:43.224621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:43.224896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:43.225204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:43.234881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:43.236332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:43.246717 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4319/8630] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:43.533852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:43.535564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:43.548547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38a34e-f1bf-40c6-8849-32eb3aeaa348 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:43.554198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:43.555083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:43.555360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:43.555639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] PATH_INFO: `/v3/projects/0b73a590b0c1448d8ca007bf07339ff2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:43.556862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b73a590b0c1448d8ca007bf07339ff2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:43.558816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:43.608644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b73a590b0c1448d8ca007bf07339ff2', 'request_id': 'req-3ee6b719-c126-445a-860c-595919dd076d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.615380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b73a590b0c1448d8ca007bf07339ff2', 'request_id': 'req-3ee6b719-c126-445a-860c-595919dd076d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.625058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b73a590b0c1448d8ca007bf07339ff2', 'request_id': 'req-3ee6b719-c126-445a-860c-595919dd076d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.631229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:43.636131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] The token cache is being invalidate because project 0b73a590b0c1448d8ca007bf07339ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:43.636535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.637690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.639348 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4312/8631] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:43 2022] DELETE /identity/v3/projects/0b73a590b0c1448d8ca007bf07339ff2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:43.643534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:43.653993 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768f201-1b2b-4f89-8881-b1cb7be051e7 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:43.697441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:43.715007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:43.715892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:43.716172 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:43.716445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] PATH_INFO: `/v3/users/ef822f1609944c68b512187214cd3ac9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:43.717678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef822f1609944c68b512187214cd3ac9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:43.719618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:43.770086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef822f1609944c68b512187214cd3ac9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.770755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef822f1609944c68b512187214cd3ac9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.783145 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef822f1609944c68b512187214cd3ac9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.783847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef822f1609944c68b512187214cd3ac9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.791652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-02530d14-f25b-4335-b1a6-64c92959468c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef822f1609944c68b512187214cd3ac9'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:43.807815 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4320/8632] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:36:43 2022] DELETE /identity/v3/users/ef822f1609944c68b512187214cd3ac9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:44.100076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:44.101590 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:44.114618 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6b719-c126-445a-860c-595919dd076d admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:44.177505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:44.178381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:44.178662 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:44.178925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] PATH_INFO: `/v3/projects/07ddd8d285d44ae5af6591c7dd94d49e` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:44.180123 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ddd8d285d44ae5af6591c7dd94d49e)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:44.182095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:44.235049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ddd8d285d44ae5af6591c7dd94d49e', 'request_id': 'req-a0e49190-217f-4f05-af02-d899ad77ca6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:44.242522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ddd8d285d44ae5af6591c7dd94d49e', 'request_id': 'req-a0e49190-217f-4f05-af02-d899ad77ca6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:44.252868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ddd8d285d44ae5af6591c7dd94d49e', 'request_id': 'req-a0e49190-217f-4f05-af02-d899ad77ca6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:44.264146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] The token cache is being invalidate because project 07ddd8d285d44ae5af6591c7dd94d49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:36:44.264436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:44.265353 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:36:44.267174 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4313/8633] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:36:44 2022] DELETE /identity/v3/projects/07ddd8d285d44ae5af6591c7dd94d49e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:36:46.492757 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:46.493328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:46.493328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:46.511334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] MFA Rules not processed for user `e4fe3c12cc414bdd97c19803c6911b35`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:46.512531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:46.579854 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4321/8634] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:36:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:47.149493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:47.151151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:47.215043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e49190-217f-4f05-af02-d899ad77ca6c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:47.219051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:47.219700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:47.219981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:47.220224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:47.222117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:47.234295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:47.235722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:47.246326 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4314/8635] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:56.569259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:57.240157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:57.345630 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:57.347079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:57.432839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7923-4cdf-4333-847e-bce5bd5c8b00 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:57.439562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ee34-d6db-4208-b258-ef34b478007c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:57.440634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ee34-d6db-4208-b258-ef34b478007c service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:57.440947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ee34-d6db-4208-b258-ef34b478007c service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:57.441326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ee34-d6db-4208-b258-ef34b478007c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:57.445591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-de95ee34-d6db-4208-b258-ef34b478007c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:57.463669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ee34-d6db-4208-b258-ef34b478007c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:57.466366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ee34-d6db-4208-b258-ef34b478007c service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:57.482675 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4322/8636] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:57.653723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:57.655338 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:57.672209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b08b4-be32-4fb3-9e49-0f2ad6b5cb91 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:57.678318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5668a5-9fdc-4cb1-a9a8-efbe6962cb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:57.678997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5668a5-9fdc-4cb1-a9a8-efbe6962cb1e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:57.679280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5668a5-9fdc-4cb1-a9a8-efbe6962cb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:57.679600 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5668a5-9fdc-4cb1-a9a8-efbe6962cb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:57.681788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5d5668a5-9fdc-4cb1-a9a8-efbe6962cb1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:57.696606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5668a5-9fdc-4cb1-a9a8-efbe6962cb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:57.698079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5668a5-9fdc-4cb1-a9a8-efbe6962cb1e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:57.710377 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4315/8637] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:57.806508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7840e-d1fb-4f3b-82d7-d6f87974237a None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:57.807126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7840e-d1fb-4f3b-82d7-d6f87974237a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:57.807126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7840e-d1fb-4f3b-82d7-d6f87974237a None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:57.808401 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4323/8638] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:36:57.813912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978803-86f6-4f37-a622-91bf2f4c9b40 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:57.814199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978803-86f6-4f37-a622-91bf2f4c9b40 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:57.814507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75978803-86f6-4f37-a622-91bf2f4c9b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:57.851637 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-75978803-86f6-4f37-a622-91bf2f4c9b40 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:36:57.852864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-75978803-86f6-4f37-a622-91bf2f4c9b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:57.862648 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4316/8639] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:36:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:36:57.884528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7840e-d1fb-4f3b-82d7-d6f87974237a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:57.902454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7840e-d1fb-4f3b-82d7-d6f87974237a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:57.908541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:57.910555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:57.910555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:57.910555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:57.920326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:57.922298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:57.937523 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4324/8640] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:58.115492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978803-86f6-4f37-a622-91bf2f4c9b40 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:58.129678 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75978803-86f6-4f37-a622-91bf2f4c9b40 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:58.134729 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:58.135627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:58.135902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:58.136186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:58.138203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:58.223917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:58.225437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:58.239722 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4317/8641] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:36:59.166413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:36:59.181677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ff4b-3558-47ae-a8b4-ce8b9a88ba97 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:36:59.186445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:36:59.187178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:36:59.187856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:36:59.188144 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:36:59.191603 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:36:59.208672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:36:59.210674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:36:59.224269 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4325/8642] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:36:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:37:08.231812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=49 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:09.216962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=44 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:11.677015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:11.679118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:11.744970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba844b8-6d94-474a-9983-1ba2a299befa service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:11.750047 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:11.750923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:11.751202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:11.751478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] PATH_INFO: `/v3/users/e4fe3c12cc414bdd97c19803c6911b35` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:11.752773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fe3c12cc414bdd97c19803c6911b35)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:11.754753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:11.806297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fe3c12cc414bdd97c19803c6911b35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:11.806984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fe3c12cc414bdd97c19803c6911b35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:11.819874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fe3c12cc414bdd97c19803c6911b35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:11.821508 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fe3c12cc414bdd97c19803c6911b35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:11.832463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fe3c12cc414bdd97c19803c6911b35'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:11.848197 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4318/8643] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:37:11 2022] DELETE /identity/v3/users/e4fe3c12cc414bdd97c19803c6911b35 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:37:12.056069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:12.071821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc696387-b488-4bd6-954d-9e29f17e0706 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:12.139160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:12.140192 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:12.140534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:12.140869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] PATH_INFO: `/v3/projects/1224106f5de04ea084a313a56a1949c9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:12.142207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1224106f5de04ea084a313a56a1949c9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:12.144305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:12.193221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1224106f5de04ea084a313a56a1949c9', 'request_id': 'req-5566a76a-1677-4358-9da0-e4ab95df6e5f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.200233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1224106f5de04ea084a313a56a1949c9', 'request_id': 'req-5566a76a-1677-4358-9da0-e4ab95df6e5f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.210163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1224106f5de04ea084a313a56a1949c9', 'request_id': 'req-5566a76a-1677-4358-9da0-e4ab95df6e5f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.222005 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] The token cache is being invalidate because project 1224106f5de04ea084a313a56a1949c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:37:12.222289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.222943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.224527 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4326/8644] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:37:12 2022] DELETE /identity/v3/projects/1224106f5de04ea084a313a56a1949c9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:37:12.228859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:12.230536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:12.244365 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d562b-e90e-4824-8248-f13b96f1f363 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:12.306150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:12.306985 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:12.307264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:12.307542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] PATH_INFO: `/v3/users/ea832a701f7a4b5d9091c89f2829c0ea` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:12.308939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea832a701f7a4b5d9091c89f2829c0ea)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:12.311083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:12.337481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:12.366644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea832a701f7a4b5d9091c89f2829c0ea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.367335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea832a701f7a4b5d9091c89f2829c0ea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.380150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea832a701f7a4b5d9091c89f2829c0ea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.380904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea832a701f7a4b5d9091c89f2829c0ea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.388126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea832a701f7a4b5d9091c89f2829c0ea'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.403022 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4319/8645] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:37:12 2022] DELETE /identity/v3/users/ea832a701f7a4b5d9091c89f2829c0ea => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:37:12.687904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:12.689581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:12.704863 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a76a-1677-4358-9da0-e4ab95df6e5f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:12.767663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:12.768641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:12.769390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:12.769390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] PATH_INFO: `/v3/projects/ca621b1e751c47918695e53f52145438` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:12.770495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca621b1e751c47918695e53f52145438)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:12.772423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:12.809656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:12.824638 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca621b1e751c47918695e53f52145438', 'request_id': 'req-7e46954c-8baa-4b6a-a62c-c5def71fad7f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.831223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca621b1e751c47918695e53f52145438', 'request_id': 'req-7e46954c-8baa-4b6a-a62c-c5def71fad7f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.840472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca621b1e751c47918695e53f52145438', 'request_id': 'req-7e46954c-8baa-4b6a-a62c-c5def71fad7f'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.851968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] The token cache is being invalidate because project ca621b1e751c47918695e53f52145438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:37:12.852242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.852925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:12.855159 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4327/8646] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:37:12 2022] DELETE /identity/v3/projects/ca621b1e751c47918695e53f52145438 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:37:12.947533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:12.950089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:13.088420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d810c-8f66-4c15-a091-9504f405fa11 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:13.184060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:13.185406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:13.185916 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:13.186571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:13.191143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:13.215163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:13.216886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:13.235868 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4320/8647] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:37:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:37:22.849000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:23.228207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=7,keystone:SELECT=82,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:39.717608 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:39.719978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:39.754491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46954c-8baa-4b6a-a62c-c5def71fad7f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:39.760506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:39.761243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:39.761528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:39.761805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:39.763798 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:39.840008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:39.841670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:39.852931 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4328/8648] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:37:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:37:41.757202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:41.758643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:41.827192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b02c-ddf9-4b25-b082-21020d8b48bf service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:41.831027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:41.831682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:41.831957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:41.832227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:41.834025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:41.907252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:41.908638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:41.929394 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4321/8649] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:37:48.528728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:48.530277 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:48.594204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:48.596437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:48.610828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71995211-1dbc-47f3-a3ee-a9d398556161 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:48.616416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:48.617351 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:48.617635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:48.617915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] PATH_INFO: `/v3/users/f228d958acdb4d769a59f019e4d41d6c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:48.619207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f228d958acdb4d769a59f019e4d41d6c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:48.619729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f5014-e0f1-499a-9ba5-95b7416f6a34 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:48.621339 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:48.625019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:48.625710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:48.625994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:48.626424 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:48.628387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:48.643212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:48.645734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:48.660130 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4329/8650] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:37:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:37:48.672573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f228d958acdb4d769a59f019e4d41d6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:48.673276 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f228d958acdb4d769a59f019e4d41d6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:48.686006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f228d958acdb4d769a59f019e4d41d6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:48.686699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f228d958acdb4d769a59f019e4d41d6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:48.694216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f228d958acdb4d769a59f019e4d41d6c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:48.707528 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4322/8651] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:37:48 2022] DELETE /identity/v3/users/f228d958acdb4d769a59f019e4d41d6c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:37:48.888227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:48.900723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441cec6-029d-4233-9736-3396756f0d1c service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:48.963388 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:48.964284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:48.964556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:48.964833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] PATH_INFO: `/v3/projects/1bf51848ad1c43ae997974ba2925ab4e` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:48.966076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf51848ad1c43ae997974ba2925ab4e)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:48.968010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:48.991865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:49.017449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf51848ad1c43ae997974ba2925ab4e', 'request_id': 'req-469460e5-008e-4d88-84d3-bd3c2d09defe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.024370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf51848ad1c43ae997974ba2925ab4e', 'request_id': 'req-469460e5-008e-4d88-84d3-bd3c2d09defe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.033515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf51848ad1c43ae997974ba2925ab4e', 'request_id': 'req-469460e5-008e-4d88-84d3-bd3c2d09defe'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.044439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] The token cache is being invalidate because project 1bf51848ad1c43ae997974ba2925ab4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:37:49.044728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.045399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.047014 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4330/8652] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:37:48 2022] DELETE /identity/v3/projects/1bf51848ad1c43ae997974ba2925ab4e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:37:49.051804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:49.053392 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:49.062924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:49.067334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c9136-bfb4-4a60-8e8e-5e66f0731768 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:49.127804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:49.128695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:49.129157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:49.129287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] PATH_INFO: `/v3/users/29193876d78148f8ba44ce9d40f691c0` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:49.130563 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29193876d78148f8ba44ce9d40f691c0)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:49.132501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:49.184113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29193876d78148f8ba44ce9d40f691c0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.184867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29193876d78148f8ba44ce9d40f691c0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.197284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29193876d78148f8ba44ce9d40f691c0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.197946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29193876d78148f8ba44ce9d40f691c0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.204807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-acc05a00-cfab-45bc-b258-d5e3f5bfbd8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29193876d78148f8ba44ce9d40f691c0'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.221167 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4323/8653] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:37:49 2022] DELETE /identity/v3/users/29193876d78148f8ba44ce9d40f691c0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:37:49.405272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:49.406838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:49.425231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469460e5-008e-4d88-84d3-bd3c2d09defe admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:49.487799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:49.488592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:49.488875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:49.489196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] PATH_INFO: `/v3/projects/445a0d0d5cc146cea23c952253106bd7` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:49.490540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=445a0d0d5cc146cea23c952253106bd7)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:49.492469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:49.543102 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445a0d0d5cc146cea23c952253106bd7', 'request_id': 'req-254ff0d1-6a67-4454-b971-e3e365b7f46c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.550852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445a0d0d5cc146cea23c952253106bd7', 'request_id': 'req-254ff0d1-6a67-4454-b971-e3e365b7f46c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.560489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445a0d0d5cc146cea23c952253106bd7', 'request_id': 'req-254ff0d1-6a67-4454-b971-e3e365b7f46c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.571912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] The token cache is being invalidate because project 445a0d0d5cc146cea23c952253106bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:37:49.572196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.572885 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:37:49.574598 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4331/8654] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:37:49 2022] DELETE /identity/v3/projects/445a0d0d5cc146cea23c952253106bd7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:37:55.522414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12303575-dc48-4756-888b-5407ce84da17 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:55.522913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12303575-dc48-4756-888b-5407ce84da17 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:55.522913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12303575-dc48-4756-888b-5407ce84da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:55.541634 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-12303575-dc48-4756-888b-5407ce84da17 None None] MFA Rules not processed for user `406628da7a8140fd83200ffc90e71198`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:37:55.542852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-12303575-dc48-4756-888b-5407ce84da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:55.601709 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4324/8655] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:37:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:37:55.934776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:55.936498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:55.984449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:56.003571 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ff0d1-6a67-4454-b971-e3e365b7f46c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:56.007883 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:56.008634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:56.008928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:56.009239 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:56.011327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:56.024069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:56.025586 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:56.037532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4332/8656] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:37:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:37:56.504262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12303575-dc48-4756-888b-5407ce84da17 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:37:56.505734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-12303575-dc48-4756-888b-5407ce84da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:56.539162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:56.582811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12303575-dc48-4756-888b-5407ce84da17 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:37:56.587816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:37:56.588479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:37:56.588753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:37:56.589025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:37:56.590810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:37:56.604896 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:37:56.606499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:37:56.618915 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4325/8657] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:37:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:38:05.731570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:38:05.733527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:38:05.819628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80243-f50f-43ba-a9b9-87750cfd0242 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:38:05.825463 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50a619-a9a7-4368-bf3a-a572fac0b894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:38:05.826106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50a619-a9a7-4368-bf3a-a572fac0b894 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:38:05.826392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50a619-a9a7-4368-bf3a-a572fac0b894 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:38:05.827152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50a619-a9a7-4368-bf3a-a572fac0b894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:38:05.828579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5f50a619-a9a7-4368-bf3a-a572fac0b894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:38:05.843696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50a619-a9a7-4368-bf3a-a572fac0b894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:38:05.845376 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50a619-a9a7-4368-bf3a-a572fac0b894 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:38:05.859336 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4333/8658] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:38:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:38:06.612675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=19 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:08.589871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:38:08.592153 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:38:08.611684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af1dea-c56d-47a9-b790-2e69a65c1fba service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:38:08.616192 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:38:08.616857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:38:08.617173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:38:08.617535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:38:08.619281 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:38:08.639069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:38:08.640547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:38:08.653286 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4326/8659] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:38:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:38:15.852839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=42 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:18.646510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:21.530454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651c42-1fb0-4743-9b1b-5ebb89c07888 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:38:21.531298 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651c42-1fb0-4743-9b1b-5ebb89c07888 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:38:21.531612 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651c42-1fb0-4743-9b1b-5ebb89c07888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:38:21.554208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f8651c42-1fb0-4743-9b1b-5ebb89c07888 None None] MFA Rules not processed for user `f1b184b4aef04efc8996eff7af43dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:38:21.556462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f8651c42-1fb0-4743-9b1b-5ebb89c07888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:38:21.620608 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4334/8660] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:38:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:38:31.614459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=25 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:35.208658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:39:35.210436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:39:35.239904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9814f-7ca1-4124-b0e3-d2bb0c628390 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:39:35.245549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e534-ac9d-4999-8500-daf8f67e2dff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:39:35.246210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e534-ac9d-4999-8500-daf8f67e2dff service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:39:35.246492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e534-ac9d-4999-8500-daf8f67e2dff service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:39:35.246798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e534-ac9d-4999-8500-daf8f67e2dff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:39:35.248712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bfc1e534-ac9d-4999-8500-daf8f67e2dff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:39:35.263284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e534-ac9d-4999-8500-daf8f67e2dff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:39:35.264871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e534-ac9d-4999-8500-daf8f67e2dff service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:39:35.277782 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4327/8661] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:39:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:39:38.312130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8651c42-1fb0-4743-9b1b-5ebb89c07888 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:39:38.325123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8651c42-1fb0-4743-9b1b-5ebb89c07888 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:39:38.330304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f448f97-1890-4513-8a98-85e183f4bfc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:39:38.330999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448f97-1890-4513-8a98-85e183f4bfc5 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:39:38.331280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448f97-1890-4513-8a98-85e183f4bfc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:39:38.331555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f448f97-1890-4513-8a98-85e183f4bfc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:39:38.333399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4f448f97-1890-4513-8a98-85e183f4bfc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:39:38.346109 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f448f97-1890-4513-8a98-85e183f4bfc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:39:38.347564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f448f97-1890-4513-8a98-85e183f4bfc5 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:39:38.358530 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4335/8662] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:39:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:39:38.476393 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eebd3-3cbe-4928-a574-1091e233e8f0 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:39:38.476902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eebd3-3cbe-4928-a574-1091e233e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:39:38.477020 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eebd3-3cbe-4928-a574-1091e233e8f0 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:39:38.478384 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4328/8663] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:39:38.483462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa208a0b-69f7-4217-bcba-c6911dcc6641 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:39:38.483752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa208a0b-69f7-4217-bcba-c6911dcc6641 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:39:38.484050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa208a0b-69f7-4217-bcba-c6911dcc6641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:39:38.503014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-aa208a0b-69f7-4217-bcba-c6911dcc6641 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:39:38.504204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aa208a0b-69f7-4217-bcba-c6911dcc6641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:39:38.513310 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4336/8664] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:39:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:39:38.534170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eebd3-3cbe-4928-a574-1091e233e8f0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:39:38.552379 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eebd3-3cbe-4928-a574-1091e233e8f0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:39:38.559204 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:39:38.559862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:39:38.560095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:39:38.560378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:39:38.571470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:39:38.573090 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:39:38.583253 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4329/8665] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:39:38.751783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa208a0b-69f7-4217-bcba-c6911dcc6641 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:39:38.764509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa208a0b-69f7-4217-bcba-c6911dcc6641 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:39:38.768691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:39:38.769691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:39:38.769968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:39:38.770240 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:39:38.772316 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:39:38.789707 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:39:38.791223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:39:38.805347 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4337/8666] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:39:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:39:43.442173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:39:43.456037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce05ec-ab07-4d99-a736-c57ffb8a8be8 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:39:43.462548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:39:43.463232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:39:43.463519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:39:43.463816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:39:43.465951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:39:43.480429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:39:43.482041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:39:43.494835 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4330/8667] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:39:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:39:48.797930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=15 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:53.487760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=22 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:35.479853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:40:35.491311 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1029ca-4715-4e33-b204-b0e6ecf61670 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:40:35.496101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:40:35.496758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:40:35.497064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:40:35.497355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:40:35.499429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:40:35.573768 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:40:35.575136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:40:35.585358 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4338/8668] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:40:38.717186 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:40:38.731178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ad3c1-67cc-4707-842c-722b1d6fc0d1 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:40:38.736535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:40:38.737297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:40:38.737580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:40:38.737854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:40:38.739680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:40:38.753999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:40:38.755580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:40:38.769081 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4331/8669] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:40:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:40:42.407661 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:40:42.409387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:40:42.424908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da019a-bf54-457c-803a-878c9458270e service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:40:42.430405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:40:42.431304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:40:42.431580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:40:42.431855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] PATH_INFO: `/v3/users/406628da7a8140fd83200ffc90e71198` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:40:42.446830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406628da7a8140fd83200ffc90e71198)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:40:42.448785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:40:42.498407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406628da7a8140fd83200ffc90e71198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.499068 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406628da7a8140fd83200ffc90e71198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.511293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406628da7a8140fd83200ffc90e71198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.511935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406628da7a8140fd83200ffc90e71198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.520622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406628da7a8140fd83200ffc90e71198'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.535499 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4339/8670] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:40:42 2022] DELETE /identity/v3/users/406628da7a8140fd83200ffc90e71198 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:40:42.717296 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:40:42.728852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f09ae-fc1f-4f3c-8f48-7fc1442e9005 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:40:42.790369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:40:42.791168 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:40:42.791453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:40:42.791730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] PATH_INFO: `/v3/projects/2d7a59e0743a480c9af66dea984113c6` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:40:42.802988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7a59e0743a480c9af66dea984113c6)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:40:42.804931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:40:42.856200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7a59e0743a480c9af66dea984113c6', 'request_id': 'req-b050ec6e-5260-4721-9c34-6ed9340d7b6b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.863165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7a59e0743a480c9af66dea984113c6', 'request_id': 'req-b050ec6e-5260-4721-9c34-6ed9340d7b6b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.872217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7a59e0743a480c9af66dea984113c6', 'request_id': 'req-b050ec6e-5260-4721-9c34-6ed9340d7b6b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.883747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] The token cache is being invalidate because project 2d7a59e0743a480c9af66dea984113c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:40:42.884035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.884739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:42.886359 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4332/8671] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:40:42 2022] DELETE /identity/v3/projects/2d7a59e0743a480c9af66dea984113c6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:40:42.890548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:40:42.891952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:40:42.905869 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf721-edd0-4923-9f43-00eb911e5929 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:40:42.959284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:42.967285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:40:42.968358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:40:42.968652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:40:42.969324 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] PATH_INFO: `/v3/users/0a7a7d74c1784ff99dbfb3b4abe152b2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:40:42.983553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7a7d74c1784ff99dbfb3b4abe152b2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:40:42.985551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:40:43.038853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7a7d74c1784ff99dbfb3b4abe152b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.039591 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7a7d74c1784ff99dbfb3b4abe152b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.052745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7a7d74c1784ff99dbfb3b4abe152b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.053371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7a7d74c1784ff99dbfb3b4abe152b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.060791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7a7d74c1784ff99dbfb3b4abe152b2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.076627 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4340/8672] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:40:42 2022] DELETE /identity/v3/users/0a7a7d74c1784ff99dbfb3b4abe152b2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:40:43.259060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:40:43.260519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:40:43.274406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050ec6e-5260-4721-9c34-6ed9340d7b6b admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:40:43.332212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:40:43.333067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:40:43.333354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:40:43.334072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] PATH_INFO: `/v3/projects/207a41c91fb6453b9eed9e5780111f76` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:40:43.345888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=207a41c91fb6453b9eed9e5780111f76)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:40:43.347991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:40:43.349914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:43.404067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207a41c91fb6453b9eed9e5780111f76', 'request_id': 'req-2297ba89-f5bc-446b-a07e-48c40909fdbe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.411024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207a41c91fb6453b9eed9e5780111f76', 'request_id': 'req-2297ba89-f5bc-446b-a07e-48c40909fdbe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.420568 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207a41c91fb6453b9eed9e5780111f76', 'request_id': 'req-2297ba89-f5bc-446b-a07e-48c40909fdbe'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.432992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] The token cache is being invalidate because project 207a41c91fb6453b9eed9e5780111f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:40:43.433312 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.434007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:40:43.435573 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4333/8673] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:40:43 2022] DELETE /identity/v3/projects/207a41c91fb6453b9eed9e5780111f76 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:40:53.073025 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:53.429722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:56.448754 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:40:56.450360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:40:56.523275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c1629-f237-4f8d-9be4-f45a90153548 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:40:56.573705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5c13-4c52-481f-a24f-ba88959eaf2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:40:56.574352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5c13-4c52-481f-a24f-ba88959eaf2c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:40:56.574631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5c13-4c52-481f-a24f-ba88959eaf2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:40:56.574897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5c13-4c52-481f-a24f-ba88959eaf2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:40:56.576740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-30dc5c13-4c52-481f-a24f-ba88959eaf2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:40:56.634360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc5c13-4c52-481f-a24f-ba88959eaf2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:40:56.635840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc5c13-4c52-481f-a24f-ba88959eaf2c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:40:56.644910 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4341/8674] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:40:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:41:05.536082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:41:05.537670 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:41:05.553744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297ba89-f5bc-446b-a07e-48c40909fdbe admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:41:05.557642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:41:05.558403 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:41:05.558754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:41:05.559101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:41:05.560996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:41:05.634239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:41:05.635740 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:41:05.646824 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4334/8675] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:41:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:41:06.640755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=68 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:08.199786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d966e-4713-4509-90b6-951cba50cfab None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:41:08.200381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d966e-4713-4509-90b6-951cba50cfab None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:41:08.200381 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d966e-4713-4509-90b6-951cba50cfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:41:08.221894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ec5d966e-4713-4509-90b6-951cba50cfab None None] MFA Rules not processed for user `f1b184b4aef04efc8996eff7af43dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:41:08.223552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ec5d966e-4713-4509-90b6-951cba50cfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:41:08.231201 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4342/8676] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:41:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:41:15.642067 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=30 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:18.222894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:22.658080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:41:22.684894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1fd8-a3d2-4fb8-91d1-ba1da42d4e26 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:41:22.690140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9cdff-f7f6-4767-8d4d-742c4f5b859a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:41:22.691159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9cdff-f7f6-4767-8d4d-742c4f5b859a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:41:22.691602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9cdff-f7f6-4767-8d4d-742c4f5b859a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:41:22.691868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9cdff-f7f6-4767-8d4d-742c4f5b859a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:41:22.694061 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-80f9cdff-f7f6-4767-8d4d-742c4f5b859a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:41:22.832131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9cdff-f7f6-4767-8d4d-742c4f5b859a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:41:22.833784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9cdff-f7f6-4767-8d4d-742c4f5b859a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:41:22.850650 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4335/8677] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:41:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:41:32.844681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=56 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:56.224931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d980b-7c14-4293-afbf-d4be7e2f61eb None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:41:56.225535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d980b-7c14-4293-afbf-d4be7e2f61eb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:41:56.225535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d980b-7c14-4293-afbf-d4be7e2f61eb None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:41:56.226901 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4343/8678] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:41:56.231776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931f6e-ac19-4c9c-b743-6e7e80465d1d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:41:56.232262 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931f6e-ac19-4c9c-b743-6e7e80465d1d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:41:56.232361 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931f6e-ac19-4c9c-b743-6e7e80465d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:41:56.263627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a2931f6e-ac19-4c9c-b743-6e7e80465d1d None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:41:56.264862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a2931f6e-ac19-4c9c-b743-6e7e80465d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:41:56.335263 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4336/8679] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:41:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:41:56.358108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d980b-7c14-4293-afbf-d4be7e2f61eb None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:41:56.360063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-660d980b-7c14-4293-afbf-d4be7e2f61eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:41:56.380582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d980b-7c14-4293-afbf-d4be7e2f61eb None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:41:56.387349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:41:56.388053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:41:56.388332 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:41:56.388689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:41:56.398071 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:41:56.399654 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:41:56.409763 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4344/8680] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:41:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:41:59.908373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2931f6e-ac19-4c9c-b743-6e7e80465d1d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:41:59.922786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2931f6e-ac19-4c9c-b743-6e7e80465d1d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:41:59.927203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:41:59.927867 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:41:59.928155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:41:59.928435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:41:59.930572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:41:59.948299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:41:59.949780 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:41:59.963436 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4337/8681] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:41:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:42:00.621897 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:42:00.623606 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:42:00.653339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf333a1-ea71-454b-8624-d4c07efe9f4d service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:42:00.657911 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5863912-a23a-4efe-94e4-dca3b81e3839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:42:00.658565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863912-a23a-4efe-94e4-dca3b81e3839 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:42:00.658840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863912-a23a-4efe-94e4-dca3b81e3839 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:42:00.659114 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863912-a23a-4efe-94e4-dca3b81e3839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:42:00.661307 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e5863912-a23a-4efe-94e4-dca3b81e3839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:42:00.674269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5863912-a23a-4efe-94e4-dca3b81e3839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:42:00.675739 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5863912-a23a-4efe-94e4-dca3b81e3839 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:42:00.686838 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4345/8682] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:42:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:42:09.955940 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=39 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:10.680541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=17 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:11.094048 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:42:11.095690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:42:11.114304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85f64-8262-4607-892d-76d52349d894 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:42:11.121498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:42:11.122180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:42:11.122462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:42:11.122739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:42:11.124925 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:42:11.141325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:42:11.142989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:42:11.160982 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4338/8683] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:42:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:42:21.151535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:22.763649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f638-1641-4df7-af01-3904544040ea None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:42:22.764367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f638-1641-4df7-af01-3904544040ea None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:42:22.764367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f638-1641-4df7-af01-3904544040ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:42:22.784813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-96d9f638-1641-4df7-af01-3904544040ea None None] MFA Rules not processed for user `f1b184b4aef04efc8996eff7af43dadb`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:42:22.786274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-96d9f638-1641-4df7-af01-3904544040ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:42:22.796021 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4346/8684] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:42:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:42:26.082767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:42:26.138146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9291ed-2261-40ae-9c96-185c5bc2adf1 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:42:26.147270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:42:26.148139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:42:26.148576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:42:26.148994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:42:26.151291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:42:26.188877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:42:26.190588 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:42:26.207466 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4339/8685] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:42:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:42:32.779435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:36.198838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=14 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:21.294314 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f638-1641-4df7-af01-3904544040ea None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:43:21.315208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f638-1641-4df7-af01-3904544040ea None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:43:21.321301 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0740fe8-412a-4a43-8910-5e5b8336b625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:43:21.321988 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0740fe8-412a-4a43-8910-5e5b8336b625 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:43:21.322257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0740fe8-412a-4a43-8910-5e5b8336b625 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:43:21.322900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0740fe8-412a-4a43-8910-5e5b8336b625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:43:21.324881 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e0740fe8-412a-4a43-8910-5e5b8336b625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:43:21.342252 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0740fe8-412a-4a43-8910-5e5b8336b625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:43:21.343864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0740fe8-412a-4a43-8910-5e5b8336b625 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:43:21.357819 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4347/8686] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:43:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:43:31.350921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:58.547899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:43:58.550018 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:43:58.642209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73e7ab-c885-4889-ab8b-4d5b51f8b077 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:43:58.647399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:43:58.648350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:43:58.648633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:43:58.648941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] PATH_INFO: `/v3/users/f1b184b4aef04efc8996eff7af43dadb` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:43:58.650294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b184b4aef04efc8996eff7af43dadb)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:43:58.652349 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:43:58.706993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b184b4aef04efc8996eff7af43dadb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:58.707699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b184b4aef04efc8996eff7af43dadb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:58.720026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b184b4aef04efc8996eff7af43dadb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:58.720687 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b184b4aef04efc8996eff7af43dadb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:58.727752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b184b4aef04efc8996eff7af43dadb'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:58.746850 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4340/8687] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:43:58 2022] DELETE /identity/v3/users/f1b184b4aef04efc8996eff7af43dadb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:43:58.753409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:43:58.753884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:43:58.753884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:43:58.781479 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:43:58.782687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:43:58.844562 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4348/8688] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:43:58.854931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:43:58.856842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:43:58.921489 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f023c-9eb8-4d1a-a6c0-1bfee3261e97 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:43:58.926277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:43:58.926937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:43:58.927239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:43:58.927516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:43:58.937956 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:43:58.939411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:43:58.949835 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4341/8689] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:43:59.131119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:43:59.132651 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:43:59.151683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea50c-910e-49d7-a1c6-313c084df196 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:43:59.157787 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:43:59.159148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:43:59.159590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:43:59.159873 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] PATH_INFO: `/v3/projects/91c64dd112fa4f7c89b2f07494e6be49` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:43:59.161243 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c64dd112fa4f7c89b2f07494e6be49)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:43:59.163340 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:43:59.213609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c64dd112fa4f7c89b2f07494e6be49', 'request_id': 'req-410f9ab4-b3e2-4554-b013-0c7985f710f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.219922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c64dd112fa4f7c89b2f07494e6be49', 'request_id': 'req-410f9ab4-b3e2-4554-b013-0c7985f710f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.228574 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c64dd112fa4f7c89b2f07494e6be49', 'request_id': 'req-410f9ab4-b3e2-4554-b013-0c7985f710f4'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.239945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] The token cache is being invalidate because project 91c64dd112fa4f7c89b2f07494e6be49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:43:59.240235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.240876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.242532 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4349/8690] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:43:59 2022] DELETE /identity/v3/projects/91c64dd112fa4f7c89b2f07494e6be49 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:43:59.247330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:43:59.254165 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:59.260717 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478465-3bbd-489d-bd3a-4f2736fd0287 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:43:59.326672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:43:59.327492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:43:59.327781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:43:59.328093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] PATH_INFO: `/v3/users/c8701ca4ee934249b5071bf8c8069d85` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:43:59.329352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8701ca4ee934249b5071bf8c8069d85)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:43:59.331291 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:43:59.379804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8701ca4ee934249b5071bf8c8069d85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.380462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8701ca4ee934249b5071bf8c8069d85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.393827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8701ca4ee934249b5071bf8c8069d85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.394462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8701ca4ee934249b5071bf8c8069d85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.402278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5968b597-c7bc-49af-9466-6b516f3c0aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8701ca4ee934249b5071bf8c8069d85'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.416496 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4342/8691] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:43:59 2022] DELETE /identity/v3/users/c8701ca4ee934249b5071bf8c8069d85 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:43:59.607367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:43:59.608907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:43:59.623584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f9ab4-b3e2-4554-b013-0c7985f710f4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:43:59.683942 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:43:59.684822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:43:59.685137 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:43:59.685413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] PATH_INFO: `/v3/projects/bf2f16bccc6b4dcbac155f125226ca8f` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:43:59.686597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2f16bccc6b4dcbac155f125226ca8f)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:43:59.688562 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:43:59.709850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:59.740352 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2f16bccc6b4dcbac155f125226ca8f', 'request_id': 'req-49cc9dc8-6456-49c3-9b40-4090d3afb91a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.746517 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2f16bccc6b4dcbac155f125226ca8f', 'request_id': 'req-49cc9dc8-6456-49c3-9b40-4090d3afb91a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.754736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2f16bccc6b4dcbac155f125226ca8f', 'request_id': 'req-49cc9dc8-6456-49c3-9b40-4090d3afb91a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.765268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] The token cache is being invalidate because project bf2f16bccc6b4dcbac155f125226ca8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:43:59.765553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.766175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-49cc9dc8-6456-49c3-9b40-4090d3afb91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:43:59.767731 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4350/8692] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:43:59 2022] DELETE /identity/v3/projects/bf2f16bccc6b4dcbac155f125226ca8f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:09.412809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:09.762266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:10.086331 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5317474-57df-4a2a-94e0-230543f1639e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.086573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5317474-57df-4a2a-94e0-230543f1639e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.086881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5317474-57df-4a2a-94e0-230543f1639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.129680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d5317474-57df-4a2a-94e0-230543f1639e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:10.130873 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d5317474-57df-4a2a-94e0-230543f1639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:10.194125 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4343/8693] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:10.206296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1c5f-d84c-47bc-8628-5694d4144e8d None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.206553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1c5f-d84c-47bc-8628-5694d4144e8d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.206853 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1c5f-d84c-47bc-8628-5694d4144e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.232720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-816b1c5f-d84c-47bc-8628-5694d4144e8d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:10.233979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-816b1c5f-d84c-47bc-8628-5694d4144e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:10.243043 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4351/8694] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:10.247970 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5317474-57df-4a2a-94e0-230543f1639e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.257952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5317474-57df-4a2a-94e0-230543f1639e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.262864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.263522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.263801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.264074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.264804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:44:10.265141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.266751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.280523 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4344/8695] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:44:10.294857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1c5f-d84c-47bc-8628-5694d4144e8d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.305536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1c5f-d84c-47bc-8628-5694d4144e8d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.311625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.312353 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.312724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.312997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.313794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.315996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.348326 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4352/8696] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:44:10 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:44:10.352686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.363075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00c205-6fd7-440c-af61-d2b65d354b13 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.425647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.426838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.427330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.427828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.428748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.431933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.460027 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4345/8697] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:44:10 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:44:10.465089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.479244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2854f-2478-42c1-a36b-b8d9ac572984 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.486558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.487391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.487672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.487952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.488700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.490364 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.501291 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4353/8698] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:44:10.505462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.515765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0acf2e-5b1e-40f0-9f6d-1c86cc4413ee admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.521058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fb757-357b-4c7e-80f3-be7d919b8fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.521743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fb757-357b-4c7e-80f3-be7d919b8fcb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.522026 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fb757-357b-4c7e-80f3-be7d919b8fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.522303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fb757-357b-4c7e-80f3-be7d919b8fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.523023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fb757-357b-4c7e-80f3-be7d919b8fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.524627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fb757-357b-4c7e-80f3-be7d919b8fcb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.535069 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4346/8699] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:44:10.539262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.550360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151be3-a962-4e7b-86c4-2518508caf30 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.555233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.556119 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.556429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.556703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] PATH_INFO: `/v3/projects/0e27446df2b84c9a9515d5774e39440d/users/4efe3ef96bb4427dbf23b5236da9689c/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.571423 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e27446df2b84c9a9515d5774e39440d, user_id=4efe3ef96bb4427dbf23b5236da9689c, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.574149 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.589876 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4354/8700] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:44:10 2022] PUT /identity/v3/projects/0e27446df2b84c9a9515d5774e39440d/users/4efe3ef96bb4427dbf23b5236da9689c/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:10.601599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59d7d-fabe-4dd2-9d3c-8036c0a1eb90 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.601893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59d7d-fabe-4dd2-9d3c-8036c0a1eb90 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.602201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59d7d-fabe-4dd2-9d3c-8036c0a1eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.628847 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9dd59d7d-fabe-4dd2-9d3c-8036c0a1eb90 None None] MFA Rules not processed for user `4efe3ef96bb4427dbf23b5236da9689c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:10.630091 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9dd59d7d-fabe-4dd2-9d3c-8036c0a1eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:10.673702 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:10.703606 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4347/8701] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:44:10.708415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.778039 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd96f9-459c-4f05-ae57-080195101763 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.783017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.783683 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.784000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.784233 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.784950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.786929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.822213 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4355/8702] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:44:10 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:44:10.823355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59d7d-fabe-4dd2-9d3c-8036c0a1eb90 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.835474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59d7d-fabe-4dd2-9d3c-8036c0a1eb90 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.897371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.898043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.898326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.898596 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.899285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.901255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.925704 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4348/8703] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:44:10 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:44:10.929985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.940820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facc973-72f1-4a43-89f3-0584132a63f7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.946777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.947459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.947855 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.948136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.949007 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:10.951234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:10.963391 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4356/8704] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:44:10.967744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:10.978072 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0fe2-4e86-411b-b07d-5b45e17b5519 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:10.982863 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:10.983748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:10.984025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:10.984293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] PATH_INFO: `/v3/projects/739e5921b831469c96d0d09fb2bf2f91/users/a7b3d7c775424fa1934a3823f13407ca/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:10.999646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739e5921b831469c96d0d09fb2bf2f91, user_id=a7b3d7c775424fa1934a3823f13407ca, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:11.002500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:11.017122 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4349/8705] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:44:10 2022] PUT /identity/v3/projects/739e5921b831469c96d0d09fb2bf2f91/users/a7b3d7c775424fa1934a3823f13407ca/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:11.021221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:11.032107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98cd2-cadc-4e0a-93c3-25604c84de07 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:11.092012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1d26a-1534-409c-8182-0a01de693cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:11.092620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1d26a-1534-409c-8182-0a01de693cdb admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:11.092903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1d26a-1534-409c-8182-0a01de693cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:11.093221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1d26a-1534-409c-8182-0a01de693cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:11.093960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1d26a-1534-409c-8182-0a01de693cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:11.095579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1d26a-1534-409c-8182-0a01de693cdb admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:11.106068 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4357/8706] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:44:11.110432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:11.121231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365e54f-a0c8-4ed4-a327-93fb50fdfb20 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:11.126406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0305d37-8ce8-43ac-806c-2e2bb0123e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:11.127299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0305d37-8ce8-43ac-806c-2e2bb0123e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:11.127580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0305d37-8ce8-43ac-806c-2e2bb0123e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:11.127855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0305d37-8ce8-43ac-806c-2e2bb0123e0b admin admin] PATH_INFO: `/v3/projects/739e5921b831469c96d0d09fb2bf2f91/users/a7b3d7c775424fa1934a3823f13407ca/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:11.130065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0305d37-8ce8-43ac-806c-2e2bb0123e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=739e5921b831469c96d0d09fb2bf2f91, user_id=a7b3d7c775424fa1934a3823f13407ca, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:11.132738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0305d37-8ce8-43ac-806c-2e2bb0123e0b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:11.143307 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4350/8707] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:44:11 2022] PUT /identity/v3/projects/739e5921b831469c96d0d09fb2bf2f91/users/a7b3d7c775424fa1934a3823f13407ca/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:11.157593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:11.157844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:11.158148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:11.172633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:11.188485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] MFA Rules not processed for user `a7b3d7c775424fa1934a3823f13407ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:11.189758 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:11.260523 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4358/8708] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:11.272810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:11.273136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:11.273413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:11.292134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] MFA Rules not processed for user `4efe3ef96bb4427dbf23b5236da9689c`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:11.293362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:11.351235 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4351/8709] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:11.365791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:11.367508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:11.446656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcf32c-7c90-4d60-a551-fd1b241d24de None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:11.454531 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:11.455194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:11.455472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:11.455748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:11.464929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:11.466605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:11.476897 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4359/8710] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:11.969789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:11.971303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:12.018119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:12.061114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76376cd5-d06f-45a9-9daa-e3e656e03a66 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:12.066139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a79097-ca0d-481d-a099-415484117c78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:12.066801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79097-ca0d-481d-a099-415484117c78 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:12.067087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79097-ca0d-481d-a099-415484117c78 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:12.067366 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79097-ca0d-481d-a099-415484117c78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:12.069205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e7a79097-ca0d-481d-a099-415484117c78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:12.083585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a79097-ca0d-481d-a099-415484117c78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:12.085242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a79097-ca0d-481d-a099-415484117c78 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:12.099409 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4352/8711] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:21.456166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:21.470536 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237d5c8-ff5f-45cf-8dcc-914da92401d8 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:21.477628 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:21.478285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:21.478564 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:21.478835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:21.488092 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:21.489781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:21.499889 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4360/8712] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:21.513961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d694-ac11-4994-a61a-6ae1b31fa470 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:21.514442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d694-ac11-4994-a61a-6ae1b31fa470 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:21.514536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d694-ac11-4994-a61a-6ae1b31fa470 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:21.515972 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4353/8713] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:44:21.520717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] Authenticating service token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:44:21.535468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:21.544450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbed73-d658-4528-a4db-4dc8a08e533f service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:21.550459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b93e7-4725-4d35-a362-203350c97549 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7b3d7c775424fa1934a3823f13407ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739e5921b831469c96d0d09fb2bf2f91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:21.551355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b93e7-4725-4d35-a362-203350c97549 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:21.551641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b93e7-4725-4d35-a362-203350c97549 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:21.551918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b93e7-4725-4d35-a362-203350c97549 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] PATH_INFO: `/v3/projects/739e5921b831469c96d0d09fb2bf2f91` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:21.553321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b93e7-4725-4d35-a362-203350c97549 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] RBAC: Authorizing `identity:get_project(project_id=739e5921b831469c96d0d09fb2bf2f91)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:21.555169 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b93e7-4725-4d35-a362-203350c97549 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:21.556883 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4361/8714] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:44:21 2022] GET /identity/v3/projects/739e5921b831469c96d0d09fb2bf2f91 => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:44:21.708913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d694-ac11-4994-a61a-6ae1b31fa470 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:21.711337 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-dab4d694-ac11-4994-a61a-6ae1b31fa470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:21.773813 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d694-ac11-4994-a61a-6ae1b31fa470 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:21.778218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:21.778874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:21.779155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:21.779428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:21.781342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:21.794486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:21.795923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:21.807045 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4354/8715] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:21.965802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387ad5-cbba-4acf-86ef-33c8887d58e6 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:21.966095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387ad5-cbba-4acf-86ef-33c8887d58e6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:21.966377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53387ad5-cbba-4acf-86ef-33c8887d58e6 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:21.967780 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4362/8716] 10.222.0.30 () {54 vars in 912 bytes} [Sat Jun 18 22:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:44:21.972721 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] Authenticating service token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jun 18 22:44:21.974469 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:21.997739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:22.007935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a713290-6cb2-489d-b615-3048e87f6e7e service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:22.013011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7b3d7c775424fa1934a3823f13407ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '739e5921b831469c96d0d09fb2bf2f91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:22.013968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:22.014254 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:22.014534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] PATH_INFO: `/v3/projects/739e5921b831469c96d0d09fb2bf2f91` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:22.015809 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] RBAC: Authorizing `identity:get_project(project_id=739e5921b831469c96d0d09fb2bf2f91)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:22.017661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:22.019389 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4355/8717] 10.222.0.30 () {58 vars in 1443 bytes} [Sat Jun 18 22:44:21 2022] GET /identity/v3/projects/739e5921b831469c96d0d09fb2bf2f91 => generated 393 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:44:22.178359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53387ad5-cbba-4acf-86ef-33c8887d58e6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:22.195641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53387ad5-cbba-4acf-86ef-33c8887d58e6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:22.200035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e582b1a-21f2-4b72-b1ad-7dbcbe915bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:22.201065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e582b1a-21f2-4b72-b1ad-7dbcbe915bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:22.201356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e582b1a-21f2-4b72-b1ad-7dbcbe915bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:22.201620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e582b1a-21f2-4b72-b1ad-7dbcbe915bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:22.203490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9e582b1a-21f2-4b72-b1ad-7dbcbe915bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:22.216366 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e582b1a-21f2-4b72-b1ad-7dbcbe915bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:22.217846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e582b1a-21f2-4b72-b1ad-7dbcbe915bf6 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:22.228429 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4363/8718] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:24.891998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:24.959199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a370cd-07e9-497e-aba4-cb214b88a3eb tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:24.964350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:24.965280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:24.965562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:24.965868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] PATH_INFO: `/v3/users/4efe3ef96bb4427dbf23b5236da9689c` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:24.967104 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4efe3ef96bb4427dbf23b5236da9689c)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:24.969063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:25.019427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4efe3ef96bb4427dbf23b5236da9689c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.020100 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4efe3ef96bb4427dbf23b5236da9689c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.024811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:25.034109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4efe3ef96bb4427dbf23b5236da9689c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.034845 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4efe3ef96bb4427dbf23b5236da9689c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.043185 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4efe3ef96bb4427dbf23b5236da9689c'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.059329 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4356/8719] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:44:24 2022] DELETE /identity/v3/users/4efe3ef96bb4427dbf23b5236da9689c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:25.063978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:25.064416 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:25.064540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:25.082801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:25.084293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:25.124469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:25.145564 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4364/8720] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:25.155419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:25.156884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:25.220178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cea20-a36e-4169-839c-9d32c4cab329 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:25.224083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:25.224735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:25.225016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:25.225327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:25.234960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:25.236398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:25.246225 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4357/8721] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:25.440043 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:25.441650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:25.455060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb5827-77d3-4ba3-9b01-7987ed8c6566 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:25.460872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:25.461818 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:25.462226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:25.462505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] PATH_INFO: `/v3/projects/0e27446df2b84c9a9515d5774e39440d` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:25.463794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e27446df2b84c9a9515d5774e39440d)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:25.465760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:25.514565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e27446df2b84c9a9515d5774e39440d', 'request_id': 'req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.520976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e27446df2b84c9a9515d5774e39440d', 'request_id': 'req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.530076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e27446df2b84c9a9515d5774e39440d', 'request_id': 'req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.541199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] The token cache is being invalidate because project 0e27446df2b84c9a9515d5774e39440d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:44:25.541459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.542125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.543751 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4365/8722] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:44:25 2022] DELETE /identity/v3/projects/0e27446df2b84c9a9515d5774e39440d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:25.547944 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:25.558720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d545c-dbf9-4cf2-bafd-49f5387bceae service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:25.619853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:25.620724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:25.621010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:25.621324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] PATH_INFO: `/v3/users/a7b3d7c775424fa1934a3823f13407ca` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:25.622542 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b3d7c775424fa1934a3823f13407ca)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:25.624496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:25.673811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b3d7c775424fa1934a3823f13407ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.674507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b3d7c775424fa1934a3823f13407ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.687118 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b3d7c775424fa1934a3823f13407ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.687769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b3d7c775424fa1934a3823f13407ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.694857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-dcd7e87f-5b67-4782-a60e-45ef91126740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b3d7c775424fa1934a3823f13407ca'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:25.696516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:25.710553 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4358/8723] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:44:25 2022] DELETE /identity/v3/users/a7b3d7c775424fa1934a3823f13407ca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:25.998231 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.000120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:26.019529 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb9a22-b8d9-44a5-aedc-3fcca7685f37 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.091809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.092687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.092963 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.093550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] PATH_INFO: `/v3/projects/739e5921b831469c96d0d09fb2bf2f91` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.094774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=739e5921b831469c96d0d09fb2bf2f91)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.096691 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.144886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739e5921b831469c96d0d09fb2bf2f91', 'request_id': 'req-95245cfd-a6f2-4b36-a110-f081c228eccf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:26.151441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739e5921b831469c96d0d09fb2bf2f91', 'request_id': 'req-95245cfd-a6f2-4b36-a110-f081c228eccf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:26.160842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739e5921b831469c96d0d09fb2bf2f91', 'request_id': 'req-95245cfd-a6f2-4b36-a110-f081c228eccf'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:26.166014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:26.173281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] The token cache is being invalidate because project 739e5921b831469c96d0d09fb2bf2f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:44:26.173861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:26.174555 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-95245cfd-a6f2-4b36-a110-f081c228eccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:44:26.176138 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4366/8724] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:44:25 2022] DELETE /identity/v3/projects/739e5921b831469c96d0d09fb2bf2f91 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:26.182409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d705-7d53-4488-a57d-e2367e28efb6 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.182915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d705-7d53-4488-a57d-e2367e28efb6 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.183035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d705-7d53-4488-a57d-e2367e28efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.201519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9759d705-7d53-4488-a57d-e2367e28efb6 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:26.202664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9759d705-7d53-4488-a57d-e2367e28efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:26.266188 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4359/8725] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:26.275532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f11df-c1b8-43fa-afd2-4757b4f6de6c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.275805 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f11df-c1b8-43fa-afd2-4757b4f6de6c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.276166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f11df-c1b8-43fa-afd2-4757b4f6de6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.302740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-fc1f11df-c1b8-43fa-afd2-4757b4f6de6c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:26.304489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fc1f11df-c1b8-43fa-afd2-4757b4f6de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:26.313674 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4367/8726] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:26.318759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d705-7d53-4488-a57d-e2367e28efb6 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.331000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d705-7d53-4488-a57d-e2367e28efb6 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.336595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.337368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.337659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.337947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.338935 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:44:26.339452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.342348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.358030 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4360/8727] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:44:26.363296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f11df-c1b8-43fa-afd2-4757b4f6de6c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.378846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f11df-c1b8-43fa-afd2-4757b4f6de6c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.388117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.388940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.389349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.389712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.390752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.393718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.422445 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4368/8728] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:44:26 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:44:26.426769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.437615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ae3e1-3963-4457-a22a-3a661f279d64 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.498980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.499683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.499987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.500215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.500977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.502860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.523860 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4361/8729] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:44:26 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:44:26.528065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.538663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634db2ed-27e5-4d7a-a562-5a138877a0d4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.543609 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.544269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.544547 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.544859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.545619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.547215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.557925 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4369/8730] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:44:26.562167 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.572991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea62310-cd50-4c08-83cb-5126fa182a58 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.578822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a906-3dee-4d8f-87d0-c8af41e188eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.579497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a906-3dee-4d8f-87d0-c8af41e188eb admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.579783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a906-3dee-4d8f-87d0-c8af41e188eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.580063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a906-3dee-4d8f-87d0-c8af41e188eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.580802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a906-3dee-4d8f-87d0-c8af41e188eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.582442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a906-3dee-4d8f-87d0-c8af41e188eb admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.592576 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4362/8731] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:44:26.596830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.607045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf322d0-cbf5-415a-b24f-6b8120e085a9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.611922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.612790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.613099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.613373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] PATH_INFO: `/v3/projects/bd65fe93bda9470493efe3e6a02ac71d/users/9c987bdff390488a8a130f3ccdd46fda/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.628759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd65fe93bda9470493efe3e6a02ac71d, user_id=9c987bdff390488a8a130f3ccdd46fda, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.631444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.645353 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4370/8732] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:44:26 2022] PUT /identity/v3/projects/bd65fe93bda9470493efe3e6a02ac71d/users/9c987bdff390488a8a130f3ccdd46fda/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:44:26.650573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbfc95-6113-4b7b-8a66-72c86ed1f8be None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.650866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbfc95-6113-4b7b-8a66-72c86ed1f8be None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.651147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbfc95-6113-4b7b-8a66-72c86ed1f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.670371 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-12fbfc95-6113-4b7b-8a66-72c86ed1f8be None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:26.672173 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-12fbfc95-6113-4b7b-8a66-72c86ed1f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:26.727712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:26.739692 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4363/8733] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:26.752413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:26.754183 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:26.815806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cd206-02ef-4afc-89cd-a7e785f95b5a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:26.820489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45bea2-77b6-4d2c-9c62-277534f299c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:26.821218 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bea2-77b6-4d2c-9c62-277534f299c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:26.821518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bea2-77b6-4d2c-9c62-277534f299c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:26.821790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bea2-77b6-4d2c-9c62-277534f299c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:26.834854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45bea2-77b6-4d2c-9c62-277534f299c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:26.836393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45bea2-77b6-4d2c-9c62-277534f299c9 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:26.847898 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4371/8734] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:44:30.966893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:30.967422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:30.967536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:30.995360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] MFA Rules not processed for user `9c987bdff390488a8a130f3ccdd46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:30.996628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:31.069833 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4364/8735] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:31.085429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:31.085968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:31.085968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:31.111347 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] MFA Rules not processed for user `9c987bdff390488a8a130f3ccdd46fda`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:31.112509 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:31.120531 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4372/8736] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:44:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:31.133011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:31.134694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:31.217636 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e40073-93d2-4362-97ea-ef9c8b410887 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:31.223819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:31.224510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:31.224768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:31.225095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:31.234419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:31.236043 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:31.246125 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4365/8737] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:39.218176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:39.219846 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:39.294644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f33a-e21a-48a0-81a8-ed7c91516c68 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:39.300229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ebb12-f46b-499f-9cc9-e16c94e16868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:39.300880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ebb12-f46b-499f-9cc9-e16c94e16868 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:39.301191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ebb12-f46b-499f-9cc9-e16c94e16868 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:39.301465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ebb12-f46b-499f-9cc9-e16c94e16868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:39.303401 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fe2ebb12-f46b-499f-9cc9-e16c94e16868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:39.318242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ebb12-f46b-499f-9cc9-e16c94e16868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:39.319871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ebb12-f46b-499f-9cc9-e16c94e16868 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:39.332983 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4373/8738] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:41.241601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=67 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:41.466279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:41.480164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933b10d-19fe-4036-8f98-aa75a698df39 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:41.484500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c8e5d-6a16-43a4-ba0b-f895a14747f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:41.485219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8e5d-6a16-43a4-ba0b-f895a14747f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:41.485507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8e5d-6a16-43a4-ba0b-f895a14747f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:41.485783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8e5d-6a16-43a4-ba0b-f895a14747f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:41.487810 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5b9c8e5d-6a16-43a4-ba0b-f895a14747f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:41.501796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c8e5d-6a16-43a4-ba0b-f895a14747f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:41.502888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c8e5d-6a16-43a4-ba0b-f895a14747f1 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:41.514745 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4366/8739] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:41.603075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca813d84-c664-41a6-ba91-1aa8c81ebc7a None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:41.603585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca813d84-c664-41a6-ba91-1aa8c81ebc7a None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:41.603671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca813d84-c664-41a6-ba91-1aa8c81ebc7a None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:41.605149 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4374/8740] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:44:41.610827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:41.611154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:41.611491 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:41.631007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:44:41.632227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:41.640942 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4367/8741] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:44:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:44:41.660952 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca813d84-c664-41a6-ba91-1aa8c81ebc7a None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:41.679801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca813d84-c664-41a6-ba91-1aa8c81ebc7a None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:41.685909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:41.686559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:41.686844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:41.687118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:41.695782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:41.697498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:41.707653 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4375/8742] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:41.871902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:41.873470 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:41.888529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe152fc-6e08-4c97-9f89-4c659e6577aa None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:41.893154 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:41.893812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:41.894089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:41.894356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:41.896468 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:41.918344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:41.919875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:41.936276 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4368/8743] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:44:48.431176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:44:48.439076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:48.446148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be829bc-78f4-4121-a438-31ff0ab29dbf service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:44:48.453456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:44:48.454111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:44:48.454395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:44:48.454667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:44:48.456784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:44:48.471682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:44:48.473338 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:44:48.486467 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4376/8744] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:44:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:44:51.926760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=15 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:58.479337 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:10.268971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:10.280878 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329ea2-d74a-4a79-a99b-f05efc5d6384 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:10.285607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:10.286260 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:10.286565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:10.286846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:10.288993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:10.302560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:10.304065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:10.315375 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4369/8745] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:45:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:45:20.309290 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:21.675242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:21.687680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ae10-e218-4155-84e1-dca30e517929 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:21.695983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:21.696876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:21.697191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:21.697465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] PATH_INFO: `/v3/users/9c987bdff390488a8a130f3ccdd46fda` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:21.698657 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c987bdff390488a8a130f3ccdd46fda)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:21.700587 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:21.750175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c987bdff390488a8a130f3ccdd46fda'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:21.750832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c987bdff390488a8a130f3ccdd46fda'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:21.764319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c987bdff390488a8a130f3ccdd46fda'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:21.764999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c987bdff390488a8a130f3ccdd46fda'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:21.772409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d38802d2-0598-47ba-9cbd-cb6826c6af91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c987bdff390488a8a130f3ccdd46fda'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:21.786699 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4377/8746] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:45:21 2022] DELETE /identity/v3/users/9c987bdff390488a8a130f3ccdd46fda => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:45:21.969828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:21.990317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739eaf7-8bfd-45ae-99c1-664e40c19e14 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.056630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.057741 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.058076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.058533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] PATH_INFO: `/v3/projects/bd65fe93bda9470493efe3e6a02ac71d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.060622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd65fe93bda9470493efe3e6a02ac71d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.063722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.114240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd65fe93bda9470493efe3e6a02ac71d', 'request_id': 'req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:22.121024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd65fe93bda9470493efe3e6a02ac71d', 'request_id': 'req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:22.130279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd65fe93bda9470493efe3e6a02ac71d', 'request_id': 'req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:22.141139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] The token cache is being invalidate because project bd65fe93bda9470493efe3e6a02ac71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:45:22.141394 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:22.142021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5e70d7b2-3a83-4ea8-a15a-7028f30bd101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:45:22.143760 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4370/8747] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:45:21 2022] DELETE /identity/v3/projects/bd65fe93bda9470493efe3e6a02ac71d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:45:22.148974 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053561d1-14b9-4ccf-b932-18d3c68fb8af None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.149303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053561d1-14b9-4ccf-b932-18d3c68fb8af None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.149588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053561d1-14b9-4ccf-b932-18d3c68fb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.167358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-053561d1-14b9-4ccf-b932-18d3c68fb8af None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:45:22.168588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-053561d1-14b9-4ccf-b932-18d3c68fb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:22.236005 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4378/8748] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:45:22.245328 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037124a-695c-4caa-bbeb-edaab6061f63 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.245617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037124a-695c-4caa-bbeb-edaab6061f63 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.245892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037124a-695c-4caa-bbeb-edaab6061f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.265547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0037124a-695c-4caa-bbeb-edaab6061f63 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:45:22.266756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0037124a-695c-4caa-bbeb-edaab6061f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:22.276522 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4371/8749] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:45:22.281193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053561d1-14b9-4ccf-b932-18d3c68fb8af None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:22.292066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053561d1-14b9-4ccf-b932-18d3c68fb8af None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.297500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.298160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.298480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.298747 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.299583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:45:22.299886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.301539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.313928 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4379/8750] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:45:22.318522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037124a-695c-4caa-bbeb-edaab6061f63 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:22.329800 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037124a-695c-4caa-bbeb-edaab6061f63 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.334874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.335659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.335975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.336248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.336928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.338991 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.367050 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4372/8751] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:45:22 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:45:22.371549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:22.382211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084446a-2d99-4848-83d3-4632de5b236a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.443228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.443908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.444186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.444459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.445228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.447254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.454308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:22.469797 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4380/8752] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:45:22 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:45:22.474145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:22.484866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba00dd-58ba-495a-a9c8-88b4d44350be admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.490170 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.490834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.491114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.491413 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.492175 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.493828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.505731 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4373/8753] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:45:22.512998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:22.521415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a7394-0760-4bf8-811d-6cca50f1d669 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.527211 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a3bbc-3c7f-437f-9ae5-fcfd122ff5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.527887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3bbc-3c7f-437f-9ae5-fcfd122ff5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.528201 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3bbc-3c7f-437f-9ae5-fcfd122ff5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.528480 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3bbc-3c7f-437f-9ae5-fcfd122ff5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.529237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a3bbc-3c7f-437f-9ae5-fcfd122ff5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.530879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a3bbc-3c7f-437f-9ae5-fcfd122ff5b1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.541452 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4381/8754] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:45:22.545806 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:22.556348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73daea-ef55-40bf-b00a-4efb6bb3fe1a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.561354 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.562236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.562514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.562843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] PATH_INFO: `/v3/projects/08e42cd4b04a45a89ca54f832b312a68/users/d511accdb1fe499691157d0580dc3f04/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.578411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e42cd4b04a45a89ca54f832b312a68, user_id=d511accdb1fe499691157d0580dc3f04, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.581136 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.594976 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4374/8755] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:45:22 2022] PUT /identity/v3/projects/08e42cd4b04a45a89ca54f832b312a68/users/d511accdb1fe499691157d0580dc3f04/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:45:22.600472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e44f1-1401-4f78-beae-0b84336326df None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.600779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e44f1-1401-4f78-beae-0b84336326df None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.601079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e44f1-1401-4f78-beae-0b84336326df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.620257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-519e44f1-1401-4f78-beae-0b84336326df None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:45:22.621494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-519e44f1-1401-4f78-beae-0b84336326df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:22.685676 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4382/8756] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:45:22.695971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:22.697930 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:22.732437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:22.764499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1922f-671d-4721-976c-da55ebc19896 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:22.768496 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9b7f-7f26-47b4-ac2f-60f08068c8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:22.769235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9b7f-7f26-47b4-ac2f-60f08068c8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:22.769524 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9b7f-7f26-47b4-ac2f-60f08068c8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:22.769805 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9b7f-7f26-47b4-ac2f-60f08068c8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:22.779275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9b7f-7f26-47b4-ac2f-60f08068c8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:22.780792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9b7f-7f26-47b4-ac2f-60f08068c8f5 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:22.790581 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4375/8757] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:45:27.282962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:27.283534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:27.283534 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:27.312072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] MFA Rules not processed for user `d511accdb1fe499691157d0580dc3f04`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:45:27.313513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:27.385169 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4383/8758] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:45:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:45:27.395968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da50315-8110-47f2-9059-f0e0f90944c8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:27.396453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da50315-8110-47f2-9059-f0e0f90944c8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:27.396659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da50315-8110-47f2-9059-f0e0f90944c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:27.414951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3da50315-8110-47f2-9059-f0e0f90944c8 None None] MFA Rules not processed for user `d511accdb1fe499691157d0580dc3f04`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:45:27.416169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3da50315-8110-47f2-9059-f0e0f90944c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:27.423293 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4376/8759] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:45:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:45:27.435473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:27.436922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:27.518841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f0733-3303-4e51-ab5e-77f7317023ca None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:27.524378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5a3af-e2dd-4566-9fc4-98f7c4ad11c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:27.525074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a3af-e2dd-4566-9fc4-98f7c4ad11c6 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:27.525351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a3af-e2dd-4566-9fc4-98f7c4ad11c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:27.525623 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a3af-e2dd-4566-9fc4-98f7c4ad11c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:27.530913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:27.534890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5a3af-e2dd-4566-9fc4-98f7c4ad11c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:27.536995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5a3af-e2dd-4566-9fc4-98f7c4ad11c6 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:27.549241 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4384/8760] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:45:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:45:37.410016 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=17 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:37.548503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:39.843769 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009a94-265e-47d9-ad17-f7fd9276812f None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:39.844359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009a94-265e-47d9-ad17-f7fd9276812f None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:39.844463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009a94-265e-47d9-ad17-f7fd9276812f None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:39.846144 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4377/8761] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:45:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:45:39.851966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744678-9b53-48cd-a4fa-fba0c09e0dbf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:39.852512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744678-9b53-48cd-a4fa-fba0c09e0dbf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:39.852512 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744678-9b53-48cd-a4fa-fba0c09e0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:39.872882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-01744678-9b53-48cd-a4fa-fba0c09e0dbf None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:45:39.874176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-01744678-9b53-48cd-a4fa-fba0c09e0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:39.943829 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4385/8762] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:45:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:45:39.973510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd009a94-265e-47d9-ad17-f7fd9276812f None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:45:39.975625 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cd009a94-265e-47d9-ad17-f7fd9276812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:45:39.996736 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd009a94-265e-47d9-ad17-f7fd9276812f None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:45:40.002021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:45:40.002665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:45:40.002946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:45:40.003231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:45:40.011874 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:45:40.013520 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:45:40.024063 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4378/8763] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:45:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:45:49.935200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=29 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:50.019710 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:15.129173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5afae-2faf-48d7-bc82-1f639b914f58 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:46:15.129821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5afae-2faf-48d7-bc82-1f639b914f58 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:46:15.129925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5afae-2faf-48d7-bc82-1f639b914f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:46:15.148012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4ee5afae-2faf-48d7-bc82-1f639b914f58 None None] MFA Rules not processed for user `d511accdb1fe499691157d0580dc3f04`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:46:15.149270 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4ee5afae-2faf-48d7-bc82-1f639b914f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:46:15.157353 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4386/8764] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:46:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:46:22.693335 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:46:22.707218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7e82f-3bdb-486c-a3c4-e503b32ad0da service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:46:22.711642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed169d-d9c5-4fb4-902f-805c5606c15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:46:22.712388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed169d-d9c5-4fb4-902f-805c5606c15e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:46:22.712691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed169d-d9c5-4fb4-902f-805c5606c15e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:46:22.712981 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed169d-d9c5-4fb4-902f-805c5606c15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:46:22.715449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f0ed169d-d9c5-4fb4-902f-805c5606c15e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:46:22.735145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed169d-d9c5-4fb4-902f-805c5606c15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:46:22.737112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed169d-d9c5-4fb4-902f-805c5606c15e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:46:22.754135 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4379/8765] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:46:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:46:24.492987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbad5-c45a-43d8-9cc0-d96df29af16d None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:46:24.493527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbad5-c45a-43d8-9cc0-d96df29af16d None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:46:24.493765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbad5-c45a-43d8-9cc0-d96df29af16d None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:46:24.495329 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4387/8766] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:46:24.500815 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f061e6-b98c-4940-84af-5abeda699d30 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:46:24.501323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f061e6-b98c-4940-84af-5abeda699d30 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:46:24.501435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f061e6-b98c-4940-84af-5abeda699d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:46:24.530327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e8f061e6-b98c-4940-84af-5abeda699d30 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:46:24.531554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e8f061e6-b98c-4940-84af-5abeda699d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:46:24.540392 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4380/8767] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:46:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:46:24.561676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbad5-c45a-43d8-9cc0-d96df29af16d None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:46:24.578501 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbad5-c45a-43d8-9cc0-d96df29af16d None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:46:24.583955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:46:24.584596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:46:24.584875 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:46:24.585181 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:46:24.593605 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:46:24.595190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:46:24.605394 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4388/8768] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:46:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:46:34.525707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=13 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:34.601323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:58.946030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f061e6-b98c-4940-84af-5abeda699d30 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:46:58.959007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f061e6-b98c-4940-84af-5abeda699d30 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:46:58.963253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:46:58.963912 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:46:58.964191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:46:58.964463 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:46:58.966616 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:46:58.984195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:46:58.985725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:46:58.999800 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4381/8769] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:46:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:47:06.369160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:06.384397 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8a226-68b3-4f81-93ba-98fc11257292 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:06.389790 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:06.390459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:06.390762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:06.391018 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:06.392879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:06.411840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:06.413705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:06.431195 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4389/8770] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:47:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:47:06.455786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:06.476759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b9f93-9304-4dcf-aa71-d4c5748c067e service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:06.481554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:06.482441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:06.482886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:06.483359 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] PATH_INFO: `/v3/users/d511accdb1fe499691157d0580dc3f04` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:06.484691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d511accdb1fe499691157d0580dc3f04)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:06.487093 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:06.535872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd511accdb1fe499691157d0580dc3f04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.536744 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd511accdb1fe499691157d0580dc3f04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.549435 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd511accdb1fe499691157d0580dc3f04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.550102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd511accdb1fe499691157d0580dc3f04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.557099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2f646f98-8a72-422e-9f2d-5a8385032106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd511accdb1fe499691157d0580dc3f04'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.574142 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4382/8771] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:47:06 2022] DELETE /identity/v3/users/d511accdb1fe499691157d0580dc3f04 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:47:06.757956 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:06.769995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e6f1-e5d2-4934-ac1d-d9f239f1feea service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:06.830920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:06.832157 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:06.832434 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:06.832743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] PATH_INFO: `/v3/projects/08e42cd4b04a45a89ca54f832b312a68` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:06.834094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e42cd4b04a45a89ca54f832b312a68)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:06.836100 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:06.885220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e42cd4b04a45a89ca54f832b312a68', 'request_id': 'req-22c6bb15-8fa6-4f46-a72c-99e71889bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.891922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e42cd4b04a45a89ca54f832b312a68', 'request_id': 'req-22c6bb15-8fa6-4f46-a72c-99e71889bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.901969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e42cd4b04a45a89ca54f832b312a68', 'request_id': 'req-22c6bb15-8fa6-4f46-a72c-99e71889bb45'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.912474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] The token cache is being invalidate because project 08e42cd4b04a45a89ca54f832b312a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:47:06.912761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.913407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-22c6bb15-8fa6-4f46-a72c-99e71889bb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:47:06.915004 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4390/8772] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:47:06 2022] DELETE /identity/v3/projects/08e42cd4b04a45a89ca54f832b312a68 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:47:06.920119 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae705-06aa-4d9c-9092-e878677c5c99 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:06.920495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae705-06aa-4d9c-9092-e878677c5c99 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:06.920784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae705-06aa-4d9c-9092-e878677c5c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:06.938667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2e5ae705-06aa-4d9c-9092-e878677c5c99 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:47:06.939988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2e5ae705-06aa-4d9c-9092-e878677c5c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:07.005983 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4383/8773] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:47:07.014656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cff3c-cb74-4ed3-a033-b2d8549fe20b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.014887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cff3c-cb74-4ed3-a033-b2d8549fe20b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.015151 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cff3c-cb74-4ed3-a033-b2d8549fe20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.033907 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-445cff3c-cb74-4ed3-a033-b2d8549fe20b None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:47:07.035158 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-445cff3c-cb74-4ed3-a033-b2d8549fe20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:07.043849 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4391/8774] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:47:07.048459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ae705-06aa-4d9c-9092-e878677c5c99 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:07.059220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ae705-06aa-4d9c-9092-e878677c5c99 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:07.064839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:07.065580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.065865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.066149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.066894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:47:07.067210 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:07.068860 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:07.081846 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4384/8775] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:47:07.086116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cff3c-cb74-4ed3-a033-b2d8549fe20b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:07.095867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cff3c-cb74-4ed3-a033-b2d8549fe20b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:07.101286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:07.101947 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.102228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.102488 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.103186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:07.105116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:07.148090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4392/8776] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:47:07 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:47:07.154493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:07.167458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66867fd4-f5b5-484f-a471-c342f28788cf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:07.217604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:07.235462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:07.236455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.236770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.237217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.238282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:07.240397 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:07.263526 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4385/8777] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:47:07 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:47:07.265664 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:07.276371 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b7359-2bdb-420a-a1b0-e2d1c3e7bb1a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:07.282165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:07.282833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.283112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.283382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.284112 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:07.285838 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:07.296362 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4393/8778] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:47:07.300654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:07.311786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808be29-15e9-4605-b9b3-cd58de953418 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:07.317278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a80c7-d43b-4e06-8d19-e3717750b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:07.317952 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a80c7-d43b-4e06-8d19-e3717750b8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.318236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a80c7-d43b-4e06-8d19-e3717750b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.318514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a80c7-d43b-4e06-8d19-e3717750b8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.319249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a80c7-d43b-4e06-8d19-e3717750b8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:07.320861 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a80c7-d43b-4e06-8d19-e3717750b8a4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:07.331879 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4386/8779] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:47:07.336038 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:07.347220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a94fa-da9a-4d82-b0a0-286629907854 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:07.352932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:07.353837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.354124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.354402 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] PATH_INFO: `/v3/projects/c50bcdb7ce3f4fd59d056bf30bda1676/users/d589e9b3b6114231927b43bb4269e7db/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.371013 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50bcdb7ce3f4fd59d056bf30bda1676, user_id=d589e9b3b6114231927b43bb4269e7db, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:07.373755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:07.388996 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4394/8780] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:47:07 2022] PUT /identity/v3/projects/c50bcdb7ce3f4fd59d056bf30bda1676/users/d589e9b3b6114231927b43bb4269e7db/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:47:07.394333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d1d64-0636-43a6-ac89-1e662f9aa216 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.394653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d1d64-0636-43a6-ac89-1e662f9aa216 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.394943 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d1d64-0636-43a6-ac89-1e662f9aa216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.413452 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-3b3d1d64-0636-43a6-ac89-1e662f9aa216 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:47:07.414660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3b3d1d64-0636-43a6-ac89-1e662f9aa216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:07.474658 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4387/8781] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:47:07.488610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:07.491141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:07.498184 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:07.557599 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd4abf-9af9-4fd7-8444-1f1e213aafb5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:07.561387 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:07.562049 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:07.562315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:07.562565 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:07.572559 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:07.574036 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:07.584561 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4395/8782] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:47:11.567003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50bc0-6fec-4230-865a-451f064f1b0d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:11.567550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50bc0-6fec-4230-865a-451f064f1b0d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:11.567550 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50bc0-6fec-4230-865a-451f064f1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:11.597586 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f8c50bc0-6fec-4230-865a-451f064f1b0d None None] MFA Rules not processed for user `d589e9b3b6114231927b43bb4269e7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:47:11.598715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f8c50bc0-6fec-4230-865a-451f064f1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:11.670812 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4388/8783] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:47:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:47:11.679004 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:11.680440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:11.779415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434f27-4771-44f1-b283-9c7383176e51 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:11.785629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:11.786595 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:11.786895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:11.787216 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:11.796830 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:11.798718 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:11.808742 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4396/8784] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:47:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:47:14.148294 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13e96-4c9e-42ee-ada6-80c66ad4daa4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:14.148812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13e96-4c9e-42ee-ada6-80c66ad4daa4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:14.148812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13e96-4c9e-42ee-ada6-80c66ad4daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:14.168689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e8c13e96-4c9e-42ee-ada6-80c66ad4daa4 None None] MFA Rules not processed for user `d589e9b3b6114231927b43bb4269e7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:47:14.169961 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e8c13e96-4c9e-42ee-ada6-80c66ad4daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:14.179376 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4389/8785] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:47:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:47:21.804485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=58 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:24.161841 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:26.973373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:47:26.975219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:26.994106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebe18-a56f-450d-88a8-023c5a211343 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:47:26.999816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6e7d0-73e5-45f4-9249-6abf22ae94f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:47:27.000481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6e7d0-73e5-45f4-9249-6abf22ae94f9 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:47:27.000765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6e7d0-73e5-45f4-9249-6abf22ae94f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:47:27.001064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6e7d0-73e5-45f4-9249-6abf22ae94f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:47:27.003011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b2b6e7d0-73e5-45f4-9249-6abf22ae94f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:47:27.018542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6e7d0-73e5-45f4-9249-6abf22ae94f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:47:27.020896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6e7d0-73e5-45f4-9249-6abf22ae94f9 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:47:27.038959 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4397/8786] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:47:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:47:37.031042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:31.840902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324af7f-9054-48a3-ae25-f1c7ad9c9089 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:31.841626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324af7f-9054-48a3-ae25-f1c7ad9c9089 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:31.841626 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324af7f-9054-48a3-ae25-f1c7ad9c9089 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:31.842994 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4390/8787] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:48:31.848498 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767fe09-9070-4015-a78b-fc2ae249ca56 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:31.848955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767fe09-9070-4015-a78b-fc2ae249ca56 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:31.849249 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767fe09-9070-4015-a78b-fc2ae249ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:31.890390 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2767fe09-9070-4015-a78b-fc2ae249ca56 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:48:31.891584 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2767fe09-9070-4015-a78b-fc2ae249ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:48:31.955578 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4398/8788] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:48:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:48:31.979194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324af7f-9054-48a3-ae25-f1c7ad9c9089 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:48:31.981346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-1324af7f-9054-48a3-ae25-f1c7ad9c9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:48:32.003438 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324af7f-9054-48a3-ae25-f1c7ad9c9089 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:48:32.008990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:48:32.009664 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:32.009950 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:32.010221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:32.019101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:48:32.020709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:48:32.031161 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4391/8789] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:48:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:48:41.945794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=35 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:42.026871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:47.669938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214b85e-d590-4b4a-8e92-de343d12af43 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:47.670504 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214b85e-d590-4b4a-8e92-de343d12af43 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:47.670700 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214b85e-d590-4b4a-8e92-de343d12af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:47.708196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e214b85e-d590-4b4a-8e92-de343d12af43 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:48:47.709828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e214b85e-d590-4b4a-8e92-de343d12af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:48:47.731264 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4399/8790] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Jun 18 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:48:47.738051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:48:47.747503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848a1c-9b88-4361-8f78-ecc5c41b887a service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:48:47.751364 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:48:47.752003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:47.752311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:47.752584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:47.754601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:48:47.767936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:48:47.769419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:48:47.780278 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4392/8791] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:48:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:48:48.561403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214b85e-d590-4b4a-8e92-de343d12af43 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:48:48.592916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214b85e-d590-4b4a-8e92-de343d12af43 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:48:48.599653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735a2c7-7777-423f-a16c-5ab92f121606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:48:48.600317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a2c7-7777-423f-a16c-5ab92f121606 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:48.600601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a2c7-7777-423f-a16c-5ab92f121606 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:48.600874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a2c7-7777-423f-a16c-5ab92f121606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:48.602781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4735a2c7-7777-423f-a16c-5ab92f121606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:48:48.624290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735a2c7-7777-423f-a16c-5ab92f121606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:48:48.626154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735a2c7-7777-423f-a16c-5ab92f121606 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:48:48.642982 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4400/8792] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:48:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:48:53.041990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:48:53.058751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b7274-5faa-455b-86aa-8ded52db7a98 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:48:53.064481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:48:53.065197 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:53.065488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:53.065750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:53.067581 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:48:53.083368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:48:53.085381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:48:53.099281 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4393/8793] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:48:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:48:57.445430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020fac2-f884-4748-bdc1-67fc5142df48 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:48:57.445931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020fac2-f884-4748-bdc1-67fc5142df48 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:48:57.445931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020fac2-f884-4748-bdc1-67fc5142df48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:48:57.465175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3020fac2-f884-4748-bdc1-67fc5142df48 None None] MFA Rules not processed for user `d589e9b3b6114231927b43bb4269e7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:48:57.466361 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3020fac2-f884-4748-bdc1-67fc5142df48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:48:57.473687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4401/8794] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:48:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:49:03.094111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=12 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:07.460351 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=26 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:41.221660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:49:41.223297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:49:41.251854 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f81ac-22f6-4b77-8a0e-f796d3338dd5 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:49:41.258870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:49:41.259533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:49:41.259812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:49:41.260089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:49:41.262012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:49:41.276676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:49:41.278287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:49:41.291020 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4394/8795] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:49:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:49:51.284112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:53.426217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020fac2-f884-4748-bdc1-67fc5142df48 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:49:53.441910 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020fac2-f884-4748-bdc1-67fc5142df48 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:49:53.448106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59f099-5f56-484f-9b7a-8dc6e360af42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:49:53.448751 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f099-5f56-484f-9b7a-8dc6e360af42 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:49:53.449053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f099-5f56-484f-9b7a-8dc6e360af42 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:49:53.449317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59f099-5f56-484f-9b7a-8dc6e360af42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:49:53.451279 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-de59f099-5f56-484f-9b7a-8dc6e360af42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:49:53.466541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59f099-5f56-484f-9b7a-8dc6e360af42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:49:53.468557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59f099-5f56-484f-9b7a-8dc6e360af42 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:49:53.494108 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4402/8796] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:49:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:50:03.477110 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:25.499906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:50:25.509575 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01fc24-7155-4b5a-9069-2c7ccd73c906 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:50:25.513534 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea8bc1-6c13-479b-b4cc-c7b49e86e998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:50:25.514220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8bc1-6c13-479b-b4cc-c7b49e86e998 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:25.514462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8bc1-6c13-479b-b4cc-c7b49e86e998 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:25.514767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8bc1-6c13-479b-b4cc-c7b49e86e998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:25.516694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-27ea8bc1-6c13-479b-b4cc-c7b49e86e998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:25.529515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea8bc1-6c13-479b-b4cc-c7b49e86e998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:50:25.531108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea8bc1-6c13-479b-b4cc-c7b49e86e998 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:50:25.544875 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4395/8797] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:50:25.622925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb761-0e4f-4a4f-8b56-b4259fe029f2 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:25.623445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb761-0e4f-4a4f-8b56-b4259fe029f2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:25.623568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fb761-0e4f-4a4f-8b56-b4259fe029f2 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:25.624947 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4403/8798] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:50:25.629913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7711-221f-4796-b1ee-978a5efe2993 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:25.630201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7711-221f-4796-b1ee-978a5efe2993 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:25.630478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7711-221f-4796-b1ee-978a5efe2993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:25.648660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-36cd7711-221f-4796-b1ee-978a5efe2993 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:50:25.649888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36cd7711-221f-4796-b1ee-978a5efe2993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:25.659025 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4396/8799] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:50:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:50:25.679101 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb761-0e4f-4a4f-8b56-b4259fe029f2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:50:25.696269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fb761-0e4f-4a4f-8b56-b4259fe029f2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:50:25.701736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:50:25.702406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:25.702692 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:25.702968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:25.712166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:50:25.713822 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:50:25.723696 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4404/8800] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 22:50:25.921610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0b304-5882-4b92-84b8-aa2210643a9a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:25.921901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0b304-5882-4b92-84b8-aa2210643a9a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:25.922242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0b304-5882-4b92-84b8-aa2210643a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:25.941551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-52b0b304-5882-4b92-84b8-aa2210643a9a None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:50:25.942773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-52b0b304-5882-4b92-84b8-aa2210643a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:25.950212 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4397/8801] 10.222.0.30 () {58 vars in 1061 bytes} [Sat Jun 18 22:50:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:50:25.956220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:50:25.966857 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49194-4599-4d7a-8825-7c30cf51391c service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:50:25.971466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:50:25.972094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:25.972362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:25.972743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:25.975269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:25.996653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:50:25.998171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:50:26.013798 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4405/8802] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:50:26.071667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4d833-2f1d-4b04-962c-7d5008d3db3a None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:26.071957 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4d833-2f1d-4b04-962c-7d5008d3db3a None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:26.072234 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4d833-2f1d-4b04-962c-7d5008d3db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:26.092425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-81d4d833-2f1d-4b04-962c-7d5008d3db3a None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:50:26.093680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-81d4d833-2f1d-4b04-962c-7d5008d3db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:26.103464 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4398/8803] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:50:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:50:26.119767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:50:26.141313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038f0f0-58a5-4218-8e51-c08bc0bc953d service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:50:26.150820 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0920353-7db0-406a-993a-ef7a06a88320 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:50:26.151784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920353-7db0-406a-993a-ef7a06a88320 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:26.152206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920353-7db0-406a-993a-ef7a06a88320 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:26.152539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920353-7db0-406a-993a-ef7a06a88320 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:26.163105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0920353-7db0-406a-993a-ef7a06a88320 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:50:26.164705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0920353-7db0-406a-993a-ef7a06a88320 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:50:26.176246 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4406/8804] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:50:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:50:26.975257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4d833-2f1d-4b04-962c-7d5008d3db3a None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:50:26.985117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4d833-2f1d-4b04-962c-7d5008d3db3a None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:50:26.989299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:50:26.989971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:26.990235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:26.990507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:26.992527 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:27.005247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:50:27.006738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:50:27.017500 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4399/8805] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:50:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:50:36.171646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=18 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:37.011246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=21 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:39.532844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2900-ac1e-4684-aedb-118a9ababe82 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:39.533382 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2900-ac1e-4684-aedb-118a9ababe82 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:39.533477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2900-ac1e-4684-aedb-118a9ababe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:39.551771 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-391a2900-ac1e-4684-aedb-118a9ababe82 None None] MFA Rules not processed for user `d589e9b3b6114231927b43bb4269e7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:50:39.553194 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-391a2900-ac1e-4684-aedb-118a9ababe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:39.560609 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4407/8806] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:50:39.874390 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:50:39.883890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3691a-d914-421d-8075-daaca8df5932 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:50:39.888344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:50:39.889346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:39.889633 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:39.889911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:39.891779 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:39.905459 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:50:39.907240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:50:39.919350 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4400/8807] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:50:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:50:40.242460 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd542ab3-f11d-4b43-882d-f91b2b6e3195 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:40.243023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd542ab3-f11d-4b43-882d-f91b2b6e3195 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:40.243354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd542ab3-f11d-4b43-882d-f91b2b6e3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:40.263225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-dd542ab3-f11d-4b43-882d-f91b2b6e3195 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:50:40.264431 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dd542ab3-f11d-4b43-882d-f91b2b6e3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:50:40.276600 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4408/8808] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:50:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:50:40.288711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:50:40.303831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f158b8-38bb-4e1e-8f4b-8c286091582b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:50:40.308836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19a25b-43d6-4cc0-887e-b1e8d3ec1694 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:50:40.309539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a25b-43d6-4cc0-887e-b1e8d3ec1694 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:50:40.309825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a25b-43d6-4cc0-887e-b1e8d3ec1694 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:50:40.310101 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19a25b-43d6-4cc0-887e-b1e8d3ec1694 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:50:40.319014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19a25b-43d6-4cc0-887e-b1e8d3ec1694 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:50:40.320606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19a25b-43d6-4cc0-887e-b1e8d3ec1694 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:50:40.330664 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4401/8809] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:50:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:50:50.257553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:50.326500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=12 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:55.297708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd542ab3-f11d-4b43-882d-f91b2b6e3195 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:51:55.318012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd542ab3-f11d-4b43-882d-f91b2b6e3195 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:51:55.322126 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:51:55.322870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:51:55.323276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:51:55.323624 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:51:55.325677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:51:55.355436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd9646-cbe6-4606-a49d-987475f10f98 None None] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:51:55.356055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd9646-cbe6-4606-a49d-987475f10f98 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:51:55.356055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd9646-cbe6-4606-a49d-987475f10f98 None None] PATH_INFO: `/` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:51:55.357475 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4402/8810] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 18 22:51:55.362247 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64da28-fc55-4fc8-a6a1-d5026ceedb50 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:51:55.362571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64da28-fc55-4fc8-a6a1-d5026ceedb50 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:51:55.362818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64da28-fc55-4fc8-a6a1-d5026ceedb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:51:55.382282 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4c64da28-fc55-4fc8-a6a1-d5026ceedb50 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:51:55.383649 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4c64da28-fc55-4fc8-a6a1-d5026ceedb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:51:55.391526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:51:55.392798 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4403/8811] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:51:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:51:55.393009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:51:55.406936 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4409/8812] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:51:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:51:55.413346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64da28-fc55-4fc8-a6a1-d5026ceedb50 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:51:55.427507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64da28-fc55-4fc8-a6a1-d5026ceedb50 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:51:55.432907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:51:55.433623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:51:55.433904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:51:55.434179 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:51:55.443672 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:51:55.445303 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:51:55.455413 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4404/8813] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:51:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:52:01.316977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:52:01.326313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf28f52-8bd0-43c1-a39e-8bb01b3a1e94 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:52:01.330406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c9fcd-99ed-4668-8101-e440f9a632ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:52:01.331058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9fcd-99ed-4668-8101-e440f9a632ef service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:52:01.331368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9fcd-99ed-4668-8101-e440f9a632ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:52:01.331653 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c9fcd-99ed-4668-8101-e440f9a632ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:52:01.333896 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e74c9fcd-99ed-4668-8101-e440f9a632ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:52:01.350983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c9fcd-99ed-4668-8101-e440f9a632ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:52:01.352409 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c9fcd-99ed-4668-8101-e440f9a632ef service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:52:01.367225 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4410/8814] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:52:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:52:05.451827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:11.358991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=34 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:12.708027 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:52:12.719181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fab0e7-fd68-4491-a646-cee248d3e025 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:52:12.723615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:52:12.724283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:52:12.724555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:52:12.724872 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:52:12.735526 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:52:12.736992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:52:12.748136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4405/8815] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:52:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:52:22.743313 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:23.765865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4a939-7e8d-485b-a15b-66d49f355849 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:52:23.765865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4a939-7e8d-485b-a15b-66d49f355849 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:52:23.765865 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4a939-7e8d-485b-a15b-66d49f355849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:52:23.789774 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-35c4a939-7e8d-485b-a15b-66d49f355849 None None] MFA Rules not processed for user `d589e9b3b6114231927b43bb4269e7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:52:23.790997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-35c4a939-7e8d-485b-a15b-66d49f355849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:52:23.801092 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4411/8816] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:52:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:52:33.784200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:36.177478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:52:36.200497 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b4c68-ae81-44fb-ae44-a7d26be71556 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:52:36.206858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f991a6-3ff4-4a8b-aab5-81a34b49d2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:52:36.207552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f991a6-3ff4-4a8b-aab5-81a34b49d2c8 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:52:36.207838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f991a6-3ff4-4a8b-aab5-81a34b49d2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:52:36.208110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f991a6-3ff4-4a8b-aab5-81a34b49d2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:52:36.220932 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f991a6-3ff4-4a8b-aab5-81a34b49d2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:52:36.222559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f991a6-3ff4-4a8b-aab5-81a34b49d2c8 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:52:36.236225 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4406/8817] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:52:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:52:46.229003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=9 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:16.656442 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8891a-1f35-4a03-bf79-65fc30bae88b None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:53:16.657171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8891a-1f35-4a03-bf79-65fc30bae88b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:53:16.657171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8891a-1f35-4a03-bf79-65fc30bae88b None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:53:16.658711 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4412/8818] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 22:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 22:53:16.664258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b652-17d3-4d05-b9dc-6df40dc8396e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:53:16.664835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b652-17d3-4d05-b9dc-6df40dc8396e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:53:16.664835 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b652-17d3-4d05-b9dc-6df40dc8396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:53:16.694917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e6b3b652-17d3-4d05-b9dc-6df40dc8396e None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:53:16.696180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e6b3b652-17d3-4d05-b9dc-6df40dc8396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:53:16.705236 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4407/8819] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 22:53:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:53:16.727435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8891a-1f35-4a03-bf79-65fc30bae88b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:53:16.745600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8891a-1f35-4a03-bf79-65fc30bae88b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:53:16.751334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:53:16.752031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:53:16.752315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:53:16.752588 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:53:16.762741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:53:16.764520 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:53:16.775683 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4413/8820] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:53:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:53:26.690814 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=7 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:26.771085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:52.496510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b652-17d3-4d05-b9dc-6df40dc8396e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:53:52.506538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b652-17d3-4d05-b9dc-6df40dc8396e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:53:52.510843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:53:52.511495 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:53:52.511776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:53:52.512041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:53:52.522713 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:53:52.524164 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:53:52.535564 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4408/8821] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:53:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:53:52.947680 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:53:52.974916 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77ca25-470e-465c-a07f-20dbd8bf78c6 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:53:52.980904 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:53:52.981641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:53:52.981930 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:53:52.982214 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:53:52.997177 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:53:52.999699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:53:53.016910 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4414/8822] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:53:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:00.890689 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:00.909198 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89335e9-f62d-4d77-ad77-a61bca3cc248 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:00.915096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:00.915760 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:00.916065 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:00.916348 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:00.928837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:00.930871 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:00.945093 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4409/8823] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:03.007935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:05.113217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:05.123059 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ff4a-642b-45f3-9b4d-94b809a76af1 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:05.126912 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:05.127551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:05.127834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:05.128117 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:05.137764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:05.139208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:05.167725 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4415/8824] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:08.067852 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:08.083620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8ba6e-9550-4df2-ada2-b7a71d0b7f68 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:08.090199 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:08.091148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.091525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.091968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.094151 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:08.112937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:08.114786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:08.129269 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4410/8825] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:08.157113 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:08.177854 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3910d0-05de-4ff3-9622-cfcea5e564c5 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:08.184809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:08.186022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.186305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.186598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] PATH_INFO: `/v3/users/d589e9b3b6114231927b43bb4269e7db` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.187799 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d589e9b3b6114231927b43bb4269e7db)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:08.189832 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:08.243887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd589e9b3b6114231927b43bb4269e7db'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.244645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd589e9b3b6114231927b43bb4269e7db'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.261242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd589e9b3b6114231927b43bb4269e7db'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.261985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd589e9b3b6114231927b43bb4269e7db'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.269241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-3aaac24f-9bc1-4b0b-b7ff-e73d67ed1ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd589e9b3b6114231927b43bb4269e7db'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.283113 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4416/8826] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:54:08 2022] DELETE /identity/v3/users/d589e9b3b6114231927b43bb4269e7db => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:54:08.462236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:08.474049 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6af97-0003-455a-8fa2-77a883339e52 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:08.533000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:08.533915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.534194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.534471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] PATH_INFO: `/v3/projects/c50bcdb7ce3f4fd59d056bf30bda1676` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.535667 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50bcdb7ce3f4fd59d056bf30bda1676)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:08.537639 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:08.585816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'request_id': 'req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.592341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'request_id': 'req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.601023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'request_id': 'req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.625519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] The token cache is being invalidate because project c50bcdb7ce3f4fd59d056bf30bda1676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:54:08.625812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.626464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-f0ab3dba-4d7f-4323-98d9-d43dbd7baf5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:08.628116 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4411/8827] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:54:08 2022] DELETE /identity/v3/projects/c50bcdb7ce3f4fd59d056bf30bda1676 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:54:08.633372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5d4c-dcfc-4102-ac28-5c54793f1812 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.633640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5d4c-dcfc-4102-ac28-5c54793f1812 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.633941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a5d4c-dcfc-4102-ac28-5c54793f1812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.664696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-7c4a5d4c-dcfc-4102-ac28-5c54793f1812 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:08.666006 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7c4a5d4c-dcfc-4102-ac28-5c54793f1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:08.729233 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4417/8828] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:08.737913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e560-0b10-49a6-abb5-67cbd16ba9b1 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.738209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e560-0b10-49a6-abb5-67cbd16ba9b1 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.738503 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e560-0b10-49a6-abb5-67cbd16ba9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.758539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-4ad6e560-0b10-49a6-abb5-67cbd16ba9b1 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:08.763012 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4ad6e560-0b10-49a6-abb5-67cbd16ba9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:08.775367 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4412/8829] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:08.776530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5d4c-dcfc-4102-ac28-5c54793f1812 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:08.790541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a5d4c-dcfc-4102-ac28-5c54793f1812 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:08.795508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:08.796178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.796459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.796736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.797487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:54:08.797813 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:08.801710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:08.812415 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4418/8830] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:54:08.816954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6e560-0b10-49a6-abb5-67cbd16ba9b1 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:08.826737 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6e560-0b10-49a6-abb5-67cbd16ba9b1 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:08.831407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:08.832066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.832346 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.832617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.833357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:08.835245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:08.864152 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4413/8831] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:54:08 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:54:08.869189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:08.882847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bff9a-9016-4dba-ba7f-98718d5103f9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:08.905949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:08.946060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:08.946750 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.947031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.947305 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.947995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:08.949965 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:08.971682 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4419/8832] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:54:08 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:54:08.976060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:08.986955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2973-ae67-4964-b8fa-1da994b5d30c admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:08.991862 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:08.992547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:08.992825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:08.993130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:08.993865 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:08.995464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:09.001021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:09.006530 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4414/8833] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:54:09.010360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:09.020749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19a756-7424-4af5-8122-a4d4bbc163f5 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:09.025712 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588695-8786-47ff-8274-eeefc441708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:09.026421 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588695-8786-47ff-8274-eeefc441708d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:09.026710 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588695-8786-47ff-8274-eeefc441708d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:09.026989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588695-8786-47ff-8274-eeefc441708d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:09.027759 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58588695-8786-47ff-8274-eeefc441708d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:09.029887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58588695-8786-47ff-8274-eeefc441708d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:09.040943 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4420/8834] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:54:09.045252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:09.055441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038656-a36f-42d4-bfdf-91f9023397c5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:09.061132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:09.062041 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:09.062327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:09.062609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] PATH_INFO: `/v3/projects/58dc2dd785cf47faa138714fd5649208/users/47dd5343c7624f21882b08dbaaab7b43/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:09.079486 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dc2dd785cf47faa138714fd5649208, user_id=47dd5343c7624f21882b08dbaaab7b43, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:09.082259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:09.097677 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4415/8835] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:54:09 2022] PUT /identity/v3/projects/58dc2dd785cf47faa138714fd5649208/users/47dd5343c7624f21882b08dbaaab7b43/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:54:09.102935 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a136-e02e-4633-a752-835065386d60 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:09.103230 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a136-e02e-4633-a752-835065386d60 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:09.103508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a136-e02e-4633-a752-835065386d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:09.121742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8750a136-e02e-4633-a752-835065386d60 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:09.122948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8750a136-e02e-4633-a752-835065386d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:09.191638 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4421/8836] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:09.201547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:09.203360 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:09.273564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2286d66-d940-4c9a-85e2-aad7af247633 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:09.278368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a48a5-f8e3-410e-85dd-dd2d796a3f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:09.279054 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a48a5-f8e3-410e-85dd-dd2d796a3f32 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:09.279334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a48a5-f8e3-410e-85dd-dd2d796a3f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:09.279607 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a48a5-f8e3-410e-85dd-dd2d796a3f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:09.290886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a48a5-f8e3-410e-85dd-dd2d796a3f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:09.292333 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a48a5-f8e3-410e-85dd-dd2d796a3f32 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:09.302587 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4416/8837] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:13.761073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:13.761493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:13.761637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:13.798528 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] MFA Rules not processed for user `47dd5343c7624f21882b08dbaaab7b43`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:13.799765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:13.872064 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4422/8838] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:13.882224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71a65-de20-465e-81a9-8e4016be5c5d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:13.882735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71a65-de20-465e-81a9-8e4016be5c5d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:13.882822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71a65-de20-465e-81a9-8e4016be5c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:13.901079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-aca71a65-de20-465e-81a9-8e4016be5c5d None None] MFA Rules not processed for user `47dd5343c7624f21882b08dbaaab7b43`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:13.902279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aca71a65-de20-465e-81a9-8e4016be5c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:13.909121 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4417/8839] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:13.920670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:13.922089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:13.963491 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:14.018374 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dc9d7-b435-4951-b537-558883eb258f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:14.025003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a5045-64a3-4e28-ac94-83a49f5a7055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:14.025698 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a5045-64a3-4e28-ac94-83a49f5a7055 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:14.025977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a5045-64a3-4e28-ac94-83a49f5a7055 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:14.026222 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a5045-64a3-4e28-ac94-83a49f5a7055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:14.035622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a5045-64a3-4e28-ac94-83a49f5a7055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:14.037265 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a5045-64a3-4e28-ac94-83a49f5a7055 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:14.047932 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4423/8840] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:14.312748 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71a65-de20-465e-81a9-8e4016be5c5d None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:14.322795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71a65-de20-465e-81a9-8e4016be5c5d None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:14.326751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:14.327423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:14.327715 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:14.328006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:14.330087 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:14.343972 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:14.345606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:14.357259 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4418/8841] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:24.042789 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=24 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:24.353021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:26.413784 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a702e-e1ca-4183-9fd0-af85d3a61188 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:26.415074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a702e-e1ca-4183-9fd0-af85d3a61188 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:26.415074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a702e-e1ca-4183-9fd0-af85d3a61188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:26.433702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-873a702e-e1ca-4183-9fd0-af85d3a61188 None None] MFA Rules not processed for user `47dd5343c7624f21882b08dbaaab7b43`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:26.434960 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-873a702e-e1ca-4183-9fd0-af85d3a61188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:26.443055 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4424/8842] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:36.428319 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:45.183795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:45.185283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:45.277728 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188000d-640a-4f07-a7f9-bae32926541f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:45.283411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:45.284083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:45.284552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:45.284692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:45.286875 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:45.301735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:45.303493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:45.317884 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4419/8843] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:47.229918 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a702e-e1ca-4183-9fd0-af85d3a61188 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:47.241856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a702e-e1ca-4183-9fd0-af85d3a61188 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:47.247296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:47.248331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:47.248615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:47.248919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] PATH_INFO: `/v3/users/47dd5343c7624f21882b08dbaaab7b43` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:47.250191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47dd5343c7624f21882b08dbaaab7b43)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:47.252163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:47.304923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dd5343c7624f21882b08dbaaab7b43'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.305695 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dd5343c7624f21882b08dbaaab7b43'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.318841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dd5343c7624f21882b08dbaaab7b43'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.319622 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dd5343c7624f21882b08dbaaab7b43'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.327128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-de65aa1b-d3cf-46e5-86dc-0a704e01556a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dd5343c7624f21882b08dbaaab7b43'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.343920 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4425/8844] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:54:47 2022] DELETE /identity/v3/users/47dd5343c7624f21882b08dbaaab7b43 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:54:47.536143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:47.548882 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a5aa8-3a09-4415-9223-1bc4c9436ffb service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:47.612803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:47.613725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:47.614011 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:47.614289 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] PATH_INFO: `/v3/projects/58dc2dd785cf47faa138714fd5649208` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:47.615612 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58dc2dd785cf47faa138714fd5649208)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:47.617602 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:47.666249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58dc2dd785cf47faa138714fd5649208', 'request_id': 'req-591576ca-a5a9-469f-9339-7caf950f2c82'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.672783 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58dc2dd785cf47faa138714fd5649208', 'request_id': 'req-591576ca-a5a9-469f-9339-7caf950f2c82'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.682316 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58dc2dd785cf47faa138714fd5649208', 'request_id': 'req-591576ca-a5a9-469f-9339-7caf950f2c82'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.693213 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] The token cache is being invalidate because project 58dc2dd785cf47faa138714fd5649208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:54:47.693378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.694063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-591576ca-a5a9-469f-9339-7caf950f2c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:54:47.695711 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4420/8845] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:54:47 2022] DELETE /identity/v3/projects/58dc2dd785cf47faa138714fd5649208 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:54:47.700941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0cb1-c74d-4b56-851c-d8f27c460b6f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:47.701269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0cb1-c74d-4b56-851c-d8f27c460b6f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:47.701551 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc0cb1-c74d-4b56-851c-d8f27c460b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:47.747962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ccfc0cb1-c74d-4b56-851c-d8f27c460b6f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:47.749659 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ccfc0cb1-c74d-4b56-851c-d8f27c460b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:47.820574 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4426/8846] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:47.833474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a47a9-26fe-4aff-9710-bb3778fa34b5 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:47.834028 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a47a9-26fe-4aff-9710-bb3778fa34b5 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:47.834427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a47a9-26fe-4aff-9710-bb3778fa34b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:47.858764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c55a47a9-26fe-4aff-9710-bb3778fa34b5 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:47.860002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c55a47a9-26fe-4aff-9710-bb3778fa34b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:47.869183 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4421/8847] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:54:47.873557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc0cb1-c74d-4b56-851c-d8f27c460b6f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:47.884435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc0cb1-c74d-4b56-851c-d8f27c460b6f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:47.889760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:47.890426 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:47.890703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:47.891000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:47.892649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:54:47.892932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:47.894610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:47.907408 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4427/8848] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:54:47.912071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a47a9-26fe-4aff-9710-bb3778fa34b5 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:47.916989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:47.923990 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a47a9-26fe-4aff-9710-bb3778fa34b5 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:47.930110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:47.930816 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:47.931102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:47.931383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:47.932117 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:47.934145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:47.963953 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4422/8849] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:54:47 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:54:47.966153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:47.976834 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a98a06-3f6d-486e-86b5-be53f55071f0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:48.022436 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:48.042439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:48.043156 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:48.043503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:48.043791 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:48.044495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:48.046497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:48.070874 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4428/8850] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:54:47 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:54:48.073145 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:48.084140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b26709-d16e-42ab-9de4-6a71719cc380 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:48.089215 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:48.090273 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:48.090547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:48.090818 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:48.091551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:48.093177 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:48.104466 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4423/8851] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:54:48.108464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:48.119717 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b824e96-795f-44e4-b4df-065cb380ca00 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:48.124989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f39b2-134e-4d2f-aba0-5d4c0e9e20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:48.125689 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f39b2-134e-4d2f-aba0-5d4c0e9e20b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:48.125985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f39b2-134e-4d2f-aba0-5d4c0e9e20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:48.126242 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f39b2-134e-4d2f-aba0-5d4c0e9e20b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:48.127014 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f39b2-134e-4d2f-aba0-5d4c0e9e20b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:48.128619 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f39b2-134e-4d2f-aba0-5d4c0e9e20b0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:48.139006 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4429/8852] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:54:48.143355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:48.153817 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce691c8-63e7-4cb3-9f4a-1411f341c0c7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:48.158694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:48.159579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:48.159856 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:48.160130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] PATH_INFO: `/v3/projects/007ebbafcbc447c8ae09a37d768f4853/users/59db671bca70420f878237b9bf00cd62/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:48.175075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007ebbafcbc447c8ae09a37d768f4853, user_id=59db671bca70420f878237b9bf00cd62, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:48.177876 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:48.192026 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4424/8853] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:54:48 2022] PUT /identity/v3/projects/007ebbafcbc447c8ae09a37d768f4853/users/59db671bca70420f878237b9bf00cd62/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:54:48.203289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:48.203582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:48.203899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:48.233008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] MFA Rules not processed for user `59db671bca70420f878237b9bf00cd62`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:54:48.234220 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:48.299238 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4430/8854] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:54:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:54:48.309870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:48.311793 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:48.369966 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77a6f-fd6e-47a2-ad17-14edb408ef39 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:48.373775 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:48.374426 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:48.374707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:48.374986 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:48.384032 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:48.385476 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:48.395893 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4425/8855] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:53.606465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:54:53.608124 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:53.714150 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7dfe-2326-47a0-8976-317546c6d9d2 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:54:53.720143 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fd21b-956d-467e-b474-4d67f95afdf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:54:53.721094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd21b-956d-467e-b474-4d67f95afdf3 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:54:53.721467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd21b-956d-467e-b474-4d67f95afdf3 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:54:53.721868 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd21b-956d-467e-b474-4d67f95afdf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:54:53.723879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-cc8fd21b-956d-467e-b474-4d67f95afdf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:54:53.740295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fd21b-956d-467e-b474-4d67f95afdf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:54:53.742171 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fd21b-956d-467e-b474-4d67f95afdf3 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:54:53.757000 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4431/8856] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:54:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:54:58.391077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:00.073388 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:00.144500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695b6f9-954f-425f-a369-057f9552f6bf service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:00.149467 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:00.150343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.150622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.150894 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] PATH_INFO: `/v3/users/59db671bca70420f878237b9bf00cd62` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.152111 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59db671bca70420f878237b9bf00cd62)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:00.154060 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:00.205428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59db671bca70420f878237b9bf00cd62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.206017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59db671bca70420f878237b9bf00cd62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.219299 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59db671bca70420f878237b9bf00cd62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.220003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59db671bca70420f878237b9bf00cd62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.229456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59db671bca70420f878237b9bf00cd62'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.251330 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4426/8857] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:55:00 2022] DELETE /identity/v3/users/59db671bca70420f878237b9bf00cd62 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:55:00.256726 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.257259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.257259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.275540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:00.276731 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:00.320128 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:00.346502 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4432/8858] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:00.357730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:00.359368 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:00.374106 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:00.375878 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:00.423551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c18d-bb94-45b0-82cf-38f45ed9430a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:00.427641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:00.428320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.428686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.429088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.438628 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:00.440066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:00.449960 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4427/8859] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:55:00.450133 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783770-3c73-4bb8-9692-55ffdbef1619 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:00.455313 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7f502-8742-4b37-b021-e6e084c7196f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:00.456000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7f502-8742-4b37-b021-e6e084c7196f service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.456266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7f502-8742-4b37-b021-e6e084c7196f service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.456545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7f502-8742-4b37-b021-e6e084c7196f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.458410 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ae7f502-8742-4b37-b021-e6e084c7196f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:00.474669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7f502-8742-4b37-b021-e6e084c7196f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:00.476253 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7f502-8742-4b37-b021-e6e084c7196f service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:00.489529 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4433/8860] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:55:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:55:00.639265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:00.640786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:00.668644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98e070-1610-4ff1-8e44-d81a2e61d318 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:00.673903 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:00.674788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.675062 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.675332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] PATH_INFO: `/v3/projects/007ebbafcbc447c8ae09a37d768f4853` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.676621 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007ebbafcbc447c8ae09a37d768f4853)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:00.678599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:00.697708 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:00.735549 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007ebbafcbc447c8ae09a37d768f4853', 'request_id': 'req-1fde3c7d-9710-4dab-98c5-d83079360758'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.743799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007ebbafcbc447c8ae09a37d768f4853', 'request_id': 'req-1fde3c7d-9710-4dab-98c5-d83079360758'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.751453 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007ebbafcbc447c8ae09a37d768f4853', 'request_id': 'req-1fde3c7d-9710-4dab-98c5-d83079360758'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.763279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] The token cache is being invalidate because project 007ebbafcbc447c8ae09a37d768f4853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:55:00.763513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.764231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-1fde3c7d-9710-4dab-98c5-d83079360758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:00.765906 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4428/8861] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:55:00 2022] DELETE /identity/v3/projects/007ebbafcbc447c8ae09a37d768f4853 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:55:00.771356 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af762a-afe6-4e18-952b-2f17b2c895d0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.771650 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af762a-afe6-4e18-952b-2f17b2c895d0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.771929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af762a-afe6-4e18-952b-2f17b2c895d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.791760 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-95af762a-afe6-4e18-952b-2f17b2c895d0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:00.792987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-95af762a-afe6-4e18-952b-2f17b2c895d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:00.856174 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4434/8862] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:00.864400 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eebef-dcd4-4b74-ab09-2e58982976da None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.864699 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eebef-dcd4-4b74-ab09-2e58982976da None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.864977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754eebef-dcd4-4b74-ab09-2e58982976da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.883789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-754eebef-dcd4-4b74-ab09-2e58982976da None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:00.885005 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-754eebef-dcd4-4b74-ab09-2e58982976da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:00.894115 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4429/8863] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:00.898626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af762a-afe6-4e18-952b-2f17b2c895d0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:00.909131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af762a-afe6-4e18-952b-2f17b2c895d0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:00.915075 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:00.915742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.916035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.916302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.917067 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:55:00.917411 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:00.919037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:00.931953 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4435/8864] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:55:00.936480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754eebef-dcd4-4b74-ab09-2e58982976da None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:00.946432 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754eebef-dcd4-4b74-ab09-2e58982976da None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:00.952278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:00.952931 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:00.953258 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:00.953541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:00.954242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:00.956180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:00.985658 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4430/8865] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:55:00 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:55:00.990053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:01.001008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ac38b-fc70-4cfe-818f-b9434647e967 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:01.058997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:01.059684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:01.059968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:01.060241 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:01.060929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:01.062922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:01.069734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=100 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:01.084675 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4436/8866] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:55:00 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:55:01.088975 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:01.100044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9638639-d5ac-4e99-a997-07d0aff10dc7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:01.104746 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:01.105439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:01.105723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:01.105997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:01.106725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:01.108329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:01.119602 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4431/8867] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:55:01.123783 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:01.135228 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1677a5-b757-4bd6-b086-36b747566085 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:01.141378 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d8fa8-4fce-4929-874e-b136bc2cfc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:01.142056 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8fa8-4fce-4929-874e-b136bc2cfc4d admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:01.142370 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8fa8-4fce-4929-874e-b136bc2cfc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:01.142645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8fa8-4fce-4929-874e-b136bc2cfc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:01.143385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d8fa8-4fce-4929-874e-b136bc2cfc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:01.145057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d8fa8-4fce-4929-874e-b136bc2cfc4d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:01.155885 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4437/8868] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:55:01.160437 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:01.171163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2869-4011-42b0-94cb-e66ea11b5ec0 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:01.176461 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:01.177415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:01.177716 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:01.177992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] PATH_INFO: `/v3/projects/494162d59ad44f6e916df72bb248b88b/users/55d7d293583a4297ad629b99e3665fa2/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:01.193080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494162d59ad44f6e916df72bb248b88b, user_id=55d7d293583a4297ad629b99e3665fa2, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:01.195792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:01.210366 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4432/8869] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:55:01 2022] PUT /identity/v3/projects/494162d59ad44f6e916df72bb248b88b/users/55d7d293583a4297ad629b99e3665fa2/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:55:01.221482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8603-b95d-4b26-9aaf-07904993bd92 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:01.221775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8603-b95d-4b26-9aaf-07904993bd92 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:01.222079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8603-b95d-4b26-9aaf-07904993bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:01.250152 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-8fed8603-b95d-4b26-9aaf-07904993bd92 None None] MFA Rules not processed for user `55d7d293583a4297ad629b99e3665fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:01.251358 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-8fed8603-b95d-4b26-9aaf-07904993bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:01.319371 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4438/8870] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:01.329654 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:01.331837 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:01.389279 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b8cd4-c886-4bc5-8881-fb009033b111 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:01.393352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250dc88-d03a-49e3-9d94-ad8cdf380544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:01.393982 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250dc88-d03a-49e3-9d94-ad8cdf380544 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:01.394362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250dc88-d03a-49e3-9d94-ad8cdf380544 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:01.394705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250dc88-d03a-49e3-9d94-ad8cdf380544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:01.403532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250dc88-d03a-49e3-9d94-ad8cdf380544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:01.404969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250dc88-d03a-49e3-9d94-ad8cdf380544 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:01.413844 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4433/8871] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:55:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:55:05.799983 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed8603-b95d-4b26-9aaf-07904993bd92 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:05.865021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed8603-b95d-4b26-9aaf-07904993bd92 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:05.869792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:05.870678 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:05.870961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:05.871235 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] PATH_INFO: `/v3/users/55d7d293583a4297ad629b99e3665fa2` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:05.872447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d7d293583a4297ad629b99e3665fa2)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:05.874432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:05.923523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d7d293583a4297ad629b99e3665fa2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:05.924179 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d7d293583a4297ad629b99e3665fa2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:05.936755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d7d293583a4297ad629b99e3665fa2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:05.937466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d7d293583a4297ad629b99e3665fa2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:05.942081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:05.945621 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d7d293583a4297ad629b99e3665fa2'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:05.959013 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4439/8872] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:55:05 2022] DELETE /identity/v3/users/55d7d293583a4297ad629b99e3665fa2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:55:05.963714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:05.964344 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:05.965539 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:05.983178 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:05.984411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:06.027431 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:06.049155 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4434/8873] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:55:06.059354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.060899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:06.119600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06475b5-bc38-4335-94e1-e56025055b25 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.123629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90b97e-45fd-4483-8959-120d05f3a9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.124285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90b97e-45fd-4483-8959-120d05f3a9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.124570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90b97e-45fd-4483-8959-120d05f3a9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.124841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90b97e-45fd-4483-8959-120d05f3a9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.134477 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90b97e-45fd-4483-8959-120d05f3a9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.135938 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90b97e-45fd-4483-8959-120d05f3a9d6 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.145863 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4440/8874] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:55:06.331180 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.333455 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:06.347445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab3d3e-1299-4c22-aca6-5b43d02fd85c None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.352673 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.353645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.353885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.354250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] PATH_INFO: `/v3/projects/494162d59ad44f6e916df72bb248b88b` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.360108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=494162d59ad44f6e916df72bb248b88b)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.362138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.413619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494162d59ad44f6e916df72bb248b88b', 'request_id': 'req-34724161-794b-4e83-87dc-88b8a55fd16d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:06.420595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494162d59ad44f6e916df72bb248b88b', 'request_id': 'req-34724161-794b-4e83-87dc-88b8a55fd16d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:06.428877 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494162d59ad44f6e916df72bb248b88b', 'request_id': 'req-34724161-794b-4e83-87dc-88b8a55fd16d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:06.439987 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] The token cache is being invalidate because project 494162d59ad44f6e916df72bb248b88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:55:06.440272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:06.440899 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-34724161-794b-4e83-87dc-88b8a55fd16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:55:06.442563 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4435/8875] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:55:06 2022] DELETE /identity/v3/projects/494162d59ad44f6e916df72bb248b88b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:55:06.448610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400494-526e-4b2a-980a-a5e9f5a74ecf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.448958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400494-526e-4b2a-980a-a5e9f5a74ecf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.449266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a400494-526e-4b2a-980a-a5e9f5a74ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.467456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1a400494-526e-4b2a-980a-a5e9f5a74ecf None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:06.468666 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1a400494-526e-4b2a-980a-a5e9f5a74ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:06.530999 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4441/8876] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:06.539238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea53b-38f8-48bc-9016-2b63b7770b21 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.539604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea53b-38f8-48bc-9016-2b63b7770b21 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.539892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ea53b-38f8-48bc-9016-2b63b7770b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.562490 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-6a4ea53b-38f8-48bc-9016-2b63b7770b21 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:06.563642 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-6a4ea53b-38f8-48bc-9016-2b63b7770b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:06.572134 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4436/8877] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:55:06.576686 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400494-526e-4b2a-980a-a5e9f5a74ecf None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.587362 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a400494-526e-4b2a-980a-a5e9f5a74ecf None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.593521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.594186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.594466 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.594749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.595456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:55:06.595841 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.597535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.610115 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4442/8878] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 22:55:06.614703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea53b-38f8-48bc-9016-2b63b7770b21 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.624485 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ea53b-38f8-48bc-9016-2b63b7770b21 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.630023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.630723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.631381 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.631604 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.632300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.634378 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.663355 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4437/8879] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:55:06 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:55:06.667840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.678924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c252c-771f-4f6f-9068-e1520b60aff3 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.738198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.738913 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.739299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.739577 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.740286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.742292 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.763276 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4443/8880] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:55:06 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:55:06.767514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.778941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e28f47-7453-48ab-b231-44cd5a7e0ad2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.784239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.784915 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.785221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.785499 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.786285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.787883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.798943 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4438/8881] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:55:06.802976 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.814615 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877e92-7075-4384-8ec1-c81ccccf8406 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.821017 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655eb9-97bc-4dee-a9e4-995102df21cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.821732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655eb9-97bc-4dee-a9e4-995102df21cc admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.822016 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655eb9-97bc-4dee-a9e4-995102df21cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.822297 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655eb9-97bc-4dee-a9e4-995102df21cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.823031 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655eb9-97bc-4dee-a9e4-995102df21cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.824652 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655eb9-97bc-4dee-a9e4-995102df21cc admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.825961 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:06.840953 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4444/8882] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:55:06.845743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.856509 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813afd0-d752-4591-8658-6cb21b8e64b5 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:06.862257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:06.863157 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.863444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.863722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] PATH_INFO: `/v3/projects/f576ae59a362455993f77dfdb870e37a/users/c544eb954e434fbda5d92667d6f4a2a8/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.879627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f576ae59a362455993f77dfdb870e37a, user_id=c544eb954e434fbda5d92667d6f4a2a8, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:06.882384 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:06.897321 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4439/8883] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:55:06 2022] PUT /identity/v3/projects/f576ae59a362455993f77dfdb870e37a/users/c544eb954e434fbda5d92667d6f4a2a8/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:55:06.902685 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd4c72-dcb3-409a-9847-c26f3796aded None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:06.902991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd4c72-dcb3-409a-9847-c26f3796aded None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:06.903262 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd4c72-dcb3-409a-9847-c26f3796aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:06.921900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-56dd4c72-dcb3-409a-9847-c26f3796aded None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:06.923131 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-56dd4c72-dcb3-409a-9847-c26f3796aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:06.984516 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4445/8884] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:06.994501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:06.996265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:07.055754 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bab0c-804f-4e21-a915-f858f827575a admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:07.059819 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:07.060482 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:07.060750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:07.060993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:07.070632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:07.071976 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:07.090324 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4440/8885] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:55:10.790046 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53bc8a-d975-43d1-80b5-23dd18d1f874 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:10.790516 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53bc8a-d975-43d1-80b5-23dd18d1f874 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:10.790626 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53bc8a-d975-43d1-80b5-23dd18d1f874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:10.817788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ea53bc8a-d975-43d1-80b5-23dd18d1f874 None None] MFA Rules not processed for user `c544eb954e434fbda5d92667d6f4a2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:10.819087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ea53bc8a-d975-43d1-80b5-23dd18d1f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:10.889194 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4446/8886] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:10.893849 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:10.904125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aca826-290b-497a-8b7c-2016d828652a service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:10.909901 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:10.910592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:10.910756 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:10.911030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:10.911733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:10.913913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:10.917947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:10.960526 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4441/8887] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:55:10 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:55:10.964021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53bc8a-d975-43d1-80b5-23dd18d1f874 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:10.982461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53bc8a-d975-43d1-80b5-23dd18d1f874 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:11.060640 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:11.061394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:11.061724 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:11.062011 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:11.062723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:11.064667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:11.090194 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4447/8888] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:55:10 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:55:11.094412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:11.105997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ff012-203b-4bb4-8f30-eae79f63b9b4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:11.116523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:11.117696 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:11.118209 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:11.118597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:11.119739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:11.121960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:11.139071 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4442/8889] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:55:11.143729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:11.154342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd50db-7389-40fa-a227-a6d2d279ebde admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:11.160275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:11.161153 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:11.161579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:11.162489 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] PATH_INFO: `/v3/projects/3e3dfa0cf0cb4fcfbe3d9445e3ded939/users/991014d5f72743d09f94cedea86312a6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:11.178317 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:11.182108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3dfa0cf0cb4fcfbe3d9445e3ded939, user_id=991014d5f72743d09f94cedea86312a6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:11.185339 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:11.200769 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4448/8890] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:55:11 2022] PUT /identity/v3/projects/3e3dfa0cf0cb4fcfbe3d9445e3ded939/users/991014d5f72743d09f94cedea86312a6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:55:11.204895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:11.215988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75ee9c-3d1e-403a-aadf-6721e93593ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:11.275964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2fd26-0615-49bd-b3c3-6dcaf2cf8155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:11.276656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fd26-0615-49bd-b3c3-6dcaf2cf8155 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:11.276938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fd26-0615-49bd-b3c3-6dcaf2cf8155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:11.277267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fd26-0615-49bd-b3c3-6dcaf2cf8155 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:11.278007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2fd26-0615-49bd-b3c3-6dcaf2cf8155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:11.279834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2fd26-0615-49bd-b3c3-6dcaf2cf8155 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:11.292971 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4443/8891] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:55:11.295105 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:11.306246 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568ff35-df9f-4580-8f79-0c09aa948115 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:11.311023 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140b842-1594-4a64-9afa-456823aef1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:11.312022 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b842-1594-4a64-9afa-456823aef1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:11.312384 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b842-1594-4a64-9afa-456823aef1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:11.312729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b842-1594-4a64-9afa-456823aef1f3 admin admin] PATH_INFO: `/v3/projects/3e3dfa0cf0cb4fcfbe3d9445e3ded939/users/991014d5f72743d09f94cedea86312a6/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:11.314864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140b842-1594-4a64-9afa-456823aef1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3dfa0cf0cb4fcfbe3d9445e3ded939, user_id=991014d5f72743d09f94cedea86312a6, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:11.317895 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140b842-1594-4a64-9afa-456823aef1f3 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:11.329723 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4449/8892] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:55:11 2022] PUT /identity/v3/projects/3e3dfa0cf0cb4fcfbe3d9445e3ded939/users/991014d5f72743d09f94cedea86312a6/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:55:15.931044 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921c4f9-25cd-4b8c-b4a5-f42c99edca5e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:15.931766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921c4f9-25cd-4b8c-b4a5-f42c99edca5e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:15.931766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921c4f9-25cd-4b8c-b4a5-f42c99edca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:15.961988 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5921c4f9-25cd-4b8c-b4a5-f42c99edca5e None None] MFA Rules not processed for user `991014d5f72743d09f94cedea86312a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:15.963652 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5921c4f9-25cd-4b8c-b4a5-f42c99edca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:16.052400 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4444/8893] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:55:16.086066 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d97e2-3178-4202-b31c-073168592068 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:16.086550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d97e2-3178-4202-b31c-073168592068 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:16.086665 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d97e2-3178-4202-b31c-073168592068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:16.136693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-4f0d97e2-3178-4202-b31c-073168592068 None None] MFA Rules not processed for user `14f94931805a4215b22237194803d41c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:16.138095 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-4f0d97e2-3178-4202-b31c-073168592068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:16.202321 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4450/8894] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Jun 18 22:55:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:16.208614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921c4f9-25cd-4b8c-b4a5-f42c99edca5e None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:16.219624 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921c4f9-25cd-4b8c-b4a5-f42c99edca5e None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:16.223446 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e7e9-3f10-4bc7-a72d-cf5a19da9a7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:16.224272 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e7e9-3f10-4bc7-a72d-cf5a19da9a7e service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:16.224552 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e7e9-3f10-4bc7-a72d-cf5a19da9a7e service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:16.224936 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e7e9-3f10-4bc7-a72d-cf5a19da9a7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:16.284574 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:16.289653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e7e9-3f10-4bc7-a72d-cf5a19da9a7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:16.292343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39e7e9-3f10-4bc7-a72d-cf5a19da9a7e service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:16.303667 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4445/8895] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:55:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:55:16.436543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d53ad6-dcb7-4799-8267-26bb78ac65fe None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:16.436831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d53ad6-dcb7-4799-8267-26bb78ac65fe None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:16.437154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d53ad6-dcb7-4799-8267-26bb78ac65fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:16.489266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-14d53ad6-dcb7-4799-8267-26bb78ac65fe None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:16.490553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-14d53ad6-dcb7-4799-8267-26bb78ac65fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:16.563598 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4451/8896] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:55:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:16.625099 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4edf4-4388-4a11-a55f-b9f2400a03da None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:16.625398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4edf4-4388-4a11-a55f-b9f2400a03da None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:16.625683 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4edf4-4388-4a11-a55f-b9f2400a03da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:16.684803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-89f4edf4-4388-4a11-a55f-b9f2400a03da None None] MFA Rules not processed for user `f2272ca86c294ec4aa96eccc1827d4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:16.686298 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-89f4edf4-4388-4a11-a55f-b9f2400a03da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:16.792447 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4446/8897] 10.222.0.30 () {58 vars in 1039 bytes} [Sat Jun 18 22:55:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:16.798844 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d53ad6-dcb7-4799-8267-26bb78ac65fe None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:16.812041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d53ad6-dcb7-4799-8267-26bb78ac65fe None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:16.821856 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d75ef-17ef-47ba-b85d-01b2296b3dfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:16.823070 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d75ef-17ef-47ba-b85d-01b2296b3dfa service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:16.823360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d75ef-17ef-47ba-b85d-01b2296b3dfa service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:16.823644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d75ef-17ef-47ba-b85d-01b2296b3dfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:16.834306 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d75ef-17ef-47ba-b85d-01b2296b3dfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:16.836161 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d75ef-17ef-47ba-b85d-01b2296b3dfa service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:16.847144 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4452/8898] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:55:25.641498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4fe4d-1277-425a-85db-5ef627576d26 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:25.642139 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4fe4d-1277-425a-85db-5ef627576d26 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:25.642246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4fe4d-1277-425a-85db-5ef627576d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:25.660996 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-cbc4fe4d-1277-425a-85db-5ef627576d26 None None] MFA Rules not processed for user `c544eb954e434fbda5d92667d6f4a2a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:25.662357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-cbc4fe4d-1277-425a-85db-5ef627576d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:25.670434 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4447/8899] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:55:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 22:55:26.842674 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:27.390557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37da21-aaf0-4c45-9f0b-b52c35b353dd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:27.390937 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37da21-aaf0-4c45-9f0b-b52c35b353dd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:27.391541 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37da21-aaf0-4c45-9f0b-b52c35b353dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:27.421464 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-eb37da21-aaf0-4c45-9f0b-b52c35b353dd None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:55:27.422920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-eb37da21-aaf0-4c45-9f0b-b52c35b353dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:55:27.431254 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4453/8900] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:55:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:55:27.443597 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4fe4d-1277-425a-85db-5ef627576d26 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:27.455811 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4fe4d-1277-425a-85db-5ef627576d26 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:27.460946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb978e-c89e-4b33-80d9-e1e83fda8df3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:27.461732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb978e-c89e-4b33-80d9-e1e83fda8df3 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:27.462075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb978e-c89e-4b33-80d9-e1e83fda8df3 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:27.462412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb978e-c89e-4b33-80d9-e1e83fda8df3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:27.472116 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb978e-c89e-4b33-80d9-e1e83fda8df3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:27.473843 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb978e-c89e-4b33-80d9-e1e83fda8df3 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:27.483136 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4448/8901] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 22:55:37.414523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:37.479686 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=56 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:48.497134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37da21-aaf0-4c45-9f0b-b52c35b353dd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:55:48.563682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37da21-aaf0-4c45-9f0b-b52c35b353dd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:55:48.567940 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:55:48.568600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:55:48.568879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:55:48.569198 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:55:48.579234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:55:48.580676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:55:48.591232 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4454/8902] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:55:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:55:58.586530 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=26 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:03.396749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e065-4334-4b1b-ab67-689a63a6ce22 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:03.397557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e065-4334-4b1b-ab67-689a63a6ce22 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:03.397557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7e065-4334-4b1b-ab67-689a63a6ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:03.428334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-85c7e065-4334-4b1b-ab67-689a63a6ce22 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:03.436525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-85c7e065-4334-4b1b-ab67-689a63a6ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:03.508009 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4449/8903] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Jun 18 22:57:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:03.523901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:03.525482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:03.543708 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2662d1-e528-4711-a5f1-64fb4df22d27 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:03.549325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:03.549970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:03.550259 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:03.550538 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:03.559285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:03.560929 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:03.571409 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4455/8904] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:07.390077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7e065-4334-4b1b-ab67-689a63a6ce22 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:07.401635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7e065-4334-4b1b-ab67-689a63a6ce22 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:07.405984 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004857ca-6ef3-4bff-9914-fae8d21b2cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:07.406640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004857ca-6ef3-4bff-9914-fae8d21b2cff service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:07.406918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004857ca-6ef3-4bff-9914-fae8d21b2cff service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:07.407220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004857ca-6ef3-4bff-9914-fae8d21b2cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:07.409516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-004857ca-6ef3-4bff-9914-fae8d21b2cff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:07.493162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004857ca-6ef3-4bff-9914-fae8d21b2cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:07.494614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004857ca-6ef3-4bff-9914-fae8d21b2cff service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:07.510082 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4450/8905] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:13.072732 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:13.082925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dce80-60df-482b-b68f-82468c2c7215 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:13.087594 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb34195-3f3b-4244-81d9-33039517c4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:13.088237 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb34195-3f3b-4244-81d9-33039517c4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:13.088521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb34195-3f3b-4244-81d9-33039517c4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:13.088794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb34195-3f3b-4244-81d9-33039517c4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:13.091369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffb34195-3f3b-4244-81d9-33039517c4b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:13.109154 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb34195-3f3b-4244-81d9-33039517c4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:13.110597 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb34195-3f3b-4244-81d9-33039517c4b7 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:13.124820 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4456/8906] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:14.284250 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900902b9-865f-463b-a338-5ce130c13fe3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:14.285252 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900902b9-865f-463b-a338-5ce130c13fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:14.285833 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900902b9-865f-463b-a338-5ce130c13fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:14.306890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-900902b9-865f-463b-a338-5ce130c13fe3 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:14.308451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-900902b9-865f-463b-a338-5ce130c13fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:14.319528 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4451/8907] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Jun 18 22:57:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:14.334721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd779-e401-4fe1-ad74-261b0a00c0c6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:14.335215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd779-e401-4fe1-ad74-261b0a00c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:14.335346 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd779-e401-4fe1-ad74-261b0a00c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:14.356103 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-d15fd779-e401-4fe1-ad74-261b0a00c0c6 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:14.357395 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d15fd779-e401-4fe1-ad74-261b0a00c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:14.368641 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4457/8908] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Jun 18 22:57:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:14.378053 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900902b9-865f-463b-a338-5ce130c13fe3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:14.389300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900902b9-865f-463b-a338-5ce130c13fe3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:14.394704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:14.395414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:14.395692 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:14.395964 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:14.405593 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:14.407246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:14.418214 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4452/8909] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:15.496393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fa6cf-f31e-4278-a733-6600838806c7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:15.496833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fa6cf-f31e-4278-a733-6600838806c7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:15.496978 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fa6cf-f31e-4278-a733-6600838806c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:15.515656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-722fa6cf-f31e-4278-a733-6600838806c7 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:15.516879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-722fa6cf-f31e-4278-a733-6600838806c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:15.524636 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4458/8910] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 22:57:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:15.564949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:15.577025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aaf4e-7274-4434-b367-5b24ac5d533c service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:15.586823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:15.587947 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:15.588451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:15.588958 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:15.599124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:15.600747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:15.609418 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4453/8911] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 22:57:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 22:57:22.703287 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fa6cf-f31e-4278-a733-6600838806c7 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:22.778647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fa6cf-f31e-4278-a733-6600838806c7 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:22.783322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:22.784248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:22.784533 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:22.784811 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] PATH_INFO: `/v3/users/c544eb954e434fbda5d92667d6f4a2a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:22.786053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c544eb954e434fbda5d92667d6f4a2a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:22.788041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:22.843254 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c544eb954e434fbda5d92667d6f4a2a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:22.843840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c544eb954e434fbda5d92667d6f4a2a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:22.857138 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c544eb954e434fbda5d92667d6f4a2a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:22.857874 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c544eb954e434fbda5d92667d6f4a2a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:22.865368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c544eb954e434fbda5d92667d6f4a2a8'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:22.879284 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4459/8912] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:57:22 2022] DELETE /identity/v3/users/c544eb954e434fbda5d92667d6f4a2a8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:57:23.059417 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:23.070937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dbffa-d88b-47fb-9784-1c73ad4f8c01 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:23.111002 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=100 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:23.130095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:23.130971 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:23.131255 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:23.131536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] PATH_INFO: `/v3/projects/f576ae59a362455993f77dfdb870e37a` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:23.132853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f576ae59a362455993f77dfdb870e37a)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:23.134924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:23.184332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f576ae59a362455993f77dfdb870e37a', 'request_id': 'req-da720a3f-7e2d-43f6-9e61-1e506e268576'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.191017 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f576ae59a362455993f77dfdb870e37a', 'request_id': 'req-da720a3f-7e2d-43f6-9e61-1e506e268576'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.200822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f576ae59a362455993f77dfdb870e37a', 'request_id': 'req-da720a3f-7e2d-43f6-9e61-1e506e268576'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.212125 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] The token cache is being invalidate because project f576ae59a362455993f77dfdb870e37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:57:23.212412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.213076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.214748 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4454/8913] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:57:23 2022] DELETE /identity/v3/projects/f576ae59a362455993f77dfdb870e37a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:57:23.219282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:23.220872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:23.234616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67a05-5888-4da8-98b3-7d1136559d7d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:23.273450 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:23.300613 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:23.301554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:23.301842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:23.302118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] PATH_INFO: `/v3/users/991014d5f72743d09f94cedea86312a6` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:23.303368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991014d5f72743d09f94cedea86312a6)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:23.305345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:23.353729 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991014d5f72743d09f94cedea86312a6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.354373 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991014d5f72743d09f94cedea86312a6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.366209 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991014d5f72743d09f94cedea86312a6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.366877 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991014d5f72743d09f94cedea86312a6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.374304 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-e8d4860c-5018-4bc2-8981-2a99d82b4600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991014d5f72743d09f94cedea86312a6'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.389339 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4460/8914] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:57:23 2022] DELETE /identity/v3/users/991014d5f72743d09f94cedea86312a6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:57:23.574109 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:23.575697 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:23.590647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da720a3f-7e2d-43f6-9e61-1e506e268576 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:23.652592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:23.653494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:23.653759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:23.654035 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] PATH_INFO: `/v3/projects/3e3dfa0cf0cb4fcfbe3d9445e3ded939` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:23.655230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3dfa0cf0cb4fcfbe3d9445e3ded939)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:23.657249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:23.705869 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3dfa0cf0cb4fcfbe3d9445e3ded939', 'request_id': 'req-4ed0d06f-9d14-4d69-8053-87019525b7d4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.712326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3dfa0cf0cb4fcfbe3d9445e3ded939', 'request_id': 'req-4ed0d06f-9d14-4d69-8053-87019525b7d4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.721142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3dfa0cf0cb4fcfbe3d9445e3ded939', 'request_id': 'req-4ed0d06f-9d14-4d69-8053-87019525b7d4'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.728219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:23.732302 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] The token cache is being invalidate because project 3e3dfa0cf0cb4fcfbe3d9445e3ded939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 22:57:23.732627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.733787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-4ed0d06f-9d14-4d69-8053-87019525b7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 22:57:23.735375 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4455/8915] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:57:23 2022] DELETE /identity/v3/projects/3e3dfa0cf0cb4fcfbe3d9445e3ded939 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:57:23.740902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297868ef-856e-4a02-9bb0-5a796afec16c None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:23.741417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297868ef-856e-4a02-9bb0-5a796afec16c None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:23.741417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297868ef-856e-4a02-9bb0-5a796afec16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:23.759892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-297868ef-856e-4a02-9bb0-5a796afec16c None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:23.761134 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-297868ef-856e-4a02-9bb0-5a796afec16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:23.822115 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4461/8916] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:23.830216 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0af2-ec3d-485f-a0e6-d625712276a9 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:23.830558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0af2-ec3d-485f-a0e6-d625712276a9 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:23.830859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f0af2-ec3d-485f-a0e6-d625712276a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:23.852788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-924f0af2-ec3d-485f-a0e6-d625712276a9 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:23.854102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-924f0af2-ec3d-485f-a0e6-d625712276a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:23.863403 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4456/8917] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:23.867939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297868ef-856e-4a02-9bb0-5a796afec16c None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:23.878637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297868ef-856e-4a02-9bb0-5a796afec16c None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:23.884452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:23.885187 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:23.885470 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:23.885742 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] PATH_INFO: `/v3/domains` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:23.886478 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91205) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 22:57:23.886782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:23.888405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:23.900908 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4462/8918] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 22:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 18 22:57:23.907096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f0af2-ec3d-485f-a0e6-d625712276a9 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:23.921720 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f0af2-ec3d-485f-a0e6-d625712276a9 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:23.926993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:23.927651 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:23.927939 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:23.928211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:23.928905 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:23.930857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:23.969591 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4457/8919] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:57:23 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:57:23.974465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:23.988475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95d78c-430e-4796-9886-21d71e53034a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.048802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:24.063166 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.063848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.064129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.064400 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.065142 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.067050 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.087838 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4463/8920] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:57:23 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:57:24.092471 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.103501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fe0d4-b895-459c-b595-d26424c279cf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.109224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.109892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.110305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.110676 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.111907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.113566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.124512 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4458/8921] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:57:24.128719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.139932 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1de28-983f-4d56-b575-f741ef01e570 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.145561 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c2b92-a965-47e6-8a52-2ebc59501af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.146226 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c2b92-a965-47e6-8a52-2ebc59501af1 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.146537 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c2b92-a965-47e6-8a52-2ebc59501af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.146812 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c2b92-a965-47e6-8a52-2ebc59501af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.147548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c2b92-a965-47e6-8a52-2ebc59501af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.149204 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c2b92-a965-47e6-8a52-2ebc59501af1 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.159272 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4464/8922] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:57:24.165757 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.179211 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77a3d4-1369-47f9-b10b-559245aee9ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.184573 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.185510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.185789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.186063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] PATH_INFO: `/v3/projects/4ec0cfc75efa4bb1a32bd2a7a44e3390/users/b1e8d5153b9345ee9619fc6dfe6a1033/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.200917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec0cfc75efa4bb1a32bd2a7a44e3390, user_id=b1e8d5153b9345ee9619fc6dfe6a1033, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.203623 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.218481 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4459/8923] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:57:24 2022] PUT /identity/v3/projects/4ec0cfc75efa4bb1a32bd2a7a44e3390/users/b1e8d5153b9345ee9619fc6dfe6a1033/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:57:24.228931 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1af1b-139e-4787-b47a-5c75ffdc4ed6 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.229393 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1af1b-139e-4787-b47a-5c75ffdc4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.229807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1af1b-139e-4787-b47a-5c75ffdc4ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.257086 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-50b1af1b-139e-4787-b47a-5c75ffdc4ed6 None None] MFA Rules not processed for user `b1e8d5153b9345ee9619fc6dfe6a1033`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:24.258354 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-50b1af1b-139e-4787-b47a-5c75ffdc4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:24.324970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4465/8924] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:57:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:24.329635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.394420 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf66178-f017-4ec7-a504-42df788ee6ae admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.399657 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.400315 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.400595 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.400866 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.401632 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.403548 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.431965 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4460/8925] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 22:57:24 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 22:57:24.436163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1af1b-139e-4787-b47a-5c75ffdc4ed6 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.448199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1af1b-139e-4787-b47a-5c75ffdc4ed6 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.513614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.514303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.514578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.514850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] PATH_INFO: `/v3/users` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.515539 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.517544 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.541623 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4466/8926] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 22:57:24 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 22:57:24.542786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.553430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b46f-4243-4357-b30b-a4bc77360c65 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.558001 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.558658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.558933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.559203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.559960 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.561599 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.572520 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4461/8927] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:57:24.576668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.586788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063a375-c937-41b4-86ae-6a1068930e52 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.592129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.592995 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.593294 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.593581 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] PATH_INFO: `/v3/projects/90f344863e8348b89df2edae98c01d9c/users/9f5c532001144f07ba177d1faa7adfa2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.609837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f344863e8348b89df2edae98c01d9c, user_id=9f5c532001144f07ba177d1faa7adfa2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.612527 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.626880 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4467/8928] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:57:24 2022] PUT /identity/v3/projects/90f344863e8348b89df2edae98c01d9c/users/9f5c532001144f07ba177d1faa7adfa2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 22:57:24.631024 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.644264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770c117-b264-4317-adbb-0f7fc62482d2 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.706755 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c089e3-b54e-4ccd-ac13-f540809aca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.707458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c089e3-b54e-4ccd-ac13-f540809aca88 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.707735 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c089e3-b54e-4ccd-ac13-f540809aca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.708014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c089e3-b54e-4ccd-ac13-f540809aca88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.708723 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c089e3-b54e-4ccd-ac13-f540809aca88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.710536 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c089e3-b54e-4ccd-ac13-f540809aca88 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.712924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:24.723184 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4462/8929] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 22:57:24.726797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.737831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8881a2-c484-4541-872f-340703bdbf76 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.743058 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.743949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.744225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.744493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] PATH_INFO: `/v3/projects/90f344863e8348b89df2edae98c01d9c/users/9f5c532001144f07ba177d1faa7adfa2/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.746601 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f344863e8348b89df2edae98c01d9c, user_id=9f5c532001144f07ba177d1faa7adfa2, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:24.749282 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:24.759661 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4468/8930] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 22:57:24 2022] PUT /identity/v3/projects/90f344863e8348b89df2edae98c01d9c/users/9f5c532001144f07ba177d1faa7adfa2/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 22:57:24.770857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.771147 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.771558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:24.799582 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] MFA Rules not processed for user `9f5c532001144f07ba177d1faa7adfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:24.800802 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:24.882651 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4463/8931] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:57:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:24.897213 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:24.899164 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:24.910456 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:24.979084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4767739-1d77-44db-aeaf-239003b3911f admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:24.985350 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620b294-58cf-4282-a4c4-2d2f4e2bf25d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:24.986003 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b294-58cf-4282-a4c4-2d2f4e2bf25d service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:24.986285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b294-58cf-4282-a4c4-2d2f4e2bf25d service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:24.986563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b294-58cf-4282-a4c4-2d2f4e2bf25d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:25.047293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620b294-58cf-4282-a4c4-2d2f4e2bf25d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:25.048894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620b294-58cf-4282-a4c4-2d2f4e2bf25d service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:25.058095 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4469/8932] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:27.847389 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:27.848886 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:27.915430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4843e7b-fe54-4301-b392-4ede70e7e2c4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:27.919355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:27.920021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:27.920329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:27.920605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:27.930474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:27.932038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:27.942363 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4464/8933] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:30.835744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a6cd-dd2f-452c-9596-8384f2c00d1b None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:30.836223 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a6cd-dd2f-452c-9596-8384f2c00d1b None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:30.836469 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a6cd-dd2f-452c-9596-8384f2c00d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:30.863702 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-59a2a6cd-dd2f-452c-9596-8384f2c00d1b None None] MFA Rules not processed for user `b1e8d5153b9345ee9619fc6dfe6a1033`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:57:30.865413 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-59a2a6cd-dd2f-452c-9596-8384f2c00d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:30.875029 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4470/8934] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:57:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:57:31.676973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:31.679430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:31.786507 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4319d0-c7e1-4ca5-b551-1d618bc236ff service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:31.791605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:31.792261 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:31.792554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:31.792830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:31.794926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:31.806933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:31.808531 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:31.818685 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4465/8935] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:33.754894 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2a6cd-dd2f-452c-9596-8384f2c00d1b None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:57:33.766035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2a6cd-dd2f-452c-9596-8384f2c00d1b None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:57:33.770372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:57:33.771196 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:57:33.771412 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:57:33.771860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:57:33.773779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:57:33.788079 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:57:33.791468 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:57:33.808063 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4471/8936] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:57:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:57:41.814747 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=93 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:43.800870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=62 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:58.441567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:58:58.469997 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d136-2ab9-451d-baab-b8e377a74fb9 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:58:58.476859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa135244-89c0-4b65-b680-4553194eef79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:58:58.477566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135244-89c0-4b65-b680-4553194eef79 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:58:58.477851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135244-89c0-4b65-b680-4553194eef79 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:58:58.478127 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135244-89c0-4b65-b680-4553194eef79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:58:58.480121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-aa135244-89c0-4b65-b680-4553194eef79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:58:58.496788 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135244-89c0-4b65-b680-4553194eef79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:58:58.498424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa135244-89c0-4b65-b680-4553194eef79 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:58:58.524382 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4466/8937] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:58:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:00.901392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:59:00.917543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70287c8-ca81-4c16-ae8c-4e46bfce2d81 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:59:00.924295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:59:00.924949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:00.925255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:00.925549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:00.928303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:00.946589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:59:00.947667 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:59:00.966931 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4472/8938] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:59:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:08.506751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=10 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:10.957206 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:11.218711 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63990c1-8cbe-41dc-b295-7a2ffd98d8e8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:11.219301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63990c1-8cbe-41dc-b295-7a2ffd98d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:11.219301 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63990c1-8cbe-41dc-b295-7a2ffd98d8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:11.241698 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-f63990c1-8cbe-41dc-b295-7a2ffd98d8e8 None None] MFA Rules not processed for user `b1e8d5153b9345ee9619fc6dfe6a1033`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:59:11.243620 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-f63990c1-8cbe-41dc-b295-7a2ffd98d8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:11.251898 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4467/8939] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 22:59:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:59:11.950107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:59:11.952120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:11.969573 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca09627-78ff-4584-8cfe-6d32cc02bc8b service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:59:11.974920 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:59:11.975580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:11.975871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:11.976492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:11.978703 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:11.991448 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:59:11.993069 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:59:12.003334 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4473/8940] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:59:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:13.060308 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11bdff-70d6-49d0-9e82-973449977f73 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:13.060764 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11bdff-70d6-49d0-9e82-973449977f73 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:13.061238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11bdff-70d6-49d0-9e82-973449977f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:13.122751 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-ef11bdff-70d6-49d0-9e82-973449977f73 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:59:13.124200 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ef11bdff-70d6-49d0-9e82-973449977f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:13.137064 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4468/8941] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Jun 18 22:59:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:59:13.766396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:59:13.788505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa68c-e85b-4ff3-9cd7-b5b8c9cf793d service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:59:13.792645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b70b1e-bf46-4f15-84a1-1c6a7becd00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:59:13.793430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b70b1e-bf46-4f15-84a1-1c6a7becd00c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:13.793761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b70b1e-bf46-4f15-84a1-1c6a7becd00c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:13.794045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b70b1e-bf46-4f15-84a1-1c6a7becd00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:13.796202 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-99b70b1e-bf46-4f15-84a1-1c6a7becd00c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:13.810377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b70b1e-bf46-4f15-84a1-1c6a7becd00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:59:13.812215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b70b1e-bf46-4f15-84a1-1c6a7becd00c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:59:13.825917 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4474/8942] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:59:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:14.252519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:14.253705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:14.254478 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:14.281195 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:59:14.282442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:14.293167 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4469/8943] 10.222.0.30 () {58 vars in 1058 bytes} [Sat Jun 18 22:59:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:59:17.898808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdb4f-3381-4927-80dc-0eb8670efeaf None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:17.899415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdb4f-3381-4927-80dc-0eb8670efeaf None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:17.899415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdb4f-3381-4927-80dc-0eb8670efeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:17.919582 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-762bdb4f-3381-4927-80dc-0eb8670efeaf None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:59:17.920786 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-762bdb4f-3381-4927-80dc-0eb8670efeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:17.932286 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4475/8944] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:59:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:59:17.943555 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:59:17.945248 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:17.957838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be749c-3115-4bc1-b08e-5044dfbd5ecf None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:59:17.962320 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:59:17.963000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:17.963300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:17.963566 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:17.974959 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:59:17.976419 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:59:17.987673 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4470/8945] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:59:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:19.165991 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae493bd4-54e7-4016-a033-7826ae1259fd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:19.166578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae493bd4-54e7-4016-a033-7826ae1259fd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:19.166578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae493bd4-54e7-4016-a033-7826ae1259fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:19.186232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-ae493bd4-54e7-4016-a033-7826ae1259fd None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:59:19.187449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ae493bd4-54e7-4016-a033-7826ae1259fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:19.202787 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4476/8946] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 22:59:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:59:19.214231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:59:19.224705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce830f-fc4c-4a6a-be7e-56d4b4e4301c service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:59:19.229141 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256a58-1b5c-40a3-bca3-03a1a2625ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:59:19.229807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256a58-1b5c-40a3-bca3-03a1a2625ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:19.230088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256a58-1b5c-40a3-bca3-03a1a2625ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:19.230332 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256a58-1b5c-40a3-bca3-03a1a2625ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:19.242474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256a58-1b5c-40a3-bca3-03a1a2625ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:59:19.243922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256a58-1b5c-40a3-bca3-03a1a2625ca8 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:59:19.255545 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4471/8947] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:59:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:20.253445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae493bd4-54e7-4016-a033-7826ae1259fd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:59:20.266308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae493bd4-54e7-4016-a033-7826ae1259fd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:59:20.272217 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:59:20.272880 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:20.273190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:20.273465 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:20.275343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:20.290816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:59:20.292406 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:59:20.306170 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4477/8948] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:59:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:24.067641 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79143517-79ef-4d06-9780-f5ef267e48e7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:24.068166 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79143517-79ef-4d06-9780-f5ef267e48e7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:24.068266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79143517-79ef-4d06-9780-f5ef267e48e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:24.114743 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-79143517-79ef-4d06-9780-f5ef267e48e7 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 22:59:24.115917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-79143517-79ef-4d06-9780-f5ef267e48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 22:59:24.122582 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4472/8949] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Jun 18 22:59:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 22:59:24.134260 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 22:59:24.143593 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0918d-4eee-4afd-9231-f372c12c122e service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 22:59:24.147281 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 22:59:24.147925 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 22:59:24.148203 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 22:59:24.148474 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 22:59:24.156566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 22:59:24.158044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 22:59:24.166388 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4478/8950] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 22:59:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 22:59:34.112137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=36 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:34.163040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=34 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:39.734233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28558fd-177b-4ff9-a4c8-61dc38193834 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:39.734790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28558fd-177b-4ff9-a4c8-61dc38193834 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:39.734790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28558fd-177b-4ff9-a4c8-61dc38193834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:39.753773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a28558fd-177b-4ff9-a4c8-61dc38193834 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:00:39.754980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a28558fd-177b-4ff9-a4c8-61dc38193834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:00:39.764551 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4473/8951] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:00:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:00:39.777266 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:00:39.791461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65375d26-200f-41f8-bae3-5317d6f5a960 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:00:39.797592 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:00:39.798236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:39.798519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:39.798788 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:39.808693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:00:39.810444 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:00:39.821778 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4479/8952] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:00:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:00:44.395888 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36196b-c814-49a2-bec7-475b52d3ca06 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:44.396401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36196b-c814-49a2-bec7-475b52d3ca06 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:44.396401 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36196b-c814-49a2-bec7-475b52d3ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:44.435242 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-2d36196b-c814-49a2-bec7-475b52d3ca06 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:00:44.436518 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2d36196b-c814-49a2-bec7-475b52d3ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:00:44.460024 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4474/8953] 10.222.0.30 () {58 vars in 1057 bytes} [Sat Jun 18 23:00:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:00:44.466647 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:00:44.478482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe664b8-ec84-40d5-961b-a9be7e74ab18 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:00:44.484057 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca143d-589e-49e7-8681-31489b1c3c22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:00:44.484792 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca143d-589e-49e7-8681-31489b1c3c22 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:44.485215 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca143d-589e-49e7-8681-31489b1c3c22 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:44.485617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca143d-589e-49e7-8681-31489b1c3c22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:44.487473 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-93ca143d-589e-49e7-8681-31489b1c3c22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:00:44.506055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca143d-589e-49e7-8681-31489b1c3c22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:00:44.507884 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca143d-589e-49e7-8681-31489b1c3c22 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:00:44.521205 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4480/8954] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:00:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:00:49.959070 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934758c-54dc-4e95-a7d1-ea8ac2cf70b3 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:49.959638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934758c-54dc-4e95-a7d1-ea8ac2cf70b3 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:49.959638 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934758c-54dc-4e95-a7d1-ea8ac2cf70b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:49.978685 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c934758c-54dc-4e95-a7d1-ea8ac2cf70b3 None None] MFA Rules not processed for user `b1e8d5153b9345ee9619fc6dfe6a1033`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:00:49.979918 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c934758c-54dc-4e95-a7d1-ea8ac2cf70b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:00:49.987433 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4475/8955] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:00:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 23:00:50.308755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6440f-0558-41dd-9a35-bbff876cb6a7 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:50.309399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6440f-0558-41dd-9a35-bbff876cb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:50.309399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6440f-0558-41dd-9a35-bbff876cb6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:50.335775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-b7a6440f-0558-41dd-9a35-bbff876cb6a7 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:00:50.337176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b7a6440f-0558-41dd-9a35-bbff876cb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:00:50.345394 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4481/8956] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 23:00:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:00:50.358722 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934758c-54dc-4e95-a7d1-ea8ac2cf70b3 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:00:50.369900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934758c-54dc-4e95-a7d1-ea8ac2cf70b3 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:00:50.374890 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:00:50.375919 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:50.376293 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:50.376665 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:50.385547 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:00:50.387456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:00:50.397062 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4476/8957] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:00:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:00:53.205970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71dc5-97c3-4219-9617-cd6d79246cc0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:53.206542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71dc5-97c3-4219-9617-cd6d79246cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:53.207136 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71dc5-97c3-4219-9617-cd6d79246cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:53.251321 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-32b71dc5-97c3-4219-9617-cd6d79246cc0 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:00:53.252917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32b71dc5-97c3-4219-9617-cd6d79246cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:00:53.261806 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4482/8958] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Jun 18 23:00:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:00:53.272840 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:00:53.284994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fe8c2-e213-4371-9a21-fcc1b38ba3b0 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:00:53.290523 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:00:53.291410 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:00:53.291827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:00:53.292239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:00:53.301759 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:00:53.304037 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:00:53.323976 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4477/8959] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:00:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:01:01.733518 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221eb89-a758-47fb-baa6-9a1e17746cd9 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:01:01.734061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221eb89-a758-47fb-baa6-9a1e17746cd9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:01:01.734061 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221eb89-a758-47fb-baa6-9a1e17746cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:01:01.756207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-e221eb89-a758-47fb-baa6-9a1e17746cd9 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:01:01.757486 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-e221eb89-a758-47fb-baa6-9a1e17746cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:01:01.768102 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4483/8960] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:01:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:01:01.784287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:01:01.797647 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd406b74-bf33-4a52-8f5d-783ba0ebae87 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:01:01.803267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:01:01.803917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:01:01.804408 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:01:01.804690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:01:01.814089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:01:01.815701 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:01:01.826232 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4478/8961] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:01:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:01:06.092872 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f391e4-dcd0-467b-8ec9-b1fcd220cdab None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:01:06.093440 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f391e4-dcd0-467b-8ec9-b1fcd220cdab None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:01:06.093535 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f391e4-dcd0-467b-8ec9-b1fcd220cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:01:06.103636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=22 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:06.123447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-22f391e4-dcd0-467b-8ec9-b1fcd220cdab None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:01:06.124886 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-22f391e4-dcd0-467b-8ec9-b1fcd220cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:01:06.135970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4484/8962] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:01:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:01:06.148828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:01:06.154831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=38 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:06.164160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eade12-7012-4309-978a-4204485cb8c1 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:01:06.171092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:01:06.172235 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:01:06.172827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:01:06.173341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:01:06.185079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:01:06.186776 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:01:06.198937 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4479/8963] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:01:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:01:16.118021 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=2 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:16.195439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:07.422009 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f391e4-dcd0-467b-8ec9-b1fcd220cdab None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:02:07.468247 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f391e4-dcd0-467b-8ec9-b1fcd220cdab None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:02:07.473917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3fda8-4a28-49c2-96ac-4b631722d5cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:02:07.474576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3fda8-4a28-49c2-96ac-4b631722d5cb service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:07.474860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3fda8-4a28-49c2-96ac-4b631722d5cb service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:07.475139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3fda8-4a28-49c2-96ac-4b631722d5cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:07.476982 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-ffb3fda8-4a28-49c2-96ac-4b631722d5cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:02:07.508728 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3fda8-4a28-49c2-96ac-4b631722d5cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:02:07.510399 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3fda8-4a28-49c2-96ac-4b631722d5cb service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:02:07.520356 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4485/8964] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:02:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:02:16.985143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:02:17.006399 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2441eef-8bd3-4b0a-96ea-46065a409bb6 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:02:17.010221 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06475bbc-dbce-4660-aa81-dc7563402700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:02:17.010977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475bbc-dbce-4660-aa81-dc7563402700 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:17.011326 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475bbc-dbce-4660-aa81-dc7563402700 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:17.011691 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475bbc-dbce-4660-aa81-dc7563402700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:17.013770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-06475bbc-dbce-4660-aa81-dc7563402700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:02:17.026909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475bbc-dbce-4660-aa81-dc7563402700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:02:17.028675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475bbc-dbce-4660-aa81-dc7563402700 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:02:17.041541 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4480/8965] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:02:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:02:17.161580 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc56ee-a2da-4787-9b97-fa311b7279c9 None None] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:17.162165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc56ee-a2da-4787-9b97-fa311b7279c9 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:17.162165 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc56ee-a2da-4787-9b97-fa311b7279c9 None None] PATH_INFO: `/` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:17.163562 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4486/8966] 10.222.0.30 () {54 vars in 921 bytes} [Sat Jun 18 23:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 18 23:02:17.168727 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b262be-6b8b-4634-8e2c-5f9ca04d1aff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:17.169079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b262be-6b8b-4634-8e2c-5f9ca04d1aff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:17.169375 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b262be-6b8b-4634-8e2c-5f9ca04d1aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:17.190557 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-40b262be-6b8b-4634-8e2c-5f9ca04d1aff None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:02:17.191766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-40b262be-6b8b-4634-8e2c-5f9ca04d1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:02:17.200640 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4481/8967] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:02:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 23:02:17.223977 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc56ee-a2da-4787-9b97-fa311b7279c9 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:02:17.237969 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc56ee-a2da-4787-9b97-fa311b7279c9 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:02:17.243261 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:02:17.243915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:17.244178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:17.244449 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:17.252801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:02:17.254428 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:02:17.263914 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4487/8968] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:02:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:02:17.465643 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b262be-6b8b-4634-8e2c-5f9ca04d1aff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:02:17.476355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b262be-6b8b-4634-8e2c-5f9ca04d1aff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:02:17.480914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:02:17.481613 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:17.481895 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:17.482182 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:17.484278 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:02:17.501286 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:02:17.502725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:02:17.518931 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4482/8969] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:02:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:02:17.913328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:02:17.923984 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a3f8-91a1-4981-b000-257131850ecc service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:02:17.929998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b2a7-aef6-40e4-b9cd-e66197f54043 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:02:17.930637 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b2a7-aef6-40e4-b9cd-e66197f54043 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:17.930919 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b2a7-aef6-40e4-b9cd-e66197f54043 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:17.931190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b2a7-aef6-40e4-b9cd-e66197f54043 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:17.933064 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-b8a0b2a7-aef6-40e4-b9cd-e66197f54043 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:02:17.945053 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b2a7-aef6-40e4-b9cd-e66197f54043 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:02:17.946675 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b2a7-aef6-40e4-b9cd-e66197f54043 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:02:17.956721 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4488/8970] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:02:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:02:25.290370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:02:25.304108 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c644-4046-4a8f-aaf7-f59d6344a0ae service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:02:25.311592 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:02:25.312042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:02:25.312323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:02:25.312594 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:02:25.321712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:02:25.323307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:02:25.332786 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4483/8971] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:02:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:02:27.952816 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=40 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:35.328440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=26 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:11.850060 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cf9b5-ad44-4228-9f25-cb158cd1f0f0 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:03:11.850649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cf9b5-ad44-4228-9f25-cb158cd1f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:03:11.850649 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cf9b5-ad44-4228-9f25-cb158cd1f0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:03:11.872274 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-370cf9b5-ad44-4228-9f25-cb158cd1f0f0 None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:03:11.873552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-370cf9b5-ad44-4228-9f25-cb158cd1f0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:03:11.884483 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4489/8972] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:03:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:03:11.910270 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:03:11.923457 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6833-31e6-4932-bd15-f46856e11875 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:03:11.932481 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab507ea-50af-4cdd-b85f-267a479370cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:03:11.933411 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab507ea-50af-4cdd-b85f-267a479370cc service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:03:11.933864 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab507ea-50af-4cdd-b85f-267a479370cc service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:03:11.934295 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab507ea-50af-4cdd-b85f-267a479370cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:03:11.949774 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab507ea-50af-4cdd-b85f-267a479370cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:03:11.951412 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab507ea-50af-4cdd-b85f-267a479370cc service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:03:11.962835 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4484/8973] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:03:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:03:15.294644 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cf9b5-ad44-4228-9f25-cb158cd1f0f0 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:03:15.304793 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cf9b5-ad44-4228-9f25-cb158cd1f0f0 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:03:15.309227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdd702-862d-4e6b-ae1d-ac6ccb9a0e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:03:15.309998 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd702-862d-4e6b-ae1d-ac6ccb9a0e19 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:03:15.310506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd702-862d-4e6b-ae1d-ac6ccb9a0e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:03:15.310915 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdd702-862d-4e6b-ae1d-ac6ccb9a0e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:03:15.320761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdd702-862d-4e6b-ae1d-ac6ccb9a0e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:03:15.322257 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdd702-862d-4e6b-ae1d-ac6ccb9a0e19 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:03:15.332087 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4490/8974] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:03:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:03:18.032256 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1eba5-56a5-4099-8823-f9b9b4352ac8 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:03:18.032827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1eba5-56a5-4099-8823-f9b9b4352ac8 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:03:18.032827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1eba5-56a5-4099-8823-f9b9b4352ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:03:18.057285 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-65f1eba5-56a5-4099-8823-f9b9b4352ac8 None None] MFA Rules not processed for user `b1e8d5153b9345ee9619fc6dfe6a1033`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:03:18.058724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-65f1eba5-56a5-4099-8823-f9b9b4352ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:03:18.066790 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4485/8975] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:03:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:03:18.406761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5da5-4163-442f-a951-0180c7e485ac None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:03:18.407291 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5da5-4163-442f-a951-0180c7e485ac None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:03:18.407396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5da5-4163-442f-a951-0180c7e485ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:03:18.439415 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-637d5da5-4163-442f-a951-0180c7e485ac None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:03:18.440556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-637d5da5-4163-442f-a951-0180c7e485ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:03:18.448535 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4491/8976] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 23:03:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:03:18.461265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1eba5-56a5-4099-8823-f9b9b4352ac8 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:03:18.471911 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1eba5-56a5-4099-8823-f9b9b4352ac8 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:03:18.476042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:03:18.476836 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:03:18.477225 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:03:18.477609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:03:18.487264 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:03:18.488798 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:03:18.498100 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4486/8977] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:03:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:03:18.890359 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d5da5-4163-442f-a951-0180c7e485ac None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:03:18.903278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d5da5-4163-442f-a951-0180c7e485ac None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:03:18.909923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:03:18.910939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:03:18.911098 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:03:18.911407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:03:18.929369 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:03:18.931210 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:03:18.948007 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4492/8978] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:03:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:03:28.494795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=15 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:28.940244 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=22 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:44.972183 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:04:44.980946 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53744668-6bf9-4588-9151-07ba9e6df0ed service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:04:44.985832 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:04:44.986859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:04:44.987309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:04:44.988039 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:04:44.998121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:04:44.999884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:04:45.008792 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4487/8979] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:04:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:04:45.107879 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:04:45.117696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f715d0-4fb2-4098-9006-2d11f4d83e5f service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:04:45.121934 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78760-d101-4bcc-ae27-adeb2dd9aa21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:04:45.122808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78760-d101-4bcc-ae27-adeb2dd9aa21 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:04:45.123175 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78760-d101-4bcc-ae27-adeb2dd9aa21 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:04:45.123545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78760-d101-4bcc-ae27-adeb2dd9aa21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:04:45.143027 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78760-d101-4bcc-ae27-adeb2dd9aa21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:04:45.144671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78760-d101-4bcc-ae27-adeb2dd9aa21 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:04:45.156823 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4493/8980] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:04:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:04:46.343031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:04:46.352140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ec37a-dcb9-4211-91b1-ed44575722bb service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:04:46.356196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:04:46.356851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:04:46.357162 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:04:46.357442 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:04:46.368239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:04:46.369749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:04:46.380786 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4488/8981] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:04:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:04:55.151690 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=9 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:56.376069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=12 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:57.715461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7ca0-e9c3-4cc0-b86d-0ae75002f0c3 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:04:57.715946 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7ca0-e9c3-4cc0-b86d-0ae75002f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:04:57.716045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7ca0-e9c3-4cc0-b86d-0ae75002f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:04:57.735550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-a91b7ca0-e9c3-4cc0-b86d-0ae75002f0c3 None None] MFA Rules not processed for user `b1e8d5153b9345ee9619fc6dfe6a1033`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:04:57.736775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-a91b7ca0-e9c3-4cc0-b86d-0ae75002f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:04:57.744012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4494/8982] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:04:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:04:58.466893 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:04:58.484791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3161c-5a7b-480f-9c63-d370539b5b15 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:04:58.491143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:04:58.492719 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:04:58.493395 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:04:58.495114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:04:58.510660 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:04:58.513324 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:04:58.544385 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4489/8983] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:04:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:05:07.729866 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:08.538143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:48.836779 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b7ca0-e9c3-4cc0-b86d-0ae75002f0c3 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:48.852072 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b7ca0-e9c3-4cc0-b86d-0ae75002f0c3 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:48.859019 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c1669-430d-4a2a-9429-799278389616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:48.859736 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c1669-430d-4a2a-9429-799278389616 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:48.860035 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c1669-430d-4a2a-9429-799278389616 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:48.860343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c1669-430d-4a2a-9429-799278389616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:48.870099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c1669-430d-4a2a-9429-799278389616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:48.871706 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c1669-430d-4a2a-9429-799278389616 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:48.882515 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4495/8984] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:05:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:05:53.675191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:53.758205 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626338b-9e9c-4bfc-8332-df6102822db7 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:53.763317 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:53.764174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:53.764464 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:53.764738 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] PATH_INFO: `/v3/users/b1e8d5153b9345ee9619fc6dfe6a1033` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:53.766013 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e8d5153b9345ee9619fc6dfe6a1033)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:53.767992 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:53.819414 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e8d5153b9345ee9619fc6dfe6a1033'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:53.819993 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e8d5153b9345ee9619fc6dfe6a1033'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:53.831941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e8d5153b9345ee9619fc6dfe6a1033'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:53.832577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e8d5153b9345ee9619fc6dfe6a1033'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:53.839494 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e8d5153b9345ee9619fc6dfe6a1033'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:53.854062 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4490/8985] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 23:05:53 2022] DELETE /identity/v3/users/b1e8d5153b9345ee9619fc6dfe6a1033 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:05:53.858958 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:53.859452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:53.859550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:53.898041 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:05:53.899295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:53.960901 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4496/8986] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 18 23:05:53.971712 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:53.973355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:54.053140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5a9b2-5a8e-4425-a6c8-0311547ecfaf admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:54.058370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:54.059429 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:54.059829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:54.060113 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:54.066465 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:54.072407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:54.073941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:54.093183 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4491/8987] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:05:54.276263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:54.277753 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:54.290091 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2628a6-0001-4311-82a0-4ca350fe6a4f None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:54.295032 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:54.295862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:54.296146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:54.296441 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] PATH_INFO: `/v3/projects/4ec0cfc75efa4bb1a32bd2a7a44e3390` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:54.297733 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec0cfc75efa4bb1a32bd2a7a44e3390)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:54.299670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:54.351921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'request_id': 'req-03df0311-4657-4b79-a2f5-355a2597362c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.358521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'request_id': 'req-03df0311-4657-4b79-a2f5-355a2597362c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.368276 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'request_id': 'req-03df0311-4657-4b79-a2f5-355a2597362c'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.379001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] The token cache is being invalidate because project 4ec0cfc75efa4bb1a32bd2a7a44e3390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 23:05:54.379299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.379948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.381642 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4497/8988] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 23:05:54 2022] DELETE /identity/v3/projects/4ec0cfc75efa4bb1a32bd2a7a44e3390 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:05:54.385801 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:54.395922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac0ab1-19d8-4f57-8b65-d8807cf2141b service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:54.461387 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:54.462297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:54.462576 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:54.462850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] PATH_INFO: `/v3/users/9f5c532001144f07ba177d1faa7adfa2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:54.464124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5c532001144f07ba177d1faa7adfa2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:54.466514 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:54.519492 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5c532001144f07ba177d1faa7adfa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.520212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5c532001144f07ba177d1faa7adfa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.537163 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5c532001144f07ba177d1faa7adfa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.537923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5c532001144f07ba177d1faa7adfa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.545937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-6f4a873e-050a-4951-982f-aee69d763591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5c532001144f07ba177d1faa7adfa2'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.561381 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4492/8989] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 23:05:54 2022] DELETE /identity/v3/users/9f5c532001144f07ba177d1faa7adfa2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 23:05:54.846268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:54.847870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:54.862327 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df0311-4657-4b79-a2f5-355a2597362c admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:54.913634 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:54.924589 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:54.925662 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:54.926174 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:54.926525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] PATH_INFO: `/v3/projects/90f344863e8348b89df2edae98c01d9c` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:54.927888 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f344863e8348b89df2edae98c01d9c)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:54.929876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:54.976227 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f344863e8348b89df2edae98c01d9c', 'request_id': 'req-c533f311-4cfa-4f8d-b744-b69d1742cfba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.982280 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f344863e8348b89df2edae98c01d9c', 'request_id': 'req-c533f311-4cfa-4f8d-b744-b69d1742cfba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:54.990859 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f344863e8348b89df2edae98c01d9c', 'request_id': 'req-c533f311-4cfa-4f8d-b744-b69d1742cfba'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:55.001972 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] The token cache is being invalidate because project 90f344863e8348b89df2edae98c01d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 23:05:55.002255 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:55.002955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-c533f311-4cfa-4f8d-b744-b69d1742cfba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:05:55.004588 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4498/8990] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 23:05:54 2022] DELETE /identity/v3/projects/90f344863e8348b89df2edae98c01d9c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:05:55.010030 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e06fa-332e-4b05-8dee-c83fe59791c0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.010565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e06fa-332e-4b05-8dee-c83fe59791c0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.010565 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e06fa-332e-4b05-8dee-c83fe59791c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.052924 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-352e06fa-332e-4b05-8dee-c83fe59791c0 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:05:55.054218 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-352e06fa-332e-4b05-8dee-c83fe59791c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:55.105307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:55.116379 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4493/8991] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:05:55.125286 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e20d61-3b69-4a0c-9c24-98e98c3b0013 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.125515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e20d61-3b69-4a0c-9c24-98e98c3b0013 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.125819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e20d61-3b69-4a0c-9c24-98e98c3b0013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.144704 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-42e20d61-3b69-4a0c-9c24-98e98c3b0013 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:05:55.146001 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-42e20d61-3b69-4a0c-9c24-98e98c3b0013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:55.154545 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4499/8992] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:05:55.158787 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e06fa-332e-4b05-8dee-c83fe59791c0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:55.168977 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e06fa-332e-4b05-8dee-c83fe59791c0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:55.174472 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:55.175124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.175440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.175745 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.176545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 23:05:55.176857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:55.178519 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:55.190468 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4494/8993] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 23:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 23:05:55.194939 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e20d61-3b69-4a0c-9c24-98e98c3b0013 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:55.204801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e20d61-3b69-4a0c-9c24-98e98c3b0013 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:55.210627 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:55.211284 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.211566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.211839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.212526 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:55.214483 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:55.241418 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4500/8994] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 23:05:55 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 23:05:55.245705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:55.255979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615227ed-c153-4195-9c22-4cf5f1efdaf6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:55.316138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:55.316822 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.317120 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.317425 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.318121 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:55.320038 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:55.342567 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4495/8995] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 23:05:55 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 23:05:55.345212 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:55.355839 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a5d29-7c32-4492-bb99-39d5980155fe admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:55.360636 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:55.361342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.361625 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.361900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.362631 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:55.364368 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:55.375179 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4501/8996] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 23:05:55.379404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:55.389739 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05e3a3-68ae-4269-b48d-1dc20ad1c7f6 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:55.394914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29decde5-d719-43c9-b395-d2b596e5b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:55.394914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29decde5-d719-43c9-b395-d2b596e5b71b admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.394914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29decde5-d719-43c9-b395-d2b596e5b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.394914 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29decde5-d719-43c9-b395-d2b596e5b71b admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.397444 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29decde5-d719-43c9-b395-d2b596e5b71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:55.398663 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29decde5-d719-43c9-b395-d2b596e5b71b admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:55.409145 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4496/8997] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 23:05:55.413557 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:55.423819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c7b53-a911-456d-a690-12a5ca942b72 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:55.428921 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:55.429843 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.430099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.430405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] PATH_INFO: `/v3/projects/cf0a1057e25d41ca9225c5e5072f17a9/users/62490dbd2f174221b6dda00ce8c3e916/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.445176 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0a1057e25d41ca9225c5e5072f17a9, user_id=62490dbd2f174221b6dda00ce8c3e916, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:55.447887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:55.461937 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4502/8998] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 23:05:55 2022] PUT /identity/v3/projects/cf0a1057e25d41ca9225c5e5072f17a9/users/62490dbd2f174221b6dda00ce8c3e916/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:05:55.467842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e481c8-cafb-4938-940e-3a0db09ed62d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.468138 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e481c8-cafb-4938-940e-3a0db09ed62d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.468406 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e481c8-cafb-4938-940e-3a0db09ed62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.488511 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-36e481c8-cafb-4938-940e-3a0db09ed62d None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:05:55.489969 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-36e481c8-cafb-4938-940e-3a0db09ed62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:55.551827 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4497/8999] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:05:55.562542 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:55.565189 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:55.631847 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9b41b-3549-4263-8b2b-d28ee254512d admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:55.636320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:55.636968 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:55.637289 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:55.637566 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:55.647278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:55.648719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:05:55.658601 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4503/9000] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:05:59.841079 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a4ca-2150-4b7d-81e6-d703b3deb5ff None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:59.841644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a4ca-2150-4b7d-81e6-d703b3deb5ff None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:59.841767 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293a4ca-2150-4b7d-81e6-d703b3deb5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:59.870424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0293a4ca-2150-4b7d-81e6-d703b3deb5ff None None] MFA Rules not processed for user `62490dbd2f174221b6dda00ce8c3e916`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:05:59.871606 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0293a4ca-2150-4b7d-81e6-d703b3deb5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:05:59.934066 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:59.948987 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4498/9001] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:05:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:05:59.953979 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:05:59.964097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c81a6-abb5-4e6a-bff3-24e9114effb9 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:05:59.969797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:05:59.970492 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:05:59.970772 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:05:59.971045 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:05:59.971748 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:05:59.973801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:00.004552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:00.015613 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4504/9002] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 23:05:59 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 23:06:00.017407 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293a4ca-2150-4b7d-81e6-d703b3deb5ff None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:00.032839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293a4ca-2150-4b7d-81e6-d703b3deb5ff None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:00.094921 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:00.095614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:00.095885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:00.096159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:00.096954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:00.099000 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:00.122776 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4499/9003] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 23:06:00 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 23:06:00.127467 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:00.139522 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbd1db-cd70-4b82-96d7-adbfbadebad9 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:00.144668 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:00.145433 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:00.145714 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:00.145989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:00.146719 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:00.148328 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:00.159776 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4505/9004] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 23:06:00.164144 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:00.175004 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519838f-48c5-4e3b-b2f6-f6b32fd77dce admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:00.181089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:00.181999 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:00.182309 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:00.182579 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] PATH_INFO: `/v3/projects/52b626d7008b4ceaa4648c76fa698ce3/users/ad59ca83ae97460e88fa9a0298d9f61d/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:00.199540 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b626d7008b4ceaa4648c76fa698ce3, user_id=ad59ca83ae97460e88fa9a0298d9f61d, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:00.202342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:00.218345 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4500/9005] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 23:06:00 2022] PUT /identity/v3/projects/52b626d7008b4ceaa4648c76fa698ce3/users/ad59ca83ae97460e88fa9a0298d9f61d/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:06:00.222676 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:00.233741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdef1b-b184-45b8-a1f7-6d8b416de66b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:00.292135 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a04410-ec47-446e-8ee2-04aa76322da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:00.292807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a04410-ec47-446e-8ee2-04aa76322da6 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:00.293094 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a04410-ec47-446e-8ee2-04aa76322da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:00.293389 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a04410-ec47-446e-8ee2-04aa76322da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:00.294111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a04410-ec47-446e-8ee2-04aa76322da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:00.295734 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a04410-ec47-446e-8ee2-04aa76322da6 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:00.305933 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4506/9006] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 23:06:00.310554 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:00.321635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcf256-1425-4142-8917-f728fc9868ef admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:00.326749 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:00.327640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:00.327917 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:00.328191 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] PATH_INFO: `/v3/projects/52b626d7008b4ceaa4648c76fa698ce3/users/ad59ca83ae97460e88fa9a0298d9f61d/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:00.330284 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b626d7008b4ceaa4648c76fa698ce3, user_id=ad59ca83ae97460e88fa9a0298d9f61d, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:00.332963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:00.343926 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4501/9007] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 23:06:00 2022] PUT /identity/v3/projects/52b626d7008b4ceaa4648c76fa698ce3/users/ad59ca83ae97460e88fa9a0298d9f61d/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:06:04.919107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f010-a97d-42f0-9c00-5106daebe050 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:04.919656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f010-a97d-42f0-9c00-5106daebe050 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:04.919656 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f010-a97d-42f0-9c00-5106daebe050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:04.952842 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-f4e3f010-a97d-42f0-9c00-5106daebe050 None None] MFA Rules not processed for user `ad59ca83ae97460e88fa9a0298d9f61d`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:06:04.954285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-f4e3f010-a97d-42f0-9c00-5106daebe050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:06:05.088380 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:05.091585 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:06:05.100316 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4507/9008] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:06:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:06:05.199355 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0067df-d89a-4dd5-809f-ba2cd853d0b4 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:05.205356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:05.206007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:05.206287 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:05.206561 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:05.256726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:05.298690 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:05.301169 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:05.314129 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4502/9009] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:06:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:06:06.371385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:06.371871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:06.371871 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:06.392887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] MFA Rules not processed for user `62490dbd2f174221b6dda00ce8c3e916`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:06:06.394162 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:06:06.402165 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4508/9010] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:06:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:06:15.307750 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=13 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:16.387258 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=71 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:18.363500 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:18.378124 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e500a-960d-43e6-b673-072ab3c72c01 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:18.385274 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:18.386022 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:18.386373 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:18.386726 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:18.388659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:06:18.402325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:18.404057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:18.416034 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4503/9011] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:06:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:06:21.078195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:21.080251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:06:21.137263 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bfbc-e89c-42e4-9d20-11ff1167be7e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:21.141245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:21.141900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:21.142173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:21.142457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:21.151756 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:21.153234 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:21.163300 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4509/9012] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:06:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:06:23.166926 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:06:23.168341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:06:23.182529 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584336d-0842-4b4c-9d37-910d91966a0c service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:06:23.188327 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:06:23.188983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:06:23.189297 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:06:23.189571 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:06:23.191404 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:06:23.204449 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:06:23.206110 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:06:23.218750 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4504/9013] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:06:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:06:31.158903 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=26 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:33.213376 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=12 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:07:16.374499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:07:16.376118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:07:16.458326 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f886c-d840-4e28-84b5-814aaf900d6c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:07:16.465396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580beea-c839-44cf-8cc3-27b642d9bee6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:07:16.466051 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580beea-c839-44cf-8cc3-27b642d9bee6 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:07:16.466331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580beea-c839-44cf-8cc3-27b642d9bee6 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:07:16.466677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580beea-c839-44cf-8cc3-27b642d9bee6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:07:16.468705 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3580beea-c839-44cf-8cc3-27b642d9bee6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:07:16.481055 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580beea-c839-44cf-8cc3-27b642d9bee6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:07:16.482669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580beea-c839-44cf-8cc3-27b642d9bee6 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:07:16.494326 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4510/9014] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:07:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:07:26.488908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=37 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:01.139350 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:01.141075 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:01.156103 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79197dd-7227-41c3-b79f-bdcf91d0681c service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:01.162650 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:01.163325 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:01.163615 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:01.163889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:01.166021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:01.178424 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:01.179953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:01.190589 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4505/9015] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:08:11.186345 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:30.141139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75e1c-fbd3-4f19-ad28-a6fdf4e2261e None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:30.141809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75e1c-fbd3-4f19-ad28-a6fdf4e2261e None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:30.141809 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75e1c-fbd3-4f19-ad28-a6fdf4e2261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:30.205696 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-36b75e1c-fbd3-4f19-ad28-a6fdf4e2261e None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:08:30.206908 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-36b75e1c-fbd3-4f19-ad28-a6fdf4e2261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:30.276918 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4511/9016] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 23:08:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:08:30.327046 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:30.328577 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:30.427304 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde143-6ff6-41c8-b5df-fc56c0693908 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:30.433610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5c4ed-7af5-4b11-9bd5-3d6cbf9bfe79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:30.434253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c4ed-7af5-4b11-9bd5-3d6cbf9bfe79 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:30.434530 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c4ed-7af5-4b11-9bd5-3d6cbf9bfe79 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:30.434808 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c4ed-7af5-4b11-9bd5-3d6cbf9bfe79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:30.444263 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5c4ed-7af5-4b11-9bd5-3d6cbf9bfe79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:30.445889 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5c4ed-7af5-4b11-9bd5-3d6cbf9bfe79 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:30.454515 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4506/9017] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:08:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 23:08:40.274141 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=44 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:40.450803 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=41 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:42.865553 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75e1c-fbd3-4f19-ad28-a6fdf4e2261e None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:42.875303 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75e1c-fbd3-4f19-ad28-a6fdf4e2261e None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:42.879864 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5ebba-0c90-4cd7-98a9-2b57a7b071a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:42.880607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5ebba-0c90-4cd7-98a9-2b57a7b071a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:42.881076 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5ebba-0c90-4cd7-98a9-2b57a7b071a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:42.881360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5ebba-0c90-4cd7-98a9-2b57a7b071a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:42.883429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-10e5ebba-0c90-4cd7-98a9-2b57a7b071a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:42.893901 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5ebba-0c90-4cd7-98a9-2b57a7b071a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:42.895345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5ebba-0c90-4cd7-98a9-2b57a7b071a8 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:42.903742 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4512/9018] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:08:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:08:43.018834 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa1ff-2a22-48eb-bf06-25a2e2fbb2db None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:43.019306 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa1ff-2a22-48eb-bf06-25a2e2fbb2db None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:43.019402 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa1ff-2a22-48eb-bf06-25a2e2fbb2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:43.039766 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-022fa1ff-2a22-48eb-bf06-25a2e2fbb2db None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:08:43.041051 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-022fa1ff-2a22-48eb-bf06-25a2e2fbb2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:43.051294 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4507/9019] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:08:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:08:43.062454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb415-f622-4488-ac3f-33959cd43458 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:43.062848 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb415-f622-4488-ac3f-33959cd43458 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:43.063188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb415-f622-4488-ac3f-33959cd43458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:43.119096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-66eeb415-f622-4488-ac3f-33959cd43458 None None] MFA Rules not processed for user `14f94931805a4215b22237194803d41c`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:08:43.120496 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-66eeb415-f622-4488-ac3f-33959cd43458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:43.184259 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4513/9020] 10.222.0.30 () {58 vars in 1059 bytes} [Sat Jun 18 23:08:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:08:43.190545 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fa1ff-2a22-48eb-bf06-25a2e2fbb2db None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:43.200069 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fa1ff-2a22-48eb-bf06-25a2e2fbb2db None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:43.204358 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:43.204994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:43.205300 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:43.205572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:43.216567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:43.218036 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:43.228964 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4508/9021] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:08:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:08:43.293840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093551ef-98ef-4d9d-9845-52ed9c45bd97 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:43.294129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093551ef-98ef-4d9d-9845-52ed9c45bd97 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:43.294427 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093551ef-98ef-4d9d-9845-52ed9c45bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:43.317508 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-093551ef-98ef-4d9d-9845-52ed9c45bd97 None None] MFA Rules not processed for user `9765a70014c74e61a93f84c801a10fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:08:43.318890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-093551ef-98ef-4d9d-9845-52ed9c45bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:43.326064 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4514/9022] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:08:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:08:43.343266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:43.356844 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501783c-a7c6-4e76-8cf9-94fee256d369 service glance] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:43.363415 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:43.364259 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:43.364569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:43.364902 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:43.376102 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:43.378230 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:43.386315 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4509/9023] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:08:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:08:43.463552 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd113-92f3-4cc1-8224-246459b03e42 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:43.464178 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd113-92f3-4cc1-8224-246459b03e42 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:43.464472 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd113-92f3-4cc1-8224-246459b03e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:43.484808 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-73abd113-92f3-4cc1-8224-246459b03e42 None None] MFA Rules not processed for user `578ca3087f9442d88152f65fad464f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:08:43.486074 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-73abd113-92f3-4cc1-8224-246459b03e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:43.497518 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4515/9024] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:08:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:08:43.507627 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:43.516913 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36d399-591f-4301-84f0-7cf594491602 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:43.521681 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e4140-6305-4deb-b469-3ccac91e84ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:43.522329 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e4140-6305-4deb-b469-3ccac91e84ee service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:43.522611 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e4140-6305-4deb-b469-3ccac91e84ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:43.522881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e4140-6305-4deb-b469-3ccac91e84ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:43.533945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e4140-6305-4deb-b469-3ccac91e84ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:43.535356 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e4140-6305-4deb-b469-3ccac91e84ee service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:43.546627 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4510/9025] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:08:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:08:44.366645 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abd113-92f3-4cc1-8224-246459b03e42 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:44.376322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abd113-92f3-4cc1-8224-246459b03e42 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:44.380923 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:44.381658 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:44.381944 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:44.382207 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:44.384383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:44.396506 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:44.399558 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:44.407687 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4516/9026] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:08:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:08:46.204892 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb307b66-5a1d-41b3-b74a-ae2a0ecb89e7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:46.205440 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb307b66-5a1d-41b3-b74a-ae2a0ecb89e7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:46.205544 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb307b66-5a1d-41b3-b74a-ae2a0ecb89e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:46.224456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-eb307b66-5a1d-41b3-b74a-ae2a0ecb89e7 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:08:46.225784 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eb307b66-5a1d-41b3-b74a-ae2a0ecb89e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:08:46.233434 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4511/9027] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 23:08:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:08:46.246403 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:08:46.259802 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c512-db08-462a-88e0-f926c54349ee service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:08:46.265646 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:08:46.266308 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:08:46.266590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:08:46.266867 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:08:46.276272 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:08:46.278033 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:08:46.287012 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4517/9028] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:08:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 23:08:56.219142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=24 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:56.283323 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=62 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:09:07.532416 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460f3e4-4428-4b5d-9841-ee5dcbb609db None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:09:07.532907 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460f3e4-4428-4b5d-9841-ee5dcbb609db None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:09:07.533010 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460f3e4-4428-4b5d-9841-ee5dcbb609db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:09:07.551473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-9460f3e4-4428-4b5d-9841-ee5dcbb609db None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:09:07.552709 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9460f3e4-4428-4b5d-9841-ee5dcbb609db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:09:07.560509 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4512/9029] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:09:07.572997 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:09:07.583950 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e014d-e29c-4f2e-a2cb-22bfcb0c8012 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:09:07.590437 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:09:07.591107 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:09:07.591405 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:09:07.591670 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:09:07.600773 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:09:07.602461 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:09:07.610882 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4518/9030] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:09:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 23:09:17.546071 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:09:17.607743 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:45.912954 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460f3e4-4428-4b5d-9841-ee5dcbb609db None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:10:45.934661 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460f3e4-4428-4b5d-9841-ee5dcbb609db None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:10:45.938488 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82026c17-14b1-42ba-841e-7138cc87f0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:10:45.939149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82026c17-14b1-42ba-841e-7138cc87f0fe service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:10:45.939430 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82026c17-14b1-42ba-841e-7138cc87f0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:10:45.939707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82026c17-14b1-42ba-841e-7138cc87f0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:10:45.941505 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-82026c17-14b1-42ba-841e-7138cc87f0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:10:45.955126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82026c17-14b1-42ba-841e-7138cc87f0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:10:45.956572 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82026c17-14b1-42ba-841e-7138cc87f0fe service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:10:45.985404 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4513/9031] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:10:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:10:47.172457 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:10:47.182765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f880-bae9-49ea-ab66-08485258aa7b service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:10:47.186417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:10:47.187065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:10:47.187344 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:10:47.187616 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:10:47.189481 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:10:47.203490 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:10:47.205002 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:10:47.216664 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4519/9032] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:10:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:10:50.652909 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b543d6-316b-4bd9-a3b7-302f1cb5da22 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:10:50.653456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b543d6-316b-4bd9-a3b7-302f1cb5da22 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:10:50.653456 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b543d6-316b-4bd9-a3b7-302f1cb5da22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:10:50.672591 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e4b543d6-316b-4bd9-a3b7-302f1cb5da22 None None] MFA Rules not processed for user `62490dbd2f174221b6dda00ce8c3e916`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:10:50.673853 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e4b543d6-316b-4bd9-a3b7-302f1cb5da22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:10:50.682073 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4514/9033] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:10:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:10:53.588556 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:10:53.598693 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23abd-176b-4269-9313-0ed4366f323b service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:10:53.603767 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:10:53.604429 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:10:53.604716 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:10:53.604989 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:10:53.607392 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:10:53.618010 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:10:53.619475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:10:53.627926 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4520/9034] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:10:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:10:55.129622 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b543d6-316b-4bd9-a3b7-302f1cb5da22 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:10:55.153838 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b543d6-316b-4bd9-a3b7-302f1cb5da22 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:10:55.160133 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:10:55.160791 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:10:55.161083 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:10:55.161382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:10:55.163398 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:10:55.175706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:10:55.177619 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:10:55.188513 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4515/9035] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:10:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:10:59.923548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:10:59.933596 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458831d-06d8-4f21-b936-f7972d2b0071 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:10:59.937641 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:10:59.938515 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:10:59.938794 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:10:59.939342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:10:59.941331 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:10:59.953315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:10:59.957966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:10:59.970263 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4521/9036] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:10:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:11:00.613006 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:11:00.626630 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504df01-8f81-4473-8d18-a2ba03bdc527 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:11:00.633973 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:11:00.635859 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:11:00.636318 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:11:00.636807 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:11:00.638951 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:11:00.653897 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:11:00.655655 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:11:00.668015 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4516/9037] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:11:05.439199 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:11:05.459521 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44af8f-5628-4886-9d73-a734e17bc580 service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:11:05.466899 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:11:05.467550 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:11:05.467840 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:11:05.468118 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:11:05.476419 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:11:05.478044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:11:05.487360 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4522/9038] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:11:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:11:10.662732 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=33 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:11:15.483200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=24 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:12:21.323706 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:12:21.368974 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a70073-d88d-4048-af31-9ed0f2b194bf service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:12:21.375068 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:12:21.375725 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:12:21.376003 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:12:21.376277 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:12:21.385114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:12:21.386695 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:12:21.396398 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4517/9039] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:12:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:12:31.392829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=20 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:07.170948 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:13:07.218093 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa7fd5-6b9e-43d7-a5e4-60c4f61656c7 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:13:07.223981 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:13:07.224762 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:13:07.225062 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:13:07.225342 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:13:07.234446 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:13:07.236044 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:13:07.245970 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4523/9040] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:13:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:13:17.242084 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=20 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:31.166704 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:13:31.178008 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a6df2-9386-4b8f-9ff5-f33d296d2841 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:13:31.183383 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:13:31.184064 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:13:31.184343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:13:31.184617 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:13:31.186439 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:13:31.218132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:13:31.219646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:13:31.229676 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4518/9041] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:13:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:13:32.224610 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:13:32.243290 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbd18c-43a0-4b85-8f67-ce3f3a11c5a8 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:13:32.252225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b64146-6532-4cb0-845c-e8c528429894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:13:32.253325 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64146-6532-4cb0-845c-e8c528429894 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:13:32.253633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64146-6532-4cb0-845c-e8c528429894 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:13:32.253987 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64146-6532-4cb0-845c-e8c528429894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:13:32.265503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b64146-6532-4cb0-845c-e8c528429894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:13:32.267495 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b64146-6532-4cb0-845c-e8c528429894 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:13:32.279995 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4524/9042] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:13:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:13:41.225724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=14 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:42.275447 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:05.769323 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:05.779789 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48721-76c2-4aa2-9089-c01c165f5589 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:05.783839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:05.784501 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:05.784790 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:05.785081 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:05.848322 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:05.849823 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:05.860411 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4519/9043] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:15:09.091318 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3de4b-5403-4f59-8fce-0a07779b21bb None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:09.091890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3de4b-5403-4f59-8fce-0a07779b21bb None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:09.092012 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3de4b-5403-4f59-8fce-0a07779b21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:09.151377 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-5ab3de4b-5403-4f59-8fce-0a07779b21bb None None] MFA Rules not processed for user `a0e2be3128404ad69b2be994caadf3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:15:09.152721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-5ab3de4b-5403-4f59-8fce-0a07779b21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:09.174802 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4525/9044] 10.222.0.30 () {58 vars in 1018 bytes} [Sat Jun 18 23:15:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:15:09.186929 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:09.199640 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6238a-7c76-47ef-83ac-eefbe5440d45 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:09.206427 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:09.207240 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:09.207609 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:09.207955 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:09.218077 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:09.219770 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:09.230205 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4520/9045] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:15:12.096278 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3de4b-5403-4f59-8fce-0a07779b21bb None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:12.107078 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3de4b-5403-4f59-8fce-0a07779b21bb None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:12.112285 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:12.113096 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:12.113451 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:12.113801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:12.115803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:12.130833 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:12.132821 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:12.145411 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4526/9046] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:15:12.164994 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:12.179525 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971039-78ee-4db6-96aa-977e1ee371f0 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:12.192906 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:12.194239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:12.194409 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:12.194855 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] PATH_INFO: `/v3/users/62490dbd2f174221b6dda00ce8c3e916` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:12.196207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62490dbd2f174221b6dda00ce8c3e916)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:12.198370 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:12.248148 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62490dbd2f174221b6dda00ce8c3e916'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.248828 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62490dbd2f174221b6dda00ce8c3e916'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.262219 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62490dbd2f174221b6dda00ce8c3e916'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.262858 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62490dbd2f174221b6dda00ce8c3e916'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.270796 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62490dbd2f174221b6dda00ce8c3e916'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.289918 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4521/9047] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 23:15:12 2022] DELETE /identity/v3/users/62490dbd2f174221b6dda00ce8c3e916 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:15:12.474104 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:12.485578 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ec23d-f2a6-4aa7-98cf-7472a0e34a7c service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:12.555755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:12.556614 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:12.556891 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:12.557193 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] PATH_INFO: `/v3/projects/cf0a1057e25d41ca9225c5e5072f17a9` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:12.558417 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0a1057e25d41ca9225c5e5072f17a9)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:12.560343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:12.611549 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0a1057e25d41ca9225c5e5072f17a9', 'request_id': 'req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.618543 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0a1057e25d41ca9225c5e5072f17a9', 'request_id': 'req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.627042 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0a1057e25d41ca9225c5e5072f17a9', 'request_id': 'req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.638519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] The token cache is being invalidate because project cf0a1057e25d41ca9225c5e5072f17a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 23:15:12.638810 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.639459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.641089 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4527/9048] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 23:15:12 2022] DELETE /identity/v3/projects/cf0a1057e25d41ca9225c5e5072f17a9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:15:12.645193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:12.646773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:12.660014 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb7eb6-b03e-4c5f-a296-d16781833b93 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:12.711515 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:12.722498 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:12.723445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:12.723941 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:12.724238 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] PATH_INFO: `/v3/users/ad59ca83ae97460e88fa9a0298d9f61d` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:12.725675 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad59ca83ae97460e88fa9a0298d9f61d)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:12.727825 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:12.779980 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad59ca83ae97460e88fa9a0298d9f61d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.780768 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad59ca83ae97460e88fa9a0298d9f61d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.792773 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad59ca83ae97460e88fa9a0298d9f61d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.793423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad59ca83ae97460e88fa9a0298d9f61d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.800362 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-75ac1f93-f0e7-43d4-bf75-45f02310a8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad59ca83ae97460e88fa9a0298d9f61d'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:12.814883 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4522/9049] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 23:15:12 2022] DELETE /identity/v3/users/ad59ca83ae97460e88fa9a0298d9f61d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:15:13.000435 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.002180 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:13.024037 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3dbaf-8066-4f1a-bf2f-a2b4fee5011a admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.076629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:13.092219 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.093229 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.093493 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.093764 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] PATH_INFO: `/v3/projects/52b626d7008b4ceaa4648c76fa698ce3` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.095040 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b626d7008b4ceaa4648c76fa698ce3)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.096954 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.145295 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b626d7008b4ceaa4648c76fa698ce3', 'request_id': 'req-d659431b-c557-4278-bb60-4d4fc81f865e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:13.151852 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b626d7008b4ceaa4648c76fa698ce3', 'request_id': 'req-d659431b-c557-4278-bb60-4d4fc81f865e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:13.160966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b626d7008b4ceaa4648c76fa698ce3', 'request_id': 'req-d659431b-c557-4278-bb60-4d4fc81f865e'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:13.171797 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] The token cache is being invalidate because project 52b626d7008b4ceaa4648c76fa698ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91205) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 23:15:13.172108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:13.172740 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-d659431b-c557-4278-bb60-4d4fc81f865e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:15:13.174617 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4528/9050] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 23:15:12 2022] DELETE /identity/v3/projects/52b626d7008b4ceaa4648c76fa698ce3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:15:13.179938 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727580-b812-4132-b19b-0811a64e1838 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.180445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727580-b812-4132-b19b-0811a64e1838 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.180445 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727580-b812-4132-b19b-0811a64e1838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.198934 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-c3727580-b812-4132-b19b-0811a64e1838 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:15:13.200137 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-c3727580-b812-4132-b19b-0811a64e1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:13.263111 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4523/9051] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:15:13.271962 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6eff-54a8-4f3e-b3fc-2baa1fb18d03 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.272225 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6eff-54a8-4f3e-b3fc-2baa1fb18d03 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.272502 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6eff-54a8-4f3e-b3fc-2baa1fb18d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.292579 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-84fe6eff-54a8-4f3e-b3fc-2baa1fb18d03 None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:15:13.293850 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-84fe6eff-54a8-4f3e-b3fc-2baa1fb18d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:13.303475 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4529/9052] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:15:13.307851 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3727580-b812-4132-b19b-0811a64e1838 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.318580 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3727580-b812-4132-b19b-0811a64e1838 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.323578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.324245 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.324522 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.324792 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] PATH_INFO: `/v3/domains` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.325644 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91204) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 18 23:15:13.326074 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.328194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.343383 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4524/9053] 10.222.0.30 () {58 vars in 1152 bytes} [Sat Jun 18 23:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 18 23:15:13.348513 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe6eff-54a8-4f3e-b3fc-2baa1fb18d03 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.359485 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe6eff-54a8-4f3e-b3fc-2baa1fb18d03 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.365909 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.366576 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.366966 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.367236 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.367941 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.369900 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.410489 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4530/9054] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 23:15:13 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 18 23:15:13.415042 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.425714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618530b-6715-4c46-92d6-f1c356079305 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.488881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.488881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.489160 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.489474 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.490181 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.492150 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.499114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:13.515907 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4525/9055] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 23:15:13 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 23:15:13.520195 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.531123 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201063f-a91d-490e-8db9-7b5406dd075b admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.536108 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.536782 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.537125 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.537394 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.538482 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.540315 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.552510 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4531/9056] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 23:15:13.556382 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.567194 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5af8-3773-4f57-a44c-1a66f4e5a090 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.572645 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edcc59-dc01-46ea-a7b0-364510f46fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.573422 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edcc59-dc01-46ea-a7b0-364510f46fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.573705 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edcc59-dc01-46ea-a7b0-364510f46fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.573968 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edcc59-dc01-46ea-a7b0-364510f46fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.574707 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edcc59-dc01-46ea-a7b0-364510f46fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.576334 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edcc59-dc01-46ea-a7b0-364510f46fe0 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.587190 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4526/9057] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 23:15:13.591955 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.602462 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44321daf-0e48-4744-82aa-9e929fd2ead7 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.607360 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.608264 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] REQUEST_METHOD: `PUT` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.608545 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.608823 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] PATH_INFO: `/v3/projects/581ddd3109e54ced88db078ddc164100/users/d7c9524120a94412be5120a292e5e875/roles/0329a03140564541b142bbc7fc5111a8` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.624600 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581ddd3109e54ced88db078ddc164100, user_id=d7c9524120a94412be5120a292e5e875, role_id=0329a03140564541b142bbc7fc5111a8)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.627300 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.641380 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4532/9058] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 23:15:13 2022] PUT /identity/v3/projects/581ddd3109e54ced88db078ddc164100/users/d7c9524120a94412be5120a292e5e875/roles/0329a03140564541b142bbc7fc5111a8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:15:13.646653 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ae8d-0ea9-45f2-bfd1-dcf71d35f41e None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.646953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ae8d-0ea9-45f2-bfd1-dcf71d35f41e None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.647265 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ae8d-0ea9-45f2-bfd1-dcf71d35f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.666114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a490ae8d-0ea9-45f2-bfd1-dcf71d35f41e None None] MFA Rules not processed for user `4a36d37a77f14439b4a1d892bb4af6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:15:13.667266 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a490ae8d-0ea9-45f2-bfd1-dcf71d35f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:13.730171 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4527/9059] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:15:13.742741 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:13.744749 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:13.803777 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1388-037e-44d2-b1e6-89f6db221255 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:13.807804 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:13.808453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:13.808730 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:13.809099 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:13.818870 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:13.820454 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:13.830843 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4533/9060] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:15:17.995714 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988a2c-b1b9-4902-a88a-5161922906b7 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:17.996243 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988a2c-b1b9-4902-a88a-5161922906b7 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:17.996341 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988a2c-b1b9-4902-a88a-5161922906b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:18.033742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-b1988a2c-b1b9-4902-a88a-5161922906b7 None None] MFA Rules not processed for user `d7c9524120a94412be5120a292e5e875`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:15:18.033742 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-b1988a2c-b1b9-4902-a88a-5161922906b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:18.111544 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4528/9061] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:15:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:15:18.116205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:18.126546 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d662-4f6d-465d-b396-0dcbb89493ab service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:18.131299 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:18.131964 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:18.132372 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:18.132598 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:18.133343 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:18.135268 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:18.139607 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:18.165605 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4534/9062] 10.222.0.30 () {60 vars in 1152 bytes} [Sat Jun 18 23:15:18 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 23:15:18.169700 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988a2c-b1b9-4902-a88a-5161922906b7 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:18.181132 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988a2c-b1b9-4902-a88a-5161922906b7 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:18.243280 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:18.243962 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:18.244239 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:18.244535 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] PATH_INFO: `/v3/users` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:18.245232 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:18.247217 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:18.263850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:18.271301 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4529/9063] 10.222.0.30 () {60 vars in 1143 bytes} [Sat Jun 18 23:15:18 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 18 23:15:18.275629 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:18.287139 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5c29-fc18-48fa-a0f4-41e79c5f84a4 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:18.292232 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:18.292943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:18.293245 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:18.293519 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:18.294699 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:18.296322 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:18.307503 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4535/9064] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 18 23:15:18.312021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:18.322850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57ed7-d5a2-4be4-901a-9c4a5732197f admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:18.328795 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:18.329734 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:18.330015 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:18.330310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] PATH_INFO: `/v3/projects/c0b732cfc7424f2a9d82bdc887a914c2/users/db4c12e9058146b6a7d1ef2acbd673fd/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:18.346884 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b732cfc7424f2a9d82bdc887a914c2, user_id=db4c12e9058146b6a7d1ef2acbd673fd, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:18.349694 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:18.365450 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4530/9065] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 23:15:18 2022] PUT /identity/v3/projects/c0b732cfc7424f2a9d82bdc887a914c2/users/db4c12e9058146b6a7d1ef2acbd673fd/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:15:18.369835 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:18.380803 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e5001-451a-4059-ac21-8afe2b8b1987 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:18.439190 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eb5fd-5005-4b4e-bd29-699b21d6be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:18.439876 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eb5fd-5005-4b4e-bd29-699b21d6be7c admin admin] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:18.440160 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eb5fd-5005-4b4e-bd29-699b21d6be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:18.440439 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eb5fd-5005-4b4e-bd29-699b21d6be7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:18.441208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eb5fd-5005-4b4e-bd29-699b21d6be7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:18.442996 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eb5fd-5005-4b4e-bd29-699b21d6be7c admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:18.453073 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4536/9066] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 23:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 18 23:15:18.457330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:18.468475 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac09d6d-8aa0-4844-9602-b379dcd676a3 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:18.473559 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:18.474451 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:18.474733 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:18.475007 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] PATH_INFO: `/v3/projects/c0b732cfc7424f2a9d82bdc887a914c2/users/db4c12e9058146b6a7d1ef2acbd673fd/roles/94ce583da5f6409cb8f3ec3771a2da17` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:18.477131 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b732cfc7424f2a9d82bdc887a914c2, user_id=db4c12e9058146b6a7d1ef2acbd673fd, role_id=94ce583da5f6409cb8f3ec3771a2da17)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:18.479782 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:18.493306 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4531/9067] 10.222.0.30 () {60 vars in 1482 bytes} [Sat Jun 18 23:15:18 2022] PUT /identity/v3/projects/c0b732cfc7424f2a9d82bdc887a914c2/users/db4c12e9058146b6a7d1ef2acbd673fd/roles/94ce583da5f6409cb8f3ec3771a2da17 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:15:23.262251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabfce2-95fd-4bea-bbba-f9b6f8ed06fc None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:23.263500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabfce2-95fd-4bea-bbba-f9b6f8ed06fc None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:23.263500 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabfce2-95fd-4bea-bbba-f9b6f8ed06fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:23.291744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-3fabfce2-95fd-4bea-bbba-f9b6f8ed06fc None None] MFA Rules not processed for user `db4c12e9058146b6a7d1ef2acbd673fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:15:23.292887 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3fabfce2-95fd-4bea-bbba-f9b6f8ed06fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:23.392305 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4537/9068] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:15:23.406342 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:23.408142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:23.550724 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027634d3-80ec-4815-b2c2-8d158f743a74 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:23.557842 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:23.558541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:23.558830 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:23.559112 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:23.623267 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:23.625088 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:23.635791 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4532/9069] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:15:24.674905 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083f06-5500-499e-98f4-241a6c6312cd None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:24.675367 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083f06-5500-499e-98f4-241a6c6312cd None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:24.675475 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083f06-5500-499e-98f4-241a6c6312cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:24.693902 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-86083f06-5500-499e-98f4-241a6c6312cd None None] MFA Rules not processed for user `d7c9524120a94412be5120a292e5e875`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:15:24.695269 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-86083f06-5500-499e-98f4-241a6c6312cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:24.703637 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4538/9070] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:15:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:15:25.027753 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:25.031730 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:25.095220 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f694c-c8bd-48ba-9574-22412f364732 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:25.098857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:25.099510 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:25.099786 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:25.100057 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:25.101923 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:25.108229 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:25.113538 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:25.115551 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:25.125056 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4533/9071] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:15:34.688525 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:35.112432 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083f06-5500-499e-98f4-241a6c6312cd None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:35.121207 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=3 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:35.125862 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083f06-5500-499e-98f4-241a6c6312cd None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:35.130445 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:35.131111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:35.131396 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:35.131672 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:35.141554 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:35.143087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:35.152846 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4539/9072] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:15:36.794794 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:15:36.808055 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab5e7d-e11e-4b2c-852a-6b6562d5251f service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:15:36.814146 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:15:36.814812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:15:36.815092 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:15:36.815369 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:15:36.817253 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:15:36.830283 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:15:36.831928 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:15:36.843427 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4534/9073] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:15:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:15:45.148765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:46.838904 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:16:12.886709 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:16:12.896080 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ccf8f-6897-4c61-aadb-d8dca63a474d service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:16:12.900826 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:16:12.901499 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:16:12.901800 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:16:12.902081 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:16:12.904089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:16:12.926681 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:16:12.928173 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:16:12.936602 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4540/9074] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:16:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:16:22.933563 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=11 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:26.355659 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:17:26.357443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:26.441433 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe64e93-dd82-41de-9e94-145429fc59a4 service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:17:26.447045 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021fda6-cff1-4202-a2ab-753f91f1a78e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:17:26.447703 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021fda6-cff1-4202-a2ab-753f91f1a78e service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:26.447983 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021fda6-cff1-4202-a2ab-753f91f1a78e service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:26.448257 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021fda6-cff1-4202-a2ab-753f91f1a78e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:26.450149 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-7021fda6-cff1-4202-a2ab-753f91f1a78e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:26.461682 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021fda6-cff1-4202-a2ab-753f91f1a78e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:17:26.463307 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021fda6-cff1-4202-a2ab-753f91f1a78e service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:17:26.474336 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4535/9075] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:17:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:17:32.148945 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:17:32.151363 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:32.214860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f84c13-cbdc-4622-ac9e-0626d81c07ce service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:17:32.219590 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:17:32.220248 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:32.220532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:32.220806 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:32.222928 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:32.250568 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:17:32.251999 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:17:32.263207 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4541/9076] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:17:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:17:36.176448 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b56d2-8730-4a9c-ae1b-2211b29ead4d None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:36.176963 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b56d2-8730-4a9c-ae1b-2211b29ead4d None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:36.177114 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b56d2-8730-4a9c-ae1b-2211b29ead4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:36.195311 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-a41b56d2-8730-4a9c-ae1b-2211b29ead4d None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:17:36.196610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-a41b56d2-8730-4a9c-ae1b-2211b29ead4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:36.255131 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4536/9077] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 23:17:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:17:36.303129 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:17:36.304765 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:36.380761 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c5ce-f775-454e-aad3-97aaeaa6dc61 service glance] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:17:36.386861 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:17:36.387523 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:36.387807 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:36.388085 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:36.396819 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:17:36.398453 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:17:36.407090 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4542/9078] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 23:17:46.038614 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02f9fe-3ab8-4d05-992b-ca41c99d47fd None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:46.039159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02f9fe-3ab8-4d05-992b-ca41c99d47fd None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:46.039159 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02f9fe-3ab8-4d05-992b-ca41c99d47fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:46.057231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-0b02f9fe-3ab8-4d05-992b-ca41c99d47fd None None] MFA Rules not processed for user `d7c9524120a94412be5120a292e5e875`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:17:46.058441 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-0b02f9fe-3ab8-4d05-992b-ca41c99d47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:46.065618 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4537/9079] 10.222.0.30 () {58 vars in 957 bytes} [Sat Jun 18 23:17:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:17:46.403585 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=63 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:47.772775 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:17:47.782633 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1ac7c-619e-4f65-8ebf-5880898cd027 service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:17:47.787452 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:17:47.788088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:47.788375 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:47.788663 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:47.790687 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:47.805505 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:17:47.806975 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:17:47.819205 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4543/9080] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:17:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:17:48.914927 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e019d1-9c93-4da1-980a-b98a146adcd4 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:48.915584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e019d1-9c93-4da1-980a-b98a146adcd4 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:48.915584 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e019d1-9c93-4da1-980a-b98a146adcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:48.922480 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=66 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:48.936423 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-e9e019d1-9c93-4da1-980a-b98a146adcd4 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:17:48.937998 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e9e019d1-9c93-4da1-980a-b98a146adcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:48.946020 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4538/9081] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 23:17:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:17:48.959296 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:17:48.972746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee7275-87ee-464a-a5ad-0fe8443c3e1c service neutron] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:17:48.977970 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:17:48.978781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:48.979120 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:48.979752 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:48.988682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:17:48.990459 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:17:48.999596 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4544/9082] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:17:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 23:17:58.403804 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e019d1-9c93-4da1-980a-b98a146adcd4 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:17:58.414908 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e019d1-9c93-4da1-980a-b98a146adcd4 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:17:58.419450 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:17:58.420516 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:58.420799 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:58.421089 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:58.422979 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:58.447752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:17:58.449241 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:17:58.458065 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4539/9083] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:17:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:17:58.995973 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=12 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:59.179801 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:17:59.193837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260b5b-3658-4ae8-9ebc-9ca67b55d88e service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:17:59.199831 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:17:59.200825 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:17:59.201208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:17:59.201572 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:17:59.203560 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:17:59.218127 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:17:59.219828 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:17:59.233327 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4545/9084] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:18:08.454140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=8 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:18:09.227348 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=6 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:18:12.154887 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:18:12.156560 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:18:12.173140 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98f9d5-c82d-438b-a955-7a292b36b5ae service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:18:12.179343 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:18:12.180227 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:18:12.180684 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:18:12.181134 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:18:12.184130 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:18:12.202598 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:18:12.204236 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:18:12.215210 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4540/9085] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:18:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:18:22.210558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:23.354116 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:23.356532 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:23.395188 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdab063-d874-4cb6-b3d5-feae54a29296 service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:23.399334 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e46a-8ed0-4a1b-b9b2-f04ebd6ede81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14f94931805a4215b22237194803d41c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:23.399994 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e46a-8ed0-4a1b-b9b2-f04ebd6ede81 service glance] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:23.400275 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e46a-8ed0-4a1b-b9b2-f04ebd6ede81 service glance] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:23.400548 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e46a-8ed0-4a1b-b9b2-f04ebd6ede81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:23.410882 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e46a-8ed0-4a1b-b9b2-f04ebd6ede81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:23.412677 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e46a-8ed0-4a1b-b9b2-f04ebd6ede81 service glance] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:23.422390 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4546/9086] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:20:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:20:29.418989 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:29.435025 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0bda0-0056-44db-a354-c5dbc4cc054b service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:29.441666 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:29.442330 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:29.442610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:29.442881 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:29.444953 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:29.458009 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:29.459608 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:29.472330 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4541/9087] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:20:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:20:30.924497 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfd251-4331-4df9-a742-ba6397df2267 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:30.925087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfd251-4331-4df9-a742-ba6397df2267 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:30.925087 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfd251-4331-4df9-a742-ba6397df2267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:30.999924 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-1cbfd251-4331-4df9-a742-ba6397df2267 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:20:31.001191 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1cbfd251-4331-4df9-a742-ba6397df2267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:31.019666 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4547/9088] 10.222.0.30 () {58 vars in 1009 bytes} [Sat Jun 18 23:20:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:20:31.064076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:31.086558 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d75b4-c942-4440-afbe-e3c2b220fdfe service nova] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:31.092567 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:31.093765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:31.093933 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:31.094201 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:31.103193 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:31.104781 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:31.113756 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4542/9089] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 23:20:40.075097 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86cc46-6cb0-4a0f-8bf9-611aa44eb115 None None] REQUEST_METHOD: `POST` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:40.075682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86cc46-6cb0-4a0f-8bf9-611aa44eb115 None None] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:40.075682 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86cc46-6cb0-4a0f-8bf9-611aa44eb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:40.100170 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.auth.core [None req-2b86cc46-6cb0-4a0f-8bf9-611aa44eb115 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91205) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:20:40.107620 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-2b86cc46-6cb0-4a0f-8bf9-611aa44eb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:40.116118 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4548/9090] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 23:20:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:20:40.128937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:40.140174 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52f64d-0cb7-43fd-bc6a-9a1876ddc3e7 service swift] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:40.145569 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31245fc4-a3b4-41b8-a9fd-f1ffad95828b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:40.146249 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245fc4-a3b4-41b8-a9fd-f1ffad95828b service swift] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:40.146541 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245fc4-a3b4-41b8-a9fd-f1ffad95828b service swift] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:40.146812 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245fc4-a3b4-41b8-a9fd-f1ffad95828b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:40.155493 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31245fc4-a3b4-41b8-a9fd-f1ffad95828b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:40.157155 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31245fc4-a3b4-41b8-a9fd-f1ffad95828b service swift] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:40.166077 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4543/9091] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 18 23:20:41.792917 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86cc46-6cb0-4a0f-8bf9-611aa44eb115 None None] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:41.809540 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86cc46-6cb0-4a0f-8bf9-611aa44eb115 None None] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:41.816487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '578ca3087f9442d88152f65fad464f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:41.817503 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:41.818034 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:41.818302 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:41.828922 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:41.830671 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:41.842174 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4549/9092] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:20:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:20:45.495096 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557574-f6d3-4eff-9948-b2fef3d665f0 None None] REQUEST_METHOD: `POST` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:45.495562 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557574-f6d3-4eff-9948-b2fef3d665f0 None None] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:45.495679 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f557574-f6d3-4eff-9948-b2fef3d665f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:45.514076 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.auth.core [None req-5f557574-f6d3-4eff-9948-b2fef3d665f0 None None] MFA Rules not processed for user `7b4aee381e9f4ba3b2f7c8a82f1842be`. Rule list: `[]` (Enabled: `True`). {{(pid=91204) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 18 23:20:45.515310 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5f557574-f6d3-4eff-9948-b2fef3d665f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:45.522985 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4544/9093] 10.222.0.30 () {58 vars in 967 bytes} [Sat Jun 18 23:20:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 18 23:20:45.537744 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:45.550208 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684c5f4-c5a4-49fc-a1cd-e1d9c76d386e service nova] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:45.556073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2272ca86c294ec4aa96eccc1827d4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:45.556721 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:45.557008 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:45.557320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:45.566063 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:45.567669 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:45.576155 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4550/9094] 10.222.0.30 () {60 vars in 1384 bytes} [Sat Jun 18 23:20:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 18 23:20:49.541080 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f557574-f6d3-4eff-9948-b2fef3d665f0 None None] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:49.560658 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f557574-f6d3-4eff-9948-b2fef3d665f0 None None] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:49.564246 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9765a70014c74e61a93f84c801a10fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:49.564900 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:49.565233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:49.565513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:49.646023 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:49.647479 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:49.667155 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4545/9095] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 18 23:20:52.961200 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:52.967130 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=53 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:52.974407 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411bc50-28b2-4253-bb73-e80d05bb547a service swift] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:52.980146 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:52.980837 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:52.981163 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:52.981487 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:52.983391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:52.998385 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:53.000148 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:53.015496 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4551/9096] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:20:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:20:56.221058 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:56.227937 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=68 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:56.247063 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554119d9-d9d8-4a1d-9181-409ab07fe1c4 service neutron] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:56.253202 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:56.253857 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:56.254143 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:56.254443 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:56.256578 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:56.269839 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:56.271868 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:56.286114 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4546/9097] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:20:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:20:56.289860 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:56.304088 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721860d-66c0-4aa4-b279-1377be5afe77 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:56.309438 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:56.310418 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:56.310814 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:56.311186 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] PATH_INFO: `/v3/users/d7c9524120a94412be5120a292e5e875` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:56.312618 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c9524120a94412be5120a292e5e875)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:56.314583 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:56.376906 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c9524120a94412be5120a292e5e875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.377776 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c9524120a94412be5120a292e5e875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.393320 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c9524120a94412be5120a292e5e875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.394065 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c9524120a94412be5120a292e5e875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.400890 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c9524120a94412be5120a292e5e875'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.417977 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4552/9098] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 23:20:56 2022] DELETE /identity/v3/users/d7c9524120a94412be5120a292e5e875 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 23:20:56.621850 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:56.638231 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6ed0-cfd9-4380-be36-bc3afa538fce service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:56.707212 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:56.708095 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:56.708357 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:56.708656 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] PATH_INFO: `/v3/projects/581ddd3109e54ced88db078ddc164100` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:56.709949 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581ddd3109e54ced88db078ddc164100)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:56.711922 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:56.770870 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581ddd3109e54ced88db078ddc164100', 'request_id': 'req-5425c41a-a425-4be9-812d-95ad83a15b98'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.778543 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581ddd3109e54ced88db078ddc164100', 'request_id': 'req-5425c41a-a425-4be9-812d-95ad83a15b98'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.787885 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581ddd3109e54ced88db078ddc164100', 'request_id': 'req-5425c41a-a425-4be9-812d-95ad83a15b98'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.816161 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] The token cache is being invalidate because project 581ddd3109e54ced88db078ddc164100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 23:20:56.816428 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.817224 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.818884 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4547/9099] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 23:20:56 2022] DELETE /identity/v3/projects/581ddd3109e54ced88db078ddc164100 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 18 23:20:56.823745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:56.825684 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:56.847073 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1896c-5f20-4662-b671-a9d91b5963a0 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:56.917047 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:56.917943 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:56.918221 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:56.918494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] PATH_INFO: `/v3/users/db4c12e9058146b6a7d1ef2acbd673fd` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:56.919725 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4c12e9058146b6a7d1ef2acbd673fd)` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:56.921720 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:56.976383 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4c12e9058146b6a7d1ef2acbd673fd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.977349 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4c12e9058146b6a7d1ef2acbd673fd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.988312 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:56.989494 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4c12e9058146b6a7d1ef2acbd673fd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.990251 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4c12e9058146b6a7d1ef2acbd673fd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:56.998089 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.notifications [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4c12e9058146b6a7d1ef2acbd673fd'} {{(pid=91205) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:57.012679 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4553/9100] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 23:20:56 2022] DELETE /identity/v3/users/db4c12e9058146b6a7d1ef2acbd673fd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:20:57.192920 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:20:57.194528 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:20:57.208203 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c41a-a425-4be9-812d-95ad83a15b98 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:20:57.268831 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a36d37a77f14439b4a1d892bb4af6b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66f428458e264ccfa7aaee63beb4b0a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:20:57.269752 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:20:57.270031 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:20:57.270305 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] PATH_INFO: `/v3/projects/c0b732cfc7424f2a9d82bdc887a914c2` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:20:57.271532 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b732cfc7424f2a9d82bdc887a914c2)` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:20:57.273601 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:20:57.275142 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:57.323462 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b732cfc7424f2a9d82bdc887a914c2', 'request_id': 'req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:57.329646 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b732cfc7424f2a9d82bdc887a914c2', 'request_id': 'req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:57.338513 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b732cfc7424f2a9d82bdc887a914c2', 'request_id': 'req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7'} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:57.349352 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] The token cache is being invalidate because project c0b732cfc7424f2a9d82bdc887a914c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91204) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 18 23:20:57.349635 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:57.350275 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.notifications [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91204) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 18 23:20:57.351949 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4548/9101] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 23:20:57 2022] DELETE /identity/v3/projects/c0b732cfc7424f2a9d82bdc887a914c2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 18 23:21:07.009000 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:21:07.346680 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:22:33.346745 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:22:33.348391 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:22:33.425755 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd939fab-0ade-400b-bb74-51113f7b03c2 admin admin] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:22:33.491570 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:22:33.492224 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:22:33.492511 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:22:33.492785 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:22:33.494781 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:22:33.506355 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:22:33.507949 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:22:33.518227 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4554/9102] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:22:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:22:43.513892 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=58 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:23:22.141458 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:23:22.143827 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:23:22.202082 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8b3e3-1084-40c7-98d0-9a2b26ca0bd7 admin admin] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:23:22.209533 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:23:22.210196 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:23:22.210473 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:23:22.210765 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:23:22.213233 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.fernet_utils [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91204) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:23:22.225829 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:23:22.227436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:23:22.237805 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4549/9103] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:23:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:23:32.233605 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=20 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:27:39.364111 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] Authenticating user token {{(pid=91205) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:27:39.365723 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.fernet_utils [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91205) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 18 23:27:39.447345 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b9aac-2175-4936-9c53-f41cf6f3eb61 service placement] Validating token access rules against request {{(pid=91205) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:27:39.452746 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84b7d9-bb7c-45b2-82f3-a04f85ec3574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91205) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:27:39.453430 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84b7d9-bb7c-45b2-82f3-a04f85ec3574 service placement] REQUEST_METHOD: `GET` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:27:39.453713 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84b7d9-bb7c-45b2-82f3-a04f85ec3574 service placement] SCRIPT_NAME: `/identity` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:27:39.453985 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84b7d9-bb7c-45b2-82f3-a04f85ec3574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91205) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:27:39.462617 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84b7d9-bb7c-45b2-82f3-a04f85ec3574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:27:39.464205 ncdv-master-1 devstack@keystone.service[91205]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84b7d9-bb7c-45b2-82f3-a04f85ec3574 service placement] RBAC: Authorization granted {{(pid=91205) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:27:39.474661 ncdv-master-1 devstack@keystone.service[91205]: [pid: 91205|app: 0|req: 4555/9104] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:27:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:27:49.470293 ncdv-master-1 devstack@keystone.service[91205]: DEBUG dbcounter [-] [91205] Writing DB stats keystone:SELECT=33 {{(pid=91205) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:28:27.147244 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] Authenticating user token {{(pid=91204) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 18 23:28:27.158436 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170de1b-27f5-43b5-89e8-1557c6b62416 service placement] Validating token access rules against request {{(pid=91204) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 18 23:28:27.164883 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c6443-c7e4-4747-b6ca-43748250d7e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e2be3128404ad69b2be994caadf3bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7325bff278b145a5a9112160d2e00a5e', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91204) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 18 23:28:27.165564 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6443-c7e4-4747-b6ca-43748250d7e1 service placement] REQUEST_METHOD: `GET` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 18 23:28:27.165846 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6443-c7e4-4747-b6ca-43748250d7e1 service placement] SCRIPT_NAME: `/identity` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 18 23:28:27.166126 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6443-c7e4-4747-b6ca-43748250d7e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91204) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 18 23:28:27.175021 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c6443-c7e4-4747-b6ca-43748250d7e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 18 23:28:27.176610 ncdv-master-1 devstack@keystone.service[91204]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c6443-c7e4-4747-b6ca-43748250d7e1 service placement] RBAC: Authorization granted {{(pid=91204) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 18 23:28:27.186948 ncdv-master-1 devstack@keystone.service[91204]: [pid: 91204|app: 0|req: 4550/9105] 10.222.0.30 () {60 vars in 1365 bytes} [Sat Jun 18 23:28:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 18 23:28:37.182945 ncdv-master-1 devstack@keystone.service[91204]: DEBUG dbcounter [-] [91204] Writing DB stats keystone:SELECT=6 {{(pid=91204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}